Human Generated Data

Title

Untitled (Rajastahani Gypsies?)
Date

c. 1860-1880
People

Artist: Willoughby Wallace Hooper, British 1837 - 1912
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.70

Human Generated Data

Title

Untitled (Rajastahani Gypsies?)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 98.6
Person 98.6
Person 95.3
Standing 77.1
Female 76.8
Apparel 75.2
Clothing 75.2
Woman 62
Photography 59.4
Photo 59.4
Portrait 58.4
Face 58.4
Back 58.3
Skin 55.8

Clarifai
created on 2018-10-18

people 99.9
portrait 98.8
adult 98.6
art 97.1
wear 97
group 95.6
print 94.6
one 94
woman 92.3
man 91.9
leader 91.6
two 90.9
veil 90.2
administration 86.5
costume 83.3
music 83
dress 82.7
actress 82.5
three 79.8
theater 79.6

Imagga
created on 2018-10-18

clothing 31.7
fashion 30.9
dress 28
religion 24.2
vestment 24.1
sculpture 23.4
face 22.7
gown 21
statue 20.8
portrait 20.7
hair 20.6
lingerie 20.2
style 20
adult 19.5
person 19.5
lady 19.5
old 18.8
model 17.9
people 17.3
costume 17.3
antique 17.2
attractive 16.8
art 16
ancient 15.6
pretty 15.4
culture 15.4
sexy 15.3
clothes 15
black 14.5
outerwear 14.5
god 14.3
make 13.6
covering 13.6
faith 13.4
hairstyle 13.3
posing 13.3
religious 13.1
brunette 13.1
expression 12.8
body 12.8
outfit 12
sensual 11.8
catholic 11.7
vintage 11.6
cute 11.5
fashionable 11.4
garment 11.1
architecture 10.9
elegance 10.9
stylish 10.8
traditional 10.8
man 10.8
makeup 10.1
dark 10
sensuality 10
studio 9.9
gold 9.9
holy 9.6
saint 9.6
church 9.2
tradition 9.2
sketch 9.2
figure 9.2
gorgeous 9.1
human 9
coat 9
prayer 8.7
eyes 8.6
elegant 8.6
cross 8.5
stone 8.4
monument 8.4
history 8
detail 8
robe 8
cloak 7.9
vogue 7.7
worship 7.7
symbol 7.4
consumer goods 7.4
historic 7.3
pose 7.2
women 7.1
male 7.1
interior 7.1

Google
created on 2018-10-18

standing 88.7
history 77.2
black and white 73.7
ancient history 67
vintage clothing 63.9
middle ages 61
costume design 54.6
artwork 53.9
art 50.7

Microsoft
created on 2018-10-18

person 96.8
standing 84.3
posing 77.8
old 63.1
white 60.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 64.8%
Confused 4.6%
Disgusted 2.2%
Sad 81.3%
Angry 7.1%
Calm 2.5%
Happy 0.8%
Surprised 1.4%

AWS Rekognition

Age 35-52
Gender Male, 97.4%
Angry 3.4%
Calm 66%
Surprised 3.7%
Happy 2%
Sad 18.7%
Disgusted 0.7%
Confused 5.5%

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

a vintage photo of Edward S. Curtis et al. posing for the camera 86.8%
a vintage photo of Edward S. Curtis and woman posing for a picture 78.5%
a vintage photo of Edward S. Curtis et al. posing for a picture 78.4%