Human Generated Data

Title

Untitled (Begum Bhopal's two daughters)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.45

Human Generated Data

Title

Untitled (Begum Bhopal's two daughters)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 98.7
Person 98.7
Person 98.3
Painting 92.7
Art 92.7
Clothing 80.4
Apparel 80.4
People 71.3
Outdoors 67.2
Crowd 66.9
Female 62.9
Nature 57.5
Hat 56.9
Sleeve 56.6
Drawing 55.3

Clarifai
created on 2018-10-18

people 100
print 99.5
wear 99.3
adult 99.1
veil 98.6
portrait 98
military 97.8
group 96.3
engraving 96.2
man 96
illustration 95.8
one 95.7
royalty 95.4
soldier 94.8
art 94.6
outfit 94.6
weapon 93.4
military uniform 92.9
leader 92.8
two 92.4

Imagga
created on 2018-10-18

vestment 31.1
clothing 29.8
gown 29.4
face 27.7
person 26.9
portrait 24.6
dress 21.7
costume 20.5
fashion 19.6
people 18.9
religion 18.8
man 18.8
outerwear 18.6
art 18.5
old 18.1
mask 16.8
metropolitan 16.3
style 14.1
adult 13.9
lady 13.8
covering 13.5
attractive 13.3
church 12.9
culture 12.8
makeup 12.8
male 12.8
pretty 12.6
traditional 12.5
jacket 11.9
vintage 11.6
faith 11.5
religious 11.2
clothes 11.2
hair 11.1
model 10.9
mystery 10.6
god 10.5
antique 10.2
mysterious 9.7
saint 9.6
consumer goods 9.3
outfit 9.2
statue 9
catholic 9
history 8.9
sexy 8.8
carnival 8.7
decoration 8.7
holy 8.7
ancient 8.6
spirituality 8.6
colorful 8.6
crown 8.4
detail 8
posing 8
body 8
cute 7.9
masquerade 7.9
warrior 7.8
expression 7.7
cathedral 7.7
head 7.5
happy 7.5
dark 7.5
sculpture 7.5
feminine 7.5
hat 7.3
protection 7.3
smiling 7.2
fantasy 7.2

Google
created on 2018-10-18

Microsoft
created on 2018-10-18

text 99.7
book 98.8
person 95.2
white 74.4
black 72.8
old 64.9
vintage 41.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 87.1%
Sad 4%
Surprised 3.1%
Angry 3.5%
Disgusted 2.8%
Happy 1.9%
Confused 1.2%
Calm 83.5%

AWS Rekognition

Age 10-15
Gender Female, 84.3%
Happy 0.9%
Calm 2.4%
Disgusted 0.3%
Confused 0.2%
Sad 95.2%
Angry 0.7%
Surprised 0.3%

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 92.7%

Captions

Microsoft

a vintage photo of a boy 78.9%
a vintage photo of a person 78.8%
a black and white photo of a boy 68.4%