Human Generated Data

Title

Untitled (a musician and his family)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.46

Human Generated Data

Title

Untitled (a musician and his family)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.46

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 98.9
People 98.6
Person 98.4
Person 97.8
Family 97
Painting 78.7
Art 78.7
Face 77.6
Person 77.1
Apparel 69.5
Clothing 69.5
Helmet 69.5
Photography 64.2
Portrait 64.2
Photo 64.2
Smile 55.2

Clarifai
created on 2018-10-18

people 99.9
wear 98.7
adult 98.2
group 96.1
man 94.7
two 94.6
woman 93.1
child 93
veil 91.7
military 90.8
administration 90.6
portrait 90.2
retro 88.9
music 87.9
war 87.3
one 87
three 85.5
leader 83.9
group together 83.8
weapon 82.2

Imagga
created on 2018-10-18

statue 42.2
sculpture 29.2
art 26
old 23.7
religion 22.4
ancient 19
monument 18.7
architecture 17.2
person 17.1
culture 15.4
history 15.2
catholic 14.4
god 14.4
religious 14.1
antique 13.9
detail 13.7
man 13.4
historical 13.2
mask 13
dress 12.7
vintage 12.4
tourism 12.4
church 12
decoration 12
historic 11.9
building 11.9
stone 11.8
city 11.6
marble 11.6
people 11.2
traditional 10.8
saint 10.6
travel 10.6
faith 10.5
famous 10.2
head 10.1
holy 9.6
face 9.2
nurse 9.2
fan 9.1
tourist 9.1
mother 8.8
male 8.5
cross 8.5
portrait 8.4
clothing 8.3
kin 8.3
landmark 8.1
costume 8.1
closeup 8.1
golden 7.7
cathedral 7.7
spirituality 7.7
disguise 7.6
decorative 7.5
symbol 7.4
adult 7.4
follower 7.4
world 7.2
love 7.1

Google
created on 2018-10-18

Microsoft
created on 2018-10-18

old 94.1
posing 92.9
person 90.6
white 72.6
vintage 45.7
clothes 18.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Surprised 1.6%
Happy 1%
Calm 6.7%
Sad 2.4%
Disgusted 1.5%
Confused 0.8%
Angry 86.2%

AWS Rekognition

Age 27-44
Gender Female, 93.9%
Confused 12.9%
Angry 15.1%
Disgusted 9.5%
Sad 44.6%
Calm 6.7%
Happy 5.1%
Surprised 6%

AWS Rekognition

Age 6-13
Gender Female, 89.8%
Disgusted 17.3%
Calm 0.2%
Surprised 4.3%
Angry 30.5%
Happy 20.4%
Sad 2.2%
Confused 25.1%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 78.7%
Helmet 69.5%