Human Generated Data

Title

Untitled (girl blowing at candles at birthday party)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.466

Human Generated Data

Title

Untitled (girl blowing at candles at birthday party)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.5
Person 99.5
Person 99.5
Person 99.5
Person 98.9
Person 98.9
Person 94.5
Tablecloth 89.3
People 89
Clothing 75.5
Apparel 75.5
Face 71
Photography 61.4
Photo 61.4
Female 60.5
Girl 59.3
Bed 57.8
Furniture 57.8

Imagga
created on 2022-01-23

child 60.3
sibling 50.7
mother 40.6
family 37.4
happy 30.7
male 28.5
parent 28
people 27.9
man 24.9
father 24.3
kid 23.9
together 23.7
love 22.9
home 22.3
smiling 21.7
daughter 21.3
kin 21.1
couple 20.9
children 20
adult 20
portrait 19.4
smile 19.2
happiness 18.8
boy 18.3
person 17.3
cheerful 17.1
childhood 17
son 15.9
fun 15.7
sitting 15.5
room 14.6
baby 14.3
women 14.2
old 13.9
girls 13.7
cute 13.6
husband 13.4
senior 13.1
brother 12.8
indoors 12.3
dad 11.7
holding 11.6
interior 11.5
life 11.3
kids 11.3
school 11.2
men 11.2
casual 11
lifestyle 10.8
elderly 10.5
youth 10.2
two 10.2
affection 9.7
30s 9.6
wife 9.5
adults 9.5
togetherness 9.4
nurse 9.4
adorable 9.2
blond 9.1
care 9.1
dress 9
reading 8.6
sit 8.5
attractive 8.4
mature 8.4
color 8.3
classroom 8.2
indoor 8.2
clothing 8.2
group 8.1
little 7.9
generations 7.9
education 7.8
affectionate 7.7
toddler 7.6
newspaper 7.6
living 7.6
females 7.6
house 7.5
learning 7.5
relationship 7.5
leisure 7.5
hospital 7.4
tradition 7.4
grandma 7.3
black 7.2
looking 7.2
to 7.1

Google
created on 2022-01-23

Photograph 94.3
White 92.2
Black 89.7
Sharing 87.7
Table 86.8
Chair 82.4
Smile 82.3
Happy 81.8
Adaptation 79.4
Toddler 79.3
Vintage clothing 76.7
Monochrome 74.8
Snapshot 74.3
Classic 74.2
Event 74.2
Monochrome photography 73.5
Flash photography 73.2
Fun 73
Photo caption 72.2
Child 70.5

Microsoft
created on 2022-01-23

person 100
baby 98.4
toddler 98.3
human face 97.9
child 97.7
clothing 97.6
boy 85.8
text 84.1
family 78.7
group 70.5
girl 62.1
old 59.7
smile 58.9
posing 45.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Male, 99.6%
Calm 39.4%
Angry 38.7%
Sad 12.5%
Confused 3.1%
Disgusted 2.7%
Surprised 1.8%
Fear 1%
Happy 0.9%

AWS Rekognition

Age 4-12
Gender Male, 100%
Calm 97.9%
Angry 0.9%
Sad 0.7%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 97.1%
Disgusted 1.5%
Angry 0.4%
Surprised 0.3%
Fear 0.2%
Sad 0.2%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 6-12
Gender Female, 99.9%
Calm 61.9%
Sad 35.7%
Happy 0.6%
Disgusted 0.5%
Angry 0.4%
Fear 0.4%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 6-16
Gender Female, 51.6%
Calm 54.9%
Disgusted 37.6%
Happy 2.8%
Sad 1.3%
Angry 1.2%
Fear 1%
Confused 0.6%
Surprised 0.5%

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Bed 57.8%

Captions

Microsoft

a group of people posing for a photo 97.2%
a group of kids posing for a photo 92.3%
a group of people posing for the camera 92.2%