Human Generated Data

Title

Untitled (children's birthday party)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.452

Human Generated Data

Title

Untitled (children's birthday party)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.6
Human 99.6
Person 99.6
Person 99.5
Person 99.3
Person 99
Person 98.9
Person 98.7
People 98.2
Person 95.2
Person 95.1
Person 93.5
Family 91.3
Person 90.6
Person 89.4
Person 78.2
Person 69.1
Person 65.5
Kindergarten 57.3

Imagga
created on 2022-01-23

child 33.1
man 32.3
male 30.9
people 30.7
kin 27.9
family 27.6
happy 27.6
adult 27.3
mother 25.6
smiling 25.3
couple 24.4
home 22.3
nurse 21.6
happiness 21.2
person 20.8
room 18.5
indoors 18.5
senior 17.8
boy 17.4
love 17.4
together 16.6
children 16.4
smile 16.4
salon 16.4
sitting 16.3
cheerful 16.3
kid 16
father 15.5
two 15.2
portrait 14.9
lifestyle 13.7
classroom 13.7
teacher 13.6
women 13.4
childhood 13.4
husband 13.4
patient 13.1
parent 13
men 12.9
son 12.4
hairdresser 12.3
bed 12.3
fun 12
indoor 11.9
hospital 11.5
wife 11.4
daughter 11.2
mature 11.2
casual 11
dress 10.8
couch 10.6
attractive 10.5
old 10.5
sibling 10.1
interior 9.7
medical 9.7
class 9.6
grandfather 9.5
sit 9.5
relationship 9.4
clothing 9.3
face 9.2
joy 9.2
school 9
group 8.9
little 8.8
grandmother 8.8
teaching 8.8
affection 8.7
years 8.7
youth 8.5
desk 8.5
togetherness 8.5
doctor 8.5
inside 8.3
vintage 8.3
holding 8.3
care 8.2
girls 8.2
handsome 8
romantic 8
looking 8
to 8
working 8
day 7.8
education 7.8
table 7.8
two people 7.8
dad 7.7
pretty 7.7
expression 7.7
elderly 7.7
talking 7.6
enjoying 7.6
adults 7.6
fashion 7.5
learning 7.5
occupation 7.3
lady 7.3
aged 7.2
color 7.2
office 7.2
cute 7.2

Google
created on 2022-01-23

Photograph 94.2
Sharing 86.1
Hat 79.5
Toddler 77.2
Art 76
Monochrome 75.2
Monochrome photography 74.9
Chair 74.4
Child 74.4
Snapshot 74.3
Event 73.8
Vintage clothing 73.7
Room 72.2
Fun 71
Photo caption 69
Table 64.8
Stock photography 63.4
Suit 56.7
Family 54.6
Photographic paper 51.8

Microsoft
created on 2022-01-23

person 99.9
human face 99.2
clothing 98.5
wall 95.2
smile 94.3
indoor 91.3
text 90.7
family 89.8
child 89.6
group 85.2
woman 83.6
baby 77.6
toddler 76.3
girl 71
old 68.1
crowd 0.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 99.9%
Sad 53.9%
Calm 45%
Angry 0.5%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%

AWS Rekognition

Age 0-4
Gender Female, 99.8%
Surprised 90.9%
Fear 3.6%
Calm 3.1%
Confused 1.7%
Angry 0.3%
Disgusted 0.2%
Sad 0.2%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 99.2%
Surprised 88.7%
Angry 5.1%
Calm 2.8%
Fear 1%
Confused 0.9%
Disgusted 0.9%
Happy 0.5%
Sad 0.2%

AWS Rekognition

Age 6-12
Gender Female, 99.6%
Calm 86.8%
Sad 10.3%
Fear 1%
Angry 0.5%
Surprised 0.5%
Happy 0.3%
Disgusted 0.3%
Confused 0.2%

AWS Rekognition

Age 2-10
Gender Female, 99.9%
Sad 99.1%
Calm 0.4%
Confused 0.2%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Happy 0%

AWS Rekognition

Age 2-8
Gender Female, 86.5%
Calm 67%
Angry 11%
Surprised 6.8%
Fear 6.5%
Disgusted 2.9%
Confused 2.4%
Happy 2.1%
Sad 1.2%

AWS Rekognition

Age 30-40
Gender Female, 99.7%
Sad 72.8%
Happy 7.3%
Calm 5.8%
Disgusted 4.1%
Angry 4%
Confused 2.8%
Surprised 2.1%
Fear 1.1%

AWS Rekognition

Age 0-6
Gender Female, 94.8%
Calm 83.7%
Sad 9.6%
Fear 2.6%
Confused 2.3%
Surprised 0.7%
Angry 0.7%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Sad 94.9%
Calm 2.1%
Disgusted 0.9%
Confused 0.8%
Angry 0.4%
Surprised 0.3%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 20-28
Gender Female, 65.6%
Calm 73.5%
Fear 20.6%
Sad 3.7%
Angry 1%
Surprised 0.5%
Disgusted 0.4%
Confused 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 95.6%
a group of people posing for the camera 95.5%
an old photo of a group of people posing for the camera 94.1%