Human Generated Data

Title

Untitled (six girls in living room, birthday girl opening presents)

Date

1952

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6979

Human Generated Data

Title

Untitled (six girls in living room, birthday girl opening presents)

People

Artist: Harry Annas, American 1897 - 1980

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.6
Person 99.6
Person 99
Person 99
Person 98.4
Person 98.2
People 95.2
Clothing 87.7
Apparel 87.7
Family 84.2
Person 79.8
Female 78.5
Indoors 72.9
Room 72.9
Workshop 72.3
Girl 69.1
Face 67.1
Living Room 55.7

Imagga
created on 2022-01-23

kin 100
family 34.7
home 34.3
people 31.8
man 30.9
mother 30.1
happy 29.5
male 28.5
couple 27
adult 26.2
child 24.2
person 22.5
smile 22.1
portrait 22
happiness 21.9
smiling 21.7
room 21.3
indoors 20.2
father 19.7
love 19.7
together 17.5
two 16.9
boy 16.5
daughter 16.4
casual 16.1
face 15.6
lifestyle 15.2
interior 15
parent 15
sitting 14.6
fun 14.2
cheerful 13.8
clothing 13.7
children 13.7
son 13.6
couch 13.5
husband 13.4
senior 13.1
indoor 12.8
women 12.7
kid 12.4
wife 12.3
30s 11.5
old 11.2
day 11
salon 10.9
house 10.9
color 10.6
pretty 10.5
attractive 10.5
group 10.5
shop 10.4
togetherness 10.4
relationship 10.3
teen 10.1
20s 10.1
cute 10
dress 9.9
fashion 9.8
enjoying 9.5
laughing 9.5
youth 9.4
joy 9.2
domestic 9.2
classroom 9
childhood 9
kitchen 8.9
handsome 8.9
grandmother 8.8
standing 8.7
bride 8.6
men 8.6
adults 8.5
barbershop 8.5
horizontal 8.4
mature 8.4
wedding 8.3
style 8.2
romantic 8
helping 7.9
brunette 7.8
sister 7.8
table 7.8
affection 7.7
elderly 7.7
talking 7.6
sibling 7.6
camera 7.4
blond 7.3
lady 7.3
girls 7.3
computer 7.2
looking 7.2
holiday 7.2
little 7.1
work 7.1
brother 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.8
clothing 98.8
human face 97.1
text 96
smile 94.6
toddler 76.8
woman 76.1
baby 73.9
girl 73.8
child 73.4
posing 71.8
family 71.7
boy 66.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Female, 99.9%
Happy 99.8%
Surprised 0%
Angry 0%
Confused 0%
Calm 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 9-17
Gender Female, 99.6%
Happy 72.1%
Calm 24.8%
Surprised 1.1%
Confused 0.6%
Angry 0.5%
Disgusted 0.3%
Sad 0.3%
Fear 0.3%

AWS Rekognition

Age 7-17
Gender Male, 76.9%
Happy 78.4%
Calm 9.7%
Fear 3.4%
Surprised 3.1%
Angry 2.1%
Confused 1.3%
Sad 1.2%
Disgusted 0.8%

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Happy 89.1%
Calm 4.8%
Surprised 1.9%
Angry 1.6%
Confused 1.1%
Disgusted 0.6%
Fear 0.4%
Sad 0.4%

AWS Rekognition

Age 6-14
Gender Female, 94.4%
Happy 96.8%
Surprised 2.5%
Fear 0.2%
Angry 0.2%
Confused 0.1%
Disgusted 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 6-12
Gender Female, 99.6%
Happy 93.1%
Calm 2.2%
Confused 2.1%
Surprised 1.1%
Angry 0.5%
Disgusted 0.5%
Sad 0.3%
Fear 0.1%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 95.5%
a group of people sitting posing for the camera 95.3%
a group of people posing for the camera 95.2%