Human Generated Data

Title

Untitled (children at birthday party, tree with candy canes as table centerpiece)

Date

1948

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6975

Human Generated Data

Title

Untitled (children at birthday party, tree with candy canes as table centerpiece)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 98.9
Person 98.9
Person 98.6
Person 97.4
Person 96.7
Person 95.9
Person 95.4
Person 94.2
Person 88.7
Person 85
Room 83.4
Indoors 83.4
People 81.4
Person 77.3
Kindergarten 77.2
Crowd 76.2
Person 72
Person 72
Clothing 70.6
Apparel 70.6
Face 64.2
Person 60.2
Hair 59.5
Audience 59.1
Party 58.1
Classroom 56.4
School 56.4
Person 47.8

Imagga
created on 2022-01-23

kin 100
people 27.9
portrait 27.8
adult 27.2
person 26.4
happy 26.3
family 25.8
happiness 21.9
face 21.3
fashion 21.1
attractive 21
love 20.5
hair 19
pretty 18.9
sexy 18.5
child 18.1
cute 17.9
home 17.5
mother 17.5
women 17.4
smile 17.1
smiling 16.6
black 16.3
male 15.8
man 15.4
couple 14.8
model 14
brunette 13.9
lady 13.8
lifestyle 13.7
girls 13.7
dress 13.5
childhood 13.4
violin 13.3
youth 12.8
two 12.7
elegance 12.6
joy 12.5
cheerful 12.2
fun 12
style 11.9
kid 11.5
bride 11.5
daughter 11.4
bowed stringed instrument 11.3
stringed instrument 11.3
human 11.2
eyes 11.2
blond 10.8
vintage 10.7
room 10.7
together 10.5
old 10.4
sepia 9.7
parent 9.6
healthy 9.4
makeup 9.1
hand 9.1
sensuality 9.1
holding 9.1
musical instrument 9
look 8.8
sibling 8.7
expression 8.5
wife 8.5
senior 8.4
head 8.4
wedding 8.3
retro 8.2
lovely 8
posing 8
interior 8
boy 7.8
affection 7.7
relax 7.6
females 7.6
relationship 7.5
one 7.5
father 7.4
care 7.4
tradition 7.4
joyful 7.3
decoration 7.3
make 7.3
fresh 7.2
holiday 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 100
group 98.3
clothing 97.8
posing 97.7
human face 97.1
toddler 95.6
child 92.5
baby 91.2
boy 88.7
window 88.6
smile 86.6
people 84.7
girl 81.2
text 73.7
christmas tree 60.4
family 40.4
dressed 30.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Female, 97.2%
Calm 97.5%
Surprised 0.6%
Happy 0.5%
Confused 0.5%
Angry 0.4%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 0-4
Gender Male, 54.3%
Calm 70.6%
Confused 12.9%
Fear 4.3%
Surprised 3.9%
Angry 3.6%
Happy 2%
Sad 1.7%
Disgusted 1%

AWS Rekognition

Age 0-4
Gender Female, 99.9%
Fear 73.6%
Calm 16.6%
Surprised 7.5%
Sad 0.7%
Disgusted 0.6%
Confused 0.4%
Angry 0.4%
Happy 0.3%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 68.5%
Fear 17.1%
Confused 5.5%
Surprised 4.4%
Angry 1.9%
Disgusted 1%
Sad 0.8%
Happy 0.8%

AWS Rekognition

Age 6-12
Gender Female, 69%
Calm 98.1%
Angry 0.6%
Confused 0.4%
Sad 0.4%
Happy 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 0-4
Gender Female, 99.9%
Surprised 45.6%
Fear 26.1%
Calm 20.8%
Sad 2.1%
Angry 1.7%
Confused 1.7%
Disgusted 1.1%
Happy 0.8%

AWS Rekognition

Age 4-10
Gender Female, 100%
Calm 97.5%
Confused 1.3%
Angry 0.4%
Disgusted 0.3%
Sad 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Calm 88.1%
Fear 5.3%
Angry 1.7%
Surprised 1.3%
Disgusted 1%
Happy 0.9%
Sad 0.8%
Confused 0.8%

AWS Rekognition

Age 6-12
Gender Male, 91.3%
Happy 55.8%
Calm 28.7%
Surprised 8.9%
Angry 3.1%
Sad 1.8%
Fear 0.9%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 6-12
Gender Female, 64.3%
Calm 76.1%
Surprised 13.2%
Sad 2.8%
Confused 2.1%
Angry 1.8%
Fear 1.6%
Disgusted 1.5%
Happy 0.8%

AWS Rekognition

Age 2-8
Gender Female, 59.7%
Calm 92.6%
Happy 3%
Sad 2.1%
Angry 0.7%
Disgusted 0.5%
Surprised 0.4%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 0-6
Gender Female, 97.2%
Calm 71.6%
Fear 16.3%
Surprised 5.7%
Happy 1.9%
Sad 1.4%
Angry 1.3%
Confused 1%
Disgusted 0.8%

AWS Rekognition

Age 2-8
Gender Female, 100%
Calm 66%
Fear 24%
Surprised 4.5%
Sad 2.2%
Confused 1.3%
Angry 1%
Disgusted 0.5%
Happy 0.5%

AWS Rekognition

Age 0-6
Gender Female, 99.9%
Calm 99.8%
Surprised 0.1%
Sad 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 0-6
Gender Female, 55.7%
Calm 79.7%
Confused 7.5%
Surprised 3.9%
Sad 3.8%
Angry 1.4%
Happy 1.4%
Disgusted 1.2%
Fear 1.2%

AWS Rekognition

Age 1-7
Gender Female, 100%
Confused 31.6%
Calm 30.4%
Happy 12.3%
Sad 9.8%
Angry 6.1%
Fear 4.1%
Surprised 3.3%
Disgusted 2.3%

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Possible
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people posing for a photo 99.1%
a group of people posing for the camera 99%
a group of people posing for a picture 98.9%