Human Generated Data

Title

Untitled (children at birthday party, girl blowing out candles on cake)
Date

1948
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6973

Human Generated Data

Title

Untitled (children at birthday party, girl blowing out candles on cake)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.2
Human 99.2
Person 98.9
Person 97.1
Person 93.3
Person 89.7
People 87.8
Dessert 87.6
Food 87.6
Accessories 83.3
Accessory 83.3
Tie 83.3
Cake 79.7
Person 76.7
Person 75.5
Tie 74.2
Person 68.6
Girl 66.1
Female 66.1
Person 62
Child 59.8
Kid 59.8
Pub 58.9
Bar Counter 58.9
Creme 58.7
Cream 58.7
Icing 58.4
Person 43.8

Imagga
created on 2022-01-23

person 21.3
fashion 18.8
people 17.8
style 17.8
black 17.7
portrait 16.2
adult 15.6
dress 14.5
sexy 14.5
man 13.6
hair 12.7
shop 11.7
art 11.2
drawing 11.1
elegance 10.9
face 10.7
sketch 10.6
urban 10.5
window 10.2
room 9.6
women 9.5
male 9.3
smile 9.3
music 9
retro 9
fun 9
family 8.9
decoration 8.9
interior 8.8
body 8.8
brunette 8.7
eyes 8.6
model 8.6
wall 8.5
barbershop 8.5
grunge 8.5
hand 8.4
attractive 8.4
pretty 8.4
vintage 8.4
old 8.4
studio 8.4
pattern 8.2
paint 8.1
happy 8.1
lady 8.1
home 8
child 7.9
color 7.8
mercantile establishment 7.8
modern 7.7
elegant 7.7
youth 7.7
fashionable 7.6
house 7.5
city 7.5
girls 7.3
sensuality 7.3
painting 7.2

Google
created on 2022-01-23

Hairstyle 95.1
Picture frame 89.6
Sharing 81.4
Toddler 80.1
Adaptation 79.3
Smile 78.7
Chair 77.6
Art 75.7
Vintage clothing 75.2
Event 74
Monochrome 71.1
Happy 69.7
Photo caption 69.1
Child 68.5
Monochrome photography 68.5
Fun 67.2
Stock photography 66.2
Room 64.7
Sitting 64.4
Table 60.2

Microsoft
created on 2022-01-23

human face 92.5
birthday cake 90.5
text 89.4
clothing 88.8
person 88.7
indoor 86.6
baby 78.1
toddler 72.9
old 56.7
woman 54.6
posing 44.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 91.9%
Surprised 93.4%
Calm 4.1%
Angry 0.9%
Confused 0.8%
Disgusted 0.3%
Sad 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Calm 57%
Surprised 26.5%
Confused 4.2%
Angry 3.7%
Happy 3.5%
Sad 1.9%
Disgusted 1.7%
Fear 1.5%

AWS Rekognition

Age 1-7
Gender Female, 99.6%
Calm 92.9%
Sad 3.4%
Surprised 0.9%
Fear 0.8%
Disgusted 0.8%
Angry 0.6%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 51-59
Gender Female, 99.8%
Happy 98.4%
Calm 0.4%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 0-6
Gender Female, 83.9%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 0-4
Gender Female, 67.8%
Calm 79.3%
Happy 11.4%
Sad 2.7%
Surprised 2.6%
Angry 1.5%
Confused 1.2%
Disgusted 0.9%
Fear 0.4%

AWS Rekognition

Age 0-4
Gender Male, 99.2%
Calm 95.4%
Happy 1.7%
Confused 1.1%
Surprised 0.6%
Sad 0.5%
Angry 0.4%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 1-7
Gender Female, 99.9%
Happy 99.9%
Surprised 0%
Disgusted 0%
Calm 0%
Confused 0%
Angry 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 4-10
Gender Female, 97.7%
Calm 99.5%
Sad 0.3%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 14-22
Gender Female, 99.8%
Calm 88.9%
Sad 4.1%
Surprised 2.8%
Confused 1.5%
Happy 1.1%
Disgusted 0.8%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Female, 91.5%
Sad 92.2%
Calm 6.1%
Fear 1%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0.1%

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 2
Gender Female

Microsoft Cognitive Services

Age 54
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 83.3%

Captions

Microsoft

a group of stuffed animals that are posing for a photo 82.8%
a group of stuffed animals sitting next to a window 75.3%
an old photo of a group of stuffed animals 75.2%

Text analysis

Google

よ
よ