Human Generated Data

Title

Untitled (teacher (?) with eight little girls and two babies)
Date

c. 1955
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10367

Human Generated Data

Title

Untitled (teacher (?) with eight little girls and two babies)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.3
Person 99.3
Person 98.4
Person 96.9
Person 96.2
Person 94.5
Person 94.1
Person 93.9
Person 93.7
Person 93.2
Kindergarten 91.6
Person 91.3
Apparel 88
Clothing 88
Kid 71.7
Child 71.7
Person 68.9
People 66.9
Shorts 63.6
Footwear 61.1
Shoe 61.1

Imagga
created on 2022-01-23

kin 77.2
child 42.8
happy 37.6
family 37.3
people 32.9
smiling 29.6
together 28
portrait 27.8
kid 27.5
person 27.3
mother 27.2
smile 27.1
childhood 26.8
sibling 26.6
fun 26.2
happiness 25.1
boy 24.3
children 23.7
daughter 23.5
group 23.4
male 22.8
cheerful 21.9
man 21.6
cute 20.8
father 20.5
girls 20
little 19.4
parent 17
love 16.6
couple 16.5
adult 16.2
brother 16.1
home 15.9
youth 15.3
holding 14.8
joy 14.2
kids 14.1
friends 14.1
friendship 14
casual 13.5
studio 12.9
color 12.8
son 12.7
lifestyle 12.3
education 12.1
teen 11.9
two 11.8
team 11.6
face 11.4
laughing 11.3
standing 11.3
pretty 11.2
women 11.1
mug shot 10.9
buddy 10.8
school 10.4
diversity 9.6
toddler 9.5
holiday 9.3
adorable 9.2
leisure 9.1
attractive 9.1
blond 9
room 8.9
laugh 8.6
clothing 8.6
togetherness 8.5
sport 8.5
photograph 8.5
traditional 8.3
20s 8.2
indoor 8.2
representation 8
play 7.7
gift 7.7
men 7.7
culture 7.7
wife 7.6
fashion 7.5
house 7.5
camera 7.4
student 7.4
toy 7.4
teenager 7.3
playing 7.3
dress 7.2
looking 7.2
colorful 7.2
game 7.1
classroom 7.1
indoors 7

Google
created on 2022-01-23

Photograph 94.2
Dress 89.5
Sleeve 87.1
Font 83.5
Vintage clothing 78.3
Toddler 77
Snapshot 74.3
Art 71.8
Event 68.3
Room 68.3
Team 67
Smile 66
Pattern 65.7
History 65.5
Stock photography 64.1
Fun 62.4
Child 60.6
Retro style 59.1
Monochrome 58.3
Baby 57.2

Microsoft
created on 2022-01-23

posing 99.3
wall 98.3
person 98.3
clothing 97.6
toddler 95.1
text 95
smile 94.1
baby 92.8
human face 92.7
child 89.8
group 89.1
girl 81.6
family 75.8
boy 75.3
woman 65.7
team 55.1
old 49.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Male, 92.9%
Happy 92.9%
Calm 5.2%
Sad 0.5%
Angry 0.3%
Confused 0.3%
Disgusted 0.3%
Surprised 0.3%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Female, 99.9%
Calm 95.9%
Happy 0.9%
Sad 0.7%
Angry 0.7%
Surprised 0.5%
Disgusted 0.5%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 6-12
Gender Female, 99.8%
Calm 97.7%
Sad 0.9%
Happy 0.8%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 0-6
Gender Female, 99.7%
Happy 94.1%
Calm 2.7%
Surprised 1.3%
Confused 1%
Angry 0.3%
Disgusted 0.3%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 4-10
Gender Female, 99.1%
Happy 63.5%
Calm 34.7%
Confused 0.6%
Sad 0.5%
Surprised 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 2-8
Gender Male, 73.7%
Calm 77.1%
Happy 17.5%
Confused 1.8%
Sad 1%
Surprised 0.9%
Disgusted 0.6%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 0-4
Gender Male, 99.4%
Calm 98.6%
Angry 0.7%
Sad 0.3%
Confused 0.2%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 16-24
Gender Female, 76%
Happy 99.2%
Calm 0.5%
Confused 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Female, 83.8%
Calm 98.3%
Sad 1.4%
Confused 0.1%
Surprised 0.1%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Female, 98.9%
Happy 99.7%
Calm 0.1%
Sad 0%
Angry 0%
Confused 0%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Female, 75.4%
Fear 95.5%
Calm 3.9%
Surprised 0.2%
Sad 0.1%
Confused 0.1%
Happy 0%
Disgusted 0%
Angry 0%

Microsoft Cognitive Services

Age 2
Gender Male

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 61.1%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of kids posing for a photo 93.2%
a group of people posing for the camera 93.1%