Human Generated Data

Title

Untitled (teacher (?) with eight little girls and two babies)

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10369

Human Generated Data

Title

Untitled (teacher (?) with eight little girls and two babies)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99
Human 99
Person 98.2
Person 96.7
Person 95.9
Person 94.9
Person 94.4
Person 90.9
Kindergarten 90.5
Person 90.3
Person 89.9
Clothing 89.6
Apparel 89.6
People 88.5
Person 83.6
Person 73.1
Toy 72

Imagga
created on 2022-01-23

kin 67.9
child 54.4
happy 35.7
childhood 33.1
kid 31.9
people 31.2
family 31.1
happiness 30.5
fun 29.9
mother 29.5
person 28.7
smiling 28.2
smile 27.8
cute 27.2
cheerful 26
portrait 24.6
children 22.8
together 21.9
daughter 21.4
girls 21
little 20.3
youth 19.6
male 19.4
boy 19.1
parent 17.5
love 17.3
sibling 17.2
brother 17.1
adult 17
casual 16.9
group 16.9
holding 16.5
man 16.3
home 15.9
two 15.2
joy 15
lifestyle 14.4
father 14.4
women 14.2
kids 13.2
friends 13.1
friendship 13.1
education 13
son 12.9
clothing 12.8
face 12.8
dress 12.6
toddler 12.4
room 12.1
pretty 11.9
traditional 11.6
couple 11.3
color 11.1
indoor 10.9
leisure 10.8
studio 10.6
attractive 10.5
innocent 10.4
laughing 10.4
toy 10.1
holiday 10
playing 10
school 9.9
interior 9.7
sit 9.5
teen 9.2
fashion 9
blond 9
life 8.6
play 8.6
gift 8.6
husband 8.6
wife 8.5
togetherness 8.5
baby 8.4
pink 8.4
teenager 8.2
lady 8.1
buddy 8.1
team 8.1
dancer 8
indoors 7.9
performer 7.8
standing 7.8
sister 7.8
preschool 7.8
diversity 7.7
learning 7.5
clothes 7.5
style 7.4
tradition 7.4
year 7.3
new 7.3

Google
created on 2022-01-23

Footwear 98
Photograph 94.3
Dress 91.4
Sleeve 85.9
Font 80.1
Toddler 78.4
Vintage clothing 77.3
Snapshot 74.3
Pattern 71.8
Art 70.1
Event 69.4
Smile 68.9
Room 67.2
History 66.1
Stock photography 65.9
Baby & toddler clothing 63.9
Child 61.7
Retro style 57.5
Classic 57.3
Picture frame 53.1

Microsoft
created on 2022-01-23

posing 99.1
wall 99
text 97.7
person 97.3
clothing 97
toddler 96.3
child 95.4
baby 94.9
indoor 93.8
human face 92
boy 88.6
smile 87.1
group 84.3
family 80.7
black 71.8
old 50.1
team 37.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-6
Gender Female, 100%
Calm 99.8%
Disgusted 0%
Happy 0%
Sad 0%
Confused 0%
Angry 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 4-12
Gender Female, 88.1%
Happy 92.1%
Calm 5%
Confused 0.8%
Surprised 0.5%
Angry 0.5%
Sad 0.4%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 2-10
Gender Female, 99.2%
Calm 98.3%
Happy 0.7%
Sad 0.4%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 2-10
Gender Female, 98.6%
Calm 88.8%
Happy 6.5%
Confused 1.8%
Surprised 0.8%
Sad 0.6%
Angry 0.6%
Disgusted 0.6%
Fear 0.2%

AWS Rekognition

Age 0-6
Gender Male, 98.9%
Angry 46.8%
Calm 46.1%
Sad 2.6%
Confused 1.9%
Fear 0.8%
Surprised 0.8%
Disgusted 0.6%
Happy 0.4%

AWS Rekognition

Age 4-12
Gender Female, 99.9%
Calm 97.9%
Happy 1.1%
Sad 0.3%
Angry 0.2%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 2-8
Gender Male, 93.2%
Calm 91.2%
Happy 8.2%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 12-20
Gender Female, 97.8%
Happy 99%
Calm 0.7%
Surprised 0.1%
Confused 0.1%
Angry 0%
Sad 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 0-6
Gender Female, 99.9%
Surprised 59.2%
Calm 25%
Angry 6.8%
Disgusted 4.5%
Happy 1.5%
Fear 1.3%
Confused 0.9%
Sad 0.7%

AWS Rekognition

Age 0-4
Gender Female, 86%
Fear 93.1%
Calm 6.4%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 0-3
Gender Female, 99.8%
Calm 99.8%
Surprised 0.1%
Confused 0%
Sad 0%
Disgusted 0%
Fear 0%
Happy 0%
Angry 0%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 3
Gender Male

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 1
Gender Male

Microsoft Cognitive Services

Age 1
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of people posing for the camera 97.7%
a group of kids posing for a photo 92.8%