Human Generated Data

Title

Untitled (group portrait of schoolchildren posed with teacher)
Date

1952-1953
People

Artist: Orrion Barger, American active 1913 - 1984
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6700

Human Generated Data

Title

Untitled (group portrait of schoolchildren posed with teacher)

People

Artist: Orrion Barger, American active 1913 - 1984

Date

1952-1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.6
Human 99.6
Person 99.6
Person 99.6
Person 99.6
Person 99.4
Person 99.3
Person 99.1
Person 99.1
Person 99
Person 98.8
Person 97.1
People 96.5
Person 95.3
Person 92.4
Apparel 91.1
Clothing 91.1
Family 91
Person 89.8
School 64.4
Room 57.4
Indoors 57.4
Kindergarten 56.8

Imagga
created on 2022-01-22

kin 94.5
people 31.8
person 28.2
child 27.8
man 27.5
family 26.7
male 26.4
happy 25.7
nurse 23.3
mother 22.2
smiling 21.7
home 20.7
adult 19.7
happiness 19.6
group 19.3
portrait 18.7
room 18.6
golfer 18.4
men 18
couple 17.4
women 16.6
kid 15.9
smile 15.7
boy 15.6
classroom 15.6
player 15.4
lifestyle 15.2
love 15
team 14.3
holding 14
business 13.4
father 13
cheerful 13
professional 12.9
daughter 12.7
attractive 12.6
childhood 12.5
businessman 12.4
indoors 12.3
teacher 12.3
together 12.3
fun 12
life 11.7
interior 11.5
cute 11.5
contestant 11.4
youth 11.1
two 11
joy 10.8
pretty 10.5
sitting 10.3
casual 10.2
son 10.1
sibling 10
school 10
parent 9.7
30s 9.6
husband 9.5
doctor 9.4
girls 9.1
businesswoman 9.1
dress 9
medical 8.8
standing 8.7
uniform 8.6
wife 8.5
teamwork 8.3
fashion 8.3
teen 8.3
human 8.2
children 8.2
new 8.1
success 8
looking 8
to 8
working 7.9
black 7.8
face 7.8
education 7.8
diversity 7.7
meeting 7.5
house 7.5
20s 7.3
office 7.2
blond 7.2
hospital 7.2
little 7.1

Google
created on 2022-01-22

Hairstyle 95.1
Facial expression 93.3
Human 89.1
Dress 86
Event 74.4
Team 73.2
Vintage clothing 72.3
Family reunion 69.8
Smile 69.2
Crew 68.7
Room 66.4
Monochrome 64.8
Family taking photos together 64.6
History 63.1
Font 63
Monochrome photography 60
Classic 59.2
Child 57.3
Sitting 57.2
Family 55.9

Microsoft
created on 2022-01-22

person 99.9
wall 99.8
posing 99.8
clothing 98.5
text 97.8
smile 97.6
group 95.6
human face 95
standing 92
team 91.6
indoor 88
man 83.6
boy 83.6
old 53.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Female, 68.2%
Happy 99.6%
Surprised 0.1%
Calm 0.1%
Angry 0.1%
Fear 0.1%
Confused 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 7-17
Gender Female, 100%
Happy 98.6%
Surprised 0.6%
Calm 0.3%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0%

AWS Rekognition

Age 11-19
Gender Male, 100%
Happy 94.5%
Calm 2.4%
Surprised 0.9%
Confused 0.7%
Angry 0.6%
Disgusted 0.4%
Sad 0.3%
Fear 0.1%

AWS Rekognition

Age 9-17
Gender Male, 78.5%
Calm 99.6%
Happy 0.1%
Angry 0.1%
Confused 0%
Sad 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 74.9%
Happy 89.5%
Surprised 5.1%
Calm 1.5%
Confused 1.4%
Fear 1.2%
Angry 0.6%
Disgusted 0.4%
Sad 0.3%

AWS Rekognition

Age 4-12
Gender Female, 59.3%
Happy 96.8%
Surprised 0.7%
Calm 0.5%
Angry 0.5%
Disgusted 0.5%
Confused 0.5%
Sad 0.4%
Fear 0.2%

AWS Rekognition

Age 7-17
Gender Female, 100%
Calm 99.5%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 12-20
Gender Female, 100%
Happy 97.3%
Surprised 0.7%
Angry 0.5%
Confused 0.4%
Calm 0.3%
Disgusted 0.3%
Fear 0.3%
Sad 0.2%

AWS Rekognition

Age 18-24
Gender Male, 55.4%
Happy 99.7%
Surprised 0.1%
Confused 0%
Angry 0%
Calm 0%
Disgusted 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 7-17
Gender Female, 100%
Happy 90%
Calm 6.9%
Angry 0.9%
Confused 0.7%
Surprised 0.6%
Sad 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 6-16
Gender Male, 100%
Happy 99.9%
Surprised 0%
Calm 0%
Angry 0%
Confused 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 99.9%
Happy 97.2%
Calm 2.2%
Surprised 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 6-16
Gender Male, 95.3%
Happy 96%
Calm 1.4%
Surprised 0.6%
Disgusted 0.5%
Confused 0.5%
Sad 0.5%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 45-51
Gender Female, 100%
Calm 49.9%
Happy 41.1%
Surprised 5.9%
Disgusted 1.2%
Angry 0.6%
Confused 0.6%
Fear 0.5%
Sad 0.3%

Microsoft Cognitive Services

Age 47
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

Danuta Siedzikówna et al. posing for a photo 98.7%
Danuta Siedzikówna et al. posing for the camera 98.6%
Danuta Siedzikówna et al. posing for a picture 98.5%