Human Generated Data

Title

Untitled (students from high school senior class with teacher)

Date

1937, negative made later

People

Artist: Legler Studio, American active 1930s-1950s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19682

Human Generated Data

Title

Untitled (students from high school senior class with teacher)

People

Artist: Legler Studio, American active 1930s-1950s

Date

1937, negative made later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.6
Human 99.6
Person 99.6
Person 99.5
Person 99.3
Person 99.3
Person 99.1
Apparel 99.1
Clothing 99.1
Person 98.7
Face 98.5
Person 98.4
Person 98.2
Person 98.2
Person 98.2
Goggles 94.8
Accessories 94.8
Accessory 94.8
Person 92.8
Person 92.7
Tie 91.3
Sunglasses 90.7
Person 90.1
Sailor Suit 89.4
Glasses 89.4
Head 86.4
Sleeve 86.2
Sunglasses 84.8
Coat 69.5
Photography 68.2
Portrait 68.2
Photo 68.2
Overcoat 67.9
Suit 67.9
Sunglasses 66
Helmet 66
Outdoors 65.5
Military Uniform 63.4
Officer 63.4
Military 63.4
Helmet 63.1
Person 61.4
Hat 60
Man 58.8
People 57.5
Poster 57
Advertisement 57
Smile 56.7
Nature 55.7
Shirt 55.6
Jaw 55

Imagga
created on 2022-03-05

man 38.3
kin 36.5
male 33.3
person 30.7
people 30.1
happy 27.5
adult 26.3
couple 25.2
senior 23.4
smiling 21
group 20.1
elderly 18.2
nurse 18.1
portrait 18.1
businessman 17.6
team 16.1
business 15.8
men 15.4
teacher 15.2
old 14.6
groom 13.7
professional 13.6
two 13.5
smile 13.5
student 13.4
together 13.1
room 13.1
patient 13.1
mature 13
camera 12.9
indoor 12.8
grandfather 12.7
happiness 12.5
family 12.4
child 12.2
doctor 12.2
education 12.1
office 12
looking 12
husband 11.8
love 11.8
blackboard 11.7
lifestyle 11.5
30s 11.5
care 11.5
medical 11.5
indoors 11.4
cheerful 11.4
women 11.1
hospital 10.8
golfer 10.5
health 10.4
world 10.4
home 10.4
sitting 10.3
aged 9.9
school 9.9
black 9.6
lab coat 9.5
classroom 9.5
wife 9.5
casual 9.3
player 9.3
face 9.2
fun 9
worker 9
job 8.8
60s 8.8
colleagues 8.7
boy 8.7
standing 8.7
bride 8.6
coat 8.4
teamwork 8.3
interior 7.9
medicine 7.9
older 7.8
attractive 7.7
retirement 7.7
married 7.7
exam 7.7
age 7.6
businesspeople 7.6
mother 7.6
desk 7.5
clothing 7.5
meeting 7.5
contestant 7.5
color 7.2
life 7.2
work 7.1
day 7.1

Google
created on 2022-03-05

Collar 81.3
Smile 80.4
Font 78.8
Suit 78.8
Crew 77
Formal wear 76.5
Blazer 75.8
Event 73.9
Vintage clothing 73.9
White-collar worker 72
Fun 66.6
Team 66.3
History 65.2
Uniform 62.6
Room 62.5
Photo caption 62.2
Art 58.5
Tie 57.7
Monochrome 57
Paper product 55.4

Microsoft
created on 2022-03-05

posing 99.9
wall 99.8
indoor 92
group 90.4
person 89.8
clothing 85.1
smile 83.3
man 75.6
text 73.3
human face 66.6
hockey 50.9
old 41.3
picture frame 7.3

Face analysis

Amazon

Google

AWS Rekognition

Age 21-29
Gender Male, 92.7%
Calm 88.5%
Surprised 8.8%
Happy 0.9%
Sad 0.6%
Fear 0.5%
Disgusted 0.3%
Angry 0.2%
Confused 0.2%

AWS Rekognition

Age 21-29
Gender Male, 98.2%
Happy 52.6%
Surprised 29%
Calm 17.3%
Disgusted 0.3%
Angry 0.3%
Fear 0.3%
Confused 0.1%
Sad 0.1%

AWS Rekognition

Age 19-27
Gender Male, 79.6%
Happy 77.9%
Calm 8.9%
Surprised 7.8%
Sad 3.7%
Fear 0.7%
Disgusted 0.5%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Male, 62.2%
Calm 77.5%
Surprised 19.9%
Disgusted 0.6%
Angry 0.6%
Sad 0.5%
Confused 0.4%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Male, 95.4%
Surprised 61.3%
Calm 34.6%
Happy 2.6%
Sad 0.6%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Confused 0.1%

AWS Rekognition

Age 20-28
Gender Male, 98%
Calm 99.6%
Happy 0.2%
Sad 0.1%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Female, 93.2%
Surprised 51.2%
Happy 23.8%
Calm 13.2%
Fear 5.8%
Sad 2.3%
Angry 1.9%
Disgusted 1.1%
Confused 0.6%

AWS Rekognition

Age 20-28
Gender Female, 97.5%
Calm 54.4%
Surprised 38%
Happy 5.2%
Fear 0.7%
Sad 0.6%
Angry 0.5%
Disgusted 0.5%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Male, 98.5%
Surprised 67.5%
Happy 14%
Fear 5.5%
Sad 4.6%
Calm 3.7%
Angry 2.2%
Disgusted 1.9%
Confused 0.7%

AWS Rekognition

Age 16-22
Gender Male, 100%
Surprised 81.6%
Calm 6.5%
Sad 4.3%
Fear 2.5%
Angry 2.2%
Happy 1.5%
Disgusted 1.1%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Male, 62.1%
Calm 36%
Happy 33.7%
Surprised 25.9%
Sad 1.9%
Disgusted 0.9%
Angry 0.8%
Fear 0.6%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 81.8%
Happy 15.3%
Confused 0.7%
Surprised 0.7%
Sad 0.7%
Disgusted 0.4%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 96.9%
Happy 98.9%
Calm 0.5%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.4%
Calm 51.9%
Surprised 40.3%
Sad 3.9%
Angry 1.1%
Happy 1.1%
Fear 0.9%
Disgusted 0.7%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 91.3%
Sunglasses 90.7%
Helmet 66%
Poster 57%

Captions

Microsoft

a group of people posing for a photo 98.2%
a group of people posing for the camera 98.1%
a group of people posing for a picture 98%