Human Generated Data

Title

Untitled (students sitting at desks in a classroom)
Date

c. 1945
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7696
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (students sitting at desks in a classroom)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Classroom 99.7
School 99.7
Room 99.7
Indoors 99.7
Person 98.9
Human 98.9
Person 98.6
Person 98
Person 95.4
Person 94.8
Person 93.9
Person 93.5
Person 93.3
Person 90.6
Person 89.7
Person 86.3
Person 86
Person 85.9
Person 81.4
Person 80.3
Person 69.9
Person 69.3
Person 65.5
Person 64.5
Person 60.3
Person 53.7

Imagga
created on 2022-01-09

room 37.7
classroom 35.4
people 27.9
person 26.9
teacher 22.5
man 20.1
table 19.9
men 19.7
brass 17.3
interior 16.8
business 16.4
women 15.8
male 15.6
wind instrument 15.1
group 14.5
work 14.1
indoors 14
planner 13.9
chair 13
glass 12.4
hall 12.4
professional 12.3
restaurant 12.3
adult 12.1
team 11.6
educator 11.3
school 10.5
boy 10.4
education 10.4
musical instrument 10.3
city 10
building 9.8
urban 9.6
shop 9.6
crowd 9.6
home 9.6
meeting 9.4
smiling 9.4
happy 9.4
lifestyle 9.4
student 9.3
conference 8.8
life 8.6
equipment 8.6
modern 8.4
training 8.3
inside 8.3
girls 8.2
office 8.2
board 8.1
businessman 7.9
bugle 7.9
cafeteria 7.8
students 7.8
travel 7.7
dinner 7.6
learning 7.5
outdoors 7.5
study 7.5
event 7.4
exercise 7.3
sax 7.2
transportation 7.2
nurse 7.1
working 7.1

Google
created on 2022-01-09

Photograph 94.2
Window 90.2
Black 89.5
Style 83.9
Chair 83.2
Adaptation 79.2
Painting 76.9
Snapshot 74.3
Table 74.2
Monochrome 74.2
Font 73
Event 72.2
Monochrome photography 70.3
Art 70.2
Room 67
Stock photography 66
Illustration 64.8
Photo caption 64.7
Class 62.3
Crowd 61.8

Microsoft
created on 2022-01-09

text 99.8
table 97.1
person 93.4
furniture 91.9
chair 88.8
clothing 68.3
house 63
group 61.2
building 51.9

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 89.3%
Calm 99.2%
Happy 0.4%
Confused 0.1%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 92.9%
Calm 99.9%
Sad 0%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Female, 51.3%
Sad 96.4%
Calm 3.1%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 23-33
Gender Male, 51.3%
Calm 98.3%
Surprised 0.5%
Disgusted 0.3%
Sad 0.3%
Happy 0.2%
Fear 0.2%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Female, 93.2%
Calm 86%
Sad 6.8%
Happy 2.7%
Disgusted 1%
Fear 1%
Surprised 1%
Angry 0.9%
Confused 0.6%

AWS Rekognition

Age 38-46
Gender Male, 97.3%
Calm 34.1%
Confused 29.6%
Happy 18.6%
Sad 10.8%
Disgusted 2.5%
Angry 1.8%
Fear 1.3%
Surprised 1.3%

AWS Rekognition

Age 28-38
Gender Male, 86.9%
Calm 93.7%
Confused 3%
Sad 1.2%
Happy 1.1%
Disgusted 0.5%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 62.1%
Calm 98.6%
Sad 0.5%
Happy 0.4%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Female, 76.4%
Happy 44.8%
Sad 37.6%
Calm 14.6%
Confused 1.2%
Disgusted 0.5%
Angry 0.5%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 31-41
Gender Male, 67.5%
Sad 65%
Happy 15.7%
Calm 11.5%
Confused 4.7%
Disgusted 1%
Angry 0.9%
Surprised 0.8%
Fear 0.4%

AWS Rekognition

Age 22-30
Gender Female, 57.6%
Calm 92.8%
Happy 2.6%
Sad 2.2%
Surprised 0.8%
Angry 0.5%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98.2%
Calm 98.9%
Sad 0.4%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 59.5%
Calm 74.5%
Sad 12.4%
Happy 7.9%
Fear 2.7%
Disgusted 0.9%
Confused 0.9%
Surprised 0.3%
Angry 0.3%

AWS Rekognition

Age 35-43
Gender Male, 93.9%
Happy 90.6%
Calm 7.8%
Surprised 0.5%
Confused 0.3%
Sad 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Female, 87.9%
Sad 51.2%
Calm 35.8%
Happy 9.9%
Confused 1%
Disgusted 0.8%
Surprised 0.5%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 99.4%
Calm 96.1%
Sad 2%
Angry 0.7%
Surprised 0.5%
Fear 0.2%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.6%
Calm 77.7%
Happy 20.6%
Sad 0.7%
Disgusted 0.4%
Surprised 0.3%
Fear 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.5%
Calm 99.2%
Sad 0.5%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Female, 51.7%
Calm 76.7%
Sad 14.2%
Confused 4.7%
Happy 2.6%
Angry 0.7%
Surprised 0.6%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 41-49
Gender Male, 61.7%
Confused 93.6%
Surprised 2.7%
Calm 2%
Angry 1.1%
Sad 0.3%
Disgusted 0.2%
Fear 0.1%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people sitting at a table 82.5%
a group of people sitting around a table 82%
a group of people in a room 81.9%

Text analysis

Amazon

24523.

Google

24523.
24523.