Human Generated Data

Title

Untitled (classroom full of students sitting at their desks)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7850
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (classroom full of students sitting at their desks)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Classroom 99.7
School 99.7
Room 99.7
Indoors 99.7
Person 99.1
Human 99.1
Person 98.1
Person 97.8
Person 97.5
Person 96.8
Person 95.7
Person 95.2
Person 94.4
Person 92
Person 91.9
Person 88.5
Person 88.4
Person 88
Person 87.9
Person 84.7
Person 82.7
Person 81.4
Person 73.3
Person 55.3
Person 54.1
Person 51.5

Imagga
created on 2022-01-09

classroom 61.1
room 58.5
table 27.7
shop 25.3
restaurant 24.5
chair 23.5
people 23.4
interior 23
salon 20.4
indoors 20.2
barbershop 20.1
man 18.8
business 18.2
person 16.7
building 15.8
men 15.4
teacher 15.1
work 14.9
dinner 14.3
adult 14.3
hall 13.3
modern 13.3
brass 13.2
mercantile establishment 12.7
office 11.8
dining 11.4
male 11.3
wind instrument 11.3
party 11.2
empty 11.2
women 11.1
indoor 10.9
lifestyle 10.8
furniture 10.7
businessman 10.6
cafeteria 10.4
desk 10.4
home 10.4
food 10.3
glass 10.1
eat 10.1
tables 9.8
professional 9.8
conference 9.8
decor 9.7
group 9.7
seat 9.3
mature 9.3
service 9.3
inside 9.2
equipment 9
style 8.9
chairs 8.8
computer 8.8
library 8.8
class 8.7
student 8.6
sitting 8.6
meeting 8.5
place of business 8.4
design 8.4
house 8.3
drink 8.3
window 8.2
musical instrument 8.1
meal 8.1
team 8.1
life 8
counter 8
working 7.9
device 7.9
lunch 7.8
education 7.8
comfortable 7.6
hotel 7.6
happy 7.5
row 7.4
floor 7.4
structure 7.4
occupation 7.3
decoration 7.2
smiling 7.2
celebration 7.2
portrait 7.1
architecture 7

Google
created on 2022-01-09

Window 89.5
Chair 86.7
Style 83.9
Black-and-white 82.9
Monochrome 74.5
Snapshot 74.3
Monochrome photography 73.5
Event 71.6
Table 68.2
Painting 67.7
Font 67.4
Room 65.8
Stock photography 65.7
Sitting 62.4
Class 61.1
Team 60.8
History 59.4
Photo caption 59
Academic institution 57.7
Education 56

Microsoft
created on 2022-01-09

text 99.6
person 98.1
table 96.4
furniture 94.6
chair 92.3
clothing 78.9
group 77.9
house 75.3

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 80.7%
Calm 97.4%
Sad 2%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 55.5%
Calm 99.8%
Surprised 0.1%
Sad 0%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Female, 75.6%
Calm 86.6%
Sad 9.3%
Confused 1.8%
Happy 0.7%
Surprised 0.6%
Fear 0.4%
Disgusted 0.3%
Angry 0.3%

AWS Rekognition

Age 47-53
Gender Male, 89.8%
Calm 52.1%
Happy 29.6%
Sad 11.8%
Disgusted 2.3%
Angry 2%
Surprised 1%
Fear 0.6%
Confused 0.5%

AWS Rekognition

Age 29-39
Gender Male, 83.9%
Happy 81.4%
Sad 11.8%
Calm 3.8%
Disgusted 1%
Fear 0.7%
Confused 0.7%
Surprised 0.3%
Angry 0.3%

AWS Rekognition

Age 43-51
Gender Male, 53.8%
Happy 98.1%
Calm 1.2%
Sad 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0%

AWS Rekognition

Age 40-48
Gender Male, 96.9%
Calm 99.3%
Sad 0.4%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 23-31
Gender Female, 98.2%
Calm 84.1%
Sad 14.6%
Angry 0.4%
Disgusted 0.3%
Confused 0.2%
Surprised 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 35-43
Gender Male, 82.9%
Calm 97.6%
Sad 1.6%
Angry 0.3%
Happy 0.2%
Disgusted 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Female, 70%
Calm 40.3%
Sad 35%
Confused 18.3%
Angry 1.8%
Disgusted 1.7%
Happy 1.3%
Surprised 1%
Fear 0.6%

AWS Rekognition

Age 28-38
Gender Male, 85.5%
Calm 50.9%
Happy 20.5%
Sad 10.6%
Surprised 7.4%
Angry 3.2%
Disgusted 3.2%
Confused 2.4%
Fear 1.8%

AWS Rekognition

Age 42-50
Gender Male, 99.5%
Calm 82.8%
Sad 16.3%
Angry 0.3%
Confused 0.2%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Female, 86.6%
Calm 58%
Sad 35%
Happy 4.3%
Fear 0.7%
Disgusted 0.7%
Confused 0.7%
Surprised 0.4%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 98.1%
Calm 89.8%
Surprised 6%
Fear 1.5%
Sad 1.4%
Happy 0.4%
Confused 0.4%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Female, 93.7%
Calm 99.6%
Happy 0.4%
Sad 0%
Confused 0%
Disgusted 0%
Fear 0%
Angry 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a group of people sitting at a table 91%
a group of people sitting around a table 90.8%
a group of people sitting at a table in a restaurant 87.8%

Text analysis

Amazon

37AS