Human Generated Data

Title

Untitled (children reading at tables/teachers standing at perimeter of classroom)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5278
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children reading at tables/teachers standing at perimeter of classroom)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Room 99.6
Classroom 99.6
School 99.6
Indoors 99.6
Person 99.1
Human 99.1
Person 98.8
Person 98.4
Person 97.2
Person 95.7
Chair 94.6
Furniture 94.6
Person 93.9
Person 93.1
Chair 92.7
Person 92
Person 91.8
Chair 91.2
Person 90
Person 87.4
Person 87.1
Person 83.9
Person 80.4
Person 76.6
Person 75.9
Person 69.9
Person 68.1
Cafeteria 64.8
Restaurant 64.8
Person 64.6
Person 60.7
Person 59.3
Person 58.2
Person 57.2

Imagga
created on 2022-01-22

room 46.3
hall 38.5
classroom 32.7
interior 31.8
table 31.3
restaurant 29.8
chair 27.5
people 21.7
center 21
shop 19.8
business 17.6
modern 17.5
cafeteria 17
dinner 16.8
work 16.5
dining 15.2
office 14.9
case 14.9
furniture 14.5
person 14
party 13.7
empty 13.7
decor 13.3
indoors 13.2
design 12.9
group 12.9
tables 12.8
man 12.8
building 12.6
meeting 12.2
service 12
indoor 11.9
seat 11.8
eat 11.7
adult 11.7
glass 10.9
food 10.9
clothing 10.3
men 10.3
place 10.2
drink 10
male 9.9
banquet 9.9
chairs 9.8
businessman 9.7
desk 9.6
hotel 9.5
mercantile establishment 9.3
shoe shop 9.2
inside 9.2
equipment 9
meal 8.9
computer 8.8
teacher 8.8
conference 8.8
setting 8.7
education 8.6
comfortable 8.6
corporate 8.6
luxury 8.6
elegant 8.6
floor 8.4
life 8.3
structure 8.3
occupation 8.2
counter 8
decoration 8
reception 7.8
student 7.8
lunch 7.7
industry 7.7
professional 7.7
elegance 7.6
communication 7.6
fashion 7.5
house 7.5
wood 7.5
laptop 7.4
event 7.4
bar 7.4
wine 7.4
wedding 7.4
businesswoman 7.3
home 7.2
celebration 7.2

Google
created on 2022-01-22

Chair 85.6
Black-and-white 84.1
Style 83.8
Suit 79.3
Monochrome 76.1
Crowd 74.9
Monochrome photography 74.5
Event 73.6
Art 73.4
Room 71.6
Table 69
Font 67.6
History 65.1
Stock photography 65.1
Photo caption 61.8
Hat 61.1
Class 59.7
Team 53.6

Microsoft
created on 2022-01-22

text 99.6
person 94
clothing 91.4
man 85.6
group 77.4
table 76.4
posing 44.5
crowd 0.8

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 91.9%
Calm 94.7%
Sad 4.3%
Fear 0.4%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0.1%

AWS Rekognition

Age 21-29
Gender Male, 98.9%
Calm 90.8%
Sad 8.6%
Confused 0.3%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 29-39
Gender Female, 86.9%
Sad 76.8%
Calm 21.7%
Disgusted 0.5%
Happy 0.3%
Fear 0.3%
Confused 0.2%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Male, 79.2%
Calm 95.9%
Sad 2.5%
Happy 0.7%
Confused 0.3%
Surprised 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Female, 94.8%
Calm 72.5%
Sad 26%
Confused 0.6%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 98.4%
Sad 74.3%
Calm 9.1%
Confused 5%
Fear 4.5%
Disgusted 3.4%
Happy 2.1%
Angry 1%
Surprised 0.6%

AWS Rekognition

Age 18-26
Gender Female, 95.9%
Sad 51.2%
Calm 39.2%
Surprised 4.1%
Happy 2.2%
Confused 1.3%
Angry 0.9%
Disgusted 0.8%
Fear 0.3%

AWS Rekognition

Age 23-31
Gender Female, 61.7%
Calm 62.1%
Sad 32.6%
Happy 2%
Disgusted 0.9%
Confused 0.8%
Angry 0.6%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 45-51
Gender Male, 98.4%
Calm 57.5%
Sad 39.4%
Confused 2%
Angry 0.4%
Happy 0.3%
Disgusted 0.2%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Female, 76%
Calm 98.8%
Disgusted 0.4%
Sad 0.2%
Confused 0.2%
Fear 0.2%
Surprised 0.1%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 23-31
Gender Male, 99.3%
Sad 84%
Calm 13.4%
Fear 0.5%
Disgusted 0.5%
Confused 0.5%
Angry 0.5%
Surprised 0.4%
Happy 0.3%

AWS Rekognition

Age 18-26
Gender Female, 89.2%
Calm 46.7%
Sad 30.4%
Fear 5.3%
Happy 5.2%
Confused 4.8%
Disgusted 3.6%
Angry 2.7%
Surprised 1.3%

AWS Rekognition

Age 23-31
Gender Male, 98.9%
Fear 36.6%
Sad 29.8%
Calm 16.1%
Happy 10.6%
Confused 3.1%
Angry 2.5%
Surprised 0.8%
Disgusted 0.6%

AWS Rekognition

Age 29-39
Gender Male, 63.3%
Sad 41.6%
Happy 36.9%
Calm 8.5%
Fear 4.9%
Confused 4%
Disgusted 1.5%
Surprised 1.4%
Angry 1.3%

AWS Rekognition

Age 24-34
Gender Female, 85.9%
Sad 79.7%
Happy 8.7%
Fear 3.7%
Calm 3.6%
Confused 1.4%
Angry 1.2%
Disgusted 0.8%
Surprised 0.8%

AWS Rekognition

Age 28-38
Gender Female, 57.4%
Calm 78.5%
Happy 14.8%
Sad 4.5%
Disgusted 1.1%
Angry 0.3%
Fear 0.3%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 45-51
Gender Female, 95.6%
Calm 97.7%
Happy 1.4%
Surprised 0.4%
Confused 0.2%
Disgusted 0.1%
Sad 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 71.9%
Confused 23%
Sad 20.7%
Fear 15.5%
Calm 14.5%
Happy 10.2%
Disgusted 9.3%
Surprised 3.8%
Angry 3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Chair 94.6%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 90.7%
a group of people posing for a photo 90.6%
a group of people standing in front of a crowd 90.5%

Text analysis

Amazon

Group
One
please
you
Will you please CORCA
Item Group One
OESS
Will
our
CORCA
by our Historico packy
other
by
adidas
other adidas ONIFE
0ES5
Item
packy
volu
Historico
ONIFE

Google

Ilear Groap One. Wil you please come bour Halloween pcy at fwa n e
Ilear
you
pcy
Wil
Halloween
at
n
e
Groap
please
bour
fwa
come
One.