Human Generated Data

Title

Untitled (three men seated at restaurant table, waitress writing on pad)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4569
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three men seated at restaurant table, waitress writing on pad)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99
Person 99
Person 98.2
Person 98
Person 94.3
Indoors 88.3
Interior Design 88.3
Clothing 86.8
Apparel 86.8
Clinic 78
Room 68.1
Person 66.7
Face 64.6
Photo 64.1
Portrait 64.1
Photography 64.1
People 61.9
Furniture 59.6
Text 58.3
Chair 53.5

Imagga
created on 2021-12-14

man 30.2
person 29
people 27.9
male 27.6
business 27.3
newspaper 25.6
professional 25.3
businessman 24.7
worker 22.7
work 21.3
adult 21
product 20.7
men 20.6
musical instrument 20.5
job 18.6
office 18.6
wind instrument 18.2
team 16.1
laptop 15.5
corporate 15.5
creation 15.4
manager 14.9
portrait 14.9
suit 14.4
working 14.1
executive 14.1
smiling 13.7
group 13.7
businesswoman 13.6
technology 13.4
human 12.7
medical 12.4
education 12.1
accordion 11.9
lab 11.7
laboratory 11.6
desk 11.4
happy 11.3
computer 11.2
looking 11.2
instrument 11.2
occupation 11
smile 10.7
cheerful 10.6
table 10.5
development 10.5
biology 10.4
businesspeople 10.4
sax 10.4
sitting 10.3
brass 10.3
black 10.2
teamwork 10.2
scientist 9.8
chemistry 9.7
chemical 9.6
room 9.6
keyboard instrument 9.5
research 9.5
women 9.5
meeting 9.4
company 9.3
face 9.2
student 9.2
successful 9.1
confident 9.1
equipment 9
handsome 8.9
new 8.9
assistant 8.7
scientific 8.7
test 8.7
tie 8.5
holding 8.2
alone 8.2
chair 8.1
success 8
device 8
medicine 7.9
microscope 7.9
happiness 7.8
conference 7.8
health 7.6
thinking 7.6
fashion 7.5
doctor 7.5
study 7.5
color 7.2
indoors 7
modern 7

Google
created on 2021-12-14

Black 89.6
Coat 87.8
Chair 87.5
Black-and-white 85.1
Style 83.8
Table 82.3
Hat 81.7
Monochrome 77.4
Monochrome photography 77.3
Art 76.7
Plant 75.9
Font 71
Coffee table 70.2
Event 67.8
White-collar worker 67.7
Vintage clothing 67
Room 65.3
Sitting 65.2
Suit 64.1
Stock photography 64

Microsoft
created on 2021-12-14

text 98.5
indoor 89
clothing 88.5
person 86.5
black and white 76
drawing 72
book 67.7
sketch 66
furniture 60
man 58

Face analysis

Amazon

Google

AWS Rekognition

Age 43-61
Gender Male, 75.8%
Happy 86.7%
Calm 12.6%
Sad 0.2%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-30
Gender Female, 64%
Happy 56.6%
Calm 39.3%
Surprised 2.1%
Angry 0.8%
Sad 0.6%
Confused 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-37
Gender Male, 71.5%
Happy 48.1%
Calm 37.2%
Surprised 11.9%
Confused 1.1%
Angry 0.9%
Fear 0.3%
Disgusted 0.2%
Sad 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Chair 53.5%

Captions

Microsoft

a person reading a book 38.2%
a person reading a book in front of a window 34.6%
a person sitting at a desk in front of a window 34.5%

Text analysis

Amazon

119311.
.
VILLE

Google

19311. 1193|| .
19311.
.
1193||