Human Generated Data

Title

Untitled (three men seated at restaurant table, waitress writing on pad)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4568

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three men seated at restaurant table, waitress writing on pad)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.4
Human 99.4
Person 99
Person 97.5
Clinic 95.3
Person 94
Doctor 89.6
Room 88.2
Indoors 88.2
Chair 85
Furniture 85
Interior Design 79.7
Hospital 75.9
Operating Theatre 63.1
Person 62.6
Portrait 57.8
Photography 57.8
Face 57.8
Photo 57.8
Chair 55.3

Imagga
created on 2021-12-14

man 32.9
wind instrument 31.3
musical instrument 30.6
male 29.8
people 27.9
person 27
professional 26.7
business 25.5
businessman 22.9
adult 22.2
sax 20.4
office 20.1
work 19.8
job 19.4
worker 18.9
men 17.2
accordion 17
brass 16.6
team 16.1
corporate 15.5
room 15.2
meeting 15.1
group 14.5
medical 14.1
teamwork 13.9
occupation 13.7
newspaper 13.6
keyboard instrument 13.6
working 13.2
businesspeople 12.3
device 11.9
happy 11.9
executive 11.9
businesswoman 11.8
desk 11.4
table 11.3
education 11.2
manager 11.2
new 10.5
computer 10.4
doctor 10.3
patient 10.3
teacher 10.2
instrument 10.2
cornet 10.2
confident 10
suit 9.9
modern 9.8
chair 9.8
portrait 9.7
laboratory 9.6
looking 9.6
study 9.3
casual 9.3
indoor 9.1
product 9.1
laptop 9.1
black 9
human 9
handsome 8.9
technology 8.9
conference 8.8
lab 8.7
chemical 8.7
smiling 8.7
profession 8.6
research 8.6
development 8.6
biology 8.5
showing 8.4
student 8.3
successful 8.2
alone 8.2
washboard 8.1
shop 8
to 8
interior 8
classroom 7.9
smile 7.8
scientist 7.8
optical 7.8
scientific 7.7
lens 7.7
chemistry 7.7
sitting 7.7
hospital 7.7
health 7.6
clothing 7.6
clinic 7.6
talking 7.6
tie 7.6
fashion 7.5
holding 7.4
creation 7.3
home 7.2
medicine 7

Google
created on 2021-12-14

Shirt 94.3
Coat 87.6
Black-and-white 85.2
Table 84.2
Style 83.9
Chair 83
Hat 76.3
Plant 76.1
Monochrome 76
Font 75.8
Monochrome photography 74.7
White-collar worker 72.8
Event 70.5
Art 67.2
Sitting 66.6
Room 65.4
Stock photography 64.8
Vintage clothing 64.1
Suit 63.8
History 59.5

Microsoft
created on 2021-12-14

text 99.3
drawing 95.4
sketch 94.8
window 94.6
indoor 92.7
clothing 87.2
person 86.1
cartoon 73.3
man 72.1
furniture 65.4
book 59.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-43
Gender Male, 84.7%
Calm 48.4%
Happy 47.8%
Surprised 1.5%
Sad 0.8%
Angry 0.7%
Confused 0.4%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 62.3%
Calm 66.8%
Happy 24.9%
Angry 4.3%
Surprised 2.1%
Sad 0.9%
Fear 0.6%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 25-39
Gender Female, 51.9%
Calm 87.2%
Happy 9.4%
Surprised 1.6%
Angry 0.8%
Confused 0.4%
Sad 0.3%
Disgusted 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 85%

Captions

Microsoft

a group of people sitting at a desk in front of a window 80.3%
a group of people sitting at a table with a laptop 73.2%
a group of people sitting at a table in front of a window 70.7%

Text analysis

Amazon

119312.

Google

119312. T19312.
119312.
T19312.