Human Generated Data

Title

Untitled (waiter offering Heinz Chili Sauce to couple seated at table)
Date

c. 1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4566
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waiter offering Heinz Chili Sauce to couple seated at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.4
Human 99.4
Person 99.2
Person 95.6
Person 95.4
Person 78.7
Lab 68.7
Restaurant 68
Apparel 64.5
Clothing 64.5
Person 60.5
Sitting 59.4
Cafe 58.4
Coat 57.3
Furniture 57.1
Scientist 56.8
Person 47.5

Imagga
created on 2021-12-14

barbershop 52.6
man 43.7
shop 41.2
person 36.2
people 35.2
male 34.1
office 33.3
mercantile establishment 31.9
professional 30.1
adult 30
business 29.8
businessman 26.5
computer 24
working 23.9
sitting 23.2
smiling 23.2
indoors 22.9
work 22.8
men 22.3
worker 22
place of business 21.3
room 21.2
group 21
couple 20.9
table 19.9
desk 19.8
laptop 19.1
meeting 18.8
patient 18.6
hairdresser 18.4
happy 17.6
businesspeople 17.1
team 17
senior 16.9
home 16.8
businesswoman 16.4
teamwork 15.8
executive 15.6
corporate 15.5
talking 14.3
women 14.2
job 14.2
mature 14
occupation 13.8
indoor 13.7
medical 13.2
portrait 12.9
colleagues 12.6
salon 12.6
lifestyle 12.3
together 12.3
doctor 12.2
coat 12.2
smile 12.1
confident 11.8
conference 11.7
suit 11.7
education 11.3
modern 11.2
manager 11.2
technology 11.1
clothing 11
handsome 10.7
establishment 10.6
hospital 10.5
student 10.3
presentation 10.2
teacher 10.2
happiness 10.2
chair 10.2
communication 10.1
horizontal 10.1
board 10
looking 9.6
two 9.3
face 9.2
employee 9.2
holding 9.1
health 9
lab coat 8.9
cheerful 8.9
clinic 8.9
mid adult 8.7
laboratory 8.7
ethnic 8.6
casual 8.5
case 8.4
study 8.4
hand 8.4
color 8.3
focus 8.3
successful 8.2
nurse 8.1
life 8.1
family 8
interior 8
medicine 7.9
associates 7.9
coworkers 7.9
lab 7.8
concentration 7.7
elderly 7.7
formal 7.6
husband 7.6
wife 7.6
necktie 7.5
one person 7.5
bartender 7.5
keyboard 7.5
human 7.5
care 7.4
sick person 7.3
specialist 7.3
waiter 7.3
success 7.2
restaurant 7.2
barber chair 7.1

Google
created on 2021-12-14

Black 89.7
Black-and-white 85.6
Style 83.8
Monochrome 79.5
Monochrome photography 77.4
Vintage clothing 74.4
Hat 73.1
Chair 72.2
Table 70.9
Event 67.1
Room 65.4
Sitting 63.9
History 63.9
Suit 63.3
Stock photography 63.3
Cooking 60.4
Classic 59.9
Photo caption 59.5
Door 57.1
Font 56.9

Microsoft
created on 2021-12-14

text 99.8
person 97.4
indoor 85.6
window 84.5
bottle 82.5
clothing 81.7
table 77.5
man 72.9
house 59.3

Face analysis

Amazon

Google

AWS Rekognition

Age 25-39
Gender Female, 92%
Happy 99.4%
Calm 0.3%
Surprised 0.1%
Fear 0.1%
Angry 0.1%
Sad 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 72.8%
Calm 87.6%
Happy 7%
Sad 3.2%
Surprised 0.6%
Angry 0.6%
Confused 0.5%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 36-52
Gender Female, 52.6%
Calm 84.6%
Sad 7.6%
Angry 3.4%
Happy 2.7%
Confused 0.7%
Surprised 0.4%
Fear 0.4%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people sitting at a table in front of a window 72.2%
a group of people standing around a table 72.1%
a group of people sitting at a table 72%

Text analysis

Amazon

119340
12
119340.
048611
MJI7
of
of 12 ة
MJI7 YEEN ARAA
ARAA
ة
YEEN

Google

119340 119340. 19340 MJ17 YT33A2 A7JA.
119340
MJ17
YT33A2
119340.
A7JA.
19340