Human Generated Data

Title

Untitled (couple eating at restaurant counter, waiter behind counter)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4573
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple eating at restaurant counter, waiter behind counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.9
Person 99.9
Person 99.6
Person 99.2
Hat 86.1
Clothing 86.1
Apparel 86.1
Restaurant 77.7
Shop 75.2
Shelf 74.8
Chef 59.4
Cafeteria 57.9
Bakery 56.9

Imagga
created on 2021-12-14

brass 100
cornet 100
wind instrument 82.3
musical instrument 54.5
people 30.1
male 29.8
man 29.5
work 26.7
professional 26.6
person 26.4
medical 24.7
worker 21.6
adult 21.5
business 21.2
job 19.4
office 18.6
working 18.5
medicine 18.5
lab 18.4
laboratory 18.3
businessman 17.6
occupation 17.4
biology 16.1
doctor 16
team 15.2
health 13.9
patient 13.8
men 13.7
scientist 13.7
portrait 13.6
coat 13.4
serious 13.3
science 13.3
research 13.3
teamwork 13
sitting 12.9
student 12.7
test 12.5
businesspeople 12.3
smiling 12.3
group 12.1
human 12
technology 11.9
chemistry 11.6
indoors 11.4
hospital 11.3
education 11.2
computer 11.2
room 10.9
device 10.7
assistant 10.7
expertise 10.7
happy 10.6
chemical 10.6
clinic 10.4
table 10.4
meeting 10.4
corporate 10.3
manager 10.2
instrument 10.2
businesswoman 10
care 9.9
modern 9.8
scientific 9.7
looking 9.6
profession 9.6
women 9.5
horn 9.5
desk 9.4
day 9.4
study 9.3
two 9.3
shop 8.9
microscope 8.9
exam 8.6
talking 8.5
communication 8.4
equipment 8.2
clothing 7.9
chemist 7.9
smile 7.8
discovery 7.8
uniform 7.7
attractive 7.7
illness 7.6
plan 7.6
holding 7.4
focus 7.4
20s 7.3
successful 7.3
indoor 7.3
confident 7.3
color 7.2
engineer 7.2
information 7.1

Google
created on 2021-12-14

Hat 90.2
Coat 87.5
Chef 85.4
Smile 85.2
Black-and-white 84.6
Headgear 82
Cap 79.9
Eyewear 76.4
Tie 75.3
Cooking 74.6
Monochrome photography 74.3
Snapshot 74.3
Monochrome 73.4
Vintage clothing 70.8
Fedora 69.6
Font 69.1
T-shirt 65.9
Customer 65.9
Event 65.8
Suit 65.8

Microsoft
created on 2021-12-14

text 99.5
person 99.2
clothing 96.5
man 94.1
people 78.3
group 58.6

Face analysis

Amazon

AWS Rekognition

Age 40-58
Gender Male, 97.4%
Calm 58.3%
Happy 19.6%
Confused 8.2%
Sad 6.4%
Surprised 3.2%
Angry 2.7%
Disgusted 1.3%
Fear 0.3%

AWS Rekognition

Age 26-42
Gender Male, 86.4%
Happy 54.3%
Calm 42.2%
Sad 2.8%
Angry 0.4%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-37
Gender Female, 75.7%
Calm 96.6%
Sad 1.3%
Happy 0.7%
Surprised 0.6%
Angry 0.3%
Fear 0.2%
Confused 0.2%
Disgusted 0.1%

Feature analysis

Amazon

Person 99.9%
Hat 86.1%

Captions

Microsoft

a group of people sitting at a table 94.7%
a group of people sitting around a table 94.4%
a group of people around a table 94.3%

Text analysis

Amazon

SOUPS
HEINZ
CREAM
MILK
DRINKS
MALTED MILK
5
от DRINKS
TOMATO
MALTED
EGG
New
ICE
LETTUCE
от
BACON
CHEESE
ICE CREAM MILK SHAKE
JELLY
Cream
LIVE
FRIED
Chicken
FRIED HAM
adidas
HAM
SHAKE
ICE CREAM MALTED MILK
CREAM -
-
es
2
FALAM
ELETTUCE
119330.
TOMATO BACON LETTUCE - LECICED EGG - LETTUCE
119330. CREAM CHEESE MAIO JELLY ELETTUCE
IS
Tomato
M LIVE
Cream - Tomato
BACON E
FALAM L EGG
WE EGG IS
E
KRIED FRIED
- -
CHEAM
Try a New
Cream - -
EL EGG
in
FARDINE
DE
M
ELICEO EGG
adidas ESLETTUCE
Keel
PASHIONES
Corn
KRIED
USA CHEAM SOCAS DE
SOCAS
J
Clam
Cream - J Per
CHICA
REIKE
I
C
AL PASHIONES BEAN
THANK
Vegetaki
AL
- LECICED
EL
BOO CHICA
L
ELICEO
WE
MIR THANK
BEAN
Per
Try a
Chamber
Shokey
Tagetakia
Tagetakia Territo
Territo
MAIO
BOO
ESLETTUCE
MIR
USA

Google

OT
CFE
MALTED
MILK
EGG
s
BACON
WE
OUPs
CHEMN
BOWL
119330.
LAM SOCAS OT DRINKS CFE JEP KE CREAM MILK SHANE KE CREAM MALTED MILK BACON EICED EGG CLETTUCE MALTED MILK WE I5 KEINE OUPs HEINZ SOUPS CRAN e CAN s C CHEMN AUH LARGE BOWL 15 119330. VAGOX-YT37A2 -VAMTZA
KE
CREAM
I5
SOUPS
CRAN
15
-VAMTZA
LAM
JEP
SHANE
EICED
CLETTUCE
KEINE
HEINZ
e
C
AUH
LARGE
SOCAS
DRINKS
CAN
VAGOX-YT37A2