Human Generated Data

Title

Untitled (waitress serving a man at the counter of a Heinz restaurant)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11962

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress serving a man at the counter of a Heinz restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.5
Human 99.5
Person 99.4
Person 98.6
Apparel 81.4
Clothing 81.4
Meal 73.7
Food 73.7
Shop 72.7
Shelf 71.9
Hat 70.5
Restaurant 69.8
Chef 69.5
Bakery 56.2

Imagga
created on 2022-01-15

clinic 61.4
shop 39.3
man 35.6
male 33.3
people 32.9
medical 32.6
professional 30.5
doctor 29.1
person 29
mercantile establishment 26.6
work 25.9
patient 24.7
men 23.2
hospital 22.2
medicine 21.1
occupation 21.1
lab 20.4
job 20.3
laboratory 20.2
adult 19.6
coat 19.1
barbershop 19
health 18.7
worker 17.8
working 17.7
place of business 17.7
business 17
scientist 16.6
lab coat 16.4
biology 15.2
science 15.1
room 15.1
research 14.3
newspaper 14.1
technology 14.1
bakery 14.1
indoors 14
smiling 13.7
nurse 13.6
chemistry 13.5
student 12.7
team 12.5
test 12.5
exam 12.4
assistant 11.7
portrait 11.6
chemical 11.6
care 11.5
businessman 11.5
illness 11.4
pharmacist 11.4
office 11.4
happy 11.3
sitting 11.2
surgeon 10.9
scientific 10.6
serious 10.5
education 10.4
product 10.3
teamwork 10.2
equipment 9.9
uniform 9.9
human 9.7
30s 9.6
computer 9.6
profession 9.6
women 9.5
senior 9.4
20s 9.2
black 9
to 8.8
optical 8.7
expertise 8.7
establishment 8.6
seller 8.6
college 8.5
two 8.5
horizontal 8.4
instrument 8.4
looking 8
home 8
lifestyle 7.9
tobacco shop 7.9
microscope 7.9
chemist 7.9
smile 7.8
technician 7.8
standing 7.8
experiment 7.8
casual 7.6
customer 7.6
development 7.6
study 7.5
holding 7.4
treatment 7.3
creation 7.3
confident 7.3
school 7.2
chair 7.1
family 7.1
building 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.8
person 92.7
clothing 88.1
man 75.4
shop 19.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 70.2%
Calm 99.9%
Happy 0.1%
Sad 0%
Surprised 0%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 36-44
Gender Male, 69.7%
Surprised 54%
Calm 32.9%
Sad 10.4%
Happy 0.9%
Fear 0.7%
Confused 0.4%
Angry 0.4%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 70.5%

Captions

Microsoft

a person standing in front of a store 77.2%
a man and a woman standing in front of a store 53%
a person standing in front of a store 52.9%

Text analysis

Amazon

ICE
ICE COLD
COLD
157
PEP
Ma
SOUPS
Chocolate
157 92
BEANS
BAKED
Cola
92
Coca Cola
Coca-Cola
DELICIOUS
Coca
CREAM
PEP PEF
SHARPLESS
PEF
CHOCOLAT
BLACK
15792.
FOR
ICE CREAM
PEP FP PEP PEP
-
DRINK
KEINZ
AND
Chocolate Ma lied M
REFRESHING
BLACK STON
SR
with
Borden's
FOR GET UP AND до DRINK
5c
STON
lied
MARY with Borden's
M
FP
до
Sereing
CHOCOMAN 5c
COFFEE
Darks
MARY
BOWL159
Heart
LABOR BOWL159
FUDOR
CHOCOMAN
CIELECA Heart
LABOR
GET UP
CIELECA

Google

15792.
PEP
TAORSE
BOWL
BEANS
CocaCola
DELICE
Ge
E
1S792.
FOR
PEFIE
CHEAM
1
Coca-Cola
AND
gO.
DRINK
Me
Seing
ICE
COLD
BAKED
15792. CocaCola DELICE Coca-Cola PEP EP PEP PEP FOR Ge AND gO. DRINK Chocolate Me CEINZ SOUPS PEP PEFIE E CHEAM Seing TAORSE BOWL 1 CocaCola ICE COLD BAKED BEANS 1S792.
EP
Chocolate
CEINZ
SOUPS