Human Generated Data

Title

Untitled (waitress serving a man at the counter of a Heinz restaurant)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11961

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress serving a man at the counter of a Heinz restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.1
Human 99.1
Person 98.9
Person 98.4
Shop 78.1
Shelf 76.7
Clothing 68.9
Apparel 68.9
Chef 58.8

Imagga
created on 2022-01-15

seller 43.8
man 33.6
people 29.6
clinic 29.2
shop 27.9
person 27.1
male 26.9
medical 24.7
professional 24.2
doctor 22.5
coat 19.9
patient 19.8
mercantile establishment 19.7
work 19.7
lab coat 19.3
adult 18.4
men 18
pharmacist 16.8
medicine 15.8
worker 15.7
hospital 15.4
newspaper 14.7
health 14.6
laboratory 14.5
bakery 14.1
occupation 13.7
scientist 13.7
lab 13.6
job 13.3
place of business 13.1
business 12.7
chemistry 12.6
old 12.5
smiling 12.3
health professional 12
room 12
happy 11.9
nurse 11.6
exam 11.5
illness 11.4
research 11.4
education 11.2
senior 11.2
office 11.2
sitting 11.2
product 10.8
surgeon 10.7
care 10.7
science 10.7
businessman 10.6
human 10.5
biology 10.4
portrait 10.4
two 10.2
tobacco shop 10.1
student 10
indoors 9.7
test 9.6
black 9.6
couple 9.6
ancient 9.5
clothing 9.4
smile 9.3
hand 9.1
team 9
technology 8.9
women 8.7
table 8.7
serious 8.6
study 8.4
20s 8.2
cheerful 8.1
looking 8
to 8
interior 8
lifestyle 7.9
surgery 7.8
face 7.8
chemical 7.7
profession 7.7
creation 7.6
casual 7.6
instrument 7.4
holding 7.4
teamwork 7.4
group 7.2
restaurant 7.2
home 7.2
employee 7.1
family 7.1
waiter 7
architecture 7
modern 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.6
clothing 93.3
person 87.5
man 84.1
black and white 67.8
bottle 52.6
preparing 44.7
shop 32.2
cooking 28.4

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Female, 89.7%
Calm 99.5%
Happy 0.2%
Sad 0.2%
Disgusted 0%
Confused 0%
Fear 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 35-43
Gender Male, 57.2%
Sad 50.9%
Calm 32.8%
Surprised 10.2%
Happy 2.3%
Confused 2.3%
Fear 0.6%
Disgusted 0.5%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a person standing in front of a store 86.8%
a man and a woman standing in front of a store 69.3%
a person standing in front of a shop 69.2%

Text analysis

Amazon

ICE
ICE COLD
COLD
PEP
FOR
1579
15793
Chocolate
as
SOUPS
BAKED
Coca-Cola
CREAM
KEINZ
1579 3
DELICIOUS
SHARPLESS
5
BEANS
Serving
3
COFFEE
Malted
PEP EF PEP PEP
308
PEP PEE
BLACKSTONE
Chocolate Malted We
DE CREAM
-
PEE
MADE
STRAWBERRY
Borden's
EF
PECAN
AND
FOR GALIS AND EO DRIVE
DE
any Borden's
EO
FUOGE
We
VANIKIC
DRIVE
any
SKINA
LE
GALIS

Google

15793-
EP
Bendenis
OWL
15793
CocaCola
PERICE
CREAM
EE
BAKED
BEANS
ESTRAW
PEP
DR
M
SOUPS
COLD
Coca-Cola
FOR
EO
AN
KEINZ
SHARPLESS
154
ICE
15793- CocaCola Coca-Cola ESTRAW PEP EP PEP PEP FOR GELP AD EO DR Chocolate Maed M AN a Bendenis KEINZ SOUPS PEP PERICE SHARPLESS CREAM EE OWL 154 CocaCola ICE COLD BAKED BEANS 15793
GELP
AD
Chocolate
Maed
a