Human Generated Data

Title

Untitled (waiter serving baked beans to customers at counter of Heinz restaurant)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11960
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waiter serving baked beans to customers at counter of Heinz restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.8
Human 99.8
Person 98.8
Person 98.6
Person 98.5
Shop 71.6
Clothing 71
Apparel 71
Shelf 71
Lab 70
Bakery 68.4
Restaurant 67.3

Imagga
created on 2022-01-15

shop 65.2
clinic 48.9
barbershop 48.6
mercantile establishment 48.3
man 36.3
place of business 32
people 31.2
medical 28.2
doctor 24.4
work 23.6
professional 22.7
male 22
person 21.2
bakery 19.3
hospital 19.2
counter 18.6
medicine 18.5
adult 18.3
patient 18.2
salon 17.5
laboratory 17.4
sitting 17.2
establishment 15.7
scientist 15.7
occupation 15.6
men 14.6
room 14.6
lab 14.6
research 14.3
working 14.1
indoors 14.1
together 14
couple 13.9
happy 13.8
worker 13.6
chemistry 13.5
health 13.2
restaurant 13.2
business 12.8
two 12.7
coat 12.7
science 12.5
profession 12.4
illness 12.4
biology 12.3
senior 12.2
smile 12.1
old 11.8
smiling 11.6
holding 11.6
office 11.5
table 11.3
looking 11.2
care 10.7
job 10.6
chemical 10.6
test 10.6
serious 10.5
lifestyle 10.1
student 10
team 9.9
experiment 9.8
assistant 9.7
portrait 9.7
love 9.5
happiness 9.4
instrument 9.3
20s 9.2
technology 8.9
color 8.9
women 8.7
exam 8.6
nurse 8.6
wedding 8.3
surgeon 8.2
confident 8.2
cheerful 8.1
family 8
tobacco shop 8
businessman 7.9
microscope 7.9
surgery 7.8
face 7.8
chair 7.8
scientific 7.8
husband 7.6
talking 7.6
uniform 7.6
wife 7.6
groom 7.6
study 7.5
hairdresser 7.3
equipment 7.3
indoor 7.3
dress 7.2
black 7.2

Google
created on 2022-01-15

Outerwear 95.1
Black 89.8
Coat 89.3
Table 85.8
Black-and-white 85.7
Hat 84.8
Style 83.9
Monochrome 74.3
Snapshot 74.3
Monochrome photography 74.3
Eyewear 73.9
Font 72.5
Room 71.9
Vintage clothing 71.7
Event 68.1
Stock photography 65.6
History 65.4
Art 65.3
Cooking 62.6
T-shirt 61.9

Microsoft
created on 2022-01-15

text 99.7
clothing 90.7
person 90.3
man 81
black and white 73.3
woman 69.7
items 54.8
cooking 23.4
shop 8.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 81.4%
Calm 89.4%
Surprised 9.1%
Confused 0.3%
Sad 0.3%
Angry 0.3%
Happy 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 47-53
Gender Male, 91.3%
Happy 98.7%
Calm 1%
Surprised 0.1%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people standing in front of a store 76.8%
a person standing in front of a store 76.7%
a group of people standing in front of a shop 76.6%

Text analysis

Amazon

ICE
ICE COLD
PEP
COLD
SOURS
Chocolate
Malted
5
BEANS
se
CREAM
BAKED
Cola
Coca-Cola
15795
Coca Cola
Coca
HEINZ
FOR
SHARPLESS
Chesterfield
15795.
PEP E PEP PER
Chocolate Malted M
AND
PEP PEPUISI
E
PER
GOLEMAN 5
GT CREAM
PECAN
FOR GET UP AND es DEVIDE
M
PEPUISI
GET UP
DEVIDE
why
Bondon's
es
with why Bondon's
with
...
Serving
GT
GOLEMAN
UNIVERSIDAD

Google

15995.
Coca-Cola
PEP
EP
FOR
GELP
AND
O
Ar
Rocolate
Malted
SHARPLS
CREAM
ICE
Spraty
15995. Coca-Cola Coca-Cola PEP EP PEP PEP FOR GELP AND O Ar Rocolate Malted IIPINZ SOURS SHARPLS E CREAM Coca-ola ICE COLD Spraty BAKE 15795- Ohesterheld
IIPINZ
SOURS
E
Coca-ola
COLD
BAKE
15795-
Ohesterheld