Human Generated Data

Title

Untitled (waitress handing a bottle of ketchup over the counter to a man)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4571
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress handing a bottle of ketchup over the counter to a man)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.8
Human 99.8
Person 99.8
Person 99.2
Person 97.2
Person 92.2
Indoors 91.9
Interior Design 91.9
Person 67.3
Shop 65.2
Meal 60.7
Food 60.7
Room 59.9
Restaurant 59.1
Cafe 59.1
Workshop 58.4
Shelf 56.9

Imagga
created on 2021-12-14

industry 19.6
building 19.1
city 19.1
man 18.8
shop 18.8
architecture 17.3
equipment 16.7
urban 14.8
industrial 14.5
people 14.5
machine 13.8
work 13.7
male 13.5
mercantile establishment 13.4
person 13.3
stall 12.2
factory 11.9
business 11.5
steel 11.5
men 11.1
old 11.1
weight 10.9
counter 10.8
adult 10.4
place of business 9.9
transportation 9.8
house 9.7
heavy 9.5
iron 9.3
worker 9.2
power 9.2
barroom 9.2
travel 9.1
history 8.9
metal 8.8
interior 8.8
indoors 8.8
center 8.7
light 8.7
gym 8.6
inside 8.3
human 8.2
occupation 8.2
landmark 8.1
structure 8.1
night 8
job 7.9
smile 7.8
standing 7.8
manufacturing 7.8
sitting 7.7
modern 7.7
construction 7.7
engineering 7.6
chair 7.6
street 7.4
loom 7.3
fitness 7.2
religion 7.2
activity 7.2
working 7.1

Google
created on 2021-12-14

Shirt 94.6
Black 89.7
Black-and-white 85.5
Style 84
Monochrome 76
T-shirt 75.7
Monochrome photography 75.2
Snapshot 74.3
Bottle 66.8
Room 66.3
Barware 66.1
Font 65.5
Event 64.7
Hat 63.9
Stock photography 63.4
Machine 58.2
Street 53.7
Sitting 50.6

Microsoft
created on 2021-12-14

text 99.7
person 99
clothing 96.5
man 90.5
black and white 55.3
newspaper 51.3

Face analysis

Amazon

Google

AWS Rekognition

Age 26-40
Gender Female, 93.3%
Happy 60.5%
Calm 13.1%
Sad 9.4%
Surprised 8.1%
Confused 5.1%
Fear 2.8%
Angry 0.9%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a man standing in front of a store 61.1%
a man that is standing in front of a store 50.7%
a man standing in front of a refrigerator 27.1%

Text analysis

Amazon

Try
Includes
EGGS
119325
119325.
BREA
Coffee
FRUITJUICE
FRIED HAM-EGG
- Coffee
Good
Cream
morning
-
Potatoca
SOUPE
EGGS Skill
fresh
Cream 1.
Gried Potatoca
VI37A2
Gried
1.
Femata
The
The They
They
ECOG
NEW
Skill
STORIDAD
DOL

Google

OurCh
Snad
19325.
Good
Try
FRUITJUICE
19325. Good BREA moming Try OurCh Iacludes FRUITJUICE EGGS FRIEDHAM-EGG Snad etatocs 19325.
BREA
Iacludes
EGGS
etatocs
moming
FRIEDHAM-EGG