Human Generated Data

Title

Untitled (waiter taking order from two women at Heinz Company restaurant)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10538
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waiter taking order from two women at Heinz Company restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.2
Human 99.2
Person 98.8
Person 98.5
Person 98.3
Apparel 97.7
Clothing 97.7
Person 92.1
Musician 89
Musical Instrument 89
Leisure Activities 81.5
Restaurant 81.3
Guitar 80.8
Performer 74.6
Guitarist 74.6
Hat 71.9
Food 62.2
Meal 62.2
Cafe 61.4
Sun Hat 60
Coat 57.8
Overcoat 57.8

Imagga
created on 2022-01-09

restaurant 49.6
barbershop 44.7
building 43.1
shop 42.6
mercantile establishment 31.5
place of business 22
man 21.5
structure 20.8
people 19.5
city 19.1
person 15.8
male 15.6
architecture 14.8
office 14.6
business 14.6
black 13.8
room 13.2
computer 12.8
old 12.5
window 12.1
men 12
adult 11.8
indoors 11.4
hand 11.4
urban 11.4
establishment 11.1
center 10.8
job 10.6
interior 10.6
modern 10.5
chair 10.4
sitting 10.3
work 10.2
love 9.5
glass 9.3
street 9.2
indoor 9.1
holding 9.1
technology 8.9
working 8.8
businessman 8.8
travel 8.4
laptop 8.4
house 8.4
inside 8.3
group 8.1
table 7.9
equipment 7.9
lamp 7.6
buildings 7.6
communication 7.6
town 7.4
light 7.3
aged 7.2
lifestyle 7.2
history 7.2
sky 7

Google
created on 2022-01-09

Black 89.6
Hat 86.6
Black-and-white 84.2
Style 83.8
Font 77.3
Art 77
Monochrome photography 75.4
Monochrome 74.8
Snapshot 74.3
Suit 73.1
Room 70.4
History 66.3
Event 63.9
Vintage clothing 63.6
Stock photography 63.4
Table 61.9
Illustration 61.2
Visual arts 57.4
Chair 55.2
Sun hat 53.8

Microsoft
created on 2022-01-09

text 97.8
street 93.5
person 89
clothing 88
black and white 87.9
man 81.8
monochrome 56.9

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Female, 93%
Calm 98.3%
Sad 0.8%
Surprised 0.2%
Fear 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 28-38
Gender Male, 94.6%
Calm 92.4%
Fear 3.4%
Sad 2.7%
Disgusted 0.4%
Happy 0.4%
Surprised 0.4%
Confused 0.2%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a group of people standing in front of a store 76.6%
a group of people in front of a store 75.1%
a person standing in front of a store 75%

Text analysis

Amazon

65
WALNUT
YEARS
1193
ADDRESS
FOR
OF
ST
ONLY
BEST
ADDRESS FOR
ONE
1193 18.
OTHER
SAME
BRANCHES
18.
II OTHER ADDRESS
99 BEST OF
125
YEARS S
and BRANCHES
815611
II
S
NAGOY
all
99
and
VIZUAL

Google

119318.
YEARS
ADORESE
119318. SIME ADDRESS FOR 65 YEARS WALNUT ST NOUNER ADORESE NCIES 119318.
SIME
FOR
ST
NOUNER
NCIES
ADDRESS
65
WALNUT