Human Generated Data

Title

Untitled (waitress behind counter in a diner with Heinz products)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4892
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress behind counter in a diner with Heinz products)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.8
Person 99.7
Person 99.6
Person 98.8
Restaurant 89.4
Shop 84.4
Meal 76.7
Food 76.7
Cafeteria 73.2
Room 69.2
Indoors 69.2
People 67.3
Person 63.3
Clothing 61.6
Apparel 61.6
Cafe 60.6
Workshop 59.1
Furniture 59
Bakery 57.2
Advertisement 55.5

Imagga
created on 2022-01-23

man 36.3
people 34.6
male 33.3
business 32.2
office 31.4
businessman 30
indoors 29.9
person 27.8
shop 27.6
adult 26.5
meeting 26.4
restaurant 26.1
room 24.6
businesswoman 24.5
businesspeople 23.7
table 22.8
group 22.6
work 22.1
professional 22
sitting 21.5
corporate 20.6
desk 20.2
indoor 20.1
men 19.8
team 19.7
job 18.6
computer 18.4
mercantile establishment 18.2
happy 18.2
casual 17.8
colleagues 17.5
building 16.9
executive 16.2
working 15.9
clinic 15.7
cafeteria 15.7
smiling 15.2
together 14.9
teamwork 14.8
occupation 14.7
20s 14.7
lifestyle 14.5
horizontal 14.2
interior 14.2
patient 13.9
worker 13.6
color 13.4
barbershop 13.3
senior 13.1
manager 13
conference 12.7
discussion 12.7
women 12.7
suit 12.6
communication 12.6
holding 12.4
talking 12.4
hospital 12.3
education 12.1
bakery 12
inside 12
modern 11.9
place of business 11.9
chair 11.8
day 11.8
40s 11.7
portrait 11.7
hall 11.6
counter 11.5
cheerful 11.4
couple 11.3
looking 11.2
mature 11.2
laptop 10.9
smile 10.7
face 10.7
medical 10.6
four 10.5
classroom 10.5
home 10.4
coffee 10.2
board 10.1
confident 10
employee 9.9
associates 9.8
coworkers 9.8
success 9.7
corporation 9.6
doctor 9.4
clothing 9.3
structure 9.2
salon 9.2
technology 8.9
cooperation 8.7
mid adult 8.7
staff 8.6
career 8.5
clothes 8.4
attractive 8.4
presentation 8.4
company 8.4
bar 8.3
camera 8.3
handsome 8
discussing 7.9
25 30 years 7.8
two people 7.8
30s 7.7
sit 7.6
document 7.4
light 7.4
newspaper 7.2
bright 7.1
happiness 7.1

Google
created on 2022-01-23

Photograph 94.2
Black 89.6
Black-and-white 83.3
Chair 78.4
T-shirt 76.8
Art 75.5
Snapshot 74.3
Monochrome photography 73
Machine 72.9
Monochrome 72.6
Font 72.6
Desk 72.4
Job 68.2
Room 65.2
Stock photography 64.8
Publication 63.6
Table 61.2
History 60.2
Employment 59
Service 58.4

Microsoft
created on 2022-01-23

text 99.9
indoor 98.1
kitchen 95.3
person 93.3
clothing 91.8
drawing 67.5
preparing 65.2
man 60.6
woman 52
cooking 41.4
store 40.2
cluttered 12.7

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Female, 77%
Calm 79.9%
Surprised 10.3%
Happy 3.1%
Angry 2.4%
Disgusted 1.6%
Sad 1%
Confused 0.9%
Fear 0.8%

AWS Rekognition

Age 52-60
Gender Female, 77.6%
Calm 99.2%
Happy 0.4%
Surprised 0.2%
Disgusted 0.1%
Fear 0%
Sad 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 30-40
Gender Male, 72.4%
Calm 69.8%
Surprised 9.3%
Sad 8.8%
Happy 5.6%
Confused 2.3%
Disgusted 2.2%
Angry 1.1%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a man cooking in a kitchen preparing food 54.1%
a man preparing food in a kitchen 54%
a group of people preparing food in a kitchen 53.9%

Text analysis

Amazon

SOUPS
HEINZ
BEANS
COFFEE
RELISH COFFEE
RELISH
HEINZ BAKED BEANS
BAKED
CREAM
FRANKFURTERS
-
I
II I
II
BEAN
CREAM OLD PREMIUMEN BEAN
MINITS
CREATE - TOWAYO ENDOREN
H 16001
OLD
25g
H 16001.
II =
=
CREATE
PREMIUMEN
TOWAYO
ENDOREN

Google

FRAM H16001. HEINZ SOUPS c T coo MIE LA AKED BEANe RELISH H 16001.
FRAM
H16001.
HEINZ
SOUPS
c
T
coo
MIE
LA
AKED
BEANe
RELISH
H
16001.