Human Generated Data

Title

Untitled (waiter serving baked beans to customers at counter of Heinz restaurant)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11963

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waiter serving baked beans to customers at counter of Heinz restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11963

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Person 98.9
Person 98.3
Person 98.1
Shop 62.5
Clinic 59.5
Lab 58
Interior Design 56.6
Indoors 56.6
Restaurant 56.2

Clarifai
created on 2023-10-26

people 99.9
monochrome 99.6
group 98.2
adult 98.2
man 98
street 94.4
woman 91.4
many 89.8
group together 86.9
wear 84.9
veil 84.1
commerce 83.5
two 82.1
merchant 81.7
stock 81.2
barber 80.2
war 79.8
several 79.4
three 77
child 75.2

Imagga
created on 2022-01-15

barbershop 92.7
shop 88.8
mercantile establishment 61.3
place of business 40.8
man 34.9
people 34.6
counter 32.6
medical 27.4
clinic 26.4
work 25.1
professional 24.2
male 23.4
person 23.4
doctor 22.6
establishment 20.2
occupation 18.3
restaurant 18.1
adult 17.8
medicine 17.6
indoors 17.6
business 17
hospital 16.9
happy 16.3
job 15.9
patient 15.7
salon 15.6
men 15.5
laboratory 15.4
sitting 14.6
lab 14.6
working 14.1
health 13.9
scientist 13.7
worker 13.4
research 13.3
office 13.3
smiling 13
room 11.8
coat 11.7
chemistry 11.6
science 11.6
smile 11.4
biology 11.4
senior 11.2
technology 11.1
portrait 11
student 10.9
to 10.6
profession 10.5
customer 10.5
computer 10.4
service 10.2
two 10.2
lifestyle 10.1
care 9.9
team 9.9
assistant 9.7
test 9.6
looking 9.6
illness 9.5
table 9.5
education 9.5
college 9.5
20s 9.2
confident 9.1
color 8.9
pharmacist 8.9
experiment 8.8
standing 8.7
chemical 8.7
exam 8.6
serious 8.6
retail 8.5
store 8.5
casual 8.5
black 8.4
study 8.4
horizontal 8.4
chair 8.4
inside 8.3
holding 8.3
group 8.1
women 7.9
nurse 7.8
scientific 7.7
check 7.7
using 7.7
old 7.7
style 7.4
equipment 7.3
indoor 7.3
board 7.2
surgeon 7
modern 7
look 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.7
clothing 90.8
person 87.5
man 76.5
woman 75.3
black and white 52.5
store 40
cooking 29.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Female, 58.2%
Calm 89.5%
Surprised 9.1%
Sad 0.9%
Angry 0.3%
Confused 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 23-33
Gender Female, 99.3%
Calm 42.6%
Happy 18.8%
Angry 12.5%
Surprised 11.5%
Sad 7.9%
Confused 3.3%
Disgusted 2%
Fear 1.3%

AWS Rekognition

Age 51-59
Gender Female, 60.3%
Happy 99.7%
Calm 0.2%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Captions

Microsoft
created on 2022-01-15

text 40.2%

Text analysis

Amazon

COLD
ICE COLD
ICE
FOR
15794
PEP
Chocolate
SOUPS
Coca-Cola
BEANS
CREAM
BAKED
15794.
Malted
AND
HEANZ
...
PEP PEP
DRINK
5
-
Chocolate Malted MIL
PEP F. PEP PER
- CREAM
FOR GET WE AND 60
PER
SHARPLESS
المبكمة SOUPS
and
Borden's
moto creatures and Borden's
GET WE
60
SQ
MIL
creatures
F.
المبكمة
moto
HOCCMIN
REAL
TOKO
Kalling

Google

15794. CocaCola CocaCola Coca-Cola P PEP PEP Chocolate Maled IEINZ SOURS PEP CHEAM ICE COLD BAKED BEAND 15794. 15794.
15794.
CocaCola
Coca-Cola
P
PEP
Chocolate
Maled
IEINZ
SOURS
CHEAM
ICE
COLD
BAKED
BEAND