Human Generated Data

Title

Untitled (two men eating at a table with Heinz products)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4913

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men eating at a table with Heinz products)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tablecloth 99.8
Person 99.8
Human 99.8
Person 99.5
Home Decor 98.6
Furniture 97.1
Dining Table 95
Table 95
Tabletop 88.1
Food 82.6
Meal 82.6
Linen 77.6
Dish 77.3
People 75.3
Indoors 72.4
Dining Room 72.4
Room 72.4
Person 70.6
Apparel 69.1
Clothing 69.1
Glass 67.2
Photo 66.3
Photography 66.3
Portrait 66.3
Face 66.3
Bottle 60.4
Sleeve 58

Imagga
created on 2022-01-23

patient 56.8
man 54.5
person 52.5
lab coat 41.8
male 39.8
coat 39.1
professional 34.9
specialist 34.1
doctor 33
people 30.7
office 30.6
adult 30.1
medical 29.2
case 28.8
sick person 28.4
working 27.4
indoors 25.5
hospital 25.4
businessman 23.9
business 23.7
clinic 23.3
work 21.2
health 20.9
senior 20.7
sitting 20.7
desk 19.9
nurse 19.6
40s 19.5
occupation 19.3
medicine 18.5
colleagues 18.5
table 18.2
happy 18.2
smiling 18.1
men 18.1
team 18
mature 17.7
computer 17.7
home 17.6
elderly 17.3
talking 17.1
practitioner 17.1
meeting 17
care 16.5
laptop 16.4
businesswoman 16.4
worker 15.3
businesspeople 15.2
portrait 14.9
color 14.5
casual 14.4
room 14.3
job 14.2
garment 14
clothing 13.7
looking 13.6
illness 12.4
lifestyle 12.3
treatment 12
20s 11.9
discussing 11.8
horizontal 11.7
discussion 11.7
smile 11.4
together 11.4
face 11.4
group 11.3
teamwork 11.1
coworkers 10.8
forties 10.8
physician 10.8
to 10.6
30s 10.6
profession 10.5
education 10.4
health professional 10.4
day 10.2
camera 10.2
inside 10.1
pharmacist 10.1
suit 10.1
bright 10
associates 9.9
surgery 9.8
expertise 9.7
couple 9.6
exam 9.6
student 9.6
indoor 9.1
confident 9.1
old 9.1
teacher 9
surgeon 9
technology 8.9
70s 8.9
50s 8.8
diagnosis 8.8
middle aged 8.8
thirties 8.8
lab 8.8
retired 8.7
women 8.7
concentration 8.7
laboratory 8.7
retirement 8.7
happiness 8.6
uniform 8.6
grandfather 8.5
stethoscope 8.3
handsome 8
boardroom 7.9
business people 7.9
four people 7.9
doctors 7.9
appointment 7.9
scientist 7.8
consultant 7.8
two people 7.8
check 7.7
corporate 7.7
sick 7.7
mid adult 7.7
busy 7.7
attractive 7.7
four 7.7
notes 7.7
twenties 7.7
workplace 7.6
adults 7.6
sit 7.6
coffee 7.4
science 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

person 99.7
man 97.7
indoor 96
wall 95.7
clothing 93.6
text 87.8
human face 75.7
preparing 53.8
black and white 50.2
cooking 22.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 93.5%
Disgusted 65.2%
Calm 11.4%
Angry 7.2%
Sad 5.4%
Fear 4.3%
Surprised 3.4%
Happy 1.7%
Confused 1.4%

AWS Rekognition

Age 25-35
Gender Female, 68%
Happy 66.7%
Calm 24.6%
Surprised 6.2%
Sad 1%
Fear 0.8%
Disgusted 0.4%
Angry 0.2%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people standing in a kitchen 81.7%
a group of people standing in a kitchen preparing food 76.5%
a group of people preparing food in a kitchen 76.4%

Text analysis

Amazon

SAUCE
CHILI
119315.
es
NHEINZ
one

Google

HEINZ
HEINZ CHILI SAUCE T9315.
T9315.
CHILI
SAUCE