Human Generated Data

Title

Untitled (two men eating at a table with Heinz products)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4913
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men eating at a table with Heinz products)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Tablecloth 99.8
Person 99.8
Human 99.8
Person 99.5
Home Decor 98.6
Furniture 97.1
Dining Table 95
Table 95
Tabletop 88.1
Meal 82.6
Food 82.6
Linen 77.6
Dish 77.3
People 75.3
Dining Room 72.4
Room 72.4
Indoors 72.4
Person 70.6
Clothing 69.1
Apparel 69.1
Glass 67.2
Portrait 66.3
Photography 66.3
Face 66.3
Photo 66.3
Bottle 60.4
Sleeve 58

Imagga
created on 2022-01-23

patient 56.8
man 54.5
person 52.5
lab coat 41.8
male 39.8
coat 39.1
professional 34.9
specialist 34.1
doctor 33
people 30.7
office 30.6
adult 30.1
medical 29.2
case 28.8
sick person 28.4
working 27.4
indoors 25.5
hospital 25.4
businessman 23.9
business 23.7
clinic 23.3
work 21.2
health 20.9
senior 20.7
sitting 20.7
desk 19.9
nurse 19.6
40s 19.5
occupation 19.3
medicine 18.5
colleagues 18.5
table 18.2
happy 18.2
smiling 18.1
men 18.1
team 18
mature 17.7
computer 17.7
home 17.6
elderly 17.3
talking 17.1
practitioner 17.1
meeting 17
care 16.5
laptop 16.4
businesswoman 16.4
worker 15.3
businesspeople 15.2
portrait 14.9
color 14.5
casual 14.4
room 14.3
job 14.2
garment 14
clothing 13.7
looking 13.6
illness 12.4
lifestyle 12.3
treatment 12
20s 11.9
discussing 11.8
horizontal 11.7
discussion 11.7
smile 11.4
together 11.4
face 11.4
group 11.3
teamwork 11.1
coworkers 10.8
forties 10.8
physician 10.8
to 10.6
30s 10.6
profession 10.5
education 10.4
health professional 10.4
day 10.2
camera 10.2
inside 10.1
pharmacist 10.1
suit 10.1
bright 10
associates 9.9
surgery 9.8
expertise 9.7
couple 9.6
exam 9.6
student 9.6
indoor 9.1
confident 9.1
old 9.1
teacher 9
surgeon 9
technology 8.9
70s 8.9
50s 8.8
diagnosis 8.8
middle aged 8.8
thirties 8.8
lab 8.8
retired 8.7
women 8.7
concentration 8.7
laboratory 8.7
retirement 8.7
happiness 8.6
uniform 8.6
grandfather 8.5
stethoscope 8.3
handsome 8
boardroom 7.9
business people 7.9
four people 7.9
doctors 7.9
appointment 7.9
scientist 7.8
consultant 7.8
two people 7.8
check 7.7
corporate 7.7
sick 7.7
mid adult 7.7
busy 7.7
attractive 7.7
four 7.7
notes 7.7
twenties 7.7
workplace 7.6
adults 7.6
sit 7.6
coffee 7.4
science 7.1

Google
created on 2022-01-23

Outerwear 95.3
Table 92.7
Black 89.7
Tablecloth 77.2
Hat 76.3
Snapshot 74.3
Monochrome photography 73.3
Service 72.8
Desk 71.3
Event 71.1
Monochrome 68.3
Cooking 66.1
Writing desk 65.6
Stock photography 64
Sitting 62.6
Vintage clothing 61.4
History 60.9
Room 60.6
Linens 56
Rectangle 55

Microsoft
created on 2022-01-23

person 99.7
man 97.7
indoor 96
wall 95.7
clothing 93.6
text 87.8
human face 75.7
preparing 53.8
black and white 50.2
cooking 22.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 93.5%
Disgusted 65.2%
Calm 11.4%
Angry 7.2%
Sad 5.4%
Fear 4.3%
Surprised 3.4%
Happy 1.7%
Confused 1.4%

AWS Rekognition

Age 25-35
Gender Female, 68%
Happy 66.7%
Calm 24.6%
Surprised 6.2%
Sad 1%
Fear 0.8%
Disgusted 0.4%
Angry 0.2%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people standing in a kitchen 81.7%
a group of people standing in a kitchen preparing food 76.5%
a group of people preparing food in a kitchen 76.4%

Text analysis

Amazon

SAUCE
CHILI
119315.
es
NHEINZ
one

Google

HEINZ CHILI SAUCE T9315.
HEINZ
CHILI
SAUCE
T9315.