Human Generated Data

Title

Untitled (Campbell Soup advertisement: couple getting into chauffeured car)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5296
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Campbell Soup advertisement: couple getting into chauffeured car)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.5
Person 99.5
Person 98.7
Person 95.1
Helmet 86.8
Apparel 86.8
Clothing 86.8
Face 67.2
People 60.1
Person 60
Chef 59.5
Art 57.6
Drawing 57.6
Sketch 56.2

Imagga
created on 2022-01-22

coat 66.3
lab coat 64.9
nurse 54.4
doctor 38.5
medical 36.2
hospital 31.5
medicine 30.8
people 29.6
professional 28.2
man 27.5
garment 27.4
adult 27.3
clinic 26
person 25.6
health 23.6
male 23.4
smile 22.8
work 22.8
clothing 21.5
care 21.4
attractive 18.2
happy 18.2
smiling 17.4
uniform 17.2
specialist 17
worker 17
office 16.9
portrait 16.2
job 15.9
patient 15.5
surgery 14.6
team 14.3
business 14
occupation 13.7
clinical 13.7
assistant 13.6
doctors 12.8
laboratory 12.5
working 12.4
stethoscope 12.1
casual 11.9
indoors 11.4
businesspeople 11.4
pretty 11.2
looking 11.2
happiness 11
indoor 11
confident 10.9
businesswoman 10.9
student 10.9
businessman 10.6
men 10.3
women 10.3
room 10.1
holding 9.9
consultant 9.7
technology 9.6
surgeon 9.6
profession 9.6
illness 9.5
equipment 9.5
lifestyle 9.4
two 9.3
glasses 9.3
treatment 9.2
20s 9.2
human 9
trench coat 9
science 8.9
home 8.8
lab 8.7
colleagues 8.7
brunette 8.7
day 8.6
exam 8.6
corporate 8.6
bright 8.6
face 8.5
one 8.2
snow 8.2
computer 8
general practitioner 7.9
corridor 7.9
heal 7.8
table 7.8
expertise 7.8
chemical 7.7
modern 7.7
winter 7.7
staff 7.6
research 7.6
teamwork 7.4
focus 7.4
friendly 7.3
cheerful 7.3
practitioner 7.3
girls 7.3
raincoat 7.2
hair 7.1
instrument 7.1
to 7.1

Google
created on 2022-01-22

Sleeve 87.1
Coat 86.5
Hat 79.2
Classic 70.8
Event 69.8
Nurse 69.5
Art 65.8
Vintage clothing 65.7
Monochrome 64.2
Service 63.1
Stock photography 62.7
Health care provider 61
Monochrome photography 58.3
Nurse uniform 57.2
Uniform 56.6
History 56.4
Vehicle 55.9
Motor vehicle 55.7
Trench coat 51.3
Room 51

Microsoft
created on 2022-01-22

sketch 98.7
drawing 98
person 90.9
text 87.9
black and white 83.9
standing 79.2
white goods 78.6
appliance 68.9
clothing 67.4
child art 63.4
old 52.6

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 68.2%
Calm 99.5%
Surprised 0.2%
Happy 0.1%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 87.2%
Calm 86.6%
Angry 10.4%
Fear 1.2%
Happy 0.7%
Sad 0.6%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Helmet 86.8%

Captions

Microsoft

a group of people standing on top of a refrigerator 70.4%
a group of people standing in front of a refrigerator 70.3%
a group of people standing next to a refrigerator 70.2%

Text analysis

Amazon

5890
YT33A2
36A8 YT33A2 A3CH3330
36A8
A3CH3330

Google

5890 EAB YT3RA2 A30H330
5890
YT3RA2
A30H330
EAB