Human Generated Data

Title

Untitled (four men in suits talking, drinking and smoking)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4695

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four men in suits talking, drinking and smoking)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.3
Human 99.3
Person 98.4
Person 97.9
Person 94.5
Apparel 84.9
Clothing 84.9
Clinic 81.6
Coat 73.5
Scientist 73.2
Doctor 62.5
People 61.5
Face 60.5
Lab 56.6
Tie 56.1
Accessory 56.1
Accessories 56.1
Lab Coat 55.2

Imagga
created on 2022-01-29

doctor 58.3
lab coat 58.2
coat 54.8
man 49.8
medical 48.6
person 48.4
professional 43.5
hospital 41.7
clinic 39.6
medicine 37
male 36.9
health 36.9
patient 36.8
people 35.7
job 31.9
office 30.6
care 29.7
occupation 29.4
adult 28.5
happy 27.6
work 26.7
working 26.5
nurse 26
team 26
business 25.5
businessman 24.7
mature 24.2
stethoscope 24
smiling 23.9
specialist 23.2
looking 21.6
teamwork 21.3
laboratory 21.2
worker 20.1
surgeon 19.8
practitioner 19.2
elderly 19.2
uniform 19
men 18.9
portrait 18.8
senior 18.8
indoors 18.5
garment 18.3
smile 17.8
clinical 17.6
colleagues 17.5
businesspeople 17.1
doctors 16.7
bright 16.5
corporate 16.3
desk 16.1
clothing 15.6
indoor 15.5
confident 15.5
profession 15.3
computer 15.2
sick person 15.2
handsome 15.2
case 15
treatment 14.7
successful 14.7
physician 14.7
busy 14.5
lifestyle 14.5
technology 14.1
associates 13.8
group 13.7
secretary 13.7
laptop 13.7
businesswoman 13.6
casual 13.6
illness 13.4
table 13
face 12.8
surgery 12.7
40s 12.7
day 12.6
mid adult 12.6
30s 12.5
color 12.2
human 12
executive 11.6
science 11.6
holding 11.6
test 11.6
research 11.4
talking 11.4
look 11.4
meeting 11.3
sitting 11.2
camera 11.1
golfer 10.9
student 10.9
general practitioner 10.9
entrepreneur 10.8
coworkers 10.8
suit 10.8
lab 10.7
expertise 10.7
practice 10.7
exam 10.5
attractive 10.5
workplace 10.5
success 10.5
women 10.3
glasses 10.2
modern 9.8
examining 9.8
old 9.8
consultant 9.8
assistant 9.7
education 9.5
healing 9.4
happiness 9.4
two 9.3
chemical 9.2
lady 8.9
chemist 8.9
30 35 years 8.8
heal 8.8
scientist 8.8
diagnosis 8.8
businessmen 8.8
examination 8.8
couple 8.7
light 8.7
instrument 8.7
staff 8.6
player 8.5
horizontal 8.4
20s 8.3
room 8.2
good mood 7.8
medic 7.8
visit 7.8
health care 7.8
scientific 7.8
chemistry 7.7
corporation 7.7
partnership 7.7
biology 7.6
life 7.6
equipment 7.4
home 7.2
together 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

person 96.3
text 95.8
clothing 92.6
man 90.5
human face 85.3
black and white 77.6
old 74.1
smile 63.1
drawing 54.9
glasses 53.2

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Sad 33.7%
Calm 31.5%
Angry 17%
Confused 9.2%
Disgusted 3%
Happy 2.4%
Surprised 1.9%
Fear 1.2%

AWS Rekognition

Age 50-58
Gender Male, 75.1%
Happy 39.3%
Calm 29%
Angry 12.1%
Surprised 6%
Sad 5.4%
Confused 3.7%
Disgusted 2.4%
Fear 2.1%

AWS Rekognition

Age 52-60
Gender Male, 97.1%
Calm 73%
Confused 17.7%
Surprised 5.3%
Sad 1.8%
Angry 0.9%
Disgusted 0.8%
Happy 0.4%
Fear 0.2%

AWS Rekognition

Age 54-62
Gender Male, 100%
Sad 47.9%
Confused 41.8%
Calm 6.4%
Surprised 0.9%
Happy 0.9%
Fear 0.8%
Disgusted 0.7%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 56.1%

Captions

Microsoft

an old photo of a man 91.4%
old photo of a man 90.8%
an old photo of a group of people in a room 90.7%

Text analysis

Amazon

بت
EI
COAD
COAD YTORAS
YTORAS
..."

Google

13
13