Human Generated Data

Title

Untitled (two men talking near skull display case)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4703
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men talking near skull display case)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.6
Apparel 99.6
Human 99.3
Person 99.3
Person 97.9
Clinic 95
Tie 93.6
Accessory 93.6
Accessories 93.6
Sunglasses 90.3
Person 89.8
Person 89.6
Shirt 87.7
Coat 87.1
Lab Coat 85
Sunglasses 74.5
Hospital 73.1
Dress Shirt 58.1
Scientist 56.3
Operating Theatre 56.2

Imagga
created on 2022-01-29

specialist 80.4
man 49.1
male 41.9
office 41
doctor 40.5
person 39.6
adult 34.1
people 34.1
coat 32.7
professional 31.3
hospital 30.5
business 30.4
nurse 30.1
clinic 29.6
desk 29.3
working 29.2
medical 29.2
happy 28.9
work 28.3
lab coat 28.1
businessman 27.4
mature 27
colleagues 26.3
computer 25.7
job 24.8
businesspeople 24.7
smiling 24.6
portrait 24.6
patient 24.2
occupation 23.9
casual 23.8
health 23.7
medicine 22.9
men 22.4
care 21.4
laptop 21
smile 20.7
indoor 20.1
looking 20
sitting 18.9
handsome 18.7
indoors 18.5
team 17.9
lifestyle 17.4
table 17.3
businesswoman 17.3
practitioner 17.1
meeting 17
senior 16.9
associates 16.7
face 16.4
elderly 16.3
color 16.2
bright 15.8
stethoscope 15.5
laboratory 15.5
attractive 15.4
home 15.2
happiness 14.9
surgeon 14.9
camera 14.8
coworkers 14.8
30s 14.5
uniform 14.4
horizontal 14.3
women 14.3
together 14
confident 13.7
busy 13.5
cheerful 13
suit 13
worker 12.9
corporate 12.9
20s 12.8
clinical 12.7
clothing 12.7
expertise 12.6
exam 12.5
profession 12.5
group 12.1
teamwork 12.1
day 11.8
human 11.3
modern 11.2
glasses 11.1
treatment 11
executive 11
doctors 10.8
physician 10.8
businessmen 10.7
40s 10.7
case 10.7
formal 10.5
workplace 10.5
illness 10.5
two 10.2
surgery 9.8
old 9.8
success 9.7
technology 9.7
mid adult 9.7
staff 9.6
sick person 9.6
talking 9.5
career 9.5
manager 9.3
successful 9.2
friendly 9.2
general practitioner 8.9
medic 8.8
good mood 8.8
consultant 8.8
lab 8.8
older 8.8
healing 8.8
light 8.7
using 8.7
females 8.5
notebook 8.5
student 8.5
holding 8.3
room 8.2
science 8
jacket 8
look 7.9
crew 7.9
30 35 years 7.9
heal 7.9
couple 7.9
visit 7.8
education 7.8
thirties 7.8
assistant 7.8
examination 7.8
cooperation 7.7
garment 7.7
1 7.7
writing 7.7
sit 7.6
alone 7.3
teacher 7.2

Google
created on 2022-01-29

Outerwear 95.2
Shirt 93.8
Motor vehicle 90.4
Sleeve 87.2
Coat 86.1
Hat 85.5
Gesture 85.3
Black-and-white 82.6
Automotive design 81.6
Eyewear 75.9
Font 73
Monochrome photography 72.2
Monochrome 71.4
Glass 71.2
Event 70.5
Service 68.1
Recreation 68
Vintage clothing 67.8
Art 66.5
Indoor games and sports 66.2

Microsoft
created on 2022-01-29

man 96.5
text 96.4
clothing 95.3
person 92.6
old 80.3
human face 69.4
posing 53.5

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 75.4%
Calm 99.3%
Sad 0.3%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 98%
Calm 92.2%
Surprised 3.9%
Happy 1.4%
Confused 1%
Sad 0.6%
Disgusted 0.5%
Angry 0.3%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 93.6%
Sunglasses 90.3%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 87.3%
an old photo of a man 87.2%
an old man standing in front of a mirror posing for the camera 84.8%

Text analysis

Amazon

NWW
NWW 30
FAIHO
30

Google

A
PAHO A NAGOX-YT3RA2-NAMTA3
NAGOX-YT3RA2-NAMTA3
PAHO