Human Generated Data

Title

Untitled (man with hands on glass display case)

Date

c. 1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4771

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with hands on glass display case)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Accessories 99.2
Tie 99.2
Accessory 99.2
Clothing 98.6
Apparel 98.6
Human 98.3
Person 98.3
Person 98.1
Person 97.8
Tie 97.8
Person 96.6
Clinic 92
Person 87.8
Hospital 83.7
Coat 80
Person 78.6
Sleeve 73.5
Lab Coat 61.6
Operating Theatre 59.7
Scientist 58.6
Lab 56.2
Shirt 55.3

Imagga
created on 2022-01-29

lab coat 51.3
coat 49.1
man 47.8
doctor 42.3
male 39.8
professional 37.6
person 36.4
people 35.7
adult 35
specialist 34.9
medical 33.6
hospital 31.1
mature 29.8
office 29.7
clinic 29.2
looking 28
business 28
businessman 27.4
happy 26.3
indoors 25.5
health 25
medicine 24.7
job 23.9
smiling 23.9
portrait 23.3
men 23.2
nurse 23.1
care 23.1
elderly 22
occupation 22
indoor 21.9
desk 21.7
colleagues 21.4
casual 21.2
team 20.6
camera 20.3
clothing 19.9
senior 19.7
work 19.6
lifestyle 19.5
businesspeople 19
working 18.6
clinical 18.6
color 17.8
face 17.8
computer 17.6
table 17.3
practitioner 16.7
patient 16.7
executive 16.5
bright 16.5
garment 16.4
handsome 16.1
home 16
horizontal 15.9
associates 15.8
doctors 15.7
day 15.7
smile 15.7
sitting 15.5
groom 15.4
meeting 15.1
happiness 14.9
teamwork 14.8
coworkers 14.7
20s 14.7
laptop 14.6
group 14.5
uniform 14.4
attractive 14
stethoscope 13.9
corporate 13.8
confident 13.7
consultant 13.6
businesswoman 13.6
suit 13.6
expertise 13.6
glasses 13
treatment 12.9
heal 12.8
old 12.6
30s 12.5
together 12.3
look 12.3
healing 12.3
worker 12.3
cheerful 12.2
general practitioner 11.9
good mood 11.8
60s 11.7
older 11.7
busy 11.6
couple 11.3
surgeon 11.2
modern 11.2
clinician 10.9
gray hair 10.8
40s 10.7
cooperation 10.6
mid adult 10.6
profession 10.5
human 10.5
women 10.3
room 10
expert 9.9
discussing 9.8
examining 9.8
baron 9.8
businessmen 9.8
discussion 9.7
examination 9.7
assistant 9.7
laboratory 9.6
exam 9.6
successful 9.2
crew 8.9
success 8.9
50s 8.8
medication 8.8
surgery 8.8
physician 8.8
daylight 8.7
staff 8.6
talking 8.6
manager 8.4
aged 8.2
light 8
fifties 7.9
brunette 7.8
eye contact 7.8
2 7.8
1 7.7
two 7.6
tie 7.6
career 7.6
one person 7.5
science 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

person 99
clothing 94.5
man 92.5
wedding 92.4
indoor 88.5
human face 87.9
text 86.2
standing 83.1
smile 81.7
wedding dress 62.1
preparing 44.9
posing 38.6

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 92.9%
Happy 97.6%
Surprised 1.9%
Angry 0.1%
Calm 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 0%

AWS Rekognition

Age 47-53
Gender Male, 99.1%
Sad 82.5%
Happy 5.8%
Confused 5.5%
Fear 1.8%
Surprised 1.6%
Disgusted 1.2%
Calm 0.9%
Angry 0.8%

AWS Rekognition

Age 51-59
Gender Male, 75.9%
Calm 80.3%
Happy 10.7%
Angry 2.3%
Confused 2.2%
Disgusted 1.9%
Sad 1.2%
Surprised 0.7%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 89.8%
Calm 32.9%
Confused 28%
Sad 20.1%
Happy 9.1%
Surprised 3.3%
Disgusted 3.3%
Angry 1.8%
Fear 1.6%

AWS Rekognition

Age 34-42
Gender Male, 94.3%
Calm 97.3%
Sad 1.5%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Tie 99.2%
Person 98.3%

Captions

Microsoft

a group of people posing for a photo 90.5%
a group of people standing in front of a window 83.8%
a person standing in front of a group of people posing for a photo 80%

Text analysis

Amazon

YY33A2
2008 YY33A2 830N333
2008
PE
830N333