Human Generated Data

Title

Untitled (two men standing next to large glass display case)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4818

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men standing next to large glass display case)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.9
Apparel 99.9
Person 99
Human 99
Person 98.7
Hat 98.3
Person 96.2
Suit 95.7
Coat 95.7
Overcoat 95.7
Person 93.7
Shirt 89.3
Accessories 82.4
Accessory 82.4
Tie 82.4
Sunglasses 76.6
Sleeve 76.5
Tuxedo 76.4
Text 69.1
People 56.5
Dress Shirt 55.5
Lab Coat 55.4
Steamer 55.1

Imagga
created on 2022-01-29

lab coat 87.6
coat 84
man 46.4
medical 43.3
doctor 42.3
garment 40.8
person 40
professional 36.6
male 36.2
people 34.6
specialist 32.4
medicine 31.7
hospital 30.1
adult 29.9
work 29.1
laboratory 28.9
looking 28.8
health 26.4
smiling 24.6
scientist 24.5
lab 24.3
chemistry 24.2
occupation 23.9
clothing 23.3
happy 23.2
businessman 23
science 22.2
care 22.2
research 21.9
portrait 21.4
working 21.2
office 20.9
student 20.8
business 20.7
job 20.4
clinic 20.1
uniform 20
bow tie 19.7
worker 19
biology 19
mature 18.6
necktie 18.4
chemical 18.1
men 18
senior 17.8
face 17.8
education 17.3
surgeon 17.1
nurse 16.7
scientific 16.5
patient 16.4
elderly 16.3
businesspeople 16.1
team 16.1
computer 16
indoors 15.8
smile 15.7
stethoscope 15.6
expertise 15.5
laptop 15.5
test 15.4
handsome 15.2
technology 14.9
chemist 14.8
indoor 14.6
sitting 14.6
human 14.3
desk 14.2
attractive 14
bright 13.6
modern 13.3
look 13.2
couple 13.1
serious 12.4
lifestyle 12.3
table 12.1
women 11.9
two 11.9
exam 11.5
profession 11.5
illness 11.4
corporate 11.2
color 11.1
glasses 11.1
casual 11
practitioner 11
examining 10.8
holding 10.7
experiment 10.7
assistant 10.7
colleagues 10.7
busy 10.6
together 10.5
home 10.4
teamwork 10.2
20s 10.1
biotechnology 9.8
technician 9.8
equipment 9.8
old 9.8
examination 9.7
corporation 9.7
suit 9.6
development 9.5
tie 9.5
successful 9.2
hand 9.1
microscope 8.9
standing 8.7
tube 8.7
instrument 8.5
horizontal 8.4
treatment 8.3
businesswoman 8.2
cheerful 8.1
group 8.1
microbiology 7.9
associates 7.9
doctors 7.9
day 7.9
happiness 7.8
businessmen 7.8
older 7.8
pharmacy 7.8
concentration 7.7
using 7.7
notebook 7.5
shirt 7.5
study 7.5
camera 7.4
light 7.4
confident 7.3
success 7.2

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

wall 98.4
hat 97.4
fashion accessory 97.2
human face 94.5
clothing 92.9
man 91.3
black and white 90.7
person 89.5
smile 84.7
fedora 83.8
text 83.2
old 69.2
glasses 66.4
cowboy hat 63.8
sun hat 51.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Female, 81.3%
Happy 96.8%
Calm 1.6%
Disgusted 0.4%
Sad 0.4%
Confused 0.2%
Angry 0.2%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 51-59
Gender Male, 69.9%
Calm 98.4%
Confused 0.4%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%
Happy 0.2%
Sad 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Hat 98.3%
Tie 82.4%
Sunglasses 76.6%

Captions

Microsoft

an old photo of a person 90%
a group of people standing in front of a mirror posing for the camera 71.8%
a group of people standing in front of a mirror 71.7%

Text analysis

Amazon

evas
ELENDEM SALEJA evas
ELENDEM
SALEJA
+7
.the