Human Generated Data

Title

Untitled (two men talking near glass case)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4707

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men talking near glass case)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.3
Apparel 99.3
Person 98.4
Human 98.4
Person 98.4
Person 97.6
Shirt 87.8
Lab Coat 82.8
Coat 82.8
Person 81.9
Scientist 78.7
Glass 69.4
Chef 68.6
Dress Shirt 60.8
Lab 57

Imagga
created on 2022-01-29

man 41.7
people 36.3
adult 35.7
office 35.6
male 35.5
professional 34.4
work 33
person 32.3
computer 31.5
businessman 30.9
working 30.1
laptop 29.9
business 29.8
coat 28.3
businesspeople 25.6
lab coat 25
job 24.8
desk 24.6
doctor 24.4
happy 24.4
smiling 23.9
colleagues 23.3
sitting 23.2
looking 23.2
businesswoman 22.7
worker 22.4
medical 22.1
team 21.5
casual 21.2
indoors 20.2
portrait 19.4
technology 19.3
indoor 19.2
corporate 18.9
teamwork 18.5
mature 17.7
men 17.2
clinic 17
group 16.9
medicine 16.7
associates 16.7
laboratory 16.4
hospital 16.3
modern 16.1
health 16
executive 15.7
smile 15.7
student 15.6
face 15.6
education 15.6
lifestyle 15.2
meeting 15.1
cheerful 14.6
lab 14.6
bright 14.3
women 14.2
nurse 14.1
senior 14.1
together 14
attractive 14
manager 14
successful 13.7
handsome 13.4
science 13.3
care 13.2
table 13
coworkers 12.8
suit 12.6
patient 12.2
success 12.1
human 12
occupation 11.9
day 11.8
scientist 11.8
color 11.7
case 11.7
groom 11.5
workplace 11.4
research 11.4
chemical 11.4
specialist 11.2
confident 10.9
consultant 10.7
assistant 10.7
expertise 10.7
scientific 10.7
hand 10.6
mid adult 10.6
test 10.6
elderly 10.5
couple 10.5
biology 10.4
happiness 10.2
20s 10.1
notebook 9.9
room 9.8
chemistry 9.7
30s 9.6
home 9.6
clothing 9.5
talking 9.5
keyboard 9.4
glasses 9.3
horizontal 9.2
clipboard 9.2
friendly 9.2
alone 9.1
holding 9.1
old 9.1
secretary 9.1
equipment 8.9
chemist 8.9
conference 8.8
colleague 8.8
businessmen 8.8
40s 8.8
two people 8.8
light 8.7
busy 8.7
communication 8.4
focus 8.3
microscope 8
crew 7.9
doctors 7.9
good mood 7.8
clinical 7.8
concentration 7.7
pretty 7.7
expression 7.7
writing 7.7
serious 7.6
instrument 7.6
females 7.6
smart 7.5
monitor 7.2
look 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 99.3
person 93.3
clothing 91.1
human face 76.5
black and white 68.5
man 68.1

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Female, 77.2%
Calm 35.7%
Surprised 23.2%
Sad 20.2%
Fear 12.3%
Confused 2.5%
Disgusted 2.3%
Angry 2%
Happy 1.8%

AWS Rekognition

Age 19-27
Gender Female, 84.7%
Calm 89.6%
Happy 3.4%
Disgusted 3.3%
Fear 2.1%
Angry 0.6%
Surprised 0.4%
Sad 0.4%
Confused 0.2%

AWS Rekognition

Age 51-59
Gender Male, 91.6%
Calm 43.8%
Surprised 25.7%
Angry 19%
Disgusted 3.7%
Sad 3.7%
Confused 1.5%
Happy 1.3%
Fear 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%

Captions

Microsoft

a man standing in front of a window 60.6%
a man and a woman standing in front of a window 35.5%
a man standing next to a window 35.4%

Text analysis

Amazon

SOUT
of

Google

SOUT
SOUT