Human Generated Data

Title

Untitled (men near glass case looking at skull)
Date

c. 1936
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4773
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men near glass case looking at skull)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.1
Human 99.1
Person 97.2
Person 96.9
Person 96.7
Person 95.8
Clothing 92.9
Apparel 92.9
Helmet 92.9
Face 87.8
Accessories 72.9
Accessory 72.9
Sunglasses 72.9
Shop 66
Suit 61.1
Coat 61.1
Overcoat 61.1
Mirror 60.5
Beard 56.3
Electronics 55.4
Screen 55.4

Imagga
created on 2022-01-29

television 55.7
office 50
computer 49.5
laptop 44.1
business 40.7
professional 39.1
work 38.5
man 36.3
adult 35.1
monitor 34.6
desk 33.1
job 31.9
businesswoman 31.8
corporate 31.8
businessman 31.8
people 31.2
working 30.9
executive 28.7
male 27.7
businesspeople 27.5
happy 26.9
person 26.7
sitting 25.8
telecommunication system 23.9
worker 23.4
broadcasting 22.3
portrait 21.4
smile 20.7
smiling 20.3
technology 20
confident 19.1
modern 18.9
success 18.5
communication 18.5
equipment 18.4
looking 18.4
meeting 17.9
table 17.3
notebook 16.8
electronic equipment 16.6
doctor 16
telecommunication 15.9
successful 15.6
hospital 15.3
team 15.2
medical 15
manager 14.9
attractive 14.7
indoor 14.6
men 14.6
handsome 14.3
case 14.2
indoors 14.1
occupation 13.8
group 13.7
formal 13.4
pretty 13.3
smart 13.2
screen 13.1
teamwork 13
employee 12.9
room 12.9
friendly 12.8
face 12.8
women 12.7
colleagues 12.6
specialist 12.6
suit 12.6
health 12.5
workplace 12.4
medicine 12.3
keyboard 12.2
casual 11.9
clinic 11.8
talking 11.4
liquid crystal display 11.3
education 11.3
mature 11.2
expression 11.1
coat 10.7
stethoscope 10.6
medium 10.6
career 10.4
company 10.2
lifestyle 10.1
light-emitting diode 10.1
color 10
bright 10
student 10
care 9.9
secretary 9.5
senior 9.4
two 9.3
finance 9.3
window 9.2
20s 9.2
alone 9.1
one 9
cheerful 8.9
lady 8.9
associates 8.8
businessperson 8.8
partners 8.7
expertise 8.7
staff 8.7
corporation 8.7
happiness 8.6
boss 8.6
contemporary 8.5
black 8.4
hand 8.4
building 8.1
diode 8.1
couple 7.8
consultant 7.8
cooperation 7.7
patient 7.7
collar 7.7
telephone 7.6
serious 7.6
ethnic 7.6
nurse 7.6
shirt 7.5
clothing 7.4
document 7.4
hair 7.1
interior 7.1
day 7.1
together 7

Google
created on 2022-01-29

Automotive design 87.7
Gesture 85.3
Font 82.8
Television set 82.3
Black-and-white 82.1
Motor vehicle 79.5
Display device 76.3
Technology 74.4
Electronic device 74
Picture frame 73.9
Rectangle 73.7
Multimedia 72
Gadget 71.9
Monochrome photography 69.4
Personal luxury car 68.6
Room 67.7
Family car 67.1
Monochrome 66.9
White-collar worker 66.6
Output device 66.6

Microsoft
created on 2022-01-29

text 98.9
window 94.6
black and white 90.6
clothing 61.3
person 61.1
man 58.3
picture frame 15.5

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Female, 87.9%
Calm 99.2%
Sad 0.6%
Surprised 0.1%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 56-64
Gender Male, 99.7%
Calm 97.4%
Disgusted 0.7%
Confused 0.7%
Surprised 0.6%
Happy 0.3%
Angry 0.2%
Sad 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Female, 61.6%
Calm 81%
Sad 14%
Happy 3%
Angry 0.6%
Fear 0.5%
Confused 0.4%
Disgusted 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Helmet 92.9%
Sunglasses 72.9%

Captions

Microsoft

a man standing in front of a window 90.3%
a man that is standing in front of a window 87.7%
a man standing next to a window 86.8%

Text analysis

Amazon

SOUTH

Google

SOUTH
SOUTH