Human Generated Data

Title

Untitled (three men in front of glass case holding skulls)

Date

c. 1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4772

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three men in front of glass case holding skulls)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 98.3
Human 98.3
Person 98.2
Person 98.1
Person 89.9
Clothing 87.9
Apparel 87.9
Crowd 63.1
Text 62
Drawing 58.2
Art 58.2

Imagga
created on 2022-01-29

office 46.9
professional 46.9
business 43.8
laptop 43.2
computer 41.8
work 41.7
adult 40.1
businessman 39.8
people 39.7
job 39
man 38.4
person 37.2
businesspeople 37
corporate 36.1
male 35.5
businesswoman 34.6
working 32.7
desk 32.2
happy 31.4
portrait 28.5
smiling 27.5
looking 26.4
executive 26.1
worker 25.2
table 24.3
smile 22.8
face 22.8
team 22.4
indoor 21.9
confident 21.9
attractive 21
sitting 20.6
occupation 20.2
success 20.1
meeting 19.8
doctor 19.8
handsome 19.6
colleagues 19.5
coat 19.3
suit 19.3
modern 18.9
hospital 18.8
successful 18.3
women 18.2
casual 17.8
mature 17.7
medicine 17.6
notebook 17.2
men 17.2
lifestyle 16.6
lab coat 16.2
career 16.1
medical 15.9
manager 15.8
indoors 15.8
teamwork 15.8
employee 15.7
technology 15.6
student 15.5
group 15.3
workplace 15.3
communication 15.1
together 14.9
pretty 14.7
secretary 14.6
clinic 14.5
formal 14.3
care 14
company 14
corporation 13.5
horizontal 13.4
specialist 13.1
bright 12.9
alone 12.8
expertise 12.6
cheerful 12.2
monitor 12.2
human 12
room 12
associates 11.8
color 11.7
hand 11.7
clothing 11.4
health 11.1
happiness 11
groom 10.9
discussing 10.8
businessperson 10.7
consultant 10.7
1 10.6
laboratory 10.6
busy 10.6
elderly 10.5
boss 10.5
20s 10.1
friendly 10.1
coworkers 9.8
businessmen 9.8
lady 9.8
employment 9.7
collar 9.6
staff 9.6
education 9.5
uniform 9.5
talking 9.5
smart 9.4
one person 9.4
day 9.4
jacket 9.4
senior 9.4
partner 8.7
30s 8.7
profession 8.6
only 8.6
two 8.5
contemporary 8.5
patient 8.4
black 8.4
shirt 8.4
glasses 8.3
inside 8.3
science 8
doctors 7.9
attire 7.9
25 30 years 7.8
hands 7.8
clinical 7.8
stethoscope 7.8
lab 7.8
assistant 7.8
older 7.8
leader 7.7
leadership 7.7
expression 7.7
exam 7.7
confidence 7.7
ethnic 7.6
writing 7.5
keyboard 7.5
one 7.5
holding 7.4
camera 7.4
light 7.4
home 7.2
hair 7.1
nurse 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 99.4
person 94.6
clothing 94
man 90.5
human face 88.3
poster 76.8
old 54.6
posing 49.8

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 81.5%
Calm 95.3%
Happy 2.4%
Surprised 0.8%
Confused 0.5%
Disgusted 0.4%
Fear 0.3%
Sad 0.2%
Angry 0.1%

AWS Rekognition

Age 49-57
Gender Male, 99.5%
Sad 57.3%
Confused 15.4%
Calm 15.3%
Happy 5.7%
Fear 2%
Angry 1.5%
Surprised 1.4%
Disgusted 1.3%

AWS Rekognition

Age 48-54
Gender Male, 99.7%
Disgusted 26.8%
Calm 23.8%
Surprised 20.7%
Angry 10.6%
Confused 6.5%
Happy 6.2%
Sad 3.3%
Fear 2.1%

AWS Rekognition

Age 50-58
Gender Female, 79%
Sad 45.2%
Calm 28%
Confused 17.4%
Surprised 3.9%
Happy 1.8%
Angry 1.7%
Disgusted 1.1%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a vintage photo of a person 90%
a vintage photo of a person holding a sign 74.8%
a vintage photo of a group of people posing for the camera 74.7%

Text analysis

Amazon

AF
SOUTH AF
SOUTH

Google

SOUTH AF
AF
SOUTH