Human Generated Data

Title

Untitled (men in suits and hats gathered around table)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4930
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men in suits and hats gathered around table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.3
Person 99.3
Person 99.3
Person 99.2
Person 98.9
Person 98.8
Scientist 93.8
Lab 93.1
Apparel 83.9
Clothing 83.9
Coat 75.3
Crowd 68.1
Lab Coat 67.4
Hat 66.4
Chef 55.5

Imagga
created on 2022-01-23

man 42.3
male 36.9
nurse 35.4
people 34
professional 32.3
person 30.2
businessman 27.4
business 27.3
office 26.6
coat 25.7
job 24.8
medical 24.7
work 24.3
adult 24.2
team 24.2
lab coat 23.2
smiling 23.1
doctor 22.5
worker 21.5
teamwork 21.3
working 21.2
happy 20.7
men 20.6
marimba 18.8
laboratory 18.3
patient 17.8
lab 17.5
colleagues 17.5
percussion instrument 17.1
barbershop 16.9
shop 16.5
room 16.2
portrait 16.2
indoors 15.8
sitting 15.5
group 15.3
health 15.3
smile 15
scientist 14.7
occupation 14.7
chemistry 14.5
research 14.3
talking 14.2
women 14.2
businesspeople 14.2
desk 14.2
musical instrument 14.2
meeting 14.1
hospital 14
specialist 14
mature 13.9
corporate 13.7
businesswoman 13.6
chemical 13.6
clinic 13.4
medicine 13.2
lifestyle 13
student 12.8
technology 12.6
mercantile establishment 12.6
education 12.1
table 12.1
scientific 11.6
30s 11.5
biology 11.4
standing 11.3
computer 11.2
modern 11.2
looking 11.2
manager 11.2
casual 11
suit 10.9
clothing 10.8
holding 10.7
40s 10.7
science 10.7
together 10.5
human 10.5
senior 10.3
day 10.2
two 10.2
20s 10.1
building 10.1
color 10
bright 10
case 9.7
concentration 9.7
couple 9.6
executive 9.3
indoor 9.1
associates 8.8
success 8.8
coworkers 8.8
assistant 8.7
mid adult 8.7
test 8.7
serious 8.6
face 8.5
study 8.4
place of business 8.3
life 8.3
care 8.2
laptop 8.2
confident 8.2
handsome 8
practitioner 7.9
microscope 7.9
casual clothing 7.8
black 7.8
discussion 7.8
classroom 7.7
busy 7.7
profession 7.7
garment 7.6
development 7.6
uniform 7.6
instrument 7.6
plan 7.6
treatment 7.3
successful 7.3
bartender 7.3
new 7.3
teacher 7.2
home 7.2
to 7.1
interior 7.1

Google
created on 2022-01-23

Photograph 94.2
Hat 88
Coat 86.4
Health care 85
Health care provider 84.6
Black-and-white 83.8
Cooking 82.1
Service 77.7
Medical 77.5
Monochrome photography 76.5
Monochrome 76.2
Snapshot 74.3
Science 74
Nurse uniform 72.8
Machine 72.5
Medical equipment 71.2
Laboratory equipment 71.1
Room 70.2
Event 70
Table 69.8

Microsoft
created on 2022-01-23

person 97.2
text 96.2
clothing 94.6
man 93.8
preparing 75.9
black and white 68.5

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 99.3%
Happy 48.2%
Calm 43.3%
Confused 2.1%
Surprised 1.6%
Fear 1.4%
Angry 1.3%
Sad 1.2%
Disgusted 1%

AWS Rekognition

Age 48-56
Gender Male, 93.7%
Calm 81.9%
Disgusted 4.6%
Happy 3.6%
Fear 3.1%
Surprised 2.8%
Confused 1.8%
Angry 1.3%
Sad 1%

AWS Rekognition

Age 30-40
Gender Male, 91.1%
Happy 56.9%
Sad 28.5%
Calm 11.9%
Angry 0.7%
Disgusted 0.6%
Confused 0.5%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 29-39
Gender Male, 84.9%
Sad 65%
Calm 31.6%
Disgusted 1.4%
Confused 0.8%
Happy 0.5%
Angry 0.3%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 14-22
Gender Male, 93.7%
Calm 82.4%
Sad 9.9%
Angry 4.3%
Confused 1%
Happy 0.7%
Disgusted 0.7%
Fear 0.4%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Hat 66.4%

Captions

Microsoft

a group of people standing in a kitchen preparing food 69.9%
a group of people standing in a kitchen 69.8%
a group of people standing in front of a counter 69.7%

Text analysis

Amazon

10734
10734.
that

Google

10734.
10734. 10734.