Human Generated Data

Title

Untitled (group of people looking in glass case)
Date

c. 1936
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4776
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of people looking in glass case)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Tie 99.7
Accessories 99.7
Accessory 99.7
Human 99.4
Person 99.4
Person 99.4
Person 99.3
Person 98.9
Person 98.9
Person 97.8
Person 96.4
Clinic 95
Clothing 94
Apparel 94
Person 92
Tie 87.3
Person 86.5
Coat 84.6
Hospital 82.3
Operating Theatre 77.7
Sunglasses 71.6
Lab Coat 67.8
Person 66.8
Tie 65.6
Lab 64.6
Shop 59.9
Tie 58.7
Person 54.9

Imagga
created on 2022-01-29

lab coat 100
coat 96.5
specialist 48.7
man 48.4
garment 39.9
doctor 37.6
male 36.9
person 36
surgeon 35.8
people 35.2
medical 34.5
professional 33.5
working 30.1
work 28.3
adult 28.1
clinic 26.4
hospital 26.3
patient 24.2
health 23.6
clothing 23.6
team 23.3
businessman 23
business 22.5
smiling 22.4
office 21.7
medicine 21.2
occupation 20.2
happy 19.4
laboratory 19.3
worker 18.7
job 18.6
lab 18.5
men 18
colleagues 17.5
scientist 16.7
table 16.5
sitting 16.3
businesspeople 16.1
desk 16.1
science 16
indoors 15.8
20s 15.6
student 15.4
30s 15.4
casual 15.3
computer 15.2
portrait 14.9
technology 14.9
teamwork 14.8
nurse 14.7
research 14.3
mature 14
room 13.7
test 13.5
women 13.5
uniform 13.3
meeting 13.2
senior 13.1
smile 12.8
face 12.8
indoor 12.8
home 12.8
confident 12.7
businesswoman 12.7
two 12.7
assistant 12.6
attractive 12.6
horizontal 12.6
chemistry 12.6
illness 12.4
care 12.4
biology 12.3
education 12.1
treatment 12
associates 11.8
bright 11.5
looking 11.2
color 11.1
laptop 10.9
chemical 10.9
suit 10.8
surgery 10.8
equipment 10.6
exam 10.5
together 10.5
serious 10.5
couple 10.5
corporate 10.3
coworkers 9.8
modern 9.8
human 9.8
thirties 9.7
mid adult 9.7
busy 9.6
profession 9.6
standing 9.6
lifestyle 9.4
holding 9.1
handsome 8.9
group 8.9
chemist 8.9
to 8.9
doctors 8.9
50s 8.8
technician 8.8
businessmen 8.8
40s 8.8
look 8.8
scientific 8.7
day 8.6
elderly 8.6
workplace 8.6
sit 8.5
practitioner 8.4
camera 8.3
cheerful 8.1
light 8
microbiology 7.9
biotechnology 7.9
25 30 years 7.8
cure 7.8
two people 7.8
expertise 7.8
using 7.7
study 7.5
manager 7.5
successful 7.3
happiness 7.1

Google
created on 2022-01-29

Hat 84.8
Sleeve 83.1
Cooking 77.6
Service 72.1
Chef 70.6
Event 69.7
Science 69.1
Monochrome photography 67.7
Monochrome 67.6
Engineering 65.3
Cook 65.1
Vintage clothing 64.4
Room 63.2
Eyewear 61.8
Art 61.1
Uniform 61
Glass 55.4
Job 54.2
Machine 54.1
History 51.8

Microsoft
created on 2022-01-29

person 99.4
text 95.6
indoor 85.2
black and white 64.4
group 63
clothing 55.5
posing 46.6

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 87.5%
Calm 83%
Sad 13%
Happy 1.1%
Disgusted 0.7%
Surprised 0.7%
Angry 0.6%
Confused 0.5%
Fear 0.3%

AWS Rekognition

Age 45-51
Gender Male, 97.1%
Calm 99.8%
Sad 0.1%
Happy 0%
Confused 0%
Disgusted 0%
Angry 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 98.8%
Calm 92%
Sad 5.9%
Surprised 0.9%
Confused 0.6%
Happy 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 89.7%
Calm 94.4%
Sad 1.7%
Confused 1.1%
Surprised 0.9%
Angry 0.7%
Happy 0.5%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Male, 94%
Calm 89.6%
Happy 4.7%
Surprised 2%
Disgusted 1.4%
Angry 0.9%
Confused 0.7%
Sad 0.5%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Sad 83.2%
Calm 15.8%
Confused 0.2%
Happy 0.2%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 48-56
Gender Male, 99.2%
Calm 99.4%
Sad 0.3%
Confused 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 79.5%
Calm 70.4%
Sad 24.8%
Disgusted 1.3%
Confused 1.2%
Happy 1%
Angry 0.5%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Female, 74.6%
Calm 96.3%
Confused 1%
Surprised 0.7%
Sad 0.5%
Angry 0.4%
Disgusted 0.4%
Happy 0.4%
Fear 0.2%

AWS Rekognition

Age 16-22
Gender Female, 82.5%
Calm 99.5%
Sad 0.3%
Happy 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.7%
Person 99.4%
Sunglasses 71.6%

Captions

Microsoft

a group of people posing for a photo 95.2%
a group of people standing around a table 95.1%
a group of people posing for the camera 95%

Text analysis

Amazon

PREHISTORIC
IN
IN PA
LEDGE
PA
BLIC LEDGE
BLIC
S
-
hrs
4
NA

Google

PA
PREHISTORIC IN PA
IN
PREHISTORIC