Human Generated Data

Title

Untitled (Mask and Wig members sitting around a piano)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8364
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Mask and Wig members sitting around a piano)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 98.7
Human 98.7
Person 98.6
Person 98.5
Person 97.8
Person 97.2
Person 95.8
Person 95.3
Person 93.8
Clothing 91.7
Apparel 91.7
Clinic 90.1
Face 79.3
Scientist 76.9
Coat 69.6
Photography 69.2
Photo 69.2
People 67.2
Portrait 64.5
Dish 63.1
Food 63.1
Meal 63.1
Sunglasses 62
Accessories 62
Accessory 62
Table 60.8
Furniture 60.8
Doctor 58.6
Suit 58.3
Overcoat 58.3
Electronics 58.3
Photographer 57.8
Crowd 56.5
Lab Coat 55.5
Nature 55.3

Imagga
created on 2022-01-09

patient 81.6
nurse 77.2
person 66.3
case 53.6
sick person 52.7
man 41
male 35.4
people 35.1
medical 32.6
doctor 29.1
work 29
professional 27.5
men 27.5
worker 25.1
adult 24.8
hospital 23.1
coat 22.9
medicine 22.9
health 21.5
women 20.5
occupation 20.2
business 20
team 19.7
job 18.6
lab coat 18.3
laboratory 18.3
profession 18.2
surgeon 18.1
lab 17.5
equipment 17.2
student 16.7
education 16.4
chemistry 16.4
room 16.4
teamwork 15.8
scientist 15.7
clinic 15.4
research 15.2
working 15
uniform 14.4
happy 13.8
group 13.7
office 13.6
looking 13.6
science 13.3
businessman 13.2
smiling 13
test 12.5
biology 12.3
indoors 12.3
smile 12.1
technology 11.9
surgery 11.7
chemical 11.7
assistant 11.7
colleagues 11.7
portrait 11.6
care 11.5
human 11.2
instrument 11.2
industry 11.1
specialist 11.1
industrial 10.9
clothing 10.6
standing 10.4
operation 9.8
scientific 9.7
exam 9.6
illness 9.5
development 9.5
casual 9.3
manager 9.3
bright 9.3
treatment 9.2
modern 9.1
holding 9.1
black 9
surgical 8.9
microscope 8.9
to 8.8
technician 8.8
life 8.7
emergency 8.7
30s 8.7
day 8.6
corporate 8.6
sitting 8.6
college 8.5
two 8.5
color 8.3
indoor 8.2
look 7.9
chemist 7.9
face 7.8
table 7.8
discussion 7.8
optical 7.8
university 7.6
serious 7.6
study 7.5
20s 7.3
garment 7.3
confident 7.3
lifestyle 7.2
suit 7.2
school 7.2

Google
created on 2022-01-09

Photograph 94.3
Shirt 93.8
Health care provider 90.5
Coat 87.5
Medical assistant 85.5
Health care 84.2
Medical equipment 83.7
Scrubs 81.1
Medical procedure 79.3
Surgeon 78.3
Medical 75.9
Nurse 75.6
Service 75.3
Snapshot 74.3
Event 71.5
Laboratory equipment 70.4
Hat 70.3
Machine 68.2
T-shirt 68.2
Room 67.8

Microsoft
created on 2022-01-09

clothing 96.8
text 96.3
person 95.6
outdoor 90.4
man 90.3
wedding dress 68.4
woman 56.1
smile 50.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 96.8%
Sad 1.1%
Happy 0.8%
Angry 0.4%
Confused 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 80%
Calm 93.7%
Happy 5.3%
Surprised 0.5%
Sad 0.2%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 98.3%
Calm 99%
Surprised 0.5%
Sad 0.4%
Disgusted 0%
Happy 0%
Fear 0%
Angry 0%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 29.6%
Happy 23.7%
Surprised 23.1%
Sad 11.9%
Confused 4.9%
Angry 4.4%
Disgusted 1.8%
Fear 0.6%

AWS Rekognition

Age 30-40
Gender Male, 100%
Surprised 98.1%
Calm 1%
Happy 0.3%
Fear 0.3%
Disgusted 0.1%
Angry 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Surprised 95.3%
Calm 2.2%
Fear 0.8%
Happy 0.6%
Disgusted 0.4%
Confused 0.3%
Angry 0.1%
Sad 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Sunglasses 62%

Captions

Microsoft

a group of people posing for the camera 84.8%
a group of people posing for a picture 84.7%
a group of people posing for a photo 78.4%

Text analysis

Amazon

14355
OS

Google

14355· 14355· YACOK- YT3RA2-NAMTZA3
14355·
YACOK-
YT3RA2-NAMTZA3