Human Generated Data

Title

Untitled (man in suit at party raising his glass)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8974

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man in suit at party raising his glass)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Apparel 99.5
Clothing 99.5
Person 99
Human 99
Person 97.1
Person 97.1
Person 96.5
Person 93.6
Coat 85.9
Helmet 84.3
Accessories 84
Accessory 84
Tie 84
Overcoat 74.9
Shirt 74.3
Person 61.9
Suit 61.2
Nature 56.7
Lab Coat 55.4
Crowd 55.1

Imagga
created on 2022-01-09

coat 100
lab coat 100
garment 49.5
man 43.7
medical 43.3
doctor 39.5
hospital 33.9
person 32.1
patient 31.9
professional 31.3
clothing 30.9
male 29.8
people 29
health 28.5
nurse 27.9
work 25.9
medicine 24.7
surgeon 22.7
men 22.3
clinic 22
worker 19.7
adult 19.6
scientist 18.6
lab 18.5
laboratory 18.3
team 17.9
happy 17.5
occupation 17.4
smiling 17.4
indoors 16.7
business 16.4
care 15.6
job 15
assistant 14.6
chemistry 14.5
looking 14.4
uniform 14.4
profession 14.4
illness 14.3
research 14.3
biology 14.2
working 14.1
businessman 14.1
student 13.9
science 13.3
room 12.8
surgery 12.7
practitioner 12.6
exam 12.5
portrait 12.3
standing 12.2
office 12.1
technology 11.9
women 11.9
equipment 11.4
hand 11.4
education 11.3
specialist 11.1
teamwork 11.1
operation 10.8
bright 10.7
40s 10.7
smile 10.7
sick 10.6
chemical 10.6
test 10.6
confident 10
microscope 9.9
physician 9.8
colleagues 9.7
home 9.6
instrument 9.5
corporate 9.5
senior 9.4
study 9.3
treatment 9.2
50s 8.8
technician 8.8
middle aged 8.8
case 8.8
disease 8.7
expertise 8.7
scientific 8.7
30s 8.7
happiness 8.6
sitting 8.6
talking 8.6
desk 8.5
two 8.5
black 8.4
color 8.3
inside 8.3
human 8.2
indoor 8.2
suit 8.2
school 8.1
to 8
sick person 7.9
surgical 7.9
look 7.9
doctors 7.9
day 7.8
hands 7.8
face 7.8
two people 7.8
emergency 7.7
development 7.6
adults 7.6
clothes 7.5
mature 7.4
focus 7.4
group 7.3
computer 7.2
modern 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 98.5
wall 96.9
person 96.1
clothing 89.1
man 87.2
black and white 84.6

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Sad 62.1%
Angry 9.9%
Calm 6%
Fear 5.5%
Disgusted 5.3%
Happy 4.6%
Confused 3.9%
Surprised 2.7%

AWS Rekognition

Age 48-54
Gender Male, 98.7%
Surprised 72.9%
Fear 9.1%
Sad 7.1%
Happy 4.3%
Confused 2.3%
Calm 1.9%
Angry 1.3%
Disgusted 1.1%

AWS Rekognition

Age 33-41
Gender Male, 83.9%
Calm 99.9%
Sad 0.1%
Surprised 0%
Happy 0%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Helmet 84.3%
Tie 84%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 77%
a group of people standing in front of a mirror 76.9%
a group of people in front of a mirror posing for the camera 75.3%

Text analysis

Amazon

10522.
10522,
MJI7
MJI7 YE3A A73A
A73A
YE3A

Google

MJ17
10522
YT37A
10522,
2
A7
A
10522 MJ17 YT37A 2 A7 A 10522,