Human Generated Data

Title

Untitled (seated man and woman)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4421

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (seated man and woman)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.9
Apparel 99.9
Human 98.9
Person 98.9
Person 98.5
Person 97.1
Tie 94.9
Accessories 94.9
Accessory 94.9
Suit 83.8
Overcoat 83.8
Coat 83.8
Robe 83.6
Fashion 83.6
Gown 81.1
Female 81.1
Face 80.4
Wedding 73.4
Shirt 72.2
Photo 68.5
Portrait 68.5
Photography 68.5
Bridegroom 66.4
People 65.2
Woman 64.2
Clinic 64.1
Wedding Gown 63.9
Person 63.7
Chair 60.3
Furniture 60.3
Scientist 58.4
Lab Coat 56.9
Text 56

Imagga
created on 2022-01-23

coat 100
lab coat 100
doctor 48
garment 45.6
medical 45.1
man 44.4
professional 41.9
person 39
people 36.3
medicine 33.5
laboratory 31.9
hospital 31.2
male 30.5
health 28.5
work 27.5
adult 27.4
clothing 27.4
lab 26.3
specialist 25.9
clinic 25.9
science 25.8
scientist 25.5
surgeon 24.8
businessman 23.9
occupation 23.9
research 23.8
team 23.3
student 22.7
chemistry 22.2
care 22.2
working 22.1
looking 20.8
chemical 20.6
patient 20
job 19.5
business 19.5
biology 19
education 18.2
worker 17.8
test 17.3
equipment 17.1
technology 17.1
scientific 16.5
uniform 16.2
chemist 15.8
office 15.3
happy 15
mature 14.9
nurse 14.7
assistant 14.6
stethoscope 14.6
human 14.3
portrait 14.2
face 13.5
smiling 13
teamwork 13
bright 12.9
biotechnology 12.8
confident 12.7
colleagues 12.6
development 12.4
instrument 12.2
corporate 12
men 12
technician 11.8
examination 11.7
exam 11.5
serious 11.5
illness 11.4
indoors 11.4
businesspeople 11.4
senior 11.3
attractive 11.2
women 11.1
day 11
successful 11
researcher 10.9
doctors 10.8
smile 10.7
elderly 10.5
profession 10.5
desk 10.4
two 10.2
suit 9.9
microscope 9.9
microbiology 9.9
examining 9.8
experiment 9.8
to 9.7
optical 9.7
expertise 9.7
study 9.3
camera 9.2
mask 9.1
handsome 8.9
biochemistry 8.9
success 8.9
couple 8.7
table 8.7
horizontal 8.4
treatment 8.3
look 7.9
together 7.9
surgery 7.8
clinical 7.8
discovery 7.8
40s 7.8
tube 7.7
old 7.7
tie 7.6
career 7.6
one 7.5
manager 7.5
holding 7.4
20s 7.3
indoor 7.3
group 7.3
color 7.2
computer 7.2

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 97.6
sketch 97.2
drawing 96.8
smile 89.7
human face 88.2
person 86
clothing 85.6
man 85.2
posing 84.6
cartoon 69.4
black and white 68
wedding dress 65.9
bride 50.4
old 43.6

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Female, 64%
Happy 82.2%
Surprised 7.7%
Sad 3.9%
Confused 1.7%
Calm 1.4%
Disgusted 1.3%
Fear 0.9%
Angry 0.9%

AWS Rekognition

Age 48-56
Gender Male, 98.7%
Surprised 45%
Calm 26.4%
Happy 15.4%
Confused 9.2%
Disgusted 1.7%
Sad 1.1%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 26-36
Gender Female, 96%
Surprised 91.9%
Happy 5.9%
Angry 0.6%
Fear 0.5%
Disgusted 0.4%
Sad 0.2%
Calm 0.2%
Confused 0.2%

AWS Rekognition

Age 45-53
Gender Female, 93%
Angry 58.6%
Calm 19.5%
Happy 13.2%
Surprised 2.2%
Disgusted 1.9%
Fear 1.8%
Sad 1.5%
Confused 1.4%

AWS Rekognition

Age 45-51
Gender Male, 91.8%
Sad 42.4%
Happy 20.4%
Confused 14.7%
Fear 6.7%
Calm 6.4%
Surprised 4.3%
Disgusted 3%
Angry 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Tie 94.9%

Captions

Microsoft

a group of people posing for a photo 96%
a group of people posing for the camera 95.9%
a group of people posing for a picture 95.8%

Text analysis

Amazon

17289.
MA00X
BO

Google

17289. 17289.
17289.