Human Generated Data

Title

Untitled (two men speaking into microphone, Princeton University reunion, Princeton, NJ)
Date

c. 1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4548
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men speaking into microphone, Princeton University reunion, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.4
Human 99.4
Clothing 98.6
Apparel 98.6
Person 98.3
Hat 98
Hat 94.4
Person 88.2
Face 87.8
Sleeve 85.8
Finger 72.1
Shirt 70.1
Scientist 67.5
Hat 66.1
Portrait 63
Photography 63
Photo 63
Long Sleeve 61.2
Glass 61.2
Text 59.8
Poster 55.8
Advertisement 55.8
Beverage 55.3
Drink 55.3
Sailor Suit 55.2

Imagga
created on 2021-12-14

lab coat 83
coat 81
medical 45
doctor 44.2
man 39.7
person 38.4
male 34.1
hospital 33.9
professional 33.2
garment 30.3
people 29.6
nurse 28.4
medicine 28.2
health 27.1
adult 25.8
care 23.9
clinic 23.7
work 23.6
happy 23.2
men 22.3
lab 21.4
clothing 21.4
laboratory 21.2
uniform 21.2
smiling 21
occupation 20.2
profession 19.2
patient 19
stethoscope 18.8
scientist 18.6
mature 17.7
worker 17.4
smile 17.1
serious 16.2
portrait 16.2
job 15.9
working 15.9
business 15.8
chemistry 15.5
office 15.3
bright 15
specialist 14.5
looking 14.4
face 14.2
surgeon 14
attractive 14
ruler 13.7
confident 13.7
practitioner 13.5
team 13.4
research 13.3
senior 13.1
exam 12.5
science 12.5
biology 12.3
student 12.3
treatment 11.9
doctors 11.8
holding 11.6
businessman 11.5
indoors 11.4
day 11
handsome 10.7
assistant 10.7
colleagues 10.7
expertise 10.7
elderly 10.5
staff 10.5
look 10.5
human 10.5
illness 10.5
computer 10.4
desk 10.4
women 10.3
study 10.3
happiness 10.2
two 10.2
metropolitan 10
suit 9.9
modern 9.8
physician 9.8
chemical 9.7
instrument 9.7
scientific 9.7
technology 9.7
education 9.5
table 9.5
color 9.5
lifestyle 9.4
indoor 9.1
hand 9.1
laptop 9.1
general practitioner 8.9
microscope 8.9
clinical 8.8
couple 8.7
standing 8.7
equipment 8.2
together 7.9
examining 7.8
surgery 7.8
analysis 7.8
examination 7.8
corporate 7.7
sitting 7.7
busy 7.7
test 7.7
old 7.7
development 7.6
horizontal 7.5
one 7.5
teamwork 7.4
service 7.4
black 7.2
white 7.2
home 7.2

Google
created on 2021-12-14

Microphone 93.6
Hat 92.8
Fedora 88.7
Coat 87.3
Sun hat 85.6
Black-and-white 85.4
Gesture 85.3
Style 83.8
Cap 78.7
Blazer 77.5
Suit 77.4
Costume hat 76.1
Monochrome photography 74.9
Monochrome 74.6
Formal wear 73.4
Eyewear 73.4
Art 70.4
Event 70.1
Cowboy hat 69.3
Stock photography 65.9

Microsoft
created on 2021-12-14

person 99.7
man 99.5
hat 97.4
text 96.2
clothing 95.6
fashion accessory 95.4
human face 92.6
black and white 88.8
fedora 85.7
standing 77.8
cowboy hat 69.5
smile 62.7

Face analysis

Amazon

Google

AWS Rekognition

Age 27-43
Gender Male, 97.3%
Surprised 29.8%
Happy 28.3%
Calm 22.6%
Angry 11.8%
Confused 2.5%
Sad 2.1%
Disgusted 1.7%
Fear 1.2%

AWS Rekognition

Age 15-27
Gender Female, 59.8%
Calm 87.8%
Surprised 10.5%
Angry 0.9%
Happy 0.5%
Fear 0.2%
Disgusted 0.1%
Sad 0.1%
Confused 0%

AWS Rekognition

Age 19-31
Gender Female, 60.9%
Fear 50.1%
Sad 37.7%
Angry 4.6%
Calm 2.5%
Surprised 2.4%
Confused 1.1%
Happy 0.9%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 98%

Captions

Microsoft

a man wearing a hat 88.3%
a man wearing a suit and tie 88.2%
a man wearing a suit and hat 88.1%

Text analysis

Amazon

DEEEMOEB
DEEEMOEB ever
PION
ever
w17