Human Generated Data

Title

Untitled (group of alumni posing for picture, Princeton University reunion, Princeton, NJ)

Date

c. 1937

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8179

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of alumni posing for picture, Princeton University reunion, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.8
Person 99.8
Person 99.5
Person 99.4
Person 99.1
Person 98.6
Person 98.4
Person 98.3
Clothing 78.7
Apparel 78.7
Face 62.2
People 60.3
Person 52.5

Imagga
created on 2022-01-08

coat 78.9
lab coat 77.4
nurse 57.7
man 53.8
doctor 53.6
medical 47.7
professional 44.7
person 43.3
male 41.8
hospital 39.9
patient 33.2
adult 33.1
stethoscope 32.9
people 32.3
health 32
medicine 31.7
team 30.5
happy 30.1
care 28
smile 27.8
clinic 27.6
garment 27.1
job 26.5
smiling 26
working 25.6
portrait 25.2
uniform 25.1
worker 24.5
mature 24.2
business 23.7
occupation 22.9
work 22.8
doctors 22.6
specialist 22.2
practitioner 21.4
confident 20.9
group 20.1
handsome 19.6
teamwork 19.5
businessman 17.7
looking 17.6
staff 17.2
men 17.2
surgeon 17
clinical 16.6
clothing 16.3
profession 16.3
senior 15.9
standing 15.6
colleagues 15.5
30s 15.4
office 15.3
physician 14.6
case 14.5
lifestyle 14.5
casual 14.4
sick person 13.8
friendly 13.7
elderly 13.4
student 13.1
black 12.6
meeting 12.2
camera 12
successful 11.9
women 11.9
suit 11.7
laboratory 11.6
illness 11.4
two 11
happiness 11
health care 10.7
mid adult 10.6
indoors 10.5
exam 10.5
human 10.5
attractive 10.5
treatment 10.1
indoor 10
modern 9.8
cheerful 9.8
consultant 9.7
lab 9.7
expertise 9.7
practice 9.7
businesspeople 9.5
color 9.5
healthy 9.4
20s 9.2
businesswoman 9.1
coworkers 8.8
heal 8.8
computer 8.8
40s 8.8
ill 8.8
middle aged 8.8
older 8.7
sick 8.7
table 8.7
confidence 8.6
corporate 8.6
sitting 8.6
face 8.5
desk 8.5
equipment 8.3
technology 8.2
success 8
clinician 7.9
general practitioner 7.9
together 7.9
surgical 7.9
expert 7.9
bright 7.9
good mood 7.8
healing 7.8
couple 7.8
eye contact 7.8
thirties 7.8
diversity 7.7
partnership 7.7
four 7.7
old 7.7
research 7.6
inside 7.4
laptop 7.3
aged 7.2
hair 7.1
science 7.1
day 7.1

Google
created on 2022-01-08

Sleeve 87.2
Chef 83.6
Uniform 72.4
Cooking 72.2
Workwear 62.2
Font 59.9
Team 59.4
Service 57.5
Cook 55.6
Vintage clothing 55.3
Room 51.9
Art 50.6

Microsoft
created on 2022-01-08

text 99.8
person 95.7
outdoor 86
man 78.3
black and white 75.7
player 74.6
clothing 72.8
black 72.5

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Angry 84.1%
Fear 4.6%
Surprised 3.8%
Confused 2.1%
Sad 1.9%
Calm 1.7%
Disgusted 1%
Happy 0.8%

AWS Rekognition

Age 40-48
Gender Male, 99.3%
Happy 61.8%
Calm 20.4%
Surprised 5%
Disgusted 4.6%
Confused 3%
Angry 2.2%
Sad 1.8%
Fear 1.3%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Fear 76.8%
Sad 8.3%
Surprised 6.2%
Happy 2.8%
Confused 2.6%
Angry 1.6%
Disgusted 0.9%
Calm 0.7%

AWS Rekognition

Age 27-37
Gender Male, 78.1%
Sad 60.5%
Surprised 24.5%
Calm 4.1%
Fear 4%
Angry 3%
Disgusted 2.1%
Confused 1%
Happy 0.6%

AWS Rekognition

Age 33-41
Gender Male, 99.3%
Surprised 67.6%
Happy 17.8%
Fear 6.7%
Confused 3.4%
Calm 1.6%
Sad 1.2%
Disgusted 0.9%
Angry 0.7%

AWS Rekognition

Age 51-59
Gender Male, 99.7%
Sad 48.3%
Happy 20.3%
Angry 18.9%
Calm 7.1%
Surprised 2.7%
Disgusted 1.3%
Confused 1%
Fear 0.4%

AWS Rekognition

Age 27-37
Gender Female, 50.2%
Sad 28.9%
Happy 22.3%
Calm 12.6%
Surprised 11.1%
Fear 7.7%
Angry 7.5%
Confused 6.2%
Disgusted 3.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 84%
a group of men posing for a photo 82.8%
a group of people posing for a picture 82.7%

Text analysis

Amazon

27
4070.
#010
YTERAS
32A8 YTERAS
32A8

Google

32A8
32A8 YT33A2 830M3130
YT33A2
830M3130