Human Generated Data

Title

Untitled (three men with hats talking under a tent, Princeton University reunion, Princeton, NJ)
Date

c. 1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8177
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three men with hats talking under a tent, Princeton University reunion, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.8
Human 99.8
Person 99.7
Person 99.2
Person 99
Person 98.7
Clothing 96.3
Apparel 96.3
Crowd 72.9
Nature 72.8
People 70
Female 69.8
Outdoors 67.5
Shorts 63.7
Photography 59.4
Photo 59.4
Portrait 59.4
Face 59.4
Furniture 58.9
Chair 58.9
Woman 58.1
Cake 57.8
Creme 57.8
Dessert 57.8
Food 57.8
Icing 57.8
Cream 57.8
Sailor Suit 56.8
Finger 56.7
Wood 56.5

Imagga
created on 2022-01-08

man 42.3
surgeon 35.5
male 32.6
work 28.2
people 27.3
person 22.3
adult 21.7
men 18.9
medical 17.6
professional 16.9
business 16.4
equipment 16.3
worker 16
patient 15.4
industry 15.4
occupation 14.7
hospital 14.4
job 13.3
doctor 13.2
industrial 12.7
nurse 12.7
uniform 12.6
health 12.5
working 11.5
businessman 11.5
building 10.8
mask 10.5
happy 10
surgery 9.8
portrait 9.7
outdoors 9.7
medicine 9.7
looking 9.6
protection 9.1
care 9
technology 8.9
surgical 8.9
operation 8.9
technician 8.8
40s 8.8
hands 8.7
laboratory 8.7
profession 8.6
architecture 8.6
case 8.6
research 8.6
adults 8.5
clinic 8.5
room 8.4
senior 8.4
old 8.4
clothing 8.3
safety 8.3
team 8.1
science 8
helmet 7.8
couple 7.8
scientist 7.8
standing 7.8
color 7.8
chemistry 7.7
emergency 7.7
modern 7.7
elderly 7.7
two 7.6
engineer 7.6
biology 7.6
specialist 7.5
human 7.5
manager 7.4
holding 7.4
women 7.1

Google
created on 2022-01-08

Shirt 94.6
Hat 92.3
Cap 81.8
Sun hat 81.6
Baseball cap 81.4
Adaptation 79.2
T-shirt 74.9
Monochrome photography 73.5
Monochrome 70.9
Event 69.5
Crew 66.8
Vintage clothing 64.6
Room 63.8
Eyewear 62.8
Stock photography 62.3
Photo caption 61.9
Team 60.4
Font 58.9
History 58.8
Sleeve 57.8

Microsoft
created on 2022-01-08

text 98.7
person 97.3
clothing 91
man 85.6
black and white 79.4

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Female, 97.1%
Calm 83.4%
Sad 16.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 99.6%
Calm 90.5%
Surprised 6.6%
Sad 1.6%
Fear 0.6%
Disgusted 0.4%
Confused 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 79.1%
Calm 80.5%
Sad 18.3%
Confused 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Angry 0.1%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people standing in front of a building 73.2%
a group of people standing outside of a building 72.5%
a group of people standing next to a building 71.8%

Text analysis

Amazon

27
830M3330
moe
3SAB 830M3330
3SAB

Google

n
ww n 32A8 YT3A2 A3OM3330
32A8
YT3A2
A3OM3330
ww