Human Generated Data

Title

Untitled (men sitting and standing around table, Princeton University reunion, Princeton, NJ)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11710

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men sitting and standing around table, Princeton University reunion, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.3
Human 99.3
Person 99.2
Person 99.1
Person 98.8
Person 98.7
Person 98
Person 98
Person 97.2
Person 94.5
Person 93.3
Face 86.1
Clothing 85.7
Apparel 85.7
Accessories 81.7
Tie 81.7
Accessory 81.7
Person 71
People 67.1
Worker 65.9
Portrait 61.3
Photography 61.3
Photo 61.3
Suit 61.1
Overcoat 61.1
Coat 61.1
Sleeve 60.4
Crowd 59.7
Meal 56.2
Food 56.2
Glass 55.6
Person 44.2

Imagga
created on 2022-01-15

man 33.6
person 32.6
nurse 31.5
people 30.1
lab coat 28.7
coat 27.8
male 24.8
patient 24.6
surgeon 23.1
medical 22.9
senior 21.5
case 20.7
adult 19.9
specialist 18.9
work 18
portrait 17.5
elderly 17.2
hospital 16.9
barbershop 16.6
doctor 16
professional 15.8
medicine 15.8
couple 15.7
men 15.4
health 15.3
shop 14.8
happy 14.4
looking 14.4
old 13.9
clinic 13.8
smiling 13.7
laboratory 12.5
illness 12.4
student 11.9
aged 11.8
lab 11.7
care 11.5
serious 11.4
face 11.4
worker 11.3
garment 11.2
home 11.2
mercantile establishment 11
sick person 10.7
retired 10.7
human 10.5
business 10.3
room 10.1
science 9.8
working 9.7
businessman 9.7
chemistry 9.7
retirement 9.6
exam 9.6
husband 9.5
clothing 9.5
wife 9.5
smile 9.3
occupation 9.2
hand 9.1
office 8.8
scientist 8.8
surgery 8.8
indoors 8.8
women 8.7
research 8.6
biology 8.5
black 8.4
mature 8.4
technology 8.2
family 8
life 7.9
happiness 7.8
education 7.8
scientific 7.7
test 7.7
development 7.6
shirt 7.5
instrument 7.4
holding 7.4
equipment 7.3
place of business 7.3
group 7.2
love 7.1
job 7.1
day 7.1
together 7

Google
created on 2022-01-15

Photograph 94.2
Shirt 94.2
Black 89.5
Coat 85.9
Hat 85.6
Black-and-white 84.5
Style 83.8
Sleeve 80.8
Font 76.9
T-shirt 76.2
Snapshot 74.3
Monochrome photography 74.1
Monochrome 73.5
Event 73.1
Crew 72.5
Team 69.8
Service 69.2
Nurse uniform 68.4
Suit 62.9
Stock photography 61.8

Microsoft
created on 2022-01-15

person 99.5
text 95.6
clothing 94.6
man 80.8
human face 71.1
old 54.8

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 98.8%
Sad 57.5%
Calm 31.8%
Happy 4%
Confused 2.5%
Angry 1.2%
Surprised 1.1%
Fear 1.1%
Disgusted 1%

AWS Rekognition

Age 13-21
Gender Male, 98.9%
Angry 52.1%
Disgusted 14.3%
Surprised 11.8%
Calm 9%
Confused 5.1%
Sad 4.2%
Fear 1.8%
Happy 1.7%

AWS Rekognition

Age 49-57
Gender Male, 99.2%
Sad 97.9%
Fear 1.6%
Confused 0.3%
Happy 0.1%
Disgusted 0%
Angry 0%
Surprised 0%
Calm 0%

AWS Rekognition

Age 48-54
Gender Male, 97.1%
Sad 61.8%
Calm 14.1%
Confused 10.9%
Surprised 4.6%
Happy 3.7%
Fear 3%
Angry 0.9%
Disgusted 0.8%

AWS Rekognition

Age 38-46
Gender Male, 99.2%
Sad 75.7%
Confused 15.6%
Calm 6%
Happy 0.6%
Disgusted 0.6%
Surprised 0.5%
Fear 0.5%
Angry 0.5%

AWS Rekognition

Age 48-56
Gender Male, 99.2%
Sad 99.1%
Calm 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 24-34
Gender Male, 98.5%
Happy 65.8%
Sad 20.4%
Calm 5.5%
Confused 5.2%
Disgusted 1%
Surprised 0.8%
Angry 0.7%
Fear 0.6%

AWS Rekognition

Age 48-56
Gender Male, 100%
Sad 53.2%
Happy 27.4%
Confused 8.9%
Disgusted 5.1%
Angry 1.9%
Fear 1.4%
Surprised 1.3%
Calm 0.8%

AWS Rekognition

Age 52-60
Gender Male, 97.8%
Calm 97.8%
Confused 0.9%
Happy 0.6%
Sad 0.3%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 99.3%
Calm 37.9%
Sad 29.3%
Fear 13.9%
Happy 6.8%
Surprised 4.3%
Confused 3.3%
Disgusted 2.3%
Angry 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 81.7%
Suit 61.1%

Captions

Microsoft

a group of people posing for a photo 91.6%
a group of people posing for the camera 91.5%
a group of people posing for a picture 91.4%

Text analysis

Amazon

SMART
PEOPLE
SMART PEOPLE AR
1917
Barc
AR
WHISKIES
Budweiser
YT3342
YT3342 830N3330
HOHD
830N3330

Google

SMART PEOPLE AR Barce WHISKIES 1917
1917
PEOPLE
SMART
Barce
AR
WHISKIES