Human Generated Data

Title

Untitled (group of men sitting on steps of Princeton University building, Princeton, NJ)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4811

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of men sitting on steps of Princeton University building, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.5
Human 99.5
Person 98.9
Person 98.9
Person 97.9
Person 95.3
Person 94.6
Person 92.3
Person 92.3
Crowd 91.9
Bench 91.2
Furniture 91.2
People 90.2
Person 90
Person 85.6
Person 84.9
Clothing 84.3
Apparel 84.3
Person 77.1
Suit 76.4
Coat 76.4
Overcoat 76.4
Person 75.5
Person 73.3
Leisure Activities 73.3
Parade 66.8
Person 65.7
Person 65.1
Person 63.3
Person 62
Person 61.7
Photo 60.5
Photography 60.5
Audience 59.3

Imagga
created on 2022-01-29

person 35.2
man 32.3
people 31.2
teacher 30.8
professional 30.2
male 27.6
room 26.5
businessman 25.6
classroom 25.1
team 25.1
group 25
business 24.3
adult 24.1
happy 22.5
men 22.3
women 19.8
corporate 19.8
teamwork 19.5
educator 18.2
smiling 18.1
sitting 18
meeting 17.9
office 17.8
together 15.8
businesswoman 15.4
worker 15.3
executive 15.1
couple 13.9
smile 13.5
work 13.3
talking 13.3
businesspeople 13.3
table 13
success 12.9
portrait 12.3
cheerful 12.2
successful 11.9
two 11.9
job 11.5
home 11.2
black 10.8
family 10.7
modern 10.5
career 10.4
communication 10.1
silhouette 9.9
suit 9.9
working 9.7
indoors 9.7
student 9.6
lifestyle 9.4
life 9.3
casual 9.3
manager 9.3
new 8.9
teaching 8.8
partner 8.7
education 8.7
planner 8.6
happiness 8.6
hall 8.6
boss 8.6
senior 8.4
building 8.4
human 8.2
indoor 8.2
kin 7.9
boy 7.8
chair 7.7
ethnic 7.6
finance 7.6
spectator 7.6
child 7.5
friendship 7.5
mature 7.4
mother 7.3
sport 7.2
day 7.1
employee 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

person 95.4
clothing 92
outdoor 89.7
text 87.7
man 70.2

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 96.9%
Calm 98%
Sad 0.7%
Surprised 0.3%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 35-43
Gender Male, 97.8%
Calm 56.3%
Sad 30.9%
Happy 5.4%
Confused 3.8%
Angry 1.7%
Fear 0.6%
Disgusted 0.6%
Surprised 0.6%

AWS Rekognition

Age 22-30
Gender Female, 81.9%
Sad 35.5%
Happy 31.6%
Calm 20.7%
Fear 5.2%
Angry 3.1%
Confused 1.5%
Disgusted 1.3%
Surprised 1.1%

AWS Rekognition

Age 22-30
Gender Female, 52.8%
Calm 98%
Sad 1%
Surprised 0.2%
Confused 0.2%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Female, 78.3%
Calm 48.4%
Confused 25.3%
Sad 18.2%
Fear 3.3%
Happy 1.7%
Disgusted 1.2%
Angry 1.1%
Surprised 0.8%

AWS Rekognition

Age 43-51
Gender Male, 99.1%
Sad 46.6%
Calm 45.8%
Confused 3.5%
Angry 1.1%
Happy 1%
Fear 0.7%
Surprised 0.7%
Disgusted 0.6%

AWS Rekognition

Age 31-41
Gender Female, 63.4%
Calm 44.3%
Sad 36.9%
Happy 10.8%
Angry 2.4%
Disgusted 2.1%
Confused 1.3%
Surprised 1.2%
Fear 0.9%

AWS Rekognition

Age 23-31
Gender Female, 67.2%
Sad 91.1%
Confused 4.1%
Calm 3.3%
Fear 0.4%
Angry 0.4%
Happy 0.3%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 12-20
Gender Female, 99%
Sad 78.2%
Fear 7.6%
Calm 4%
Confused 3.3%
Surprised 2.7%
Angry 1.7%
Disgusted 1.3%
Happy 1.2%

AWS Rekognition

Age 18-24
Gender Female, 98.5%
Calm 80.7%
Sad 7.7%
Happy 5.2%
Confused 2.4%
Angry 1.5%
Disgusted 1.2%
Fear 0.8%
Surprised 0.6%

AWS Rekognition

Age 18-26
Gender Male, 64.6%
Calm 48.3%
Sad 41%
Happy 3.2%
Confused 1.8%
Fear 1.7%
Angry 1.4%
Disgusted 1.3%
Surprised 1.2%

AWS Rekognition

Age 35-43
Gender Male, 69.7%
Sad 78.6%
Confused 16.6%
Calm 1.2%
Disgusted 1.2%
Fear 0.8%
Angry 0.6%
Surprised 0.5%
Happy 0.5%

AWS Rekognition

Age 38-46
Gender Female, 97.1%
Calm 70.7%
Sad 22.6%
Happy 2.4%
Angry 1.5%
Confused 1.3%
Disgusted 0.8%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 23-31
Gender Female, 61.4%
Calm 88.2%
Happy 5.3%
Surprised 2.4%
Fear 1.4%
Confused 0.9%
Sad 0.8%
Disgusted 0.7%
Angry 0.3%

AWS Rekognition

Age 26-36
Gender Male, 60.2%
Calm 45.2%
Sad 30.8%
Happy 11.9%
Confused 9.2%
Angry 1%
Disgusted 0.8%
Fear 0.6%
Surprised 0.5%

AWS Rekognition

Age 23-31
Gender Female, 59.5%
Confused 33.3%
Sad 24.7%
Disgusted 22%
Calm 6%
Angry 4.3%
Surprised 4.2%
Happy 3.7%
Fear 1.9%

AWS Rekognition

Age 35-43
Gender Male, 91.9%
Calm 39.7%
Sad 29.9%
Angry 13.7%
Confused 5.9%
Fear 3.7%
Surprised 3.1%
Happy 2.3%
Disgusted 1.6%

AWS Rekognition

Age 28-38
Gender Female, 61.8%
Happy 74.3%
Calm 11%
Angry 7%
Sad 3.7%
Fear 1.5%
Disgusted 1.1%
Confused 0.9%
Surprised 0.6%

AWS Rekognition

Age 26-36
Gender Male, 94.1%
Sad 44.3%
Confused 16.8%
Happy 13.8%
Calm 11.1%
Disgusted 6.9%
Surprised 3.5%
Angry 2.8%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.5%
Bench 91.2%

Captions

Microsoft

a group of people sitting in front of a building 88.7%
a group of people sitting on top of a building 85.8%
a group of people around each other 85.7%

Text analysis

Amazon

170A
PaoE
MUNUYTRAA 170A
MUNUYTRAA