Human Generated Data

Title

Untitled (class of 1917 and their children, Princeton University reunion, Princeton, NJ)
Date

1938
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7658
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (class of 1917 and their children, Princeton University reunion, Princeton, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7658

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.4
Person 95.5
Crowd 93.9
Person 88.8
Audience 88.7
Person 85.2
Person 83.7
Person 83.5
Clothing 81.4
Apparel 81.4
People 80.7
Person 79.5
Person 72.8
Person 70.7
Person 70.5
Person 66.6
Face 65
Leisure Activities 60.1
Musician 58.3
Musical Instrument 58.3
Suit 58.2
Coat 58.2
Overcoat 58.2
Outdoors 56.6
Field 56.3
Person 55.6
Funeral 55.2

Clarifai
created on 2023-10-25

people 99.9
many 99.5
group 98.5
child 98.3
crowd 98.1
group together 98.1
spectator 96.9
adult 96.9
man 96.8
audience 96.6
music 95.1
woman 95
boy 93.7
administration 93.1
recreation 89.7
wear 89.4
uniform 85.1
war 84.7
monochrome 83.5
leader 81.2

Imagga
created on 2022-01-08

spectator 25.4
stage 20.3
city 16.6
people 15.6
platform 14.3
old 13.9
crowd 13.4
world 13.3
black 12.7
sky 12.1
building 11.3
group 11.3
travel 11.3
art 10.5
event 10.2
silhouette 9.9
architecture 9.4
grunge 9.4
park 9.3
dark 9.2
person 9.2
vintage 9.1
party 8.6
men 8.6
stall 8.1
dirty 8.1
music 8.1
new 8.1
symbol 8.1
urban 7.9
summer 7.7
texture 7.6
landscape 7.4
tourism 7.4
street 7.4
industrial 7.3
history 7.1

Google
created on 2022-01-08

Adaptation 79.4
Crowd 75.6
Art 75.2
Event 71.1
Font 71
Crew 68.6
History 68.2
Monochrome 68.1
Vintage clothing 67.6
Pole 66.7
Military organization 63.6
Infantry 62.6
Team 60.6
Uniform 57.8
Monochrome photography 57.8
Illustration 56.3
Flag 55.9
Visual arts 53.4
Room 53.2
Troop 53

Microsoft
created on 2022-01-08

outdoor 98.5
person 97.6
clothing 94.9
people 94.2
man 91.8
group 89.3
text 85.5
standing 77.1
posing 71
funeral 58.7
black and white 52.4
crowd 49.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Female, 90.6%
Sad 35.3%
Happy 29.9%
Calm 17%
Surprised 6.2%
Fear 4%
Disgusted 3.4%
Angry 2.9%
Confused 1.2%

AWS Rekognition

Age 35-43
Gender Male, 99.3%
Calm 35%
Sad 28.3%
Confused 12.7%
Surprised 9.9%
Happy 6.4%
Angry 4.5%
Disgusted 2.7%
Fear 0.5%

AWS Rekognition

Age 43-51
Gender Female, 86.5%
Calm 93.1%
Angry 4.8%
Confused 0.6%
Sad 0.6%
Disgusted 0.3%
Happy 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 72.6%
Calm 99.1%
Happy 0.4%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 83.2%
Calm 55.1%
Happy 36.9%
Confused 4.5%
Sad 1.2%
Disgusted 0.8%
Surprised 0.7%
Angry 0.6%
Fear 0.2%

AWS Rekognition

Age 42-50
Gender Male, 67.3%
Happy 46.6%
Sad 44.2%
Calm 4%
Fear 3.5%
Disgusted 0.6%
Angry 0.5%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.6%
Calm 93.9%
Fear 3.5%
Sad 1.4%
Angry 0.4%
Disgusted 0.3%
Surprised 0.2%
Happy 0.1%
Confused 0.1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 91.9%
Sad 3.6%
Disgusted 1.6%
Surprised 1%
Happy 0.7%
Angry 0.6%
Fear 0.4%
Confused 0.2%

AWS Rekognition

Age 28-38
Gender Male, 99.5%
Sad 29.3%
Fear 24.5%
Happy 15.5%
Calm 13.7%
Disgusted 6.2%
Surprised 5.1%
Confused 3%
Angry 2.8%

AWS Rekognition

Age 49-57
Gender Male, 61%
Happy 86.9%
Calm 4.5%
Angry 4.3%
Surprised 1.4%
Sad 1.3%
Disgusted 0.8%
Confused 0.6%
Fear 0.2%

AWS Rekognition

Age 33-41
Gender Male, 63.2%
Sad 41.1%
Happy 23.8%
Calm 18.8%
Fear 7.1%
Surprised 3.7%
Confused 2.2%
Angry 1.7%
Disgusted 1.7%

AWS Rekognition

Age 38-46
Gender Female, 92.8%
Calm 96%
Sad 3.4%
Happy 0.3%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 99.3%
Calm 93.7%
Sad 3.2%
Confused 1.1%
Disgusted 0.7%
Happy 0.7%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 95.4%
Calm 97.4%
Happy 0.5%
Surprised 0.5%
Confused 0.5%
Sad 0.4%
Disgusted 0.3%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Male, 92.7%
Calm 88.6%
Surprised 2.9%
Happy 2.7%
Sad 2.1%
Confused 1.4%
Fear 0.9%
Disgusted 0.7%
Angry 0.7%

AWS Rekognition

Age 40-48
Gender Male, 90.8%
Calm 96.5%
Sad 1.1%
Angry 1%
Disgusted 0.4%
Fear 0.3%
Surprised 0.3%
Happy 0.2%
Confused 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Sad 95.5%
Confused 2%
Calm 1.2%
Happy 0.5%
Disgusted 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 71.1%
Calm 99%
Angry 0.3%
Sad 0.2%
Disgusted 0.2%
Happy 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 50-58
Gender Male, 87%
Calm 66%
Sad 15.8%
Happy 7.1%
Surprised 5.3%
Confused 2.9%
Angry 1.5%
Disgusted 1%
Fear 0.4%

AWS Rekognition

Age 40-48
Gender Female, 83.6%
Calm 95%
Sad 3.4%
Confused 1.1%
Fear 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 38-46
Gender Male, 90.5%
Calm 46.3%
Happy 36.2%
Surprised 7.3%
Sad 3.3%
Confused 3.1%
Disgusted 1.4%
Fear 1.3%
Angry 1.1%

AWS Rekognition

Age 25-35
Gender Female, 92.3%
Calm 55.4%
Sad 17.4%
Surprised 13.9%
Disgusted 3.7%
Angry 3.6%
Happy 2.6%
Fear 2.1%
Confused 1.3%

AWS Rekognition

Age 27-37
Gender Male, 93.4%
Happy 99.4%
Sad 0.2%
Calm 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 52.2%
Calm 91.5%
Surprised 3.2%
Happy 2.6%
Confused 0.8%
Fear 0.7%
Angry 0.4%
Disgusted 0.4%
Sad 0.3%

AWS Rekognition

Age 29-39
Gender Female, 88.5%
Calm 90.1%
Sad 6.1%
Happy 1.9%
Confused 0.7%
Disgusted 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 55%
Sad 83.4%
Confused 4.3%
Calm 3.6%
Fear 2.9%
Happy 2.5%
Surprised 1.3%
Disgusted 1.1%
Angry 0.9%

AWS Rekognition

Age 43-51
Gender Male, 98.8%
Calm 93.5%
Happy 4.5%
Surprised 0.5%
Angry 0.4%
Confused 0.3%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 13-21
Gender Male, 99.7%
Calm 98.4%
Happy 0.9%
Sad 0.5%
Surprised 0.1%
Disgusted 0.1%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 87.8%
Calm 93%
Fear 2.3%
Happy 2%
Angry 1%
Disgusted 0.6%
Sad 0.5%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 35-43
Gender Male, 91.6%
Calm 99.6%
Sad 0.3%
Surprised 0%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 96%
Calm 79.4%
Fear 15.2%
Happy 2.2%
Surprised 1%
Sad 1%
Disgusted 0.5%
Angry 0.4%
Confused 0.4%

AWS Rekognition

Age 35-43
Gender Male, 98.3%
Calm 59.1%
Angry 12.1%
Happy 12.1%
Confused 10.7%
Surprised 3.6%
Sad 1.2%
Disgusted 1.1%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Male, 99.2%
Sad 71.7%
Calm 18.5%
Happy 5.9%
Disgusted 1.4%
Angry 1.1%
Surprised 0.6%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 94.7%
Calm 99.6%
Sad 0.2%
Surprised 0.1%
Fear 0%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 28-38
Gender Male, 90.5%
Happy 50.9%
Calm 46.6%
Sad 1.3%
Confused 0.3%
Surprised 0.3%
Angry 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Male, 95.6%
Calm 65%
Surprised 21%
Happy 6.3%
Angry 3.5%
Sad 1.4%
Fear 1.2%
Disgusted 0.8%
Confused 0.8%

AWS Rekognition

Age 51-59
Gender Male, 96.3%
Calm 45.8%
Sad 37.1%
Confused 5.5%
Happy 3.8%
Fear 2.6%
Disgusted 2.1%
Surprised 2%
Angry 1.1%

AWS Rekognition

Age 36-44
Gender Male, 99.6%
Calm 92.2%
Sad 3.7%
Angry 1.6%
Fear 0.8%
Disgusted 0.6%
Surprised 0.5%
Happy 0.3%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Female, 92.9%
Sad 98.4%
Calm 1.2%
Confused 0.1%
Fear 0.1%
Happy 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 36-44
Gender Male, 76%
Calm 75.7%
Sad 19.4%
Fear 1.4%
Confused 1%
Disgusted 1%
Happy 0.8%
Angry 0.4%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Female, 93.9%
Calm 99.5%
Happy 0.4%
Surprised 0%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 37-45
Gender Male, 97.6%
Calm 99.8%
Sad 0.1%
Confused 0%
Disgusted 0%
Happy 0%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Female, 65.2%
Sad 87.9%
Happy 5.6%
Angry 2%
Confused 1.3%
Calm 1.2%
Disgusted 1.1%
Surprised 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Text analysis

Amazon

2012
1817
1010