Human Generated Data

Title

Untitled (graduation ceremony for young children)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7979
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (graduation ceremony for young children)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.6
Human 99.6
Clothing 98.8
Apparel 98.8
Person 98.5
Person 98.3
Person 98.2
Person 97.6
Person 94.4
Person 93.1
Person 92.1
Person 91.5
Person 87.5
Person 87
Person 85.8
Person 84.3
People 82.5
Person 81.5
Crowd 79.2
Military 79.1
Person 78.7
Military Uniform 76.8
Officer 74.4
Person 72.1
Person 69.9
Person 66.8
Person 66.7
Person 66.3
Hat 63.8
Person 62.6
Cap 60.3
Funeral 58.4
Outdoors 58.4
Sailor Suit 55.2
Hat 50.1
Person 50
Person 44.4
Person 43.2

Imagga
created on 2022-01-09

people 22.9
person 17.9
man 16.9
business 15.2
men 13.7
room 12.5
musical instrument 12.2
male 12.1
group 12.1
life 12
businessman 11.5
table 11.2
travel 10.6
women 10.3
classroom 9.8
outdoors 9.7
fan 9.7
celebration 9.6
sky 9.6
beach 9.3
bathing cap 9.3
wedding 9.2
animal 9
summer 9
sunset 9
seller 8.9
landscape 8.9
couple 8.7
water 8.7
day 8.6
bouquet 8.5
cap 8.5
outdoor 8.4
brass 8.3
clothing 8.1
sea 8
building 7.9
party 7.7
worker 7.7
percussion instrument 7.6
wind instrument 7.5
house 7.5
leisure 7.5
ocean 7.5
new 7.3
success 7.2
coast 7.2
love 7.1
follower 7
together 7

Google
created on 2022-01-09

Photograph 94.2
Hat 87.3
Style 83.9
Sun hat 82.5
Headgear 80.8
Monochrome 75.2
Snapshot 74.3
Suit 73.5
Event 73
Monochrome photography 72.7
Crew 71.3
Crowd 70.9
Chair 69.7
Team 69.1
History 67.1
Vintage clothing 63.8
Uniform 62.9
Stock photography 62
Dishware 61.8
Room 61.6

Microsoft
created on 2022-01-09

text 97.9
clothing 93.9
person 93.5
man 90.9
funeral 79.1
people 72.6
group 65.1
crowd 22.5
several 10.9

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Male, 98.8%
Calm 92.7%
Sad 2.9%
Confused 1.2%
Happy 1.2%
Angry 0.7%
Fear 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 33-41
Gender Male, 96.9%
Calm 74.5%
Sad 16.2%
Happy 3.1%
Confused 1.4%
Disgusted 1.3%
Surprised 1.2%
Angry 1.2%
Fear 1.1%

AWS Rekognition

Age 23-33
Gender Male, 99.4%
Calm 64.1%
Happy 22%
Sad 5.1%
Angry 4.3%
Disgusted 1.5%
Fear 1.3%
Surprised 1%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Female, 80.9%
Calm 55.6%
Sad 21.9%
Happy 13.2%
Fear 5%
Disgusted 1.7%
Angry 1.2%
Confused 1%
Surprised 0.5%

AWS Rekognition

Age 26-36
Gender Male, 96.5%
Happy 72.6%
Calm 20.4%
Surprised 2.9%
Disgusted 1.7%
Sad 0.9%
Fear 0.8%
Confused 0.5%
Angry 0.4%

AWS Rekognition

Age 30-40
Gender Male, 98.3%
Happy 45.5%
Disgusted 20.3%
Calm 13.8%
Surprised 8.6%
Angry 6.3%
Confused 4%
Fear 0.8%
Sad 0.7%

AWS Rekognition

Age 24-34
Gender Female, 62.7%
Calm 94.6%
Happy 2.3%
Sad 1.7%
Angry 0.3%
Disgusted 0.3%
Surprised 0.3%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 43-51
Gender Female, 85.8%
Calm 64.3%
Sad 20.8%
Happy 5.9%
Fear 2.9%
Confused 2.7%
Disgusted 1.7%
Surprised 0.9%
Angry 0.7%

AWS Rekognition

Age 24-34
Gender Female, 59.9%
Calm 66.7%
Happy 28.9%
Sad 1.5%
Surprised 1%
Confused 0.7%
Disgusted 0.6%
Angry 0.4%
Fear 0.3%

AWS Rekognition

Age 39-47
Gender Female, 51.8%
Sad 71.6%
Calm 16.4%
Happy 7.4%
Confused 2.2%
Fear 0.7%
Surprised 0.7%
Disgusted 0.6%
Angry 0.4%

AWS Rekognition

Age 25-35
Gender Male, 67.8%
Calm 82.4%
Sad 7.1%
Surprised 3.6%
Disgusted 2.4%
Happy 1.4%
Angry 1.4%
Confused 1.3%
Fear 0.4%

AWS Rekognition

Age 23-33
Gender Female, 90.1%
Happy 99.3%
Surprised 0.3%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Calm 0.1%
Angry 0%
Sad 0%

AWS Rekognition

Age 30-40
Gender Male, 98.4%
Sad 53%
Calm 41.6%
Happy 1.6%
Angry 1.3%
Confused 1%
Fear 0.5%
Disgusted 0.4%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.6%
Hat 63.8%

Captions

Microsoft

a group of people standing in front of a crowd 88.6%
a group of people sitting in front of a crowd 85.3%
a group of people sitting and standing in front of a crowd 85.2%

Text analysis

Amazon

FLORIDA
SARASOTA.
43053
STEINMETZ. SARASOTA. FLORIDA
STEINMETZ.

Google

STEINMETZ. SARASOTA. FLORIDA MJI7--YT3A°2-
STEINMETZ.
SARASOTA.
FLORIDA
MJI7--YT3A°2-