Human Generated Data

Title

Untitled (graduation ceremony for young children)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7978

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (graduation ceremony for young children)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.3
Person 98.8
Person 98.1
Person 95.7
Person 95.3
Person 95.1
Funeral 94.6
Person 90.9
Crowd 89.2
Face 85.7
Person 82.8
Person 81.5
Person 81
Footwear 80.1
Shoe 80.1
Clothing 80.1
Apparel 80.1
People 78.2
Person 77.2
Person 71.6
Person 71.2
Person 70.8
Person 68.1
Photography 65.5
Photo 65.5
Musician 58.4
Musical Instrument 58.4
Person 56.3
Person 53.4
Person 42.3

Imagga
created on 2022-01-09

percussion instrument 28.5
musical instrument 28
stage 21.9
people 20.1
man 16.8
group 16.1
steel drum 16
male 15.6
platform 15.4
business 15.2
person 15.1
men 14.6
drum 13.6
travel 13.4
city 10.8
center 10.8
room 10.5
speaker 10.1
tourism 9.9
old 9.7
businessman 9.7
sea 9.4
street 9.2
sky 8.9
celebration 8.8
table 8.6
mortar 8.6
architecture 8.6
teacher 8.5
summer 8.4
silhouette 8.3
hall 8.2
team 8.1
device 7.8
corporate 7.7
crowd 7.7
ocean 7.5
brass 7.5
water 7.3
vessel 7.3
new 7.3
wind instrument 7.2
color 7.2
work 7.2
classroom 7.2
bass 7.2
women 7.1
day 7.1

Google
created on 2022-01-09

Photograph 94.2
Black 89.6
Hat 88.9
Sun hat 84.3
Style 84
Monochrome 78.8
Monochrome photography 76.9
Event 73.3
Crew 73.1
Crowd 72.9
Chair 68
Team 68
History 67.8
Funeral 65.4
Art 64.7
Stock photography 64.3
Circle 62
Uniform 59
Font 57
Vintage clothing 56.9

Microsoft
created on 2022-01-09

text 97.6
clothing 93.5
man 90.7
people 87.9
person 87.6
funeral 84.9
black and white 71.8
group 70.5
crowd 33.2
several 10.4

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 94.7%
Calm 43.5%
Sad 32.2%
Happy 14.5%
Angry 5.3%
Disgusted 1.6%
Confused 1.2%
Fear 0.9%
Surprised 0.7%

AWS Rekognition

Age 29-39
Gender Male, 99.5%
Calm 79.4%
Sad 15.6%
Fear 1.4%
Confused 1%
Surprised 0.8%
Angry 0.8%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 28-38
Gender Male, 97.7%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Surprised 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Disgusted 49.3%
Calm 16.4%
Sad 15.8%
Confused 7%
Happy 6.6%
Surprised 2%
Fear 1.6%
Angry 1.1%

AWS Rekognition

Age 33-41
Gender Male, 90%
Happy 61.9%
Calm 32.5%
Sad 3.4%
Disgusted 0.7%
Surprised 0.5%
Confused 0.4%
Fear 0.4%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Female, 58.4%
Happy 65.4%
Calm 20.6%
Sad 6.9%
Confused 1.6%
Disgusted 1.4%
Angry 1.3%
Fear 1.3%
Surprised 1.3%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 88.9%
Happy 7.1%
Sad 1.9%
Confused 1.2%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Female, 54.2%
Calm 96.9%
Surprised 1.3%
Happy 0.6%
Fear 0.4%
Sad 0.3%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 45-53
Gender Male, 99.7%
Happy 52.6%
Calm 30.6%
Sad 5.6%
Confused 4.2%
Disgusted 2.5%
Fear 1.9%
Surprised 1.6%
Angry 0.9%

AWS Rekognition

Age 38-46
Gender Male, 92.6%
Calm 90.1%
Happy 6.8%
Surprised 0.8%
Sad 0.7%
Confused 0.6%
Disgusted 0.5%
Angry 0.4%
Fear 0.1%

AWS Rekognition

Age 16-22
Gender Female, 82.3%
Happy 98.7%
Sad 0.5%
Calm 0.4%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Male, 59.6%
Happy 46%
Sad 22.4%
Calm 22.1%
Disgusted 2.5%
Fear 2%
Confused 1.9%
Angry 1.8%
Surprised 1.4%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Calm 58.7%
Sad 24.1%
Angry 5.5%
Happy 4.1%
Confused 3.7%
Fear 1.6%
Surprised 1.4%
Disgusted 0.9%

AWS Rekognition

Age 22-30
Gender Female, 57.7%
Calm 96.3%
Sad 2.1%
Happy 1%
Surprised 0.3%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 80.1%

Captions

Microsoft

a group of people standing in front of a crowd 93%
a group of people standing in front of a crowd of people 92.3%
a group of people in front of a crowd 92.2%

Text analysis

Amazon

FLORIDA
SARASOTA.
STEINMETZ. SARASOTA. FLORIDA
43054
STEINMETZ.

Google

MJI7--
STEINMETZ
FLORIDA
3RA
2--AGON
SARASOTA.
STEINMETZ SARASOTA. FLORIDA MJI7-- YT 3RA 2--AGON
YT