Human Generated Data

Title

Untitled (parade with marching band)
Date

c. 1945
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8943
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (parade with marching band)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Person 99.4
Person 99.1
Clothing 99.1
Apparel 99.1
Person 98.9
Person 98.8
Person 98.4
Person 97.6
Person 97.3
Person 97.2
Person 96.9
Person 96.2
Shorts 96.2
Person 95.9
Person 92.7
Person 91
Person 88.4
Pedestrian 88.1
Crowd 86.7
People 84
Person 81.9
Person 81.3
Tarmac 77.9
Asphalt 77.9
Person 77.4
Person 76.2
Face 70.1
Home Decor 67.9
Person 65.9
Officer 63.8
Military 63.8
Military Uniform 63.8
Hat 63.7
Road 62
Field 60.6
Leisure Activities 60.4
Suit 60.2
Coat 60.2
Overcoat 60.2
Parade 59.6
Female 59.2
Stage 58.5
Person 49.5

Imagga
created on 2022-01-09

spectator 34.4
city 24.9
architecture 23.4
stall 23.1
travel 19.7
people 18.4
building 17.8
old 17.4
world 17.2
sky 15.3
history 15.2
culture 14.5
night 14.2
tourism 13.2
crowd 12.5
classroom 12.3
urban 12.2
light 12
stone 11.8
landmark 11.7
ancient 11.2
room 11.2
famous 11.2
scene 10.4
monument 10.3
park 10.1
house 10.1
water 10
tourist 10
hall 9.7
group 9.7
capital 9.5
destination 9.3
church 9.2
street 9.2
business 9.1
black 9
stage 8.9
landscape 8.9
symbol 8.7
person 8.6
art 8.6
construction 8.5
historic 8.2
religion 8.1
rock 7.8
houses 7.7
men 7.7
tree 7.7
historical 7.5
structure 7.5
silhouette 7.4
coast 7.2
transportation 7.2
summer 7.1

Google
created on 2022-01-09

Black 89.6
Black-and-white 82.7
Motor vehicle 81.1
Art 80.6
Adaptation 79.2
People 77.7
Monochrome 75.9
Monochrome photography 75.3
Tree 70.1
Room 69.9
Vintage clothing 68.5
Pole 68.4
History 66.9
Visual arts 66.4
Event 65.6
Stock photography 63.7
Classic 63.3
Building 63.1
Paper product 61.4
Suit 59.5

Microsoft
created on 2022-01-09

text 95.8
clothing 93.5
outdoor 91.2
black and white 89.9
man 87.3
person 85.8
black 70.2
white 69.4
tree 51

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 97.1%
Calm 72.5%
Disgusted 19.6%
Happy 4.2%
Fear 0.9%
Sad 0.8%
Confused 0.7%
Angry 0.7%
Surprised 0.5%

AWS Rekognition

Age 25-35
Gender Female, 91.5%
Fear 35.2%
Happy 33.5%
Surprised 8.2%
Angry 7.8%
Calm 7.4%
Disgusted 4.9%
Sad 1.8%
Confused 1.3%

AWS Rekognition

Age 22-30
Gender Female, 94.8%
Fear 100%
Sad 0%
Calm 0%
Surprised 0%
Happy 0%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 19-27
Gender Male, 88.9%
Calm 64.4%
Happy 13.7%
Surprised 12.1%
Confused 4.6%
Fear 1.5%
Disgusted 1.5%
Angry 1.1%
Sad 1%

AWS Rekognition

Age 28-38
Gender Female, 86.3%
Calm 21%
Angry 16.4%
Sad 15.9%
Surprised 13.3%
Disgusted 13.3%
Happy 10.7%
Confused 7.1%
Fear 2.2%

AWS Rekognition

Age 29-39
Gender Female, 55.7%
Disgusted 78.1%
Happy 10.3%
Calm 3.8%
Fear 2.2%
Confused 2%
Sad 1.4%
Surprised 1.3%
Angry 0.9%

AWS Rekognition

Age 12-20
Gender Male, 77.1%
Calm 86.1%
Disgusted 3.9%
Happy 3.2%
Angry 2.8%
Confused 1.3%
Sad 1.3%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 34-42
Gender Male, 93.7%
Happy 50%
Surprised 23%
Calm 15.5%
Confused 5.8%
Sad 3%
Angry 1%
Fear 0.9%
Disgusted 0.8%

AWS Rekognition

Age 21-29
Gender Male, 97.5%
Calm 71.6%
Sad 7.5%
Happy 7.2%
Disgusted 5.3%
Confused 3.5%
Fear 2%
Surprised 1.8%
Angry 1.1%

AWS Rekognition

Age 20-28
Gender Male, 85.9%
Calm 50%
Sad 41.4%
Happy 6.4%
Fear 0.7%
Confused 0.7%
Disgusted 0.3%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 12-20
Gender Female, 58.3%
Disgusted 33.6%
Calm 23.3%
Sad 23.1%
Fear 6.8%
Angry 4.6%
Happy 4.5%
Surprised 3.2%
Confused 0.8%

AWS Rekognition

Age 20-28
Gender Male, 55.2%
Calm 45%
Fear 21.2%
Sad 20.1%
Happy 4.7%
Angry 2.5%
Surprised 2.5%
Disgusted 2.4%
Confused 1.6%

AWS Rekognition

Age 34-42
Gender Female, 58.3%
Calm 34.6%
Fear 23.9%
Confused 16.7%
Surprised 10.4%
Happy 7.3%
Disgusted 2.8%
Sad 2.5%
Angry 1.9%

AWS Rekognition

Age 23-31
Gender Female, 73.6%
Calm 62.5%
Happy 28.4%
Confused 2.6%
Sad 2.4%
Disgusted 1.4%
Angry 1.4%
Fear 0.7%
Surprised 0.5%

AWS Rekognition

Age 22-30
Gender Male, 82.9%
Calm 89.9%
Happy 3.2%
Fear 2.5%
Confused 1.3%
Sad 1%
Disgusted 0.8%
Angry 0.8%
Surprised 0.5%

AWS Rekognition

Age 23-33
Gender Male, 97.9%
Fear 81.2%
Sad 6.9%
Calm 3.2%
Happy 3.2%
Angry 1.7%
Disgusted 1.4%
Confused 1.3%
Surprised 1.1%

AWS Rekognition

Age 18-24
Gender Female, 52.8%
Calm 70.7%
Happy 14.5%
Sad 7.6%
Confused 3%
Fear 1.8%
Disgusted 1.2%
Surprised 0.6%
Angry 0.6%

AWS Rekognition

Age 30-40
Gender Female, 52.1%
Calm 62.5%
Happy 22.4%
Fear 6.7%
Sad 2.8%
Surprised 2%
Confused 1.5%
Angry 1.1%
Disgusted 1%

AWS Rekognition

Age 16-22
Gender Female, 74.5%
Calm 65.5%
Surprised 15.3%
Happy 7.1%
Fear 4.8%
Confused 2.3%
Sad 2.1%
Angry 1.4%
Disgusted 1.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people standing in front of a building 92.8%
a group of people walking in front of a building 92.7%
a group of people standing in front of a crowd 87.6%

Text analysis

Amazon

STOP