Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4255

Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 99.9
Apparel 99.9
Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99.3
Person 98.9
Person 98.5
Person 97.8
Person 96.4
Person 96.3
Person 93.5
Person 92.8
Person 91
Helmet 87.7
Electronics 79.6
Screen 79.6
Person 78.6
Helmet 76.3
Helmet 73.7
Hat 73.6
Monitor 73.2
Display 73.2
People 71.4
Helmet 71.3
Person 69.5
Cowboy Hat 67.8
Person 64.4
Helmet 63.8
Sun Hat 61.6
Crash Helmet 61.2
Mirror 60.8
Hat 59.7
Military 59.7
Sailor Suit 57.5
Hardhat 57.3
Military Uniform 56.3
Car Mirror 55.6
Coat 55.6
Overcoat 55.6
Person 50.4

Imagga
created on 2022-01-08

military uniform 73.7
uniform 60.4
clothing 54.6
covering 34.7
consumer goods 34.1
man 24.8
hat 21.9
male 20.5
cowboy hat 19.1
people 17.8
person 17.8
commodity 14.6
black 14.4
old 13.9
adult 13.6
military 13.5
horse 13.3
suit 12.6
statue 12.3
headdress 12
industrial 11.8
soldier 11.7
history 11.6
war 11.5
protection 10.9
industry 10.2
danger 10
city 10
worker 9.8
business 9.7
sculpture 9.7
historic 9.2
travel 9.1
vintage 9.1
tourism 9.1
portrait 9.1
one 8.9
mask 8.9
nuclear 8.7
world 8.7
men 8.6
safety 8.3
dirty 8.1
transportation 8.1
destruction 7.8
disaster 7.8
toxic 7.8
gas 7.7
building 7.5
outdoors 7.5
holding 7.4
environment 7.4
private 7.3
work 7.1
businessman 7.1
architecture 7

Google
created on 2022-01-08

Hat 94.7
Sun hat 92.2
Fedora 91
Headgear 83.1
Font 78.5
Art 74.9
Suit 73.4
Cap 70.8
Picture frame 69
Event 67.7
Vintage clothing 67.7
Cowboy hat 66.4
Photo caption 62.1
Stock photography 61.8
History 60.6
Room 60.4
Street 59.6
Monochrome 59.1
Monochrome photography 59.1
Advertising 56.4

Microsoft
created on 2022-01-08

text 99.3
person 96.7
hat 94.7
clothing 94.1
military uniform 94
fashion accessory 85
man 83.5
military 66.9
old 65
fedora 64.7
helmet 55.2

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 86.7%
Calm 95.2%
Confused 1.3%
Sad 1.2%
Angry 0.9%
Surprised 0.7%
Disgusted 0.4%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 96.7%
Fear 1.2%
Surprised 0.5%
Angry 0.4%
Confused 0.4%
Disgusted 0.3%
Happy 0.3%
Sad 0.3%

AWS Rekognition

Age 23-31
Gender Male, 59.4%
Calm 58.5%
Surprised 23.8%
Disgusted 7.5%
Angry 6.4%
Confused 1.1%
Happy 1%
Sad 0.8%
Fear 0.8%

AWS Rekognition

Age 41-49
Gender Male, 99.4%
Calm 97.7%
Sad 1.5%
Angry 0.5%
Disgusted 0.1%
Surprised 0.1%
Happy 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 27-37
Gender Male, 97%
Calm 74.7%
Sad 23.6%
Fear 0.4%
Happy 0.3%
Angry 0.3%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 39-47
Gender Male, 100%
Sad 51.1%
Calm 23%
Angry 10.4%
Fear 7.6%
Surprised 3.6%
Disgusted 3%
Confused 0.7%
Happy 0.7%

AWS Rekognition

Age 26-36
Gender Male, 97.9%
Fear 81.2%
Sad 11.4%
Angry 3.9%
Calm 1.9%
Surprised 0.8%
Happy 0.3%
Disgusted 0.3%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Helmet 87.7%
Hat 73.6%

Captions

Microsoft

a group of people in uniform 89.5%
a man wearing a uniform 88.9%
an old photo of a group of people in uniform 85.1%

Text analysis

Amazon

CIGARS
ND
CIGANS
FROM5UP
ТИОЧИО
FROM5FUP

Google

DN 6OMI CIGARS FRONSUP FRON UP
FRON
DN
6OMI
UP
CIGARS
FRONSUP