Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

Date

1932-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4260

Human Generated Data

Title

Untitled (Sixth Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Person 99.7
Human 99.7
Person 99.6
Person 99.2
Person 98.7
Person 98.5
Person 98.2
Person 96.6
Person 96.2
Person 93.9
Person 91.2
Cowboy Hat 85.8
Sun Hat 83.1
Face 72.7
Hat 63.5
Screen 60.8
Electronics 60.8
Crowd 59.8
People 58
Mirror 55.1
Person 49.4
Person 43.1

Imagga
created on 2022-01-08

military uniform 97.5
uniform 80.6
clothing 58.6
consumer goods 41
covering 40.6
architecture 24.2
city 20.8
history 20.6
man 19.5
commodity 19.2
old 18.8
building 17.5
hat 17.3
male 15.6
statue 15.2
people 15
sculpture 14.3
gun 13.9
construction 13.7
cannon 13.2
weapon 13.1
person 12.4
private 12.2
travel 12
urban 11.4
war 11.3
monument 11.2
historic 11
portrait 11
military 10.6
vintage 9.9
helmet 9.7
outdoors 9.7
work 9.4
culture 9.4
artillery 9.1
art 9.1
landmark 9
religion 9
men 8.6
industry 8.5
adult 8.4
power 8.4
engineer 8.3
sky 8.3
tourism 8.2
retro 8.2
protection 8.2
transportation 8.1
battle 7.8
soldier 7.8
army 7.8
sitting 7.7
palace 7.7
capital 7.6
stone 7.6
world 7.6
buildings 7.6
historical 7.5
town 7.4
business 7.3
industrial 7.3
black 7.2
face 7.1

Google
created on 2022-01-08

Photograph 94.2
Hat 91.8
Fedora 89.7
Coat 87.4
Headgear 83.5
Font 83.1
Sun hat 79.8
Technology 75.3
Snapshot 74.3
Electronic device 74.2
Suit 68.9
Room 66.9
Advertising 65.5
Vintage clothing 65.3
Art 64.1
Photo caption 63.5
Stock photography 62.5
History 61.8
Square 58.1
Display device 57.2

Microsoft
created on 2022-01-08

text 99
person 85.8
clothing 77.3
hat 66.8
man 59.6
military 58.9
old 58.6

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 41.9%
Happy 23.6%
Sad 19.2%
Angry 6.9%
Fear 2.7%
Disgusted 2.1%
Surprised 1.9%
Confused 1.6%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 72.5%
Confused 10.4%
Angry 6.6%
Surprised 2.7%
Sad 2.6%
Fear 2.5%
Disgusted 1.5%
Happy 1.2%

AWS Rekognition

Age 23-31
Gender Male, 99%
Calm 64.9%
Sad 31.9%
Angry 1.1%
Confused 0.7%
Disgusted 0.5%
Surprised 0.4%
Happy 0.4%
Fear 0.3%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 63.6%
Happy 12.4%
Sad 6.8%
Angry 6.1%
Fear 3.8%
Confused 3.4%
Surprised 2.3%
Disgusted 1.7%

AWS Rekognition

Age 24-34
Gender Male, 99.7%
Calm 89.5%
Angry 4%
Surprised 2.1%
Sad 1.5%
Confused 1.1%
Happy 1%
Disgusted 0.6%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 63.5%

Captions

Microsoft

a group of people standing in front of a building 82%
a group of people standing in front of a store 75.1%
a group of people in front of a store 72.8%

Text analysis

Amazon

MILK
STUDIO
MALTED
LIGHTING
G
HEALTH
SHOP
BLIC
R
ELECTRIC SHOP
STRENGIN
ELECTRIC
ENEVA
STA
17
FIXTURES
В
POR 17
IN
THIN
NURCIN IN
NURCIN
NKK
PESA
a
NKK NIKE
POR
СТАР
NIKE

Google

GHTING
MALTED
5
SB8
DITAMORHEMA 00000 GHTING XTURES STUDIO HEALTH MALTED MILK 5 STRENCIN BLIC STAN SB8 e 3 t 2.
00000
STUDIO
STAN
3
2.
MILK
STRENCIN
t
DITAMORHEMA
XTURES
HEALTH
BLIC
e