Human Generated Data

Title

Untitled (Washington Square, New York City)
Date

1933-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4211
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Washington Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 98.8
Human 98.8
Person 97.6
Apparel 96.3
Clothing 96.3
Person 85.7
Military 77.9
Military Uniform 75.4
Officer 75
Hat 62.5
Sailor Suit 57.1
Porch 55

Imagga
created on 2021-12-15

column 43.8
sculpture 38
architecture 37
statue 35
brick 34.7
old 28.6
ancient 28.5
building material 28.4
stone 27.8
building 26.4
art 26.3
history 25.9
monument 25.2
tourism 23.9
religion 23.3
historic 22.9
temple 21.3
travel 21.1
crate 20.2
culture 18.8
marble 18.2
landmark 18.1
box 17.4
city 16.6
detail 16.1
god 15.3
religious 15
antique 14.8
carving 14.3
historical 14.1
container 13.1
structure 12.9
roman 12.7
facade 12.4
famous 12.1
exterior 12
heritage 11.6
retro 11.5
wall 11.3
church 11.1
tourist 10.9
flute 10.5
vintage 9.9
buildings 9.5
texture 9
palace 9
brown 8.8
columns 8.8
pray 8.7
decoration 8.7
holy 8.7
paper 8.6
woodwind 8.5
fountain 8.3
wind instrument 8.3
aged 8.1
face 7.8
catholic 7.8
grunge 7.7
attraction 7.6
outdoor 7.6
traditional 7.5
east 7.5
symbol 7.4
design 7.3
sky 7

Google
created on 2021-12-15

Hat 84.9
Rectangle 84.4
Window 80.5
Tints and shades 77.4
Wood 77.3
Snapshot 74.3
Sun hat 72.1
Vintage clothing 71
Room 65.9
Suit 64.1
Art 63.5
Paper product 59.1
Photographic film 57.2
Photographic paper 55.6
Square 55.4
Sitting 54.3
Font 52.3
Picture frame 52
Visual arts 50.4

Microsoft
created on 2021-12-15

hat 92
indoor 89.8
clothing 89.2
person 86.8
musical instrument 75.4
text 75.2
fedora 66.9
cowboy hat 66.2
old 51.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 39-57
Gender Male, 95.9%
Happy 97.5%
Calm 2.3%
Sad 0.1%
Surprised 0%
Angry 0%
Confused 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 5-15
Gender Female, 98.6%
Happy 99.6%
Calm 0.3%
Sad 0%
Confused 0%
Surprised 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 36-54
Gender Female, 59.5%
Happy 98.5%
Calm 1.4%
Sad 0%
Surprised 0%
Angry 0%
Fear 0%
Confused 0%
Disgusted 0%

Microsoft Cognitive Services

Age 8
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Hat 62.5%

Captions

Microsoft

a man sitting at a train station 25.7%