Human Generated Data

Title

Untitled (Madison Square or Washington Square, New York City)

Date

1933-1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4216

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Madison Square or Washington Square, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.4
Person 99.4
Person 95.3
Person 89.9
Person 84.5
Person 78.3
Vehicle 74.7
Transportation 74.7
Building 67.6
Architecture 67.6
Military 63.1
Person 60.9
Person 60.2
Advertisement 57.7
Poster 57.7
Fort 56.9
Castle 56.9

Imagga
created on 2021-12-15

architecture 44.8
ancient 44.1
old 42.5
stone 41
brick 38.9
fortress 38.1
history 34.9
wall 29.4
hole 28.8
tourism 28.1
historic 27.5
travel 26.8
antique 26.1
building 26
landmark 24.4
culture 23.9
monument 21.5
temple 21.3
building material 20.8
column 20.5
ruin 20.4
art 20.3
roman 20.2
famous 19.6
sky 19.1
castle 18.5
vintage 18.2
grunge 17
structure 16.8
ruins 16.6
retro 16.4
archeology 15.7
tower 15.2
minaret 15.2
historical 15.1
sculpture 14.8
texture 14.6
construction 14.6
tourist 14.5
religion 14.4
past 13.6
city 13.3
rock 13
exterior 12
fort 11.8
paper 11.8
frame 11.7
facade 11.5
damaged 11.5
weathered 11.4
place 11.2
border 10.9
palace 10.8
empty 10.3
brown 10.3
film 10.2
window 10.1
aged 10
dirty 9.9
slide 9.8
movie 9.7
negative 9.5
grain 9.2
material 9.1
civilization 8.8
statue 8.8
arch 8.7
architectural 8.7
grungy 8.5
design 8.4
east 8.4
outdoors 8.2
pattern 8.2
rough 8.2
vacation 8.2
style 8.2
carving 8.1
graphic 8
text 7.9
columns 7.9
sepia 7.8
crumpled 7.8
heritage 7.7
medieval 7.7
obsolete 7.7
old fashioned 7.6
screen 7.5
detail 7.2
textured 7

Google
created on 2021-12-15

Photograph 94.3
Line 82
Rectangle 81.6
Font 80.5
Tints and shades 75.9
History 67.8
Art 67.6
Paper product 65.2
Collectable 63.9
Stock photography 62.8
Suit 61.5
Room 61.4
Negative 59.9
Visual arts 59.7
Hat 55.6
Paper 55.2
Arch 52.3
Wood 52.2
Holy places 50.7
Square 50.6

Microsoft
created on 2021-12-15

indoor 87.9
clothing 72.3
text 68.9
person 60.2
old 40.8

Face analysis

Amazon

Google

AWS Rekognition

Age 4-14
Gender Female, 80.7%
Calm 97.5%
Happy 1.3%
Angry 0.5%
Sad 0.4%
Confused 0.1%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 33-49
Gender Female, 66.1%
Calm 89.6%
Angry 2.3%
Surprised 2.2%
Sad 1.9%
Happy 1.7%
Confused 1.3%
Fear 0.5%
Disgusted 0.4%

AWS Rekognition

Age 36-52
Gender Female, 70.1%
Calm 73.1%
Sad 18.7%
Confused 3%
Happy 2.5%
Angry 1%
Fear 0.9%
Surprised 0.7%
Disgusted 0.1%

AWS Rekognition

Age 15-27
Gender Female, 64.6%
Happy 83.1%
Calm 14.8%
Angry 0.7%
Fear 0.5%
Sad 0.4%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 5-15
Gender Female, 55.7%
Calm 62.1%
Happy 30.6%
Confused 2%
Sad 1.9%
Surprised 1.3%
Angry 0.8%
Fear 0.8%
Disgusted 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Possible

Feature analysis

Amazon

Person 99.4%
Poster 57.7%

Captions

Microsoft

an old photo of a man 42.5%
old photo of a man 40.9%
a display in a store 40.8%

Text analysis

Amazon

UO
ТИОЧ UO
ТИОЧ
treate