Human Generated Data

Title

Untitled (Natchez, Mississippi)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1484

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Natchez, Mississippi)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Footwear 99.9
Apparel 99.9
Shoe 99.9
Clothing 99.9
Shoe 99.5
Person 99.3
Human 99.3
Person 96.3
Walkway 88.7
Path 88.7
Home Decor 84.2
Outdoors 82.5
Brick 81.9
Nature 74.2
Wall 72.4
Flagstone 64.2
Window 63.4
Door 60.9
Sitting 58.7
Cafe 57.7
Restaurant 57.7
Pavement 57.2
Sidewalk 57.2

Imagga
created on 2021-12-15

sill 67.1
structural member 51.3
old 49.5
architecture 49.5
building 47.9
ancient 39
support 32.8
door 32.4
stone 30.4
wall 30.2
history 29.5
tourism 26.4
city 25.8
window 24.7
travel 24
historic 23.9
house 23.5
brick 22.5
medieval 21.1
facade 20.8
historical 20.7
religion 19.7
culture 19.7
entrance 19.3
device 19.2
structure 18.7
town 18.6
exterior 18.5
arch 18.4
street 17.5
church 16.7
urban 16.6
monument 15.9
antique 14.7
tourist 14.6
construction 14.6
architectural 14.4
art 13.8
landmark 13.6
palace 13.1
detail 12.9
village 12.5
temple 12
sculpture 11.9
buildings 11.4
religious 11.3
place 11.2
home 11.2
wood 10.9
vintage 10.8
ruin 10.7
vacation 10.7
cathedral 10.6
traditional 10
roman 9.8
gate 9.7
wooden 9.7
residence 9.4
destination 9.4
famous 9.3
texture 9
prison 8.8
abandoned 8.8
concrete 8.6
attraction 8.6
details 8.5
balcony 8.4
alley 7.9
heritage 7.7
castle 7.7
outdoors 7.5
style 7.4
marble 7.3
stucco 7.3
design 7.3
aged 7.2
dirty 7.2

Google
created on 2021-12-15

Building 93.2
Window 91.7
Rectangle 84.3
Door 82
Wood 81.6
Wall 81.4
Adaptation 79.2
People 78.4
Tints and shades 77.4
House 76.8
Brick 73.3
Monochrome 72.4
Facade 72.2
Monochrome photography 71
Art 69.9
Room 67.5
Vintage clothing 66.8
Street 66.6
Sitting 66.4
History 63.3

Microsoft
created on 2021-12-15

building 99.9
door 84.7
clothing 59.8
street 55.5
person 50.1
stone 26.1

Face analysis

Amazon

Google

AWS Rekognition

Age 26-42
Gender Male, 93.9%
Calm 88.4%
Sad 6.8%
Confused 1.3%
Surprised 1.3%
Angry 1.1%
Happy 0.6%
Fear 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.9%
Person 99.3%
Door 60.9%

Captions

Microsoft

a cat sitting on a bench in front of a brick building 45.1%
a cat sitting on a bench in front of a building 45%
a cat sitting on a bench in front of a window 43.4%

Text analysis

Amazon

OPEN

Google

OPEN
OPEN