Human Generated Data

Title

Untitled (West Street, New York City)
Date

1933-1935
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2919
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (West Street, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1933-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 99.4
Apparel 99.4
Human 96
Person 96
Suit 94.1
Overcoat 94.1
Coat 94.1
Path 79.8
Shoe 79.5
Footwear 79.5
Face 74.1
Man 57.4
Sidewalk 57.1
Pavement 57.1
Female 56.9

Clarifai
created on 2018-03-23

people 99.9
one 99.2
adult 99.1
street 97.9
woman 97.2
man 95.9
two 92.9
wear 92.8
group together 91
administration 90
group 88.7
war 87
portrait 86.3
military 85.5
many 84.6
child 81.3
outfit 80.7
music 80.5
pavement 79.9
musician 79.3

Imagga
created on 2018-03-23

shopping cart 37.8
wheeled vehicle 30.6
handcart 30.3
newspaper 26.8
man 22.9
product 20.6
people 20.1
person 20
silhouette 18.2
sunset 17.1
container 16
creation 16
water 15.3
beach 15.2
sidewalk 14.9
adult 14.3
male 12.9
portrait 12.3
conveyance 11.5
outdoor 11.5
walking 11.4
human 11.2
black 11
sea 10.9
business 10.9
dress 10.8
businessman 10.6
sun 10.5
outdoors 10.4
legs 10.4
sport 10.3
wall 10.3
sky 10.2
alone 10
city 10
fashion 9.8
posing 9.8
style 9.6
couple 9.6
walk 9.5
action 9.3
ocean 9.1
danger 9.1
recreation 9
lady 8.9
success 8.9
runner 8.8
happy 8.8
sand 8.7
women 8.7
lifestyle 8.7
model 8.6
skateboard 8.5
summer 8.4
street 8.3
board 8.2
exercise 8.2
fitness 8.1
building 7.7
men 7.7
briefcase 7.6
dark 7.5
vacation 7.4
body 7.2
active 7.2
wet 7.2
hair 7.1
worker 7.1

Google
created on 2018-03-23

photograph 95.8
black 95.5
infrastructure 88.6
snapshot 81.8
photography 81.5
darkness 75.3
standing 74.1
street 74
black and white 71.3
road 63.2
night 61.6
human behavior 58.3
alley 58
flooring 54.7
floor 52.1

Microsoft
created on 2018-03-23

ground 99.2
outdoor 99.1
sidewalk 28.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 45-63
Gender Male, 54.8%
Calm 49.5%
Surprised 45.1%
Confused 46.8%
Angry 45.7%
Sad 47.6%
Happy 45.1%
Disgusted 45.1%

Feature analysis

Amazon

Person 96%
Shoe 79.5%

Captions

Microsoft

a person standing on a sidewalk 75.4%
a person walking down a sidewalk 75.3%
a person talking on a cell phone 24.3%

Text analysis

Amazon

WINES
LICENSED
10
WHISKJES
io
SN
We arc
LIOUORs.
io Scll
T
Scll
RE4 S0O

Google

WHISKIES a.tc LICENSED io scii
WHISKIES
a.tc
LICENSED
io
scii