Human Generated Data

Title

Untitled (Chelsea, New York City)
Date

c. 1939
People

Artist: Sid Grossman, American 1913 - 1955
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, by exchange, P2000.22
Copyright

© Howard Greenberg Gallery, New York

Human Generated Data

Title

Untitled (Chelsea, New York City)

People

Artist: Sid Grossman, American 1913 - 1955

Date

c. 1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Apparel 99.8
Clothing 99.8
Person 99.3
Human 99.3
Footwear 79
Shoe 79
Shorts 76.4
Town 74
Metropolis 74
Building 74
Urban 74
City 74
Female 73.1
Sleeve 67.2
Advertisement 67.1
Woman 60.4
Poster 59

Imagga
created on 2022-01-08

newspaper 37.1
product 29.4
person 24.1
creation 23
shop 19.8
adult 19.5
man 19.5
black 19
city 18.3
posing 16.9
portrait 16.8
people 15.6
male 14.9
urban 14.9
statue 14.8
body 14.4
mercantile establishment 14.3
human 14.3
one 14.2
sensuality 13.6
model 13.2
pose 12.7
old 12.5
fashion 12.1
architecture 11.8
sexy 11.2
building 10.9
relaxation 10.9
art 10.4
hair 10.3
street 10.1
figure 10
fitness 9.9
world 9.9
sculpture 9.6
place of business 9.5
ancient 9.5
sitting 9.5
dark 9.2
sax 9.2
vintage 9.1
style 8.9
bookshop 8.9
lifestyle 8.7
stone 8.4
attractive 8.4
musical instrument 8.3
silhouette 8.3
lady 8.1
wind instrument 8
face 7.8
modern 7.7
pretty 7.7
outdoor 7.6
dance 7.6
balance 7.6
scholar 7.6
action 7.4
tobacco shop 7.4
billboard 7.3
alone 7.3
dress 7.2
looking 7.2
religion 7.2
cool 7.1
interior 7.1

Google
created on 2022-01-08

Photograph 94.1
Hat 88.6
Street fashion 86.2
Black-and-white 83.9
Style 83.8
Sun hat 82
Fedora 80
Thigh 79.1
Vintage clothing 75.4
Snapshot 74.3
Font 73.6
Waist 73.6
Luggage and bags 73.5
Human leg 73.5
Advertising 71.5
Monochrome photography 71.5
Monochrome 69.2
Fashion design 68.6
Knee 66.6
Street 66.2

Microsoft
created on 2022-01-08

text 99.9
outdoor 93
clothing 92.1
booth 86.5
person 85.8
poster 78.4
book 69.2
woman 65.6
human face 59.7
street 58.7
store 48.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 67%
Confused 21.3%
Fear 6.9%
Surprised 1.8%
Sad 1.6%
Angry 0.8%
Disgusted 0.4%
Happy 0.2%

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a person standing in front of a store 94.2%
a person standing in front of a store window 91.9%
a person holding a sign in front of a store 86.9%

Text analysis

Amazon

INTER
CORTLA
PLAINS
UPTOW
WHITE PLAINS
WHITE
VAN CORTLA
VAN
RAPID
FOO
SAND
DOUGHN
WALE
R
2'
do
Chel
STI
OU
МЭЙ
aga

Google

WALE
INTE
UPTOW
ME
SAND
RAPID
VAN
CORTLA
WHITE
PLAINS
DOUGHN
ME FOO DOUGHN WALE Chel SAND INTE RAPID UPTOW VAN CORTLA WHITE PLAINS
FOO
Chel