Human Generated Data

Title

Untitled (Sig. Klein Fat Men's Shop, 52 Third Avenue, New York City)
Date

1935-1936
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2926
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Sig. Klein Fat Men's Shop, 52 Third Avenue, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935-1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2926

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Advertisement 97.7
Human 97.4
Person 97.4
Text 76.8
Paper 74.5
Flyer 74.5
Brochure 74.5
Building 64.7
Urban 64.7
Town 64.7
Metropolis 64.7
City 64.7
Billboard 63.2
Sign 59.1
Symbol 59.1
Shop 57.6
Brick 56.8
Poster 55.3

Clarifai
created on 2018-03-23

people 99.8
monochrome 99
adult 98.6
street 97.7
one 95.2
man 95.1
woman 94.4
portrait 93.1
music 93
outdoors 91.3
administration 90.5
vehicle 88.4
two 88
group 87.9
city 86.8
wear 85.9
business 84.9
signal 84.5
transportation system 83.9
indoors 83.6

Imagga
created on 2018-03-23

building 66.9
architecture 51.8
city 43.3
structure 40.3
cinema 31.5
urban 29.7
billboard 29.1
signboard 26.6
theater 26.2
street 25.8
old 22.3
town 22.3
buildings 21.8
house 20.1
shop 19.8
window 19.1
travel 18.3
wall 18
windows 17.3
exterior 16.6
sky 16.6
brick 16
mercantile establishment 15.8
historic 15.6
downtown 15.4
new 13
balcony 12.8
houses 12.6
tourism 12.4
ancient 12.1
landmark 11.7
tower 11.6
facade 11.3
construction 11.1
glass 10.9
narrow 10.8
district 10.7
place of business 10.5
business 10.3
industry 10.3
stone 10.1
tobacco shop 9.9
history 9.8
modern 9.8
clock 9.6
home 9.6
cityscape 9.5
bridge 9.5
tall 9.4
destination 9.4
tourist 9.1
black 9
analog clock 8.9
high 8.7
iron 8.4
row 8.4
place 8.4
traditional 8.3
office 8.1
cities 7.8
bakery 7.8
skyscraper 7.8
crane 7.7
architectural 7.7
lamp 7.6
fire 7.5

Google
created on 2018-03-23

black and white 84.5
poster 75.7
art 75.4
building 72.7
design 65.2
font 62.5
mural 62.2
monochrome 61.9
street art 61.4
facade 56.3
street 51.2
monochrome photography 50.9
advertising 50.8

Microsoft
created on 2018-03-23

text 97.2
sign 71.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 52.7%
Disgusted 45.1%
Confused 45%
Surprised 45.1%
Calm 45.9%
Angry 45.2%
Happy 46%

Microsoft Cognitive Services

Age 46
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Poster 55.3%

Captions

Microsoft
created on 2018-03-23

a black sign with white text 92.2%
a black sign with white letters 92.1%
a white sign with black text 91%

Text analysis

Amazon

MEN'S
SHOP
KLEIN
FURNISHED
SIG. KLEIN
ROOMS
SIG.
WEAR
UNDER WEAR
FAT
UNDER
MAN'S
LARGE ROOMS
LEINS FAT MAN'S SHOP
LEINS
FAT MEN'S SHOP
SIZE
LARGE
1865
SMALL
TO
SINCE
52 SIG. 1865
TO FITANY SIZE MAN
52
FITANY
MAN
YEOLDF
THERT
RELIABLF
IVERVBODY THERT
YEOLDF RELIABLF KLE & SMALL
KLE
IVERVBODY
&

Google

0
MENS
KLEIN
LARGE
YE
S
THER
SINCE
BE
NO
UNDERWEAR
TO
FIT
ANY
SIZE
KLEINS
SHOP
52
FURNISHED ROOMS 0 FAT MENS SHOP SIG. KLEIN LARGE &SMALL ÷ 52 YE OLD S FAT THER SINCE 1865 LD BE NO WAR UNDERWEAR TO FIT ANY SIZE MAN KLEINS FAT MAN'S SHOP 52
FURNISHED
ROOMS
FAT
SIG
.
&SMALL
÷
OLD
1865
LD
WAR
MAN
MAN'S