Human Generated Data

Title

Untitled (Bowery, New York City)
Date

April 1936
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1998.135.16
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Bowery, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

April 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1998.135.16

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Poster 99
Advertisement 99
Person 98.5
Human 98.5
Interior Design 85
Indoors 85
Person 84.2
Flyer 79.5
Brochure 79.5
Paper 79.5
Furniture 72.4
Billboard 68.5
Text 68.5
Clothing 66.4
Apparel 66.4
Outdoors 58.8

Clarifai
created on 2023-10-29

people 99.6
monochrome 99.5
movie 96.4
adult 95.6
two 95.3
man 94.8
street 94.8
no person 93.9
child 93.2
retro 92.3
wear 91.3
group 90.2
elderly 90.2
woman 88.5
indoors 88.5
one 88
text 88
war 86.2
sit 84.8
recreation 82.9

Imagga
created on 2022-05-28

pay-phone 49.8
telephone 39.7
electronic equipment 38.7
equipment 24.4
barbershop 22.8
shop 22.3
old 22.3
vintage 16
mercantile establishment 15.5
dirty 15.4
building 15
texture 14.6
black 14.4
architecture 14.1
business 14
retro 13.9
house 13.4
city 13.3
grunge 12.8
light 12.7
finance 12.7
design 12.4
pattern 12.3
art 11.7
device 11.5
wall 11.1
frame 10.8
film 10.8
digital 10.5
sign 10.5
technology 10.4
window 10.3
place of business 10.3
rough 10
negative 9.9
bank 9.8
computer 9.8
movie 9.7
us 9.6
damaged 9.5
money 9.4
entertainment 9.2
banking 9.2
border 9
history 8.9
sky 8.9
machine 8.9
frames 8.8
graphic 8.8
grungy 8.5
dollar 8.3
cash 8.2
currency 8.1
success 8
metal 8
water 8
home 8
scratches 7.9
text 7.9
paper 7.8
noise 7.8
slide 7.8
antique 7.8
color 7.8
strip 7.8
hundred 7.7
rust 7.7
bill 7.6
door 7.6
dark 7.5
town 7.4
paint 7.2
vending machine 7.2
financial 7.1
night 7.1
travel 7

Google
created on 2022-05-28

Window 88
Black-and-white 86.1
Font 84.2
Style 84
Monochrome photography 75.3
Monochrome 75.3
Art 74.3
Urban area 73.6
Hat 70.8
Fedora 69.6
Poster 69.5
Street 67.5
Darkness 65.7
Stock photography 63.2
Advertising 62.9
Town 62.8
Helmet 62.4
Road 62.1
Room 61.7
Still life photography 59.9

Microsoft
created on 2022-05-28

text 99.7
black and white 95.9
person 91.2
clothing 89.3
street 82.2
handwriting 78.4
cartoon 73.9
monochrome 72.3
poster 66.9
man 64.9
drawing 61.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 86.9%
Confused 60.1%
Calm 23.7%
Surprised 13.3%
Fear 6.3%
Sad 2.9%
Disgusted 1.6%
Happy 0.9%
Angry 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Poster 99%
Person 98.5%

Categories

Imagga

interior objects 78.3%
food drinks 8.9%
text visuals 7.3%
events parties 4.7%

Captions

Text analysis

Amazon

BEFORE
WITH
LOVE
15
WITH LOVE
WHISPERING
SMITH
GAMBLE
TIMES
MODERN
DAYS
LOVE BEFORE BREAKFAST
LOMBARD
APRIL
PAULETTE
CAROLE LOMBARD
CAROLE
FRIDAY
here
FILM
Charlie
DON'T
WED.
here comes
Clap
PAULETTE GOODARD
comes
Twice
BREAKFAST
PROGRAM
GOODARD
WED. THUR. APRIL 15-16
THUR.
Clap hands
hands
COM
DON'T GAMBLE G WHISPERING
5 DAYS FRIDAY APRIL
W
Street
15-16
SMITH SPEANS
EE W
SPEANS
5
EE
G
CHAPLILO
OFFER
un

Google

PROGRAM DAYS FRIDAY APRIL 10 COM Clap handen here comes Charlie SHARLIE MODERN TIMES PAULETTE GODDARD CAROLE LOMBARD LOVE BEFORE BREAKFAST WED. THUR. APRIL 15-16 DON'T GAMBLE WHISPERING WITH LOVE SMITH SPEAKS 15 WAL
PROGRAM
DAYS
FRIDAY
APRIL
10
COM
Clap
handen
here
comes
Charlie
SHARLIE
MODERN
TIMES
PAULETTE
GODDARD
CAROLE
LOMBARD
LOVE
BEFORE
BREAKFAST
WED
.
THUR
15-16
DON'T
GAMBLE
WHISPERING
WITH
SMITH
SPEAKS
15
WAL