Human Generated Data

Title

Untitled (Bowery, New York City)
Date

1932-1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3161
Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Bowery, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1934

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 98.9
Human 98.9
Person 96.5
Text 92
Apparel 88.2
Clothing 88.2
Hat 88.2
Poster 86.1
Advertisement 86.1
Paper 75
Flyer 75
Brochure 75

Clarifai
created on 2018-03-23

people 98.9
adult 95.2
text 93
man 90
war 89.8
bill 88.6
music 88.6
business 84.5
one 83.1
retro 82.6
monochrome 81.9
conceptual 81.7
administration 81.5
musician 81.1
woman 81.1
group 80.7
offense 80
military 79.6
education 79.4
vehicle 77.8

Imagga
created on 2018-03-23

blackboard 100
menu 30.4
text 26.2
vintage 24
grunge 23.9
old 23.7
design 22.5
antique 22.5
art 22.1
retro 21.3
word 19.8
letter 17.4
fare 17.4
texture 16.7
cloud 16.4
book 16.1
business 15.2
frame 15
paper 14.9
graphic 14.6
card 14.5
creative 14.1
black 13.8
decoration 13.8
information 13.3
element 13.2
cover 13
artwork 12.8
religion 12.6
data 11.9
style 11.9
aged 11.8
definition 11.8
bible 11.8
decorative 11.7
backdrop 11.5
conceptual 11.5
food 11
words 10.8
brochure 10.7
advertising 10.6
education 10.4
composition 10.4
study 10.3
pattern 10.3
page 10.2
chalkboard 9.8
advertisement 9.7
collage 9.6
tag 9.6
ancient 9.5
symbol 9.4
writing 9.4
board 9.1
sign 9
collection 9
decor 8.8
advertise 8.8
stamp 8.7
holy 8.7
read 8.7
notes 8.6
faith 8.6
wallpaper 8.4
church 8.3
template 8.3
message 8.2
border 8.1
school 8.1
science 8
close 8
copy 8
textured 7.9
associated 7.9
association 7.9
pages 7.8
chalk 7.8
god 7.7
print 7.5
label 7.5
religious 7.5
technology 7.4
brown 7.4
digital 7.3
new 7.3

Google
created on 2018-03-23

black and white 82.5
poster 74.3
advertising 70.2
font 69.2
art 65.8
human behavior 63.7
monochrome 62.4

Microsoft
created on 2018-03-23

outdoor 99.4
text 91.8
person 89.1

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 48-68
Gender Male, 52.9%
Confused 45.2%
Surprised 45.3%
Calm 52%
Sad 46.6%
Disgusted 45.3%
Happy 45.1%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Sad 47.2%
Confused 46%
Happy 45.2%
Disgusted 45.5%
Angry 46.5%
Surprised 46.2%
Calm 48.3%

Microsoft Cognitive Services

Age 36
Gender Male

Feature analysis

Amazon

Person 98.9%
Hat 88.2%

Captions

Microsoft

a man standing in front of a sign 82.2%
a man holding a sign 76.6%
a man standing next to a sign 76.5%

Text analysis

Amazon

RESTAURANT
PIGSFEET
FOASTOIN
LAMBSTEW
GREENPE
BOILEDHAM
BRERSTOFLAMB
20
REG.
8
CORNEOBEEF
SPARERIBS
PIGSHERD
PIGSKNOCKLES
ROAST
BEEFSTEW
PIGSHERD PIGSSNOUTS
PIGSSNOUTS
ORSTSHOUS
BOILEDBACON
5
OFFEF REG. G.OINNER1525 NNER
ROLLS
G.OINNER1525
OFFEF
ROASTLEGOFLAMB
HIcEer PIGSKNOCKLES SHOKTRIBSoFE 20 LAMBSTEW ROASTLECOFVCAL BEEFSTEW
25 PE 8 CORNEOBEEF SPARERIBS BOILEDHAM OXTAILGOULASH BRERSTOFLAMB
NNER
ALL
BUns
BUns 5 ORSTSHOUS ROAST FRESiRM -OOFPORR RORSTSIRLOINOFBEEF ROASTLEGOFLAMB
SDINEO
FRESiRM
POTATOPANCAES&BAO FRANFURTERS&BERNS BOILEDBACON SDINEO
OXTAILGOULASH
ROASTLECOFVCAL
cruLers ROLLS FOASTOIN SOUPS:VEG.BOUILONLNOODLES. OR GREENPE
SHOKTRIBSoFE
FRANFURTERS&BERNS
STEREDNOODLESABACOM
PORCELTTS
SOUPS:VEG.BOUILONLNOODLES.
RORSTSIRLOINOFBEEF
POTATOPANCAES&BAO
ALL STEREDNOODLESABACOM PIGSFEET PORCELTTS Gcas Sherr TVIRS ON
Gcas
-OOFPORR
PE
25
OR
cruLers
TVIRS
HIcEer
AID
Sherr
ON

Google

RESTAURANT ER ROAST SIRLOINoFBEEF pǐGS KNUCKLES OTAIL COULRSH SEWED NDON 30 CHOppep HPMADESG5 RAISED 3EEF R18S BUTTERMILK
RESTAURANT
ER
ROAST
SIRLOINoFBEEF
pǐGS
KNUCKLES
OTAIL
COULRSH
SEWED
NDON
30
CHOppep
HPMADESG5
RAISED
3EEF
R18S
BUTTERMILK