Human Generated Data

Title

Sheet Music: The Handsome Heartbreaker
Date

19th century
People

Artist: Victor Jacques Bertauts,

Artist: Edmond Lhuillier,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard College Library, M8556

Human Generated Data

Title

Sheet Music: The Handsome Heartbreaker

People

Artist: Victor Jacques Bertauts,

Artist: Edmond Lhuillier,

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 99.5
Human 99.5
Book 99.4
Person 98.8
Novel 75.9
Text 73
Art 71.8
Alcohol 59.8
Drink 59.8
Beverage 59.8
Liquor 59.8
Poster 57.3
Advertisement 57.3

Clarifai
created on 2019-11-10

people 99.9
print 99.2
art 98.3
adult 98.2
engraving 98.1
illustration 97.8
group 93.8
portrait 93.3
man 93
two 90.7
antique 90.3
administration 90.1
wear 87
one 86.8
leader 86.4
retro 85.4
vintage 85.3
old 84.5
text 81.2
writer 80.5

Imagga
created on 2019-11-10

book jacket 65.2
jacket 51.7
money 39.2
currency 38.6
wrapping 38.5
paper 35.3
vintage 33.3
cash 33
dollar 30.7
stamp 29.5
mail 27.8
bank 26.9
covering 26.5
finance 25.4
bill 24.7
postage 24.6
banking 23.9
letter 23.9
postmark 23.7
business 23.1
envelope 21.6
postal 21.6
post 21
old 20.9
dollars 20.3
wealth 19.8
retro 18.9
savings 18.7
hundred 18.4
one 17.9
bookmark 17.4
printed 16.7
close 16.6
note 16.6
exchange 16.2
financial 16
banknote 15.5
states 15.5
product 15.3
philately 14.8
ancient 14.7
newspaper 14
brass 14
rich 14
stamps 13.8
shows 13.8
investment 13.8
us 13.5
pay 13.4
memorial 13.3
united 13.3
antique 13.1
closeup 12.8
global 12.8
bills 12.6
notes 12.5
art 12.4
treasury 12.2
symbol 12.1
creation 12
circa 11.9
economy 11.1
grunge 11.1
franklin 10.8
funds 10.8
banknotes 10.8
finances 10.6
payment 10.6
loan 10.6
collection 9.9
market 9.8
delivery 9.7
structure 9.7
card 9.7
fine 9.5
capital 9.5
culture 9.4
depository 9.2
book 9.1
aged 9.1
black 9
history 9
museum 8.9
office 8.8
debt 8.7
communications 8.6
texture 8.3
message 8.2
painter 8.1
object 8.1
icon 7.9
post mail 7.9
zigzag 7.9
wages 7.8
paintings 7.8
cutting 7.7
painted 7.6
unique 7.6
communication 7.6
portrait 7.1
face 7.1

Google
created on 2019-11-10

Vintage advertisement 60.4
Vintage clothing 50.7
Illustration 50.4

Microsoft
created on 2019-11-10

text 100
drawing 95.9
sketch 95.2
clothing 92.5
person 91.5
woman 84.1
old 72.3
engraving 71.4
cartoon 68.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 22-34
Gender Male, 54.4%
Fear 45%
Angry 45%
Confused 45%
Disgusted 45%
Sad 45.1%
Happy 45.9%
Surprised 45%
Calm 54%

AWS Rekognition

Age 11-21
Gender Female, 53.2%
Sad 46.1%
Angry 45.7%
Surprised 45.1%
Confused 45.5%
Disgusted 45.7%
Fear 45.1%
Happy 45.4%
Calm 51.5%

Feature analysis

Amazon

Person 99.5%
Book 99.4%
Poster 57.3%

Captions

Microsoft

a vintage photo of a book 50.9%
a vintage photo of a person holding a book 42.5%
an old photo of a book 42.4%

Text analysis

Amazon

LE
BEAU
EDMOND
de
Musique
LHUILLIER
Meissonnier
LE BEAU SSE-CEUR
el
Paroles
fils
SSE-CEUR
Bal
Chansonnetle
Un
idition
Paroles el Musique de CSOPIEMED
rim
Paris
Paris J Meissonnier rue
jurer
Jw
Romantt
papillon
rue
Pairontsat
nouvlle
midaillon
faut
J
d Enfan:
2'unt
thansonaele
mire
nonvtlle
milodre
Un Vitux papillon nonvtlle I Lr midaillon Pairontsat Romantt
Un Bal d Enfan: thansonaele wvsewater Jw e11e Calesss L Bnour 2'unt mire milodre
Pr 2f 5o
L
Vitux
Iln faut jurer rim J'amt '1 Valat, nouvlle idition
Bnour
J'amt
Calesss
Valat,
Lr
Pans
I
CSOPIEMED
e11e
wvsewater
Iln
'1

Google

LE BEAU CASSE-CEUR Chansonnette Paroles et Musique de eCHIPME EDMOND LHUILLIER PER &SCHI NEW YORK RADWA Pr 2 50 loueanles Ju mee duteu Un Bal d'Enfans Un Vitux papillon Il ne faul jurer dr rim Chanrophlle louvrlle tdstion J'aime la Valee Ls Byouz d'unt mire e mrdaillon la Dame Palrones imetodre d Reman Rouvelle idition Paris J. Meissonnier fils 18, rue Dauphine. WEISS A
LE
BEAU
CASSE-CEUR
Paroles
Musique
de
eCHIPME
EDMOND
LHUILLIER
PER
&SCHI
NEW
YORK
RADWA
Pr
2
50
loueanles
Ju
mee
duteu
Un
Bal
ne
jurer
rim
J.
fils
Chansonnette
et
d'Enfans
Vitux
papillon
Il
faul
dr
Chanrophlle
louvrlle
tdstion
J'aime
la
Valee
Ls
Byouz
d'unt
mire
e
mrdaillon
Dame
Palrones
imetodre
d
Reman
Rouvelle
idition
Paris
Meissonnier
18,
rue
Dauphine.
WEISS
A