Human Generated Data

Title

Sheet Music: The Path to Paradise
Date

19th century
People

Artist: Anonymous France 1835, French 1800 - 1899

Artist after: Johann Baptist Zwecker, German 1814 - 1876

Artist: Hypolite Audeval,

Artist: Jacques Blumenthal,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard College Library, M8500

Human Generated Data

Title

Sheet Music: The Path to Paradise

People

Artist: Anonymous France 1835, French 1800 - 1899

Artist after: Johann Baptist Zwecker, German 1814 - 1876

Artist: Hypolite Audeval,

Artist: Jacques Blumenthal,

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 98.8
Human 98.8
Person 92.1
Person 89.3
Book 84.6
Art 82.6
Person 79.7
Advertisement 65.2
Text 61.8
Novel 59.2
Poster 56.3

Clarifai
created on 2019-11-10

people 99.9
print 99.8
illustration 99.5
art 99.5
adult 98.2
engraving 96.5
retro 95.8
vintage 95.6
one 95.4
man 94.8
portrait 94.8
old 94.4
painting 93.9
text 92.8
wear 92.8
group 92.7
antique 90.1
two 88.2
bill 86.5
woman 86.1

Imagga
created on 2019-11-10

book jacket 100
jacket 100
wrapping 93.6
covering 62.7
vintage 33.1
paper 26.7
currency 26
money 24.7
old 24.4
stamp 24.2
mail 23
cash 22
postmark 21.7
letter 21.1
postage 20.7
retro 20.5
product 20.4
ancient 19.9
bank 19.7
dollar 19.5
finance 19.4
antique 19.1
postal 18.7
aged 18.1
bill 18.1
grunge 17.9
newspaper 17.8
creation 15.8
post 15.3
business 15.2
envelope 15
philately 14.8
global 14.6
art 14.3
banking 13.8
book 13.7
exchange 13.4
printed 12.8
wealth 12.6
close 12.6
texture 12.5
shows 11.8
hundred 11.6
states 11.6
pay 11.5
one 11.2
culture 11.1
circa 10.9
stamps 10.9
symbol 10.8
history 10.7
financial 10.7
dollars 10.6
united 10.5
closeup 10.1
dirty 9.9
bills 9.7
banknote 9.7
savings 9.3
economy 9.3
franklin 8.9
banknotes 8.8
delivery 8.8
us 8.7
notes 8.6
communications 8.6
sculpture 8.6
unique 8.5
card 8.5
rich 8.4
sign 8.3
note 8.3
religion 8.1
renaissance 7.9
museum 7.8
travel 7.8
cutting 7.7
payment 7.7
international 7.6
damaged 7.6
old fashioned 7.6
capital 7.6
daily 7.5
monument 7.5
detail 7.2
collection 7.2

Google
created on 2019-11-10

Text 86.9
Illustration 68.1
History 60.4
Antique 53
Art 50.2

Microsoft
created on 2019-11-10

text 100
book 98.6
clothing 97.7
person 97.2
drawing 95.4
sketch 91.2
woman 88.7
old 67.6
photograph 61.2
engraving 61.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 19-31
Gender Female, 52.8%
Disgusted 45%
Happy 49.8%
Angry 45.2%
Calm 49.9%
Surprised 45.1%
Sad 45%
Fear 45%
Confused 45%

AWS Rekognition

Age 20-32
Gender Female, 52.6%
Fear 45.8%
Sad 45.1%
Confused 45.1%
Angry 45.3%
Disgusted 45.1%
Calm 47.9%
Happy 47%
Surprised 48.7%

AWS Rekognition

Age 22-34
Gender Female, 52.1%
Surprised 46.4%
Angry 45.6%
Confused 45%
Happy 46.2%
Disgusted 45.1%
Sad 45%
Fear 45.6%
Calm 50.9%

AWS Rekognition

Age 5-15
Gender Female, 54.6%
Angry 45.3%
Fear 45.1%
Confused 45.1%
Sad 45.7%
Happy 45.3%
Calm 53.3%
Surprised 45.1%
Disgusted 45.2%

Feature analysis

Amazon

Person 98.8%
Book 84.6%
Poster 56.3%

Captions

Microsoft

an old photo of a book 58.9%
a close up of a book 57.3%
an old photograph of a book 57.2%

Text analysis

Amazon

PARADIS
CHEMIN
LE CHEMIN DU PARADIS
Madame
DU
LE
Comtesse
de
JACQUES
a Madame la Comtesse de Shafteshury
JACQUES BLUMENTHAL.
ET
la
BLUMENTHAL.
ROMANCE
S.S.GARDONI
ROMANCE CHANTEE
S.S.GARDONI ET MARIO.
CHANTEE
a
Shafteshury
MARIO.
Paroles
London
Dessi
DE
TRANSCRITE
Zwecker
Hypolte
Audeval
LINLEY
de Hypolte Audeval DE Dessi de Jean Zwecker
PIANO
Mavence
SCROTT
SCHOTT
L'AUTEUR
PAR
SCROTT Mavence FILS TRANSCRITE POURLE PIANO PAR L'AUTEUR SCHOTT Brexelles TRERES
Hall
POURLE
P AR
LA ROMANCE
TRERES
CEORCE
C PAROLES
MUSTO
FILS
Sta LA ROMANCE C PAROLES NCLAISES CEORCE LINLEY Prix
Prix
Ent Hall
Brexelles
Jean
Paroles MUSTO uF
NCLAISES
Ent
Sta
uF

Google

à Madame la Comtesse de Shafte sbury LE CHEMIN DU PARADIS ROMANCE CHANTEE PAR S.S.GARDO NI ET MARIO . Paroles MUSIQ UE de Hypolite Audeval Dessm de dean 1wecker DE JACQUES BLUMENTHAL Prix 2 Ent. Sta Hall 2- TRANSCRITE POUR LE PIANO PAR L'AUTEUR 3- LA ROMANCE AVEC PAROLES ANGLAISES DE CEORCE LINLEY Mayence Braxelles SCHOTT TRERES B SCROTT FILS London. SCHOTT & C. 159 Regent Street
à
Madame
la
Comtesse
de
Shafte
sbury
LE
CHEMIN
DU
PARADIS
ROMANCE
CHANTEE
PAR
S.S.GARDO
NI
ET
MARIO
.
Paroles
MUSIQ
UE
Hypolite
Audeval
Dessm
dean
1wecker
DE
JACQUES
BLUMENTHAL
Prix
2
Ent.
Sta
Hall
2-
TRANSCRITE
POUR
PIANO
L'AUTEUR
3-
LA
AVEC
PAROLES
ANGLAISES
CEORCE
LINLEY
Mayence
Braxelles
SCHOTT
TRERES
B
SCROTT
FILS
London.
&
C.
159
Regent
Street