Human Generated Data

Title

Sheet Music: My Mother
Date

19th century
People

Artist: Anonymous France 1835, French 1800 - 1899

Artist: J. Colvé,

Artist: Alphonse Leduc,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard College Library, M8477

Human Generated Data

Title

Sheet Music: My Mother

People

Artist: Anonymous France 1835, French 1800 - 1899

Artist: J. Colvé,

Artist: Alphonse Leduc,

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Human 98.2
Person 98.2
Advertisement 94.1
Poster 94.1
Novel 90
Book 90
Person 88.2
Art 75.5
Text 75.5
Paper 66.9
Brochure 58.2
Flyer 58.2

Clarifai
created on 2019-11-10

print 99.9
people 99.5
engraving 99.3
illustration 99.1
art 98.8
lithograph 98
portrait 97.9
vintage 97.7
paper 97.2
adult 97.1
wear 96.2
retro 95.7
antique 94.8
one 93.9
book bindings 93.6
text 93
old 92.5
bill 92.2
music 91.8
writer 89.6

Imagga
created on 2019-11-10

book jacket 100
jacket 100
wrapping 100
covering 68.7
vintage 38.9
stamp 33.9
mail 33.5
paper 32.2
money 30.7
letter 30.3
currency 29.6
postmark 29.6
postage 27.5
old 27.2
retro 27.1
postal 25.5
dollar 24.2
cash 22.9
philately 21.7
envelope 21.2
banking 21.2
post 20
bill 20
circa 19.8
bank 19.7
book 19.1
finance 18.6
business 18.2
printed 17.7
ancient 16.5
global 16.4
wealth 16.2
exchange 15.3
stamps 14.8
shows 14.8
aged 14.5
savings 14
note 13.8
close 13.7
banknote 13.6
dollars 13.5
financial 13.4
product 13.1
antique 13
card 12.8
one 12.7
collection 12.6
hundred 12.6
history 12.5
closeup 12.1
investment 11.9
message 11.9
states 11.6
grunge 11.1
us 10.6
united 10.5
art 10.4
rich 10.3
creation 10.2
correspondence 9.8
delivery 9.7
communications 9.6
international 9.6
symbol 9.4
philatelic 8.9
bills 8.8
cutting 8.7
pay 8.6
notes 8.6
hobby 8.5
unique 8.5
economy 8.4
texture 8.3
market 8
address 7.9
black 7.8
payment 7.7
culture 7.7
communication 7.6
stock 7.5
document 7.4
page 7.4
object 7.3
success 7.3
office 7.2

Google
created on 2019-11-10

Text 91.6
Poster 85
Illustration 74.9
Vintage clothing 72.9
Vintage advertisement 67
Fiction 62.7
Advertising 59.4
Book cover 56.6
Book 55.2
Novel 54.4

Microsoft
created on 2019-11-10

text 100
book 99.8
sketch 99.3
drawing 99.1
cartoon 87.7
person 85.4
illustration 78
human face 67.4
engraving 65.2
clothing 63.9
woman 53.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 99%
Sad 7.6%
Angry 0.1%
Disgusted 0.4%
Surprised 0%
Fear 0.5%
Calm 91%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 6-16
Gender Female, 53.2%
Confused 45%
Surprised 45%
Calm 54.8%
Happy 45%
Sad 45.1%
Fear 45%
Angry 45%
Disgusted 45%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Poster 94.1%

Captions

Microsoft

a close up of a book 68.5%
close up of a book 62.6%
a hand holding a book 62.5%

Text analysis

Amazon

LEDUC
ALPHONSE LEDUC
ALPHONSE
MERE
ERMANCE
MA MERE
de
Soprano,
MA
Musique
COLVE
Editeur
depose
Melodie.
a
Mme
N2
Musique de
a Mme ERMANCE WAROQUIERS.
N'1
Paris. ALPHONSE LEDUC Editeur rue Menars.
-Soprano.
Mezzo. -Soprano. Soprano,
Paroles
WAROQUIERS.
Menars.
Belgique
rue
Londees Robent Cock Belgique depose
2f 50.
Cock
Mezzo.
21 50 Paroles de J. COLVE 2f 50.
Londees
Paris.
Robent
21 50
J.

Google

à M ERMANCE WAROQUIERS MA MERE Mélodie N 1 Mezzo-Soprano 2 50 N°2 Soprano, 250 Paroles de JCOLVE Musique de ALPHONSE LEDUC Paris, ALPHONSE LEDUC Editeur, rue Ménars, 4 Belgique depose Zondees, Robert Cocks et C
à
M
ERMANCE
WAROQUIERS
MA
MERE
Mélodie
N
1
Mezzo-Soprano
2
50
N°2
Soprano,
250
Paroles
de
JCOLVE
Musique
ALPHONSE
LEDUC
Paris,
Editeur,
rue
Ménars,
4
Belgique
depose
Zondees,
Robert
Cocks
et
C