Human Generated Data

Title

Sheet Music: The Return of the Month of May
Date

19th century
People

Artist: Anonymous France 1835, French 1800 - 1899

Artist: Emile Barateau,

Artist: Albert Crisar,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard College Library, M8465

Human Generated Data

Title

Sheet Music: The Return of the Month of May

People

Artist: Anonymous France 1835, French 1800 - 1899

Artist: Emile Barateau,

Artist: Albert Crisar,

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard College Library, M8465

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Text 98.5
Person 96.1
Human 96.1
Person 94.7
Book 84.9
Person 81.4
Person 75.6
Person 71.3
Art 71.2
Handwriting 59.4
Person 58.3
Page 57.9
Painting 57.4

Clarifai
created on 2019-11-10

vintage 98.4
art 97.6
retro 97.5
text 97.4
illustration 97.3
old 96.6
document 95.9
antique 94.7
print 94.5
paper 94.3
bill 93.3
picture frame 91.8
book bindings 91.7
page 90.6
painting 90.5
people 90.1
card 89.6
manuscript 89
design 87.6
desktop 86.6

Imagga
created on 2019-11-10

book jacket 61.1
old 53
vintage 50.3
jacket 48.5
texture 48
paper 47.1
grunge 43.5
antique 40
wrapping 36.1
aged 34.4
retro 30.3
wallpaper 28.4
document 27.9
covering 27.6
ancient 26.8
letter 25.7
rough 25.5
dirty 25.3
empty 24.9
envelope 24.1
structure 23.5
brass 23.1
frame 22.5
cardboard 22.1
sheet 21.6
cover 21.3
text 21
border 20.8
material 20.6
page 20.4
damaged 20
memorial 20
canvas 19.9
parchment 19.2
aging 19.2
blank 18.9
container 18.3
art 18.2
wall 17.1
design 16.9
textured 16.7
backgrounds 16.2
grungy 16.1
pattern 15.1
book 15
brown 14.7
crumpled 14.6
decay 14.5
worn 14.3
rusty 14.3
card 13.8
pages 13.7
binding 13.1
artistic 13
historic 12.8
manuscript 12.7
stain 12.5
grain 12
grime 11.7
ragged 11.7
stains 11.7
space 11.6
stained 11.6
old fashioned 11.4
graphic 11
decorative 10.9
backdrop 10.7
fracture 10.7
surface 10.6
faded 9.7
burnt 9.7
torn 9.7
menu 9.6
weathered 9.5
textures 9.5
detail 8.9
mottled 8.8
rust 8.7
drawing 8.6
floral 8.5
artwork 8.2
message 8.2
shabby 7.9
crack 7.8
postcard 7.7
note 7.4
yellow 7.3
paint 7.2
travel 7

Google
created on 2019-11-10

Text 90.8
Paper product 71.7
Paper 71
Illustration 50.4
Art 50.2

Microsoft
created on 2019-11-10

text 99.7
letter 80.8
handwriting 80.1
drawing 73.7
sketch 73.6
plaque 33.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-32
Gender Female, 50.1%
Fear 49.6%
Happy 49.6%
Surprised 49.7%
Calm 50%
Sad 49.5%
Angry 49.6%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 22-34
Gender Female, 50.4%
Disgusted 49.7%
Happy 49.5%
Confused 49.5%
Fear 49.8%
Calm 49.6%
Surprised 49.7%
Sad 49.5%
Angry 49.6%

AWS Rekognition

Age 27-43
Gender Female, 50.2%
Surprised 50.1%
Happy 49.5%
Calm 49.8%
Fear 49.6%
Disgusted 49.5%
Sad 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 48-66
Gender Male, 50.5%
Disgusted 49.5%
Calm 49.5%
Happy 50.5%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Fear 49.5%
Sad 49.5%

AWS Rekognition

Age 4-14
Gender Female, 50.3%
Calm 49.6%
Disgusted 49.5%
Sad 50.3%
Fear 49.5%
Confused 49.5%
Happy 49.5%
Surprised 49.5%
Angry 49.5%

AWS Rekognition

Age 40-58
Gender Male, 50.5%
Happy 49.5%
Surprised 49.5%
Sad 49.6%
Disgusted 49.6%
Angry 50.1%
Confused 49.5%
Fear 49.6%
Calm 49.6%

Feature analysis

Amazon

Person 96.1%
Book 84.9%

Categories

Imagga

paintings art 67.9%
text visuals 29.5%
streetview architecture 1.4%

Captions

Microsoft
created on 2019-11-10

a close up of a box 59.8%
close up of a box 53.1%
a close up of text on a white surface 53%

Text analysis

Amazon

RETOUR
Nocturne
Voix
MOIS
de
DE
deux
Nocturne a deux
N341.
lmitare
GRISAR
et
a
Mavence
che'z
LE RETOUR DIT MOIS DE MAI
Mavence ef Anvers, che'z
ALBERT' GRISAR
Anvers,
lagnan
dedicar
ALBERT'
piricdrict
arr
Qancl et lagnan
Choir
LE
ef
MAI
Barateau
DIT
dar
B2hr
Qancl
Rickkel
Choir d'iris de Dmor ar: de Prano o lmitare
6
ubertrrgen
Darolede Emite Barateau
79
iDi Rickkel dar Mlai
Darolede
ar:
Musipue
iDi
d'iris
Emite
o
Mlai
Denrchee
Dmor
uer
1977 uer Denrchee ubertrrgen 1 .1. 6 B2hr
.1.
1977
Prano
1

Google

79 No541 Choir d'Airs d de uas ar ace de Pana au buitare LE RETOUR DU MOIS DE MA Die Ruckkehr dar Mai Nocturne à deux Voix Parelos de M Emile Barateoau dedidar àM i. anel et i. Ragnan Murique d ALBERT GRISAR Ins Dentsche ibertragen m MG Friedrich 2kr Mayence ef Anvers, chez les fils de B. Sehol
79
No541
Choir
d'Airs
d
de
uas
ar
ace
Pana
au
buitare
LE
RETOUR
DU
MOIS
DE
MA
Die
Ruckkehr
dar
Mai
Nocturne
à
deux
Voix
Parelos
M
Emile
Barateoau
dedidar
àM
i.
anel
et
Ragnan
Murique
ALBERT
GRISAR
Ins
Dentsche
ibertragen
m
MG
Friedrich
2kr
Mayence
ef
Anvers,
chez
les
fils
B.
Sehol