Human Generated Data

Title

Sheet Music: The Jew, or Isaac the Junkman
Date

19th century
People

Artist: Anonymous France 1835, French 1800 - 1899

Artist: Vogel,

Artist: J. Blum,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard College Library, M8491

Human Generated Data

Title

Sheet Music: The Jew, or Isaac the Junkman

People

Artist: Anonymous France 1835, French 1800 - 1899

Artist: Vogel,

Artist: J. Blum,

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Harvard College Library, M8491

Machine Generated Data

Tags

Amazon
created on 2019-11-10

Person 98.2
Human 98.2
Text 96.7
Person 95.8
Art 82.1
Advertisement 72.8
Poster 70.9
Book 69.2
Painting 57
Drawing 56
Paper 55.4

Clarifai
created on 2019-11-10

people 98.8
wear 95.5
adult 95.4
art 94.8
print 94.4
illustration 94
bill 93.1
text 92.6
vintage 92.1
picture frame 91.4
retro 90.3
painting 88.6
old 85.4
antique 85.4
veil 85
award 84.5
document 83.7
portrait 82.2
ornate 80.8
paper 80.3

Imagga
created on 2019-11-10

book jacket 100
jacket 100
wrapping 78.7
covering 52.9
vintage 49.7
old 41.8
paper 37.7
retro 35.2
letter 31.2
envelope 29
grunge 27.3
antique 26.8
aged 26.2
ancient 26
texture 24.3
stamp 24.2
mail 22
postmark 19.7
postage 16.7
document 15.8
postal 15.7
art 15.7
page 14.9
philately 14.8
design 14.1
text 14
cover 13.9
card 13.9
dirty 13.6
frame 13.3
wallpaper 13
blank 12.9
symbol 12.8
message 12.8
global 12.8
book 11.9
decorative 11.7
post 11.4
canvas 11.4
decoration 11.3
sheet 11.3
pattern 10.9
rough 10.9
circa 10.9
history 10.7
stained 10.6
cardboard 10.6
container 10.6
parchment 10.6
backgrounds 10.5
comic book 10.4
brown 10.3
money 10.2
border 10
printed 9.8
drawing 9.8
aging 9.6
grungy 9.5
empty 9.5
sign 9
shows 8.9
graphic 8.8
burnt 8.7
worn 8.6
old fashioned 8.6
wall 8.6
business 8.5
writing 8.5
communication 8.4
paint 8.1
collection 8.1
currency 8.1
manuscript 7.8
international 7.6
backdrop 7.4
closeup 7.4
note 7.4
detail 7.2
textured 7

Google
created on 2019-11-10

Text 94.7
Illustration 77.2
Paper 75.8
Paper product 73.6
Art 58.1
Document 50.2

Microsoft
created on 2019-11-10

text 99.2
drawing 97.4
sketch 95.5
whiteboard 88.9
person 87.9
handwriting 81.4
cartoon 79
horse 76.8
clothing 58.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-52
Gender Male, 50.9%
Calm 48.8%
Disgusted 46.3%
Fear 46.1%
Confused 45.1%
Angry 45.3%
Surprised 45.2%
Sad 47.9%
Happy 45.2%

AWS Rekognition

Age 33-49
Gender Male, 54.8%
Angry 45.5%
Happy 45%
Sad 45.9%
Disgusted 47.5%
Fear 45.1%
Calm 50.6%
Surprised 45.2%
Confused 45.1%

Feature analysis

Amazon

Person 98.2%
Book 69.2%

Categories

Imagga

paintings art 94.3%
pets animals 2.7%
text visuals 1.2%
streetview architecture 1.1%

Captions

Microsoft
created on 2019-11-10

a close up of text on a whiteboard 48.6%
a close up of a whiteboard 42.5%
close up of text on a whiteboard 42.4%

Text analysis

Amazon

LEVASSOR.
par LEVASSOR.
sau
par
PTIT
Chtantee
COLOMBIER.
Bam
de
Nario.
Musgune de de
thee COLOMBIER.
LE
Musgune de
VoEL
delew
h.
comque
LE JuIF
u
Veicsse.
.
thee
dde
:fanage
Nario. w eyat.
JuIF
VAVILAAA
ETSA VAVILAAA
thrihs
ETSA
hiotes
14 VWne -h: PTIT :fanage delew Veicsse. dde Slunigue.
h. .biiicentet
-h:
u thrihs dar atai
atai
Cleiowlle
Slunigue.
dee . Bam
dar
.biiicentet
ASSAGL
w eyat.
14
VWne
enbr
dee

Google

LE JUIF Choelle comque Mussiqne de O GEL Chantée par LEVASSOR an thaite de ahuis heyal Pario ther COLOMBIER e A PETIT Er de Migue 5AGE VAVIENN
LE
JUIF
Choelle
comque
Mussiqne
de
O
GEL
Chantée
par
LEVASSOR
an
thaite
ahuis
heyal
Pario
ther
COLOMBIER
e
A
PETIT
Er
Migue
5AGE
VAVIENN