Human Generated Data

Title

Tale of the Rat (Nezumi zōshi)
Date

19th century
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.467

Human Generated Data

Title

Tale of the Rat (Nezumi zōshi)

People
Date

19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Envelope 99.2
Postcard 98.6
Mail 98.6
Text 91.2
Person 86.6
Human 86.6
Bird 81.9
Animal 81.9

Clarifai
created on 2019-05-31

paper 99.1
retro 98.3
antique 96.6
old 96.4
dirty 96.2
parchment 96.1
no person 95.6
document 94.8
vintage 94.8
ancient 94.8
art 94
page 93.9
wear 93.2
empty 93
desktop 92.9
chalk out 92.8
manuscript 92.1
sepia pigment 92
texture 91.5
cardboard 91.3

Imagga
created on 2019-05-31

journal 100
antique 70.9
old 68.5
vintage 67.2
aged 66.3
paper 63.7
grunge 59
parchment 54.9
ancient 54.7
texture 53.7
aging 50
canvas 49.5
stained 46.3
retro 43.6
dirty 43.5
text 42.9
rough 42.1
blank 40.4
wallpaper 40
document 39.1
border 38.1
empty 37.9
cardboard 35.7
grungy 35.2
burnt 34.1
decay 33.9
worn 33.5
torn 33
stain 30.9
sheet 30.2
letter 29.4
brown 28.8
backgrounds 28.5
pattern 28.1
space 28
page 27.9
book 27.7
frame 26.2
material 26.1
weathered 25.7
pages 25.5
manuscript 23.6
wall 23.2
decorative 22.6
obsolete 22.1
damaged 22
age 22
messy 21.3
note 21.2
crumpled 20.5
yellow 19.9
history 19.7
textured 19.4
spotted 19.3
paint 19.1
dirt 18.2
poster 18
surface 17.7
brittle 16.8
scrolls 16.8
letterhead 16.8
correspondence 16.7
burning 16.5
layers 16.5
art 16.4
rusty 16.2
grain 15.7
grime 15.7
ragged 15.7
stains 15.6
spot 15.4
design 14.7
textures 14.3
color 14
historic 13.8
burned 13.8
fracture 13.7
rust 13.5
old fashioned 13.4
backdrop 13.2
artistic 13.1
cover 13
crease 12.8
mottled 11.7
structure 11.3
tattered 10.9
shabby 10.8
stucco 10.7
faded 10.7
crack 10.7
distressed 9.9
detail 9.7
beige 9.7
edge 9.7
tracery 9
graphic 8.8
succulent 8.8
map 8.2
broad 7.9
materials 7.8
sepia 7.8
card 7.3

Google
created on 2019-05-31

Drawing 81.5
Line 73
Art 70.9
Tree 68.7
Sketch 66.4
Plant 58.5
Illustration 57.7
Artwork 55.2
Beige 54.8
Paper 51

Microsoft
created on 2019-05-31

handwriting 99.7
letter 98.2
text 85.6
old 42.8

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Female, 53.1%
Confused 45.6%
Calm 50.6%
Sad 45.6%
Surprised 46.3%
Angry 45.6%
Disgusted 45.6%
Happy 45.6%

AWS Rekognition

Age 12-22
Gender Male, 54.9%
Angry 45.8%
Sad 46.4%
Disgusted 46%
Surprised 45.5%
Happy 49.1%
Calm 46%
Confused 46.2%

Feature analysis

Amazon

Person 86.6%
Bird 81.9%

Captions

Microsoft

a close up of text on a white surface 55%
a close up of text on a black surface 54.9%
a close up of text on a white background 52.2%

Text analysis

Amazon

:5

Google

1
、
<
号
娘
<娘1 、号で
で