Human Generated Data

Title

Tale of the Rat (Nezumi zōshi emaki)

Date

Muromachi period, circa 1469

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.445

Human Generated Data

Title

Tale of the Rat (Nezumi zōshi emaki)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, circa 1469

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Painting 98.7
Art 98.7
Animal 83.7
Bird 83.7
Clothing 72.8
Apparel 72.8
Person 70.9
Human 70.9
Person 67.6
Person 64.1
Drawing 58
Archaeology 57.2
Advertisement 56.8
Collage 56.1
Poster 56.1

Clarifai
created on 2018-04-19

illustration 99.7
art 98.9
painting 98.7
people 97
manuscript 96.3
print 96.2
wall 95.8
old 95
vintage 94.7
desktop 94.2
adult 93.5
paper 93.4
man 92.6
artistic 91.9
antique 91.7
text 91.6
wear 90.7
retro 89.9
bill 89.8
texture 88.3

Imagga
created on 2018-04-19

graffito 100
decoration 91.7
vintage 41.4
grunge 35.8
old 35.5
retro 30.3
texture 25.7
antique 25.1
aged 24.4
paper 23.6
map 20
dirty 18.1
ancient 17.3
world 16.8
stamp 16.6
global 16.4
mail 15.3
money 15.3
art 15
postmark 14.8
postage 14.7
letter 14.7
geography 14.4
frame 14.2
wallpaper 13.8
postal 13.7
currency 13.5
international 13.4
country 13.2
design 13
artwork 12.8
rusty 12.4
textured 12.3
cash 11.9
atlas 11.7
envelope 11.6
damaged 11.5
post 11.5
grungy 11.4
backgrounds 11.4
card 11.1
note 11
material 10.7
continent 10.7
color 10.6
business 10.3
page 10.2
finance 10.1
banking 10.1
rough 10
travel 9.9
bank 9.9
wall 9.7
states 9.7
painted 9.5
canvas 9.5
globe 9.3
earth 9.1
border 9
collection 9
history 8.9
philately 8.9
stamps 8.9
faded 8.8
artistic 8.7
decay 8.7
parchment 8.6
blank 8.6
united 8.6
bill 8.6
nation 8.5
planet 8.5
communication 8.4
pattern 8.2
painting 8.1
surface 7.9
torn 7.7
empty 7.7
payment 7.7
flower 7.7
worn 7.6
flag 7.6
savings 7.5
backdrop 7.4
symbol 7.4
brown 7.4
graphic 7.3
wealth 7.2

Google
created on 2018-04-19

art 94.3
painting 88.9
wall 85.5
modern art 81.8
mural 79.5
artwork 64.6
paint 61.1
visual arts 53.9
street art 50.8

Microsoft
created on 2018-04-19

text 95.3

Face analysis

Amazon

AWS Rekognition

Age 2-5
Gender Female, 54.8%
Disgusted 45.1%
Calm 45.2%
Confused 45.1%
Sad 45.7%
Surprised 45.4%
Angry 45.3%
Happy 53.2%

AWS Rekognition

Age 35-55
Gender Female, 52.9%
Calm 47.5%
Confused 46.3%
Disgusted 47.2%
Sad 45.8%
Happy 46.1%
Surprised 45.5%
Angry 46.6%

AWS Rekognition

Age 20-38
Gender Female, 51.1%
Happy 46.3%
Calm 45.7%
Confused 45.8%
Disgusted 45.6%
Sad 49.7%
Angry 46.3%
Surprised 45.5%

Feature analysis

Amazon

Painting 98.7%
Bird 83.7%
Person 70.9%

Captions

Microsoft

a map of a building 59.3%
a map of the inside of a building 56.3%
a map of the building 54.9%