Human Generated Data

Title

Illustrated Mirror of Emperors and Song of Everlasting Sorrow (left)
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Charles Webster Downer, Elizabeth B. Downer, and Ahab Charles Webster Downer in memory of Harriette "Heidi" Draper Downer, 2016.236.2

Human Generated Data

Title

Illustrated Mirror of Emperors and Song of Everlasting Sorrow (left)

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Charles Webster Downer, Elizabeth B. Downer, and Ahab Charles Webster Downer in memory of Harriette "Heidi" Draper Downer, 2016.236.2

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Painting 99.1
Art 99.1
Person 93.6
Human 93.6
Person 93
Person 92
Person 90.9
Person 79.7
Person 69.7
Person 69.3
Archaeology 61.8
Person 57.2
Person 45.7

Clarifai
created on 2018-02-19

art 99.1
illustration 99.1
painting 98.6
architecture 95.7
wall 94.9
old 94.8
print 94.5
decoration 92.9
no person 92.9
people 92.3
ancient 92
design 91.9
house 91.4
building 91
religion 90.4
wear 90.2
antique 90.2
retro 89.6
desktop 89.1
travel 88.2

Imagga
created on 2018-02-19

graffito 96.7
decoration 63.1
grunge 47.7
old 45.3
vintage 43.8
texture 38.2
antique 35.6
paper 34.5
retro 32.8
aged 32.6
ancient 32
tile 25.4
art 21.1
material 19.6
wall 19.6
wallpaper 19.1
dirty 19
grungy 18
pattern 17.8
frame 17.5
damaged 17.2
brown 16.9
design 16.3
empty 16.3
worn 16.2
map 16
rusty 15.2
page 14.8
sheet 14.1
border 13.6
old fashioned 13.3
crumpled 12.6
decay 12.5
architecture 12.5
parchment 12.5
world 12.4
grain 12
rough 11.8
car 11.6
backdrop 11.5
backgrounds 11.4
artistic 11.3
travel 11.3
letter 11
historic 11
graphic 10.9
structure 10.9
grime 10.7
stains 10.7
scrapbook 10.7
geography 10.6
blank 10.3
card 10.2
scratch 9.8
ragged 9.7
album 9.7
space 9.3
decorative 9.2
business 9.1
atlas 8.8
fracture 8.8
rust 8.7
stained 8.7
spot 8.6
canvas 8.5
textures 8.5
note 8.3
earth 8.2
global 8.2
style 8.2
history 8
decor 8
country 7.9
text 7.9
shabby 7.8
mottled 7.8
faded 7.8
collage 7.7
stain 7.7
cardboard 7.7
rustic 7.7
weathered 7.6
tourism 7.4
document 7.4
globe 7.4
cover 7.4
gold 7.4
artwork 7.3
metal 7.2
color 7.2
romantic 7.1
surface 7.1
textured 7

Google
created on 2018-02-19

art 85.4
history 69.5
painting 63.6
tapestry 58.9
mural 52.3
artwork 51.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Angry 49.5%
Calm 50.3%
Surprised 49.5%
Confused 49.5%
Happy 49.5%
Disgusted 49.6%
Sad 49.6%

Feature analysis

Amazon

Painting 99.1%
Person 93.6%

Categories

Imagga

paintings art 92.8%
interior objects 6.6%
streetview architecture 0.3%
text visuals 0.2%

Captions

Microsoft
created on 2018-02-19

a display in a store 30.6%
a group of people performing on a counter 9.6%
a close up of a store 9.5%

Text analysis

Amazon

TF