Human Generated Data

Title

Illustrated Mirror of Emperors and Song of Everlasting Sorrow (right)

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Charles Webster Downer, Elizabeth B. Downer, and Ahab Charles Webster Downer in memory of Harriette "Heidi" Draper Downer, 2016.236.1

Human Generated Data

Title

Illustrated Mirror of Emperors and Song of Everlasting Sorrow (right)

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Charles Webster Downer, Elizabeth B. Downer, and Ahab Charles Webster Downer in memory of Harriette "Heidi" Draper Downer, 2016.236.1

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Painting 98.7
Art 98.7
Human 76.8
Person 64.2
Furniture 59.1
Mural 57.4
Person 49.8
Person 47.4
Person 43.4

Clarifai
created on 2018-02-19

illustration 99.8
art 99.4
painting 99.1
people 97.3
print 93.7
manuscript 92.8
wear 92
adult 91.7
house 91
woman 90.3
design 90.1
wall 90
child 88.4
decoration 86.6
picture frame 86.4
architecture 85.7
religion 85
old 84.4
man 83
no person 80.6

Imagga
created on 2018-02-19

grunge 48.5
vintage 43.8
old 42.5
graffito 41.5
screen 38.9
retro 38.5
texture 37.5
antique 36.6
aged 36.2
paper 32.9
ancient 32.9
decoration 30.8
frame 27.5
covering 24.1
page 23.2
flower 22.3
worn 21
tile 21
art 20.9
floral 20.4
material 19.6
wall 19.5
dirty 19
pattern 17.8
wallpaper 17.6
grungy 17.1
graphic 16.8
torn 16.4
decay 16.4
design 16.3
damaged 16.2
card 16.2
grain 15.7
grime 15.6
album 15.6
fracture 15.6
leaf 15.6
stain 15.4
canvas 15.2
structure 14.9
blank 14.6
mottled 13.6
scrapbook 13.6
brown 13.2
map 13
paint 12.7
border 12.7
crumpled 12.6
rusty 12.4
empty 12
rough 11.8
stains 11.7
geography 11.6
world 11.5
parchment 11.5
envelope 11.4
style 11.1
color 11.1
decorative 10.9
door 10.8
drawing 10.7
backgrounds 10.5
aging 10.5
textured 10.5
text 10.5
old fashioned 10.5
textures 10.4
sheet 10.3
painterly 9.9
faded 9.7
stained 9.6
obsolete 9.6
artistic 9.6
space 9.3
greeting 9.3
artwork 9.2
earth 9.1
smudged 8.9
shabby 8.8
ragged 8.8
silhouette 8.3
surface 7.9
country 7.9
manuscript 7.8
ornament 7.8
announcement 7.8
detailed 7.7
spot 7.7
bouquet 7.5
anniversary 7.5
element 7.4
gold 7.4
foliage 7.4
letter 7.3
global 7.3
yellow 7.3

Google
created on 2018-02-19

art 91.5
painting 81
collection 72
modern art 64.2
tapestry 62.4
artwork 58.3
picture frame 57.8
miniature 53.2
history 51.6

Microsoft
created on 2018-02-19

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 12-22
Gender Female, 50.2%
Calm 49.8%
Angry 49.6%
Surprised 49.5%
Sad 49.7%
Disgusted 49.6%
Happy 49.8%
Confused 49.5%

Feature analysis

Amazon

Painting 98.7%
Person 64.2%

Captions