Human Generated Data

Title

"Repudiation of the Billet-Doux," an episode from the Romance of the Western Chamber (Xixiangji)

Date

18th cent. - 19th cent.

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.882

Human Generated Data

Title

"Repudiation of the Billet-Doux," an episode from the Romance of the Western Chamber (Xixiangji)

People
Date

18th cent. - 19th cent.

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Painting 94.8
Art 94.8
Human 73.4
Drawing 69.5
People 67.4
Person 60.1
Person 60.1
Furniture 58.5
Wall 57.2
Sketch 55.7

Clarifai
created on 2018-02-10

illustration 98.5
art 97.5
painting 97.4
print 95.9
old 93.5
people 91.6
wall 90.1
vintage 89.4
paper 87.9
retro 87.1
desktop 86.8
design 86.8
antique 85.6
artistic 83.8
visuals 82.4
color 81.9
ancient 81.7
graffiti 81.6
man 81.2
dirty 80.6

Imagga
created on 2018-02-10

map 93.1
geography 47.2
atlas 44.3
old 41.2
antique 37.2
world 36.5
representation 34.8
vintage 34.8
grunge 33.2
globe 32.5
travel 29.6
country 28.3
nation 26.5
continent 26.2
wallpaper 25.3
texture 25
navigation 23.1
graffito 22.9
planet 22.6
discovery 21.4
mosaic 21.2
direction 21
capital 20.9
states 20.3
paper 19.8
sepia 19.5
decoration 19.3
road 19
plan 18.9
retro 18.9
journey 18.9
earth 18.7
location 18.6
route 18.6
city 18.3
border 18.1
tile 17.9
art 17.9
geographic 17.8
boundary 17.7
navigate 17.7
guide 17.6
dirty 17.2
transducer 16.8
expedition 16.8
find 16.7
position 16.6
tourism 16.5
ancient 16.5
global 16.4
aged 16.3
gold 15.6
tour 15.5
rust 15.4
grungy 15.2
pattern 15.1
explore 14.7
state 14.4
wall 14.1
paint 13.6
design 12.5
worn 12.4
backdrop 12.4
cartography 11.8
countries 11.7
color 11.7
dutch 11.7
material 11.6
north 11.5
symbol 11.5
close 10.9
topography 10.9
frame 10.8
holiday 10.8
surface 10.6
backgrounds 10.6
canvas 9.5
outline 9.5
path 9.5
chalk 9.4
sea 9.4
history 9
detail 8.9
textured 8.8
torn 8.7
stained 8.7
aging 8.6
international 8.6
weathered 8.6
land 8.5
china 8.5
puzzle 8.4
page 8.4
device 8.3
ocean 8.3
flag 8.3
graphic 8
maps 7.9
nationality 7.9
political 7.9
scratch 7.8
parchment 7.7
damaged 7.6
rusty 7.6
decorative 7.5

Google
created on 2018-02-10

art 93.7
illustration 74.3
tree 69.6
painting 62.6
artwork 56.2
mythical creature 51.3

Face analysis

Amazon

AWS Rekognition

Age 14-25
Gender Male, 90.3%
Sad 6.5%
Surprised 4.2%
Disgusted 3.5%
Angry 2.7%
Calm 74%
Happy 1.7%
Confused 7.5%

AWS Rekognition

Age 11-18
Gender Female, 52.8%
Happy 47.1%
Surprised 12.2%
Angry 16.2%
Confused 7.2%
Disgusted 6.4%
Calm 4.4%
Sad 6.5%

AWS Rekognition

Age 11-18
Gender Male, 53.4%
Happy 45.7%
Confused 47.2%
Disgusted 46.8%
Sad 45.4%
Angry 47.7%
Calm 46.1%
Surprised 46%

Feature analysis

Amazon

Painting 94.8%
Person 60.1%

Captions

Microsoft

a person sitting on the ground 24.8%
a person sitting on the floor 24.5%
a person sitting on a couch 10.7%