Human Generated Data

Title

Album Leaf of Birds and Flowers
Date
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.885.5

Human Generated Data

Title

Album Leaf of Birds and Flowers

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Pattern 95.7
Animal 95.4
Bird 95.4
Embroidery 92.7
Art 90.6
Drawing 88
Floral Design 81.9
Graphics 81.9
Bird 79.7
Doodle 66.3
Bird 61.1

Clarifai
created on 2019-05-31

illustration 98.7
art 98.6
leaf 98.2
desktop 97.6
painting 97.5
retro 97.5
flora 97
vintage 96.4
flower 96
old 95.4
people 95.3
texture 94.4
manuscript 94.2
nature 93.8
design 93.5
tree 93.1
paper 93
pattern 92.9
antique 92.6
decoration 92.1

Imagga
created on 2019-05-31

tray 100
receptacle 100
container 87.5
vintage 48
grunge 45.2
old 38.3
texture 36.8
envelope 34.8
retro 34.4
antique 33.8
paper 33.7
frame 31.7
design 31.1
floral 29.8
aged 27.2
art 26.7
page 26
flower 25.4
ancient 24.2
blank 23.2
border 21.7
decorative 20.9
wallpaper 19.2
dirty 18.1
pattern 17.8
creative 17.7
parchment 17.3
leaf 17.1
canvas 17.1
decoration 16.8
card 16.2
album 15.6
drawing 15.5
paint 15.4
wall 15.4
style 14.8
artistic 14.8
brown 14.7
chalkboard 14.7
material 14.3
text 14
graphic 13.9
symbol 13.5
element 13.2
plant 12.7
scroll 12.4
color 12.2
board 12.2
foliage 12
ornament 11.2
artwork 11
scrapbook 10.7
worn 10.5
empty 10.3
space 10.1
letter 10.1
binding 10.1
backgrounds 9.7
decor 9.7
surface 9.7
torn 9.7
stain 9.6
aging 9.6
grungy 9.5
black 9
detail 8.9
shabby 8.8
grime 8.8
textured 8.8
blackboard 8.8
leaves 8.8
crumpled 8.7
structure 8.7
education 8.7
cardboard 8.6
damaged 8.6
greeting 8.4
grain 8.3
backdrop 8.3
message 8.2
school 8.1
idea 8
holiday 7.9
burned 7.9
flowers 7.8
manuscript 7.8
chalk 7.8
fracture 7.8
invitation 7.7
decay 7.7
stained 7.7
obsolete 7.7
finance 7.6
ornamental 7.6
textures 7.6
study 7.5
silhouette 7.5
celebration 7.2
stamp 7

Google
created on 2019-05-31

Botany 86.4
Branch 81.4
Plant 73.3
Hummingbird 63.7
Twig 62.8
Painting 60.3
Flower 53.8
Drawing 51.1
Paper 51
Art 50.2

Microsoft
created on 2019-05-31

bird 98.2
drawing 85.7
animal 75.6
child art 66.6
stationary 62.4
binding 58.2
sketch 53.4
envelope 43.5

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 80.5%
Happy 4.3%
Disgusted 30.2%
Angry 6.4%
Surprised 5.3%
Sad 6.6%
Calm 41%
Confused 6.2%

Feature analysis

Amazon

Bird 95.4%

Captions

Microsoft

a close up of a sign 76.8%
a sign on a wall 62.2%
close up of a sign 62.1%