Human Generated Data

Title

Samurai, Dancers and Musicians
Date

Early Edo period, circa 1620
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Denman W. Ross, 1919.263

Human Generated Data

Title

Samurai, Dancers and Musicians

Date

Early Edo period, circa 1620

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Denman W. Ross, 1919.263

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 92.7
Person 92.7
Painting 89.4
Art 89.4
Animal 88.8
Bird 88.8
Mammal 88.4
Horse 88.4
Person 85.9
Bird 85.9
Person 79.7
Bird 76.1
Horse 68.3
Person 66.4
Collage 66.1
Advertisement 66.1
Poster 66.1
Horse 64.5
Bird 63.1
Flying 59.3
Bird 56.9
Person 49.3

Clarifai
created on 2020-04-24

fish 99.4
people 98.6
group 95.1
no person 93.1
water 91.9
sea 86.9
paper 86.4
art 86.2
vintage 85.7
child 85.5
carp 84.5
school 83.4
many 82.9
antique 82.9
adult 82.4
aquarium 81.6
woman 81.4
old 81.2
illustration 80.8
bird 80.6

Imagga
created on 2020-04-24

doormat 100
mat 80.2
floor cover 60.8
covering 42.4
grunge 40.9
tray 39.4
texture 38.2
old 37.6
vintage 34.8
container 32.2
receptacle 31.9
antique 28.6
aged 28.1
frame 25.8
wall 25.7
dirty 25.3
rusty 23.8
retro 22.9
material 22.3
pattern 21.9
ancient 20.8
envelope 20.3
blank 19.7
sand 19.2
damaged 19.1
empty 18.9
paper 18.8
surface 17.6
textured 17.5
board 16.8
chalk 16.6
art 15.6
parchment 15.4
wallpaper 15.3
weathered 15.2
beach 15.2
backdrop 14.8
rough 14.6
rust 14.5
grungy 14.2
design 14.2
blackboard 14.1
space 14
ocean 13.3
message 12.8
structure 12.6
decay 12.5
brown 12.5
aging 12.5
obsolete 12.5
dirt 12.4
color 12.2
text 12.2
communication 11.8
border 11.8
sea 11.7
nobody 11.7
water 11.3
sign 11.3
paint 10.9
wood 10.8
grime 10.7
cracked 10.7
messy 10.6
spot 10.6
backgrounds 10.5
worn 10.5
stone 10.4
drawing 10.3
summer 10.3
black 10.2
horizontal 10.1
chalkboard 9.8
scratched 9.8
stains 9.7
crumpled 9.7
close 9.7
stain 9.6
old fashioned 9.5
wave 9.5
word 9.4
write 9.4
writing 9.4
note 9.2
metal 8.9
ragged 8.8
fracture 8.8
faded 8.8
education 8.7
learn 8.5
travel 8.5
map 8.4
grain 8.3
letter 8.3
school 8.1
symbol 8.1
yellow 8
urban 7.9
crease 7.8
geography 7.7
concrete 7.7
age 7.6
iron 7.5
earth 7.3
graphic 7.3
global 7.3
holiday 7.2
wooden 7

Google
created on 2020-04-24

Stock photography 62.1
Drawing 55.8
Paper 51
Style 51
Illustration 50.4

Microsoft
created on 2020-04-24

drawing 99.2
sketch 97.7
child art 96.3
text 94.7
cartoon 92.6
black and white 86.5
black 81.2
stone 4.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 8-18
Gender Male, 50.2%
Calm 50.4%
Sad 49.6%
Surprised 49.5%
Disgusted 49.5%
Angry 49.5%
Happy 49.5%
Confused 49.5%
Fear 49.5%

Feature analysis

Amazon

Person 92.7%
Painting 89.4%
Bird 88.8%
Horse 88.4%

Captions

Microsoft
created on 2020-04-24

a black and white photo of a bird 61.8%
black and white photo of a bird 52.5%
an old photo of a bird 52.4%

Text analysis

Amazon

19-262

Google

19-263
19-263