Human Generated Data

Title

Illustrated Scroll of Events of All Year (Shiki no itami)
Date

18th-19th century
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.550.1

Human Generated Data

Title

Illustrated Scroll of Events of All Year (Shiki no itami)

People
Date

18th-19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Handrail 80.2
Banister 80.2
Art 80.2
Human 76
Person 76
Person 75.3
Person 75.2
Person 73.2
Person 73
Person 67.1
Person 66.7
Person 66.4
Painting 66.3
Mural 66.3
Advertisement 65.4
Person 64
Person 60.8
Collage 60
Poster 60
Person 58.9
Building 58.4
Housing 58.4
Playground 57.3
Play Area 57.3
Plant 55.7

Clarifai
created on 2020-04-23

art 98.2
street 98.1
people 96.7
painting 96.3
urban 96.2
wall 96.2
city 95.5
architecture 95.2
building 93
man 92.9
illustration 92.8
desktop 91.9
artistic 91.3
woman 91.3
adult 90.7
color 90.7
graffiti 89.4
girl 88.4
design 88.1
house 87.9

Imagga
created on 2020-04-23

grunge 36.6
texture 32.6
old 29.3
vintage 27.3
map 25
wallpaper 24.5
art 23.7
jigsaw puzzle 23.3
aged 21.7
puzzle 21.3
paper 21.3
dirty 19.9
surface 18.5
decoration 18.4
paint 18.1
color 17.8
pattern 17.8
antique 16.4
floral 16.2
design 15.8
retro 15.6
material 15.2
grungy 15.2
world 15.1
graffito 14.7
flower 14.6
envelope 14.5
stain 14.4
wall 14.4
game 14.4
container 13.4
rusty 13.3
frame 13.3
geography 12.5
structure 12.5
rough 11.8
colorful 11.5
worn 11.5
textured 11.4
detail 11.3
artwork 11
graphic 10.9
backgrounds 10.5
artistic 10.4
drawing 10.3
brown 10.3
grain 10.2
insulating material 10.1
school 10
atlas 9.8
creative 9.7
rust 9.6
weathered 9.5
textures 9.5
page 9.3
globe 9.3
global 9.1
backdrop 9.1
decay 8.7
aging 8.6
north 8.6
damaged 8.6
leaf 8.6
earth 8.3
pencil 8.3
effect 8.2
industrial 8.2
border 8.1
country 8
yellow 7.9
stationery 7.9
building material 7.9
text 7.9
ancient 7.8
continent 7.8
torn 7.7
canvas 7.6
planet 7.5
close 7.4
plants 7.4
crayon 7.4
steel 7.1

Google
created on 2020-04-23

Art 85.7
Painting 84.6
Illustration 81.6
Visual arts 72.2
Watercolor paint 64.8
Modern art 59.2
Mural 57.8

Microsoft
created on 2020-04-23

cartoon 97.7
drawing 96
painting 95
child art 85.6
text 77.9
illustration 77.2
person 76.1
colored 14.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 17-29
Gender Male, 50.3%
Surprised 49.7%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Calm 50.2%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%

AWS Rekognition

Age 9-19
Gender Male, 50.1%
Happy 49.6%
Surprised 50.1%
Sad 49.5%
Calm 49.6%
Disgusted 49.5%
Fear 49.5%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 23-37
Gender Female, 50.3%
Angry 49.7%
Sad 49.5%
Fear 49.5%
Surprised 50.1%
Happy 49.5%
Confused 49.5%
Calm 49.7%
Disgusted 49.5%

AWS Rekognition

Age 19-31
Gender Female, 50.1%
Angry 49.9%
Sad 49.5%
Happy 49.5%
Disgusted 49.6%
Calm 49.6%
Confused 49.5%
Surprised 49.7%
Fear 49.7%

AWS Rekognition

Age 20-32
Gender Male, 54.3%
Calm 47.6%
Disgusted 45.5%
Happy 45.5%
Surprised 46.5%
Sad 46.3%
Confused 46.4%
Fear 45.4%
Angry 46.7%

Feature analysis

Amazon

Person 76%

Captions

Microsoft

a birthday cake 42%
a table with a birthday cake 26.5%
a birthday cake on a table 26.4%