Human Generated Data

Title

The Imperial Progress (Miyuki), Illustration to Chapter 29 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.29.A

Human Generated Data

Title

The Imperial Progress (Miyuki), Illustration to Chapter 29 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Person 98.7
Human 98.7
Person 95.7
Person 93.1
Person 91.6
Person 86.8
Person 84.5
Person 83.2
Person 81.8
Art 76.7
Person 75.8
Person 74.8
Painting 70.7
Person 70.2
Outdoors 63.5
Leisure Activities 55.6

Clarifai
created on 2018-02-09

art 93.5
old 91.9
water 91.7
rain 88.2
wet 87.1
traditional 86.7
people 85.5
flood 85.4
building 85.3
industry 84.8
storm 83.4
calamity 82.5
vehicle 82.4
texture 80.9
color 80.3
watercraft 79.5
no person 79.3
grinder 79
town 78.5
weather 77.8

Imagga
created on 2018-02-09

grunge 29.8
old 27.8
texture 24.3
dirty 20.8
automaton 19.1
paint 19
grungy 19
wall 18.4
pattern 17.1
graffito 16.9
surface 15.9
decoration 15.8
vintage 15.7
device 15.4
aged 15.4
fastener 15.1
padlock 14.7
rough 14.6
puzzle 14.1
design 14.1
textured 14
lock 13.7
rusty 13.3
paper 13.3
weathered 13.3
antique 13
metal 12.9
art 12.6
rust 12.5
brown 12.5
damaged 12.4
retro 12.3
game 12.1
construction 12
restraint 11.8
industrial 11.8
wallpaper 11.5
urban 11.4
color 11.1
frame 10.8
water 10.7
border 9.9
backdrop 9.9
architecture 9.4
structure 9.3
city 9.1
material 8.9
detail 8.8
scratch 8.8
messy 8.7
industry 8.5
map 8.4
iron 8.4
steel 8
ancient 7.8
stained 7.7
worn 7.6
close 7.4
symbol 7.4
gold 7.4
metallic 7.4
world 7.3
black 7.2
equipment 7.1
building 7.1
work 7.1

Google
created on 2018-02-09

art 92.2
water 92
painting 76.2
mural 63.2
illustration 63.1
artwork 58.8
recreation 55.9
visual arts 51.6

Face analysis

Amazon

AWS Rekognition

Age 4-9
Gender Male, 54.9%
Angry 47.2%
Happy 45.2%
Disgusted 45.2%
Calm 46.7%
Confused 46.8%
Surprised 46.1%
Sad 47.8%

AWS Rekognition

Age 11-18
Gender Male, 54.8%
Disgusted 46.1%
Sad 49.1%
Surprised 45.5%
Calm 46.4%
Confused 45.8%
Angry 46.5%
Happy 45.5%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Angry 45.4%
Disgusted 45.1%
Sad 53.8%
Calm 45.3%
Happy 45.2%
Confused 45.2%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 53.2%
Surprised 45.7%
Angry 45.4%
Sad 46.9%
Happy 49.9%
Disgusted 45.3%
Calm 46.3%
Confused 45.5%

AWS Rekognition

Age 11-18
Gender Male, 54.5%
Angry 46.7%
Calm 45.4%
Sad 52%
Disgusted 45.1%
Surprised 45.2%
Confused 45.4%
Happy 45%

AWS Rekognition

Age 6-13
Gender Male, 54.7%
Angry 45.4%
Sad 54.4%
Confused 45.1%
Surprised 45%
Calm 45%
Disgusted 45%
Happy 45%

AWS Rekognition

Age 6-13
Gender Male, 54.4%
Happy 45%
Sad 53.7%
Disgusted 45.1%
Angry 45.4%
Confused 45.2%
Calm 45.4%
Surprised 45.2%

AWS Rekognition

Age 11-18
Gender Female, 50.9%
Confused 45.3%
Calm 45.2%
Sad 49%
Angry 45.8%
Disgusted 45.4%
Happy 48.7%
Surprised 45.8%

AWS Rekognition

Age 6-13
Gender Female, 50.3%
Calm 49.5%
Confused 49.6%
Happy 49.6%
Sad 49.8%
Disgusted 49.5%
Surprised 49.9%
Angry 49.6%

AWS Rekognition

Age 12-22
Gender Female, 50.7%
Sad 49.7%
Confused 45.1%
Disgusted 45.4%
Happy 45.3%
Angry 49.2%
Surprised 45.2%
Calm 45%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Angry 46.2%
Calm 45.3%
Confused 45.8%
Happy 47.6%
Disgusted 45.5%
Surprised 48.9%
Sad 45.7%

AWS Rekognition

Age 11-18
Gender Male, 50.2%
Sad 49.8%
Calm 49.6%
Confused 49.5%
Disgusted 49.5%
Happy 49.9%
Angry 49.6%
Surprised 49.6%

Feature analysis

Amazon

Person 98.7%
Painting 70.7%

Captions

Microsoft

a group of stuffed animals that are in the water 10.1%
a group of people in the water 10%
a group of people in water 9.9%