Human Generated Data

Title

The Fireflies (Hotaru), Illustration to Chapter 25 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.25.A

Human Generated Data

Title

The Fireflies (Hotaru), Illustration to Chapter 25 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.25.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Human 96.9
Art 84.6
Person 79.9
Horse 77.8
Animal 77.8
Mammal 77.8
Person 77
Person 72
People 71.4
Person 69.6
Painting 66.5
Leisure Activities 65
Person 61.4
Horse 60.3
Horse 59.7
Adventure 57.7
Drawing 56.9
Equestrian 56.8
Person 48.3

Clarifai
created on 2018-02-09

people 98.1
man 95.6
competition 95.6
group 94.9
recreation 94.4
adult 94.1
wear 92.6
action 91.8
military 91.3
many 91
motion 90.8
daylight 89.8
outdoors 89.1
water 88.2
force 87.6
travel 87
battle 86.4
home 86.2
war 85.9
stadium 85.4

Imagga
created on 2018-02-09

sky 22.3
architecture 21.9
building 19.3
city 18.3
old 17.4
tree 16.2
net 15.2
wall 14.5
travel 14.1
ball 13.2
equipment 13.1
sport 13.1
balcony 12.4
urban 12.2
structure 11.2
construction 11.1
exterior 11
volleyball 10.3
landmark 9.9
summer 9.6
high 9.5
game 9.2
historic 9.2
tourism 9.1
active 9
vehicle 8.7
art 8.5
design 8.4
people 8.4
color 8.3
fun 8.2
landscape 8.2
industrial 8.2
new 8.1
park 8.1
rope 8.1
tower 8
metal 8
device 7.9
scene 7.8
ancient 7.8
play 7.7
house 7.7
statue 7.7
grunge 7.7
energy 7.6
leisure 7.5
outdoors 7.5
man 7.4
competition 7.3
team 7.2
activity 7.2
line 7.1

Google
created on 2018-02-09

painting 53.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 2-5
Gender Male, 55%
Angry 46.8%
Surprised 45.7%
Happy 45.2%
Disgusted 45.3%
Confused 47.2%
Sad 47.6%
Calm 47.3%

AWS Rekognition

Age 11-18
Gender Male, 53.6%
Sad 47.2%
Angry 46.5%
Disgusted 45.3%
Surprised 49.3%
Calm 45.2%
Happy 45.7%
Confused 45.8%

Feature analysis

Amazon

Person 79.9%
Horse 77.8%
Painting 66.5%

Captions

Azure OpenAI

Created on 2024-01-24

The image is a traditional Japanese scene, illustrated in an East Asian art style. It depicts a group of individuals on horseback, engaged in what seems like a practice of archery or martial training. The horses are beautifully adorned, and the riders appear to be of an elite class, given their refined attire. Two figures are depicted observing the scene, placed in the middle right of the image. A target hanging on a pole can also be noted in the lower right corner, indicative of a training exercise or sport. The background details a well-manicured environment with a neatly patterned fence or wall, a lush green bush, and a structure with a roof indicative of traditional Japanese architecture. The overall palette is earth-toned with punctuations of color mainly on the figures' clothing and horses, suggesting an outdoor scene in a controlled, perhaps a noble or royal, environment.