Human Generated Data

Title

The Paulownia Pavilion (Kiritsubo), Illustration to Chapter 1 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.1.A

Human Generated Data

Title

The Paulownia Pavilion (Kiritsubo), Illustration to Chapter 1 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.1.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Human 86.1
Art 77.2
Person 77
Person 76.9
Clothing 73.1
Apparel 73.1
Flooring 71.3
Flagstone 70.9
Text 68.7
Nature 66.1
Landscape 66.1
Outdoors 66.1
Person 65.7
People 64.8
Drawing 63
Advertisement 60.3
Road 59.6
Furniture 58.6
Pedestrian 57.1
Building 57
Office Building 57
Scenery 56
Aerial View 56
Overcoat 55.9
Coat 55.9
Painting 55.7
Poster 51.8
Person 41.5

Clarifai
created on 2018-02-09

desktop 92.4
old 91.9
vintage 91.9
illustration 91.8
retro 90
paper 89.7
art 88.5
text 88.3
design 85.2
city 85.1
color 84.5
painting 82.3
ancient 81.4
travel 81.1
building 80.7
people 80.4
antique 79.6
card 79.6
no person 78.8
texture 78

Imagga
created on 2018-02-09

architecture 39.8
structure 29.7
building 28.7
city 26.6
old 22.3
travel 20.4
tourism 19.8
town 16.7
ancient 14.7
chandelier 14.5
house 14.5
tile 14
urban 14
fountain 13.7
historic 13.7
tower 13.4
art 13.2
wall 12.8
palace 12.7
landmark 12.6
historical 12.2
church 12
history 11.6
column 11.5
famous 11.2
style 11.1
roof 11.1
sky 10.8
religion 10.7
detail 10.5
buildings 10.4
design 10.1
minaret 9.5
grunge 9.4
cash 9.1
decoration 9.1
summer 9
negative 8.9
color 8.9
map 8.9
window 8.8
mosque 8.5
money 8.5
destination 8.4
tourist 8.4
traditional 8.3
pattern 8.2
vacation 8.2
film 8.2
paper 8.1
fixture 8.1
tree 8
light 8
construction 7.7
texture 7.6
finance 7.6
gold 7.4
street 7.4

Google
created on 2023-10-30

Art 85.2
Line 81.9
Slope 76
Urban design 75.8
Painting 68.6
Font 68.4
Landscape 67.5
Illustration 65
Visual arts 63
Graphic design 57.8
Graphics 57.3
Drawing 54.5
Room 53.1
Pattern 50.8

Microsoft
created on 2023-10-30

cartoon 98.3
drawing 97.6
child art 87.2
map 83.5
painting 83.2
sketch 67.3
poster 66.9
illustration 65.7
bedclothes 57.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 52.6%
Happy 45.4%
Angry 45.4%
Confused 47.9%
Disgusted 45.4%
Sad 45.5%
Surprised 46.7%
Calm 48.6%

AWS Rekognition

Age 20-38
Gender Female, 52.4%
Disgusted 45.8%
Sad 52.9%
Surprised 45.1%
Happy 45.2%
Angry 45.2%
Calm 45.2%
Confused 45.6%

Feature analysis

Amazon

Person 77%
Painting 55.7%
Poster 51.8%

Captions

Azure OpenAI

Created on 2024-01-24

This is a traditional Japanese illustration showing multiple scenes set in what appears to be a palace or a house of nobility. The image displays a bird's eye view into different rooms of the complex. In the top left room, we see a person sitting upright with their back to the viewer, surrounded by four folding screens decorated with patterns. The interior of the room suggests a setting for rest or privacy. Moving right, there is a person in a yellow robe and another figure in blue sitting on the floor, possibly engaged in a conversation and activity outside the viewer's context. Below, in a large space which seems to be a central communal area, numerous individuals, presumably men due to their black robes and hairstyles, are seated formally in rows. Their attire, the stiffness of their posture, and the orderly arrangement suggest that they could be nobles or officials in a court setting. Their detailed attire and accessories indicate a high social standing, and their focus towards the front suggest they might be attending to a lecture, ceremony, or some protocol. Each figure is separated by what seems like low wooden barriers or railings signifying rank or position, a common element in feudal Japanese court design. The room on the bottom left features another person, possibly of higher rank due to the seating on an elevated platform, engaging with scrolls or papers, accompanied by two attendants sitting lower down. Throughout the image, we see that the artist has paid great attention to depicting the architectural details like the woodwork and tatami mats. The use of blank (unpainted) space and perspective places focus on the individuals and their respective activities. Cloud-like gold motifs embellish the background, suggesting either a decorative element in the painting or symbolic representation of their elevated status and environment. This Japanese illustration is rich in cultural detail and encapsulates a moment in history, offering a glimpse into the life and proceedings of Japanese nobility.

Anthropic Claude

Created on 2024-03-29

The image appears to depict a traditional Japanese landscape scene. It shows a group of figures, likely representing people, dressed in traditional Japanese attire and seated in a contemplative or meditative pose. The figures are arranged on a raised platform or structure, surrounded by lush vegetation and what appears to be a waterfall or stream in the background. The overall composition and style of the artwork suggest it is a representation of a tranquil, serene environment, perhaps a temple or sacred space. The use of vibrant colors, intricate patterns, and delicate brushwork creates a visually striking and aesthetically pleasing depiction of this traditional Japanese scene.

Text analysis

Google

!! * B 25.
!!
*
B
25
.