Human Generated Data

Title

The Paulownia Pavilion (Kiritsubo), Illustration to Chapter 1 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.1.A

Human Generated Data

Title

The Paulownia Pavilion (Kiritsubo), Illustration to Chapter 1 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.1.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Human 86.1
Art 77.2
Person 77
Person 76.9
Clothing 73.1
Apparel 73.1
Flooring 71.3
Flagstone 70.9
Text 68.7
Nature 66.1
Landscape 66.1
Outdoors 66.1
Person 65.7
People 64.8
Drawing 63
Advertisement 60.3
Road 59.6
Furniture 58.6
Pedestrian 57.1
Building 57
Office Building 57
Scenery 56
Aerial View 56
Overcoat 55.9
Coat 55.9
Painting 55.7
Poster 51.8
Person 41.5

Clarifai
created on 2018-02-09

desktop 92.4
old 91.9
vintage 91.9
illustration 91.8
retro 90
paper 89.7
art 88.5
text 88.3
design 85.2
city 85.1
color 84.5
painting 82.3
ancient 81.4
travel 81.1
building 80.7
people 80.4
antique 79.6
card 79.6
no person 78.8
texture 78

Imagga
created on 2018-02-09

architecture 39.8
structure 29.7
building 28.7
city 26.6
old 22.3
travel 20.4
tourism 19.8
town 16.7
ancient 14.7
chandelier 14.5
house 14.5
tile 14
urban 14
fountain 13.7
historic 13.7
tower 13.4
art 13.2
wall 12.8
palace 12.7
landmark 12.6
historical 12.2
church 12
history 11.6
column 11.5
famous 11.2
style 11.1
roof 11.1
sky 10.8
religion 10.7
detail 10.5
buildings 10.4
design 10.1
minaret 9.5
grunge 9.4
cash 9.1
decoration 9.1
summer 9
negative 8.9
color 8.9
map 8.9
window 8.8
mosque 8.5
money 8.5
destination 8.4
tourist 8.4
traditional 8.3
pattern 8.2
vacation 8.2
film 8.2
paper 8.1
fixture 8.1
tree 8
light 8
construction 7.7
texture 7.6
finance 7.6
gold 7.4
street 7.4

Google
created on 2023-10-30

Art 85.2
Line 81.9
Slope 76
Urban design 75.8
Painting 68.6
Font 68.4
Landscape 67.5
Illustration 65
Visual arts 63
Graphic design 57.8
Graphics 57.3
Drawing 54.5
Room 53.1
Pattern 50.8

Microsoft
created on 2023-10-30

cartoon 98.3
drawing 97.6
child art 87.2
map 83.5
painting 83.2
sketch 67.3
poster 66.9
illustration 65.7
bedclothes 57.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 52.6%
Happy 45.4%
Angry 45.4%
Confused 47.9%
Disgusted 45.4%
Sad 45.5%
Surprised 46.7%
Calm 48.6%

AWS Rekognition

Age 20-38
Gender Female, 52.4%
Disgusted 45.8%
Sad 52.9%
Surprised 45.1%
Happy 45.2%
Angry 45.2%
Calm 45.2%
Confused 45.6%

Feature analysis

Amazon

Person
Painting
Poster
Person 77%
Person 76.9%
Person 65.7%
Person 41.5%
Painting 55.7%
Poster 51.8%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image depicts a classical Japanese scene from the Heian period, characterized by traditional architecture, elegant clothing, and an air of courtly refinement. The composition is divided into several horizontal layers, giving a bird's-eye view of an interior space, possibly a palace or high-ranking residence. The space is sectioned off with screens and sliding doors adorned with intricate designs. The flooring is lined with tatami mats, and multiple figures are depicted throughout the scene, all dressed in elaborate kimono. The individuals, most likely courtiers or aristocrats, are shown either sitting or kneeling, engaged in various activities. Notably, in the upper and central parts, two figures can be seen seated on cushions, hinting at engaged conversations or leisurely activities. In the middle left, a figure draped in a dark robe appears to be overseeing or contemplating something. Several other figures are scattered around, each absorbed in their actions, contributing to the tranquil, orderly atmosphere that is reflective of the court life during the Heian era. The background is decorated with golden cloud patterns, which is a traditional artistic technique known as 'kirikane,' used to signify a separation from the everyday world and to denote an elevated, ethereal realm within the narrative space. The colors are muted yet rich, emphasizing serenity and refinement that are hallmarks of this time period's aesthetic sensibilities.

Created by gpt-4 on 2024-01-24

This is a traditional Japanese illustration showing multiple scenes set in what appears to be a palace or a house of nobility. The image displays a bird's eye view into different rooms of the complex. In the top left room, we see a person sitting upright with their back to the viewer, surrounded by four folding screens decorated with patterns. The interior of the room suggests a setting for rest or privacy. Moving right, there is a person in a yellow robe and another figure in blue sitting on the floor, possibly engaged in a conversation and activity outside the viewer's context. Below, in a large space which seems to be a central communal area, numerous individuals, presumably men due to their black robes and hairstyles, are seated formally in rows. Their attire, the stiffness of their posture, and the orderly arrangement suggest that they could be nobles or officials in a court setting. Their detailed attire and accessories indicate a high social standing, and their focus towards the front suggest they might be attending to a lecture, ceremony, or some protocol. Each figure is separated by what seems like low wooden barriers or railings signifying rank or position, a common element in feudal Japanese court design. The room on the bottom left features another person, possibly of higher rank due to the seating on an elevated platform, engaging with scrolls or papers, accompanied by two attendants sitting lower down. Throughout the image, we see that the artist has paid great attention to depicting the architectural details like the woodwork and tatami mats. The use of blank (unpainted) space and perspective places focus on the individuals and their respective activities. Cloud-like gold motifs embellish the background, suggesting either a decorative element in the painting or symbolic representation of their elevated status and environment. This Japanese illustration is rich in cultural detail and encapsulates a moment in history, offering a glimpse into the life and proceedings of Japanese nobility.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image appears to depict a traditional Japanese landscape scene. It shows a group of figures, likely representing people, dressed in traditional Japanese attire and seated in a contemplative or meditative pose. The figures are arranged on a raised platform or structure, surrounded by lush vegetation and what appears to be a waterfall or stream in the background. The overall composition and style of the artwork suggest it is a representation of a tranquil, serene environment, perhaps a temple or sacred space. The use of vibrant colors, intricate patterns, and delicate brushwork creates a visually striking and aesthetically pleasing depiction of this traditional Japanese scene.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image depicts a traditional Japanese-style painting, showcasing a scene of people gathered in a room. The room is divided into sections by green and gold dividers, with a staircase leading to an upper level. The individuals are dressed in traditional Japanese attire, with some seated on the floor and others standing. The painting features a muted color palette, with shades of green, gold, and black dominating the scene. The overall atmosphere appears to be one of serenity and tranquility, with the subjects engaged in quiet activities or simply sitting in contemplation. The image exudes a sense of cultural heritage and historical significance, offering a glimpse into Japan's rich artistic traditions. The attention to detail and the use of traditional motifs suggest that the painting is a valuable representation of Japanese art and culture.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a traditional Japanese scene, likely from the Edo period (1603-1868), featuring a group of people in traditional attire gathered around a staircase. The individuals are dressed in black kimonos with blue accents, while one person stands out wearing a green kimono. The scene is set against a backdrop of a wooden staircase with green accents and a beige floor, surrounded by yellow clouds or smoke at the top and bottom of the image. In the background, there are various objects and characters, including a green cloth draped over a chair, a person sitting on the floor, and a small dog. The overall atmosphere of the image suggests a formal gathering or ceremony, possibly related to a traditional Japanese event or ritual. The image's style and composition are reminiscent of traditional Japanese art, with bold lines, vibrant colors, and intricate details. The use of gold accents and the depiction of traditional clothing and architecture further emphasize the image's cultural significance. Overall, the image presents a captivating and culturally rich scene that invites the viewer to explore the traditions and customs of Japan's past.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a painting of a scene from a traditional Japanese theater performance. The painting features several characters in traditional Japanese costumes, some of whom are standing and some are seated. The characters are depicted in various poses, suggesting that they are engaged in a dramatic performance. The painting also includes elements of traditional Japanese architecture, such as wooden beams and paper screens. The overall style of the painting is reminiscent of traditional Japanese art, with its use of bold lines and vibrant colors.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a traditional Japanese painting depicting a scene of people in a room with a golden background. The room appears to be a traditional Japanese setting, possibly a tea house or a ceremonial space. The painting features several figures, including a person sitting on a chair, a person standing, and a person sitting on the floor. The figures are dressed in traditional Japanese clothing, with the person sitting on the chair wearing a kimono and the person standing wearing a hakama. The room is decorated with golden patterns and designs, and there are trees and plants in the background. The painting is a beautiful example of traditional Japanese art, showcasing the intricate details and vibrant colors of the culture.

Text analysis

Google

!! * B 25.
!!
*
B
25
.