Human Generated Data

Title

Wisps of Cloud (Usugumo), Illustration to Chapter 19 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.19.A

Human Generated Data

Title

Wisps of Cloud (Usugumo), Illustration to Chapter 19 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.19.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Art 94.6
Mural 87
Human 84
Animal 71
Wall 57.9
Advertisement 55.9
Poster 55.3
Graffiti 55.2

Clarifai
created on 2018-02-09

illustration 97.4
no person 93.2
painting 92
house 90.8
building 89.5
art 89.1
architecture 88.6
print 86.6
desktop 85.7
vintage 83.7
people 83.5
wall 81.8
color 81.4
outdoors 81.4
old 80.8
retro 80.6
travel 80.4
landscape 79.1
food 78
design 76.9

Imagga
created on 2018-02-09

machine 29.3
tool 18.7
old 18.1
device 17.8
construction 16.2
paper 14.2
building 13.9
wall 13.6
architecture 13.3
vintage 11.6
card 11
house 10.9
retro 10.6
travel 10.6
equipment 10.3
grunge 10.2
letter 10.1
newspaper 9.9
business 9.7
saw 9.6
brown 9.6
sky 9.6
frame 9.2
city 9.1
currency 9
home 8.8
ancient 8.6
yellow 8.6
industry 8.5
design 8.4
stone 8.4
light 8.1
bank 8.1
financial 8
artistic 7.8
product 7.7
money 7.7
texture 7.6
bill 7.6
finance 7.6
tourism 7.4
page 7.4
envelope 7.4
vacation 7.4
historic 7.3
new 7.3
industrial 7.3
structure 7.2

Google
created on 2018-02-09

painting 82.2
art 81.4
mural 71
illustration 61.7
artwork 56.1
paint 53.2
recreation 52.7
visual arts 52.5

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 14-25
Gender Male, 55%
Confused 46.9%
Disgusted 45.4%
Angry 46.4%
Calm 47%
Sad 48.8%
Surprised 45.5%
Happy 45.1%

AWS Rekognition

Age 16-27
Gender Male, 54.4%
Disgusted 45.6%
Surprised 46.7%
Angry 46%
Calm 47.2%
Sad 47%
Happy 45.9%
Confused 46.6%

AWS Rekognition

Age 23-38
Gender Female, 51.3%
Sad 54.1%
Surprised 45.1%
Angry 45.2%
Calm 45.3%
Happy 45.1%
Disgusted 45.1%
Confused 45.1%

Imagga

Traits no traits identified

Feature analysis

Amazon

Painting
Person
Bird

Clarifai

Clothing
Human face
Land vehicle
Wheel
Poster

AWS Rekognition

Painting 88.5%

AWS Rekognition

Person 84%

AWS Rekognition

Bird 71%

Clarifai

Clothing 86.7%

Clarifai

Clothing 73.4%

Clarifai

Clothing 72.4%

Clarifai

Clothing 65.6%

Clarifai

Clothing 37.4%

Clarifai

Human face 62.6%

Clarifai

Human face 62.6%

Clarifai

Human face 61.9%

Clarifai

Human face 58.4%

Clarifai

Land vehicle 58.4%

Clarifai

Wheel 52.6%

Clarifai

Poster 47.5%

Categories

Captions

Microsoft
created by unknown on 2018-02-09

a close up of a cage 48.3%
a person sitting in a cage 24.5%
a person sitting in a cage 24.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a woman sitting on a bench

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a woman sitting on a chair and a man sitting on the ground

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image appears to be a traditional Japanese painting from the Heian period. It depicts an indoor scene with women dressed in elaborate kimonos, sitting on mats that are arranged in an organized manner. The setting seems to be within a noble or royal residence, characterized by the architectural elements such as sliding doors, wooden railings, and intricate designs. There is also a beautifully adorned cart positioned near the stairs in the lower part of the image. The overall atmosphere is one of elegance and refinement, reflecting a historical Japanese courtly setting.

Created by gpt-4 on 2024-01-24

The image depicts a traditional Japanese scene. The setting seems to be an outdoor space with elements of nature and architecture intermingling. There's a visible contrast between the lush greenery of the grass and the elegant design of a wooden structure, likely a part of a traditional Japanese building. The scene includes several individuals dressed in colorful traditional garments, seated on tatami mats inside the building. The attire suggests different colors and patterns, indicating a rich portrayal of cultural attire. The surroundings are detailed with elements such as vibrant green flooring and delicately designed screens or doors, suggestive of a calm and serene environment often found in traditional Japanese interiors. The presence of clouds or perhaps blossoming trees further cements the outdoor aspect of the scene, providing a harmonious background to the gathering. The overall aesthetic is characteristic of Japanese art, with an emphasis on the beauty of the natural world and its integration with human habitation.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a traditional Japanese painting, likely from the Heian period, showing a scene inside a noble residence. The painting uses the characteristic "floating perspective" style where the viewer looks down at an angle into the architectural space. Several figures in traditional court clothing are seated on a raised platform or veranda with green flooring. The architecture features decorative green pillars and there's a latticed screen or partition visible in the lower portion. The background has a gold leaf or similar metallic finish, which was a common technique in Japanese paintings of this era. The overall composition shows both interior and exterior elements, with the figures arranged in a formal setting that suggests this may be depicting a court ceremony or important meeting. The use of color is typical of the period, with greens, whites, reds, and black against the golden background.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a surreal, fantastical scene that appears to combine elements of traditional Japanese art with more modern sensibilities. In the foreground, there is a black lacquered chair or cart with an intricate, perforated design. Behind it, the scene opens up into a landscape with stylized, mountainous forms in shades of green, blue, and gold. Two figures, seemingly dressed in traditional Japanese attire, are visible in the background amid the abstract, patterned elements. The overall composition and artistic style suggest a blending of cultural influences and a dreamlike, imaginative quality.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image is a traditional Japanese painting, likely from the Edo period, depicting a scene of people gathered on a staircase. The painting is done in a style reminiscent of ukiyo-e, with bold lines and vibrant colors.

Key Elements:

  • Staircase: The central element of the painting is a staircase with white railings and green accents. The staircase is depicted in a diagonal composition, leading the viewer's eye from the bottom left to the top right.
  • Figures: Several figures are scattered throughout the staircase, each engaged in their own activity. Some are sitting, while others are standing or walking. The figures are dressed in traditional Japanese clothing, including kimonos and obis.
  • Colors: The painting features a bold color palette, with shades of green, red, and gold dominating the scene. The green accents on the staircase and the red kimonos of the figures add a pop of color to the otherwise muted tones of the painting.
  • Composition: The composition of the painting is dynamic, with the diagonal staircase creating a sense of movement and energy. The figures are arranged in a way that creates a sense of depth and layering, drawing the viewer's eye through the scene.

Overall Impression:

The painting exudes a sense of tranquility and elegance, capturing a moment in time when people gathered on the staircase to socialize and enjoy each other's company. The use of bold colors and dynamic composition creates a visually striking image that invites the viewer to explore the scene further.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a scene from Japanese art, specifically a painting or illustration from the Edo period (1603-1868). The artwork is characterized by its use of gold leaf and vibrant colors, which were typical of Japanese art during this time.

In the foreground, a group of people are gathered around a staircase. They are dressed in traditional Japanese clothing, with the men wearing kimonos and the women wearing long, flowing robes. The staircase is adorned with intricate carvings and ornate railings, adding to the overall sense of elegance and refinement.

To the left of the staircase, a man is standing, holding a fan and looking down at the people gathered below. He appears to be a noble or aristocrat, given his dignified demeanor and the fine clothing he wears.

The background of the image is a deep blue, which provides a striking contrast to the warm tones of the gold leaf and the vibrant colors of the clothing. The overall effect is one of beauty and sophistication, capturing a moment in time from Japan's rich cultural heritage.

The image is likely a reproduction or adaptation of an original work from the Edo period, created using traditional Japanese techniques and materials. The level of detail and craftsmanship evident in the image suggests that it is a high-quality reproduction or adaptation, rather than a modern creation.

Overall, the image provides a glimpse into the artistic and cultural traditions of Japan during the Edo period, showcasing the country's rich history and heritage.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a painting of a scene with a person standing on the balcony of a building. The balcony has a railing and a staircase. The person is wearing a hat and a white robe. On the ground floor, there are several people sitting on the floor, wearing traditional Japanese clothing. They are sitting on a green carpet. In the background, there are trees and a body of water.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a traditional Japanese painting, possibly from the Edo period, depicting a scene of a family gathering in a room with a garden view. The painting features a blend of gold and green colors, with a golden background and green accents. In the foreground, there is a green carriage with a wheel, partially hidden by a pile of golden objects. On the left side, a man is standing and looking downward, possibly holding a bag or a scroll. In the middle, a woman is sitting on a green carpet, wearing a kimono and a hat. On the right side, another woman is sitting on a carpet, wearing a kimono and a hat, and there is a box on the carpet. The painting captures a serene and peaceful moment in the lives of the depicted individuals.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

This is a scene depicted in a style reminiscent of traditional Japanese art, possibly a woodblock print or a painting in a similar vein. The overall aesthetic features flat perspectives, stylized figures, and a distinct color palette.

The composition seems to be divided into two main areas. On the left, there is an exterior scene with a dark green carriage or palanquin parked next to a gray building with white trim. A man in traditional attire, including a black headpiece and a white robe with red accents, stands with another figure, possibly a child, who is wearing a patterned brown garment.

On the right, the scene shifts to an interior setting with a green floor adorned with a grid pattern. Several women in traditional Japanese clothing are seated. Each of these women has long, black hair that flows down their backs. The colors of their garments vary, including white, pink, red, and gold. Some of the women appear to be engaged in reading or writing, as suggested by the presence of small black tables or trays in front of them.

The upper portion of the image depicts a blue sky with white clouds and a section of a building with green trim and sliding screens or doors.

Throughout the image, there are scattered areas of gold leaf or a gold-like substance, which could be a decorative element. These gold accents create a sense of opulence and visual interest, while also adding to the overall flatness and stylized nature of the image.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

The image is a traditional Japanese painting, likely a woodblock print or a painting influenced by that style. It depicts a scene from a noble or courtly setting.

Key elements:

  • Figures: Several figures are present. In the top right, there are women with long black hair and traditional robes, seated in the courtyard with the main subject in the foreground. In the lower left, two figures can be seen looking towards the palace, as well as an enclosed carriage or vehicle.
  • Setting: The scene is set inside a grand building, with a prominent perspective that shows various structures. The use of diagonal lines and a high vantage point is typical of this artistic style. The floor of the building is covered in green.
  • Details: The image is rich in details, showcasing patterns, textures, and colors. The artist used a lot of gold.
  • Style: The style of the artwork indicates a traditional Japanese influence, likely from the Heian or subsequent periods, known for their depictions of courtly life and elegance.

The overall atmosphere suggests a moment of peace, elegance, or some kind of narrative from a courtly setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

This image is a traditional Japanese painting, likely from the Heian period (794-1185), which is known for its rich artistic heritage. The painting appears to be an illustration from "The Tale of Genji," a classic work of Japanese literature written by Murasaki Shikibu.

Here are the key elements of the image:

  1. Setting and Background: The scene is set in a traditional Japanese house with sliding doors and screens. The background features a golden sky with clouds, suggesting a serene and possibly evening or early morning atmosphere.

  2. Characters:

    • Left Side: A man is sitting on the veranda, dressed in traditional attire. He appears to be in contemplation or perhaps engaged in a conversation with someone inside the house.
    • Right Side: Two women are seated inside the house, behind a partially open sliding door. They are dressed in elegant, traditional kimonos, indicating their high social status. One woman is seated closer to the door, while the other is further inside.
  3. Objects:

    • Oxcart: In the foreground, there is an oxcart, which was a common mode of transportation for nobility during the Heian period. The cart is ornately decorated, suggesting it belongs to someone of importance.
    • Furniture and Decor: The interior of the house is adorned with traditional Japanese furnishings, including screens and possibly a low table.
  4. Artistic Style: The painting uses a combination of ink and color on silk or paper, with a focus on intricate details and a delicate use of color. The gold background is a characteristic feature of Heian period art, often used to signify luxury and elegance.

Overall, the image captures a moment of quiet interaction between the characters, set against a backdrop of traditional Japanese architecture and nature, reflecting the refined and poetic sensibilities of the Heian period.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-24

This image depicts a traditional Japanese scene, likely from a scroll or a book. It features a multi-tiered structure with a balcony-like area and green railings. The top level shows two figures standing and looking down, while the middle level has a green structure with a wheel, possibly a cart or a decorative element. The bottom level is a green area where several figures are seated on the ground, engaged in what appears to be a social gathering or a ceremony. The figures are dressed in traditional Japanese attire, and the overall setting is adorned with gold leaf, giving it an ornate and historical feel. The background includes stylized representations of clouds and landscapes, enhancing the traditional aesthetic of the artwork.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-24

This image is a traditional Japanese painting, likely from the Edo period, characterized by its use of gold leaf and intricate details. The scene is set within the interior of a building, possibly a noble or royal residence, with a view of the exterior through large open windows.

In the upper right corner, two women are seated on the floor. They are dressed in elaborate traditional Japanese attire, with one of them holding a fan. The woman on the right appears to be an older individual, possibly a mother or a teacher, while the younger woman on the left is likely a student or daughter.

In the lower left corner, a man and a woman are seated on the floor, engaged in conversation. The man is wearing a white robe and a black hat, while the woman is dressed in a patterned kimono. They are positioned near a large, ornate palanquin, which is a type of covered litter used for carrying people.

The background features a rain-drenched courtyard with a tiled roof and a fence, suggesting that it is raining outside. The overall composition and style of the painting are typical of Japanese art from the Edo period, with its emphasis on detailed landscapes, human figures, and the use of gold leaf for decorative elements.

Text analysis

Amazon

ae