Human Generated Data

Title

The Seer (Maboroshi), Illustration to Chapter 41 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.41.A

Human Generated Data

Title

The Seer (Maboroshi), Illustration to Chapter 41 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.41.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Art 94
Mural 81.9
Drawing 76.2
Sketch 58.4
Doodle 56
Wall 55.2

Clarifai
created on 2018-02-09

art 96.9
wall 95.7
print 95.1
painting 94.7
illustration 93.4
desktop 93.4
no person 92.7
old 92.7
vintage 91.2
architecture 90.9
flora 89.3
ancient 88.7
antique 88.5
retro 88
building 86.7
nature 86.6
texture 86.4
design 85.2
symbol 84.8
pattern 83.6

Imagga
created on 2018-02-09

map 69.1
vintage 39.7
old 38.3
representation 35.5
retro 32
grunge 30.7
paper 29
antique 29
ancient 25.1
world 23.2
texture 22.2
aged 20.8
geography 20.2
frame 18.4
art 18.4
travel 17.6
border 17.2
atlas 16.4
globe 15.8
money 15.3
worn 15.3
card 15.2
pattern 15
letter 14.7
currency 14.4
cash 13.7
global 13.7
finance 13.5
page 13
navigation 12.5
country 12.5
lace 12.4
note 11.9
wall 11.8
continent 11.6
stamp 11.6
earth 11.1
mosaic 11
business 10.9
envelope 10.9
city 10.8
bank 10.8
wallpaper 10.7
design 10.7
scrapbook 10.7
structure 10.6
grungy 10.4
puzzle 10.4
planet 10.4
tile 10.3
postmark 9.9
mail 9.6
brown 9.6
bill 9.5
nation 9.5
drawing 9.5
plan 9.5
blank 9.4
floral 9.4
dollar 9.3
banking 9.2
tourism 9.1
decoration 8.8
torn 8.7
stained 8.7
used 8.6
north 8.6
architecture 8.6
damaged 8.6
house 8.5
backdrop 8.2
paint 8.1
close 8
album 7.8
discovery 7.8
sepia 7.8
banknote 7.8
hundred 7.7
dollars 7.7
flower 7.7
parchment 7.7
covering 7.6
decorative 7.5
economy 7.4
gold 7.4
historic 7.3
rough 7.3
wealth 7.2
history 7.2
financial 7.1
textured 7

Google
created on 2018-02-09

painting 87.2
art 79.4
artwork 63.2
paint 54.1
impressionist 52.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 11-18
Gender Male, 54%
Angry 46.2%
Calm 45.4%
Confused 45.2%
Happy 45.2%
Disgusted 45.1%
Surprised 45.2%
Sad 52.6%

Feature analysis

Amazon

Painting

Clarifai

Clothing
Plant
Person
Human face
Tree

AWS Rekognition

Painting 92.9%

Clarifai

Clothing 72.6%

Clarifai

Clothing 60.8%

Clarifai

Plant 66.3%

Clarifai

Plant 60.8%

Clarifai

Plant 52.8%

Clarifai

Plant 51.6%

Clarifai

Plant 51.4%

Clarifai

Plant 47.1%

Clarifai

Plant 42.5%

Clarifai

Plant 42.4%

Clarifai

Plant 42.4%

Clarifai

Plant 40.6%

Clarifai

Plant 39.1%

Clarifai

Plant 38.2%

Clarifai

Plant 37.1%

Clarifai

Plant 37%

Clarifai

Plant 36.2%

Clarifai

Plant 35.9%

Clarifai

Plant 35.4%

Clarifai

Plant 34.4%

Clarifai

Person 66.1%

Clarifai

Human face 55.3%

Clarifai

Human face 53.5%

Clarifai

Tree 43.2%

Clarifai

Tree 38.5%

Clarifai

Tree 33.1%

Captions

Microsoft
created by unknown on 2018-02-09

a cake made to look like a face 23%
a close up of a cake 22.9%
a picture of a cake 22.8%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a woman sitting on a bench

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man sitting in a chair and a woman sitting on the ground

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

The image is a traditional Japanese painting that depicts an indoor scene, likely from a historical or aristocratic setting. It shows three figures inside a structure with open sides, possibly a pavilion or similar building.

The figure on the left appears to be a high-ranking person given the elaborate design of his robe and headgear. He is seated on a mat, holding a bowl and looking engaged in some activity, possibly a tea ceremony or meal. The central figure, dressed in black, seems to be serving or assisting the first figure, as he is positioned lower and nearer to the ground.

The figure on the right, dressed in ornate clothing with a golden hue, is also seated and appears to be participating in the same activity. The interior structure includes rich green and yellow tones, with intricate decorations near the ceiling.

Below the structure, the outdoor area features a garden with a small pond or stream, pathways, and a prominent tree with green foliage and reddish-brown trunk, contributing to a serene and elegant atmosphere typical of traditional Japanese gardens. The overall composition suggests a peaceful and refined moment, possibly from the Heian period, characterized by harmony with nature and intricate details in the attire and architecture.

Created by gpt-4 on 2024-01-24

This image depicts a traditional Japanese scene comprising three primary elements:

  1. Interior Setting: Two figures are portrayed in a classical Japanese room. The person on the left is seated on the floor with various objects in front of them, possibly involved in a tea ceremony or another ritual. Their attire is traditional, with intricate patterns and the garment folded across the body. Opposite to this figure is another person, seen from the back, dressed in black and also seated on the floor. The interior design includes green decorative panels at the bottom of the walls and a view into an adjoining room where another figure wearing a yellow garment is visible.

  2. Architecture: The image gives a clear view of traditional Japanese sliding doors (shoji), which separate the interior space from the exterior. An interesting detail is a dish-like object perched near the roof section, possibly a type of vent or decor, and the visible construction details, like the frame of the sliding doors and the layered roof.

  3. Exterior Landscape: A snowy garden is depicted outside the rooms. The scene includes snow-covered pine trees bending under the weight of the snow, with some bare patches revealing their green needles. A small bridge arches over a partially frozen stream, and there are stones and snow-covered bushes around it, giving a sense of a chilled, serene winter atmosphere.

The painting style is traditional, with visible brush strokes and a preference for muted color tones with accentuated spots of color. It creates a calm, composed scene reflecting aspects of Japanese culture and aesthetics.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a traditional Japanese painting depicting a scene inside a building with figures engaged in what looks like a formal gathering or ceremony. The interior space is divided by architectural elements, with decorative green borders along the top. The figures are shown wearing traditional Japanese clothing, with one in white and another in black seated in formal positions on the floor. In the foreground, there is a beautifully rendered garden landscape with a pond or stream and pine trees with characteristic curved branches. The painting style is characteristic of Japanese narrative painting, likely from the medieval period, using delicate lines and subtle colors including greens, golds, and earth tones. The composition effectively combines both interior and exterior scenes, which is a common feature in Japanese architectural painting.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

This image appears to be an East Asian painting, likely from Japan or China, depicting a traditional scene. The painting shows a building or palace with intricate decorative patterns on the roofs and walls. Inside the building, there are two figures seated on the floor, dressed in traditional attire. One figure appears to be a man in formal, robed clothing, while the other seems to be a woman wearing a dark garment. The background features a landscape with trees, rocks, and a body of water, all rendered in a stylized, decorative manner characteristic of East Asian art. The overall composition and artistic style suggest this is an example of traditional East Asian painting, possibly from the imperial or aristocratic tradition.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image is a painting of three men sitting on a veranda, with a garden in the foreground. The man on the left wears a white kimono and sits cross-legged on the floor, while the man in the middle wears a black kimono and sits on his knees. The man on the right wears a yellow kimono and sits cross-legged on the floor.

The veranda has a green railing and a white roof, and there are several objects on the floor, including a box, a bowl, and a stick. In the foreground, there is a garden with trees, rocks, and a pond. The background of the painting is a light brown color, with some darker brown and green accents.

Overall, the painting appears to be a traditional Japanese art piece, possibly from the Edo period (1603-1868). It depicts a serene and peaceful scene, with the three men engaged in a quiet activity, surrounded by nature.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a traditional Japanese scene, likely from the Edo period (1603-1868), featuring a serene garden and a building with a covered porch. The scene is painted in a style reminiscent of ukiyo-e, a genre of Japanese art that flourished during this time.

  • Building and Porch:
    • The building is a traditional Japanese structure with a tiled roof and a covered porch.
    • The porch is adorned with green and white decorative elements, including a patterned railing and a lantern.
    • The building's walls are painted in a warm, beige color, while the porch is painted in a lighter shade.
  • People:
    • There are three people in the scene: two men and one woman.
    • The man on the left is seated on the floor, wearing a white kimono with a black sash.
    • The man in the center is standing, wearing a black kimono with a white sash.
    • The woman is seated on the floor, wearing a yellow kimono with a green sash.
  • Garden:
    • The garden is a traditional Japanese garden with a pond, trees, and rocks.
    • The pond is surrounded by a low wall and features a small waterfall.
    • There are several trees and bushes in the garden, including a large pine tree in the foreground.
  • Other Elements:
    • There are several other elements in the scene, including a lantern on the porch and a few pieces of furniture inside the building.
    • The overall atmosphere of the scene is one of tranquility and elegance, suggesting that it may be a depiction of a noble or aristocratic family's home.

Overall, the image presents a peaceful and serene scene that reflects the beauty and simplicity of traditional Japanese culture.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a scene from a traditional Japanese painting, likely from the Edo period. The setting appears to be a traditional Japanese house or tea house, with a veranda visible in the foreground. There are three figures in the scene. The figure on the left is seated and appears to be engaged in conversation with the figure in the middle, who is holding a fan. The figure on the right is seated and appears to be listening to the conversation. The painting has a muted color palette, with shades of green, brown, and yellow. The background of the painting is blurry, with a small tree visible in the foreground. The overall style of the painting is reminiscent of traditional Japanese art, with a focus on simplicity and elegance.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a painting of a scene that appears to be from a traditional Japanese setting. The painting depicts a group of people gathered in a room with a balcony overlooking a garden. The people are dressed in traditional Japanese clothing, and some of them are seated on the floor while others are standing. The room has a wooden floor and walls, and there is a window with a view of a garden outside. The garden is filled with trees and plants, and there is a small pond in the center. The painting has a warm and peaceful atmosphere, and it seems to capture a moment of relaxation and contemplation.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

This is a Japanese painting depicting figures inside a traditional building in a snowy landscape. The style is reminiscent of historical Japanese art, with attention to detail in clothing and architectural elements.

In the upper part of the painting, the scene is divided into two distinct areas within what appears to be an interior. On the left, a figure in white clothing with black headwear sits cross-legged, holding a small plate. There are various containers and items around them. To the right, another figure is seated, dressed in a yellow robe, also with a small plate in front of them. A figure dressed in black is seated with their back to the viewer between the two seated figures. The interior has green accents.

Below the interior scene, there is a snowy landscape, with pine trees covered in snow framing the right side. A wooden bridge is visible among the trees. A pond or water feature is in the lower-left corner, partially covered in snow. The ground is depicted with a mix of beige and white, suggesting a snowy environment.

The painting is framed, with a gold-toned background that gives the artwork a sense of age and authenticity. The style and subject matter indicate that this is likely a depiction of a historical or ceremonial event in a traditional Japanese setting.

Created by gemini-2.0-flash-lite on 2025-04-26

Here is a description of the image:

This is an illustration of a Japanese scene, likely from the Edo period (1603-1868), portraying a winter scene with figures inside a building.

Here's a breakdown:

  • Setting: The scene is set in a traditional Japanese building, possibly a house or a pavilion. Outside, there is a landscape with a pond or stream and pine trees covered with snow.
  • Figures: Inside the building, there are three figures. They are likely aristocrats or members of the court, dressed in traditional Japanese attire. They are seated on tatami mats. They have objects, that could be food, in front of them, like boxes.
  • Atmosphere: The overall mood is serene and peaceful. The use of snow, the architectural details, and the traditional clothing create a sense of traditional Japanese culture.

The illustration is rendered with a refined and delicate style. It demonstrates the style of Japanese paintings with detailed brushwork and careful color selection.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a traditional Japanese scene, likely from a historical or classical period. The artwork appears to be a painting or illustration in the style of Yamato-e, which is a style of Japanese painting inspired by Tang dynasty paintings and characterized by its use of vibrant colors and detailed depictions of people and landscapes.

In the foreground, there is a snowy landscape with a stream flowing through it. The stream is bordered by rocks and snow-covered banks, with a small bridge crossing it. The background features a traditional Japanese building, possibly a pavilion or a part of a larger residence.

Inside the building, three figures are visible:

  1. On the left, a person dressed in elaborate, white robes with intricate patterns is seated on a platform. This figure appears to be of high status, possibly a noble or a court official.
  2. In the center, a person dressed in black robes is standing and facing the seated figure on the right.
  3. On the right, another person is seated on a platform, dressed in yellow robes with a more subdued pattern. This figure also appears to be of some importance.

The scene suggests a formal or ceremonial gathering, possibly involving nobility or court officials. The snowy landscape and traditional architecture contribute to the serene and elegant atmosphere of the image.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

The image is a traditional East Asian painting, possibly Japanese, showcasing a serene outdoor scene with elements of a garden setting. In the upper portion of the painting, there are two figures seated on a raised platform, possibly a veranda or balcony, adorned with a floral patterned curtain. The figures are dressed in traditional attire, with one figure wearing a black robe and the other in a yellow robe. The figure in the yellow robe appears to be holding a tray with food.

The lower portion of the painting depicts a snowy garden with pruned pine trees and a pond that reflects the surrounding elements. The ground is covered with snow, and a small waterfall or fountain is visible in the center of the garden. The overall color palette is muted with earthy tones and hints of color in the traditional attire and the garden elements, creating a tranquil and traditional atmosphere.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This image is a traditional Japanese painting, likely from the Edo period, depicting a scene from a classic Japanese narrative, possibly from "The Tale of Genji." The painting is divided into two main sections: an interior scene and an exterior scene.

Interior Scene:

  • Setting: The interior is a room with tatami mats, sliding doors (shoji), and a traditional Japanese architectural style.
  • Characters:
    • On the left side, a person dressed in white with intricate patterns is seated on a cushion, holding a fan. This person is likely a noble or a person of high status.
    • On the right side, another person dressed in a yellow kimono is seated, possibly engaged in conversation or some other activity with the person in white.
    • In the foreground, a person dressed in black is kneeling and appears to be presenting something on a tray to the person in yellow. The black-clad figure is likely a servant or attendant.
    • There are various objects on the floor, including a small table with food or tea utensils, and some decorative items.

Exterior Scene:

  • Setting: The exterior scene shows a garden with a pond, a small island, and a tree covered in snow.
  • Details:
    • The pond has a reflective surface with ripples, suggesting some movement.
    • The tree is a pine tree, a common symbol in Japanese art, and it is covered in snow, indicating a winter scene.
    • The garden is well-maintained, with carefully pruned shrubs and a pathway leading to the house.

Overall:

The painting uses soft, muted colors and delicate brushwork, typical of Japanese art from this period. The scene is serene and elegant, capturing a moment of quiet interaction between the characters in a luxurious setting. The presence of snow adds a sense of calm and tranquility to the scene.