Human Generated Data

Title

The Seer (Maboroshi), Illustration to Chapter 41 of the "Tale of Genji" (Genji monogatari)

Date

17th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Mrs. John T. Linzee, 1931.249

Human Generated Data

Title

The Seer (Maboroshi), Illustration to Chapter 41 of the "Tale of Genji" (Genji monogatari)

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Mrs. John T. Linzee, 1931.249

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Advertisement 98
Human 83.3
Drawing 82.8
Art 82.8
Collage 73.7
Soil 67.6
Text 67.4
Plan 66.1
Plot 66.1
Diagram 66.1
People 61.5
Sketch 58.7
Archaeology 55.9

Clarifai
created on 2020-04-24

people 99.9
print 99.2
group 98.7
adult 98.3
illustration 97.9
war 97.3
vehicle 96.8
one 96.3
two 96.1
soldier 95.9
many 95.5
man 95.4
military 95.3
engraving 95
wear 94.6
skirmish 94.2
art 92.9
transportation system 90.5
painting 89.8
group together 89.6

Imagga
created on 2020-04-24

book jacket 25.9
money 25.5
cash 24.7
finance 23.6
currency 23.3
equipment 22.8
bank 22.4
business 21.2
covering 21.1
box 20.6
wealth 20.6
jacket 20.1
paper 19.6
lock 19.5
savings 18.6
blister pack 17
container 16.8
security 16.5
wrapping 16.3
old 16
packaging 15.3
open 15.3
binder 14.8
banking 14.7
metal 14.5
protective covering 13.3
financial 13.3
dollar 13
safe 12.9
device 12.7
note 11.9
briefcase 11.8
dollars 11.6
secure 11.6
storage 11.4
office 11.4
technology 11.1
investment 11
carpenter's kit 10.9
symbol 10.8
vintage 10.7
bills 10.7
home 10.4
close 10.3
object 10.3
safety 10.1
hundred 9.7
kit 9.6
exchange 9.5
bill 9.5
save 9.5
rich 9.3
3d 9.3
protection 9.1
sign 9
retro 9
computer 8.9
steel 8.8
deposit 8.8
billboard 8.7
treasure 8.7
empty 8.6
design 8.5
black 8.4
key 8.4
stack 8.3
letter 8.2
gold 8.2
data 8.2
case 8.1
information 8
vault 7.9
book 7.7
payment 7.7
door 7.6
envelope 7.6
structure 7.4
signboard 7

Google
created on 2020-04-24

Vehicle 51.9

Microsoft
created on 2020-04-24

text 98.9
drawing 98.5
sketch 93.7
black and white 88.1
painting 85.1
construction 66
old 52.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 30-46
Gender Female, 53.4%
Happy 50.1%
Calm 45.9%
Sad 46.9%
Disgusted 45.2%
Fear 45.6%
Surprised 45.3%
Angry 45.8%
Confused 45.2%

Feature analysis

Amazon

Poster
Person

Clarifai

Tree
Picture frame
Clothing
Human face

AWS Rekognition

Poster 98%

AWS Rekognition

Person 83.3%

Clarifai

Tree 71.5%

Clarifai

Picture frame 70.3%

Clarifai

Clothing 70.2%

Clarifai

Human face 46.1%

Categories

Imagga
created on 2020-04-24

paintings art 92.9%
streetview architecture 4.4%
pets animals 1.7%

Captions

Microsoft
created by unknown on 2020-04-24

an old photo of a person 31.9%
old photo of a person 29%
an old photo of a building 28.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a woman in a dress and a man in a suit

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a woman and child in a room

OpenAI GPT

Created by gpt-4 on 2024-12-04

This is a monochrome image of an artwork that appears to be a traditional Japanese scene. The artwork showcases a detailed indoor scene which is viewed at a diagonal angle, providing a sense of depth and perspective.

In the image, two women are featured prominently. On the left, a woman is seated on the floor; she wears a kimono with elaborate patterns and looks to her right. Her hair is styled in a manner typical of traditional Japanese fashion, and her posture is upright, indicating formality and poise.

In the foreground on the lower right, we see another woman depicted in a more relaxed posture, lying on the floor with her head propped up by her arm. She also wears a kimono and her long hair flows behind her.

The room they are in is richly decorated, with tatami flooring, sliding doors (fusuma), and a lattice window (shoji). A portion of the outside environment is visible through these windows, showing a garden with a tree, possibly indicating the season with its bare branches.

The whole scene is contained within a decorative border, and at the bottom center of the image, there is a label with the text "1931.249," which likely refers to an inventory or catalogue number associated with the artwork. The aged quality of the paper and the style of the image suggest this artwork could be historical.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a traditional Japanese artwork, likely from a narrative handscroll or painted screen. The image shows an interior scene with figures wearing elaborate Heian period court clothing with multiple layers of robes. There's an architectural element showing a wooden platform or veranda with railings, and what appears to be flowering plum branches visible in the background. The composition uses the characteristic "blown-off roof" perspective common in Japanese narrative painting, allowing viewers to see inside the building from above. The artwork is rendered in black and white in this reproduction, though the original would likely have been in color. The number "1931.249" appears below the image, suggesting this might be a museum catalog reference number.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a black and white photograph depicting a scene from what seems to be a traditional Japanese or East Asian artistic work. The central focus is a figure, possibly a woman, rendered in an illustrative or decorative style, reclining within a structure or architectural setting. The background features stylized landscapes and natural elements, creating a sense of depth and immersion in the scene. The overall aesthetic suggests a sophisticated and intricate artistic style.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This appears to be a traditional Japanese artwork, likely from the Heian period. It shows an interior scene depicted in the characteristic oblique angle perspective common in Japanese narrative painting. The image shows a room with tatami mats and decorative screens or latticed partitions. In the background, there appears to be a veranda or elevated platform, and some flowering tree branches are visible. The scene includes several figures in elaborate traditional Japanese court clothing, shown in seated or reclining positions. The artwork is rendered in a monochromatic style, possibly from an emaki (picture scroll) or similar narrative painting format. The composition uses the typical "blown-off roof" perspective that allows viewers to look down into the interior scene from above.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

This image is a black and white photograph of an ancient Japanese painting, depicting a scene with two figures. The painting appears to be from the Edo period, characterized by its traditional Japanese style and motifs.

In the foreground, a woman sits on the floor, wearing a long kimono with a patterned design. She has long black hair and is engaged in an activity, possibly reading or writing. Behind her, a man stands, dressed in a traditional Japanese outfit, including a hat and a robe with intricate designs. He seems to be observing the woman or waiting for something.

The background of the painting features a serene landscape with mountains, trees, and a bridge. The overall atmosphere of the painting is one of tranquility and elegance, reflecting the refined culture of the Edo period.

The photograph itself has a worn and aged appearance, with visible signs of damage and deterioration. The edges are rough and torn, and there are scratches and marks on the surface. Despite this, the image remains clear and detailed, providing a glimpse into the artistic and cultural heritage of Japan's past.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image is a black and white photograph of an old Japanese painting, depicting a scene with a man and a woman. The painting appears to be from the 19th or early 20th century, given its style and the clothing worn by the figures.

  • Man:
    • The man is seated on the left side of the image.
    • He wears a traditional Japanese hat and a kimono with intricate designs.
    • His face is partially obscured, but he seems to be looking at the woman.
  • Woman:
    • The woman is lying on her back on the right side of the image.
    • She also wears a kimono, which is more elaborate than the man's.
    • Her face is visible, and she appears to be sleeping or resting.
  • Background:
    • The background of the painting features a landscape with trees and a bridge.
    • The sky is cloudy, adding to the serene atmosphere of the scene.
  • Frame:
    • The painting is framed in a traditional Japanese style, with a decorative border around the edges.
    • The frame is made of wood and has a dark finish, which complements the colors of the painting.

Overall, the image presents a peaceful and intimate scene, capturing a moment in time from Japan's past.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a monochrome print with a black-and-white filter. The image shows a man sitting on a chair, probably in a room. The man is wearing a hat and a robe. There is a wooden fence in front of him, and a tree is behind him. There is a person lying on the floor in front of him, and a box is placed on the floor. There is a watermark with the text "1931.249" on the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a black-and-white photograph of an artwork. The artwork depicts a scene from a traditional Japanese house. It features a man seated on a tatami mat, wearing a kimono and a hat. He is holding a scroll or a piece of paper, possibly reading or examining it. In front of him, there is a woman lying on the floor, wearing traditional Japanese clothing. The setting includes a wooden fence, a small garden, and a tree with blossoms.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

Here is a description of the image:

The image is a black and white representation of a traditional East Asian scene, possibly Japanese or Chinese in origin. It features a male figure in ornate attire, including a tall hat, standing near what appears to be a table. A woman lies on the floor, her long hair flowing around her.

The scene is set within a structure that looks like a building, with sliding doors or partitions, and a lattice fence visible in the background. There is a sense of depth, with elements of landscape visible behind the building, including what looks like a tree and a hill.

The style of the image is reminiscent of traditional paintings or illustrations, and there is a distinct artistic quality. The overall tone is serene and contemplative.

Created by gemini-2.0-flash-lite on 2025-04-27

Certainly! Here's a description of the image:

Overall Impression:

The image appears to be a grayscale scan or photograph of a Japanese painting. It showcases a scene with figures in traditional attire, set in what seems to be a garden or outdoor space. The overall style suggests it might be from a historical period.

Key Elements:

  • Figures:

    • On the left side, a figure in ornate clothing, possibly a nobleman, is shown gesturing.
    • On the right, a woman with long flowing hair is depicted, perhaps reclining or seated.
  • Setting:

    • There's a structure resembling a veranda or a raised platform.
    • Elements of the garden are present, including what looks like flowering trees and a fence.
    • The backdrop includes clouds and a suggestion of hills or a landscape.
  • Composition:

    • The arrangement is layered, with figures in the foreground and background elements creating depth.
    • The composition is framed by a patterned border.
  • Details:

    • The artwork shows some wear, suggesting age.
    • The style is highly detailed, with attention paid to the figures' clothing, the architectural details, and the natural elements.
  • Identification:

    • The inscription "1931.249" suggests this image is either a reproduction or a record of an artwork within a specific collection, possibly a museum or archive.

Inference:

Based on the attire and setting, it likely represents a scene from historical Japanese culture, possibly a courtly or literary narrative. The details evoke a sense of tranquility and refinement.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image appears to be a traditional Japanese painting, likely from the Heian period (794-1185) or later, given the style and subject matter. The scene depicts a serene, indoor setting with two figures.

  1. Setting: The setting is an elegant room with tatami mats on the floor, which is characteristic of traditional Japanese interiors. The room features sliding doors and a lattice window, allowing a view of the outside garden with blossoming trees, possibly cherry blossoms, which are a common motif in Japanese art.

  2. Figures:

    • The figure on the left is seated and appears to be a woman wearing a traditional kimono with intricate patterns. She is seated on the floor, leaning against a piece of furniture, possibly a screen or a low table.
    • The figure on the right is lying down, also dressed in traditional attire, possibly a man. He is resting on what seems to be a futon or a similar type of bedding.
  3. Details: The painting showcases detailed patterns on the clothing and the room's decor, reflecting the meticulous craftsmanship typical of Japanese art from this period. The use of perspective and the depiction of the interior and exterior spaces are also noteworthy.

  4. Style: The style of the painting, with its delicate lines and subtle colors, suggests it could be an example of Yamato-e, a style of Japanese painting that focuses on Japanese themes and landscapes.

Overall, the image captures a quiet, intimate moment within a traditional Japanese setting, highlighting the elegance and refinement of the period's art and culture.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

The image appears to be a traditional Japanese painting, possibly depicting a scene from Japanese history or folklore. The artwork is rendered in a style that is characteristic of Japanese art, with a focus on intricate details and a dramatic composition.

  • Foreground: There are two figures, one wearing a kimono with a patterned design, possibly a courtier or nobleman, standing near a table. The other figure, in the foreground, is lying down and seems to be unwell or resting, dressed in a kimono with long flowing sleeves and hair styled in traditional Japanese fashion. The person lying down is positioned in a way that suggests a scene of concern or care, with the standing figure possibly attending to them.

  • Background: The background features a traditional Japanese veranda or balcony with sliding paper doors and wooden lattice work. Beyond the balcony, there are trees and plum blossoms, which could symbolize the season of the painting (likely winter or early spring, as plum blossoms typically bloom in late winter and early spring). The landscape includes hills and a hint of a night sky or moonlit scene, adding to the serene yet melancholic atmosphere of the painting.

  • Artistic Style: The use of light and shadow, as well as the detailed rendering of textures and patterns, is typical of Japanese art. The lines are precise and the use of negative space is carefully considered, contributing to the depth and intimacy of the scene.

  • Label: The lower part of the image has a label with the number "1931.249," which indicates that this image might be part of a collection or catalog from a museum or archive, possibly the Metropolitan Museum of Art, given the style and context of the image.

Overall, the painting evokes a sense of tranquility and reflection, possibly depicting a moment of care, loss, or contemplation within the context of a traditional Japanese setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This image appears to be a traditional Japanese painting, possibly from the Edo period, depicting a scene with two figures. The setting is indoors, with an open window or balcony showing a garden outside, which includes a blossoming tree and a fence.

The figure on the left is seated and dressed in elaborate, patterned clothing, suggesting a person of high social status, possibly a nobleman or a samurai. This figure is facing the other character, who is lying down on a futon or a similar piece of bedding. The person lying down appears to be a woman, dressed in traditional Japanese attire, with her hair styled in a way that is typical of the time period.

The painting uses a muted color palette, with emphasis on the intricate patterns of the clothing and the textures of the surrounding environment. The overall composition and style are characteristic of traditional Japanese art, with attention to detail and a sense of quiet, introspective mood. The label "1931.249" at the bottom suggests that this image is part of a collection, possibly in a museum or archive.

Text analysis

Amazon

1931.
2449
1931. 9 2449
9

Google

1931.249
1931.249