Human Generated Data

Title

The Imperial Progress (Miyuki), Illustration to Chapter 29 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.29.A

Human Generated Data

Title

The Imperial Progress (Miyuki), Illustration to Chapter 29 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.29.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Person 98.7
Human 98.7
Person 95.7
Person 93.1
Person 91.6
Person 86.8
Person 84.5
Person 83.2
Person 81.8
Art 76.7
Person 75.8
Person 74.8
Painting 70.7
Person 70.2
Outdoors 63.5
Leisure Activities 55.6

Clarifai
created on 2018-02-09

art 93.5
old 91.9
water 91.7
rain 88.2
wet 87.1
traditional 86.7
people 85.5
flood 85.4
building 85.3
industry 84.8
storm 83.4
calamity 82.5
vehicle 82.4
texture 80.9
color 80.3
watercraft 79.5
no person 79.3
grinder 79
town 78.5
weather 77.8

Imagga
created on 2018-02-09

grunge 29.8
old 27.8
texture 24.3
dirty 20.8
automaton 19.1
paint 19
grungy 19
wall 18.4
pattern 17.1
graffito 16.9
surface 15.9
decoration 15.8
vintage 15.7
device 15.4
aged 15.4
fastener 15.1
padlock 14.7
rough 14.6
puzzle 14.1
design 14.1
textured 14
lock 13.7
rusty 13.3
paper 13.3
weathered 13.3
antique 13
metal 12.9
art 12.6
rust 12.5
brown 12.5
damaged 12.4
retro 12.3
game 12.1
construction 12
restraint 11.8
industrial 11.8
wallpaper 11.5
urban 11.4
color 11.1
frame 10.8
water 10.7
border 9.9
backdrop 9.9
architecture 9.4
structure 9.3
city 9.1
material 8.9
detail 8.8
scratch 8.8
messy 8.7
industry 8.5
map 8.4
iron 8.4
steel 8
ancient 7.8
stained 7.7
worn 7.6
close 7.4
symbol 7.4
gold 7.4
metallic 7.4
world 7.3
black 7.2
equipment 7.1
building 7.1
work 7.1

Google
created on 2018-02-09

art 92.2
water 92
painting 76.2
mural 63.2
illustration 63.1
artwork 58.8
recreation 55.9
visual arts 51.6

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 4-9
Gender Male, 54.9%
Angry 47.2%
Happy 45.2%
Disgusted 45.2%
Calm 46.7%
Confused 46.8%
Surprised 46.1%
Sad 47.8%

AWS Rekognition

Age 11-18
Gender Male, 54.8%
Disgusted 46.1%
Sad 49.1%
Surprised 45.5%
Calm 46.4%
Confused 45.8%
Angry 46.5%
Happy 45.5%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Angry 45.4%
Disgusted 45.1%
Sad 53.8%
Calm 45.3%
Happy 45.2%
Confused 45.2%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 53.2%
Surprised 45.7%
Angry 45.4%
Sad 46.9%
Happy 49.9%
Disgusted 45.3%
Calm 46.3%
Confused 45.5%

AWS Rekognition

Age 11-18
Gender Male, 54.5%
Angry 46.7%
Calm 45.4%
Sad 52%
Disgusted 45.1%
Surprised 45.2%
Confused 45.4%
Happy 45%

AWS Rekognition

Age 6-13
Gender Male, 54.7%
Angry 45.4%
Sad 54.4%
Confused 45.1%
Surprised 45%
Calm 45%
Disgusted 45%
Happy 45%

AWS Rekognition

Age 6-13
Gender Male, 54.4%
Happy 45%
Sad 53.7%
Disgusted 45.1%
Angry 45.4%
Confused 45.2%
Calm 45.4%
Surprised 45.2%

AWS Rekognition

Age 11-18
Gender Female, 50.9%
Confused 45.3%
Calm 45.2%
Sad 49%
Angry 45.8%
Disgusted 45.4%
Happy 48.7%
Surprised 45.8%

AWS Rekognition

Age 6-13
Gender Female, 50.3%
Calm 49.5%
Confused 49.6%
Happy 49.6%
Sad 49.8%
Disgusted 49.5%
Surprised 49.9%
Angry 49.6%

AWS Rekognition

Age 12-22
Gender Female, 50.7%
Sad 49.7%
Confused 45.1%
Disgusted 45.4%
Happy 45.3%
Angry 49.2%
Surprised 45.2%
Calm 45%

AWS Rekognition

Age 20-38
Gender Male, 54.7%
Angry 46.2%
Calm 45.3%
Confused 45.8%
Happy 47.6%
Disgusted 45.5%
Surprised 48.9%
Sad 45.7%

AWS Rekognition

Age 11-18
Gender Male, 50.2%
Sad 49.8%
Calm 49.6%
Confused 49.5%
Disgusted 49.5%
Happy 49.9%
Angry 49.6%
Surprised 49.6%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting
Person 98.7%
Person 95.7%
Person 93.1%
Person 91.6%
Person 86.8%
Person 84.5%
Person 83.2%
Person 81.8%
Person 75.8%
Person 74.8%
Person 70.2%
Painting 70.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a group of people sitting on a couch -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image is a traditional Japanese painting that appears to depict scenes from court life during the Heian period. The scene includes several figures dressed in formal, elegant attire typical of this era. Several court carts, known as ox carriages (referred to as "gosho-guruma"), are present, often used by nobles. There's a body of water, possibly a river or a stream, running through the scene. The figures are arranged in small groups, either seated or standing, suggesting they are engaged in conversation or enjoying a serene outdoor setting. The painting has a tranquil, refined atmosphere, enhanced by the natural elements and the traditional garments of the figures. Circular patterns, possibly representing snowflakes or cherry blossom petals, add to the serene and elegant feel of the scene.

Created by gpt-4 on 2024-01-24

This image appears to be a traditional Japanese artwork capturing a scene by a body of water. The characters are shown wearing period-specific clothing, likely kimonos, with detailed patterns. Some individuals are standing on a shore or bank, while others appear to be seated or in the process of sitting down on textured ground that could represent sand or gravel. To the right, there's a wooden structure that could be a pier or a bridge extending into the water. The water itself is depicted with expressive lines suggesting movement, possibly indicating a flowing river or stream. The entire scene is set against a backdrop with a varied texture, giving the impression of a cloudy or overcast sky. There's a palpable sense of serene communal activity, possibly a gathering or a shared experience of enjoying nature.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a traditional East Asian or Japanese-style painting, showing a winter landscape with various figures in traditional dress. The background is dominated by a golden, textured surface, likely representing the sky or natural setting. In the foreground, there are several groups of people, some seated or walking, all dressed in intricate and colorful robes and kimonos. The figures appear to be engaged in some sort of activity or scene, though the specific narrative is not entirely clear. Overall, the image conveys a sense of serenity, with the figures nestled within the snowy, mountainous landscape.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image depicts a Japanese painting of a group of people gathered around a river, with some individuals sitting on the ground and others standing. The scene is set against a backdrop of a river, which flows through the center of the image.

Key Elements:

  • A group of people are gathered around the river.
  • Some individuals are sitting on the ground, while others are standing.
  • The scene is set against a backdrop of a river, which flows through the center of the image.

Overall Impression:

The image appears to be a traditional Japanese painting, possibly from the Edo period (1603-1868). The use of muted colors and the focus on nature suggest a sense of serenity and tranquility. The gathering of people around the river may indicate a social or cultural event, such as a festival or a meeting.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a scene of people gathered around a river, with a bridge spanning it. The scene is rendered in a traditional Japanese style, with muted colors and intricate details.

  • River and Bridge:
    • The river flows through the center of the image, its blue waters winding between the landmasses.
    • A bridge made of wood stretches across the river, connecting the two sides.
  • People:
    • Several individuals are seated on the riverbank, some dressed in traditional Japanese attire.
    • Others stand near the bridge, engaged in conversation or gazing out at the water.
  • Background:
    • The background of the image features a serene landscape, with trees and hills visible in the distance.
    • The sky above is a soft, pale blue, adding to the overall sense of tranquility.
  • Artistic Style:
    • The image is rendered in a traditional Japanese style, characterized by bold lines, vibrant colors, and intricate details.
    • The artist's use of muted colors and subtle shading creates a sense of depth and dimensionality.

Overall, the image presents a peaceful and idyllic scene, evoking a sense of serenity and tranquility. The traditional Japanese style and muted colors add to the image's aesthetic appeal, making it a visually striking representation of a serene landscape.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a scene from Chinese history, featuring a group of people in traditional attire. They are gathered around a carriage, possibly engaged in a ceremonial or formal event. The carriage is prominently displayed in the center, adorned with intricate designs and surrounded by several individuals. Some are seated on the ground, while others are standing, all dressed in long robes and hats, indicative of their high social status. The setting appears to be a sandy area, possibly a riverbank, with a bridge in the background. The sky is clear, and there is a sense of solemnity and formality in the scene. The use of gold and blue colors in the background adds to the regal and historical ambiance of the image.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image depicts a scene of people gathered on a beach. The people are wearing traditional clothing. Some of them are sitting on the sand, while others are sitting on a chariot. The chariot is positioned on the left side of the image, and a few people are sitting on it. A bridge is constructed on the right side of the image, and a few people are sitting on it.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the image:

This appears to be a Japanese painting or woodblock print depicting a scene with several figures in traditional attire near a river or body of water. The artwork has a stylized aesthetic, with an emphasis on form and pattern rather than realistic detail.

Here are some key elements I observe:

  • Figures: Multiple figures are depicted, some sitting and some appearing to be inside or near structures that may be wheeled carriages. Their clothing suggests a historical or ceremonial context. The figures are rendered in a manner characteristic of traditional Japanese art, with simplified facial features and distinct outlines.
  • Setting: A body of water, possibly a river, snakes through the scene. Along the banks, there appears to be ground cover which has a speckled pattern, giving the impression of snow. A bridge or walkway is seen across the water.
  • Vehicles/Structures: Dark, stylized structures that may represent wheeled carriages or covered seating areas appear in the foreground. These structures are dark and elaborately decorated.
  • Color Palette: The artwork utilizes a muted color palette with shades of gold, green, white, and black being prominent. The colors are not highly saturated, contributing to a gentle and subdued atmosphere.
  • Style: The image has the characteristics of traditional Japanese art, possibly from the Edo or Meiji period. The rendering of the figures, the stylized landscape, and the use of flat planes of color are typical of this artistic tradition.

Overall, the image presents a scene of a historical or cultural nature in a distinctly Japanese artistic style.

Created by gemini-2.0-flash-lite on 2025-04-26

The image appears to be a Japanese woodblock print depicting a scene of courtly life. Here's a breakdown:

  • Composition: The scene is arranged in a stylized, somewhat abstracted way. The perspective isn't strictly naturalistic.
  • Figures: There are numerous figures, dressed in traditional Japanese court attire. They are likely members of the nobility or their retinue. Some figures are seated, others are likely in carriages or similar conveyances.
  • Setting: The setting seems to be outdoors, possibly near a body of water (a river or lake). The background suggests a landscape with stylized elements. The presence of snowfall.
  • Color Palette: The artwork employs a muted and refined color palette typical of Japanese prints. There are hints of gold leaf in the background, adding a touch of luxury.
  • Vehicles: There appear to be black carriages/vehicles.

Overall, the image evokes a sense of elegance, formality, and tranquility often associated with historical Japanese art.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a traditional Japanese painting, likely from the Heian or Muromachi period, characterized by its intricate detail and use of gold and vibrant colors. The scene appears to be set in a serene natural environment, possibly a garden or a countryside landscape.

Key elements in the painting include:

  1. Figures: Several figures, both male and female, are depicted in traditional Japanese attire. They are engaged in various activities such as sitting, conversing, and observing the surroundings. The figures are portrayed with delicate facial features and are dressed in elaborate robes, indicating their high social status.

  2. Setting: The background features a tranquil landscape with a flowing river, a wooden bridge, and lush greenery. The use of gold in the sky and clouds adds a sense of elegance and mystique to the scene.

  3. Architecture: There are structures that resemble traditional Japanese buildings, possibly pavilions or temples, with intricate designs and patterns. The buildings are partially obscured by trees and foliage, adding depth to the composition.

  4. Activities: The figures seem to be enjoying a leisurely outing or gathering. Some are seated on the ground, while others are on elevated platforms or near the water. Their postures and interactions suggest a relaxed and peaceful atmosphere.

  5. Artistic Style: The painting exhibits characteristics of traditional Japanese art, such as the use of gold leaf, delicate brushwork, and a focus on natural beauty and harmony. The colors are rich and the details are meticulously rendered, reflecting the artistic techniques of the period.

Overall, the image captures a moment of tranquility and elegance in a traditional Japanese setting, highlighting the cultural and artistic heritage of the era.