Human Generated Data

Title

A Drifting Boat (Ukifune), Illustration to Chapter 51 of the Tale of Genji (Genji monogatari)

Date

Muromachi period, datable to 1509-1510

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.51.A

Human Generated Data

Title

A Drifting Boat (Ukifune), Illustration to Chapter 51 of the Tale of Genji (Genji monogatari)

People

Artist: Tosa Mitsunobu, Japanese active c. 1469-1522

Date

Muromachi period, datable to 1509-1510

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.352.51.A

Machine Generated Data

Tags

Amazon
created on 2019-03-28

Art 92.1
Animal 85.5
Mammal 85.5
Sea Life 73
Waterfowl 59
Bird 59
Transportation 56.5
Vehicle 56.3
Boat 56.1

Clarifai
created on 2018-02-09

water 99.6
bird 96.9
sea 95.9
no person 95.8
seashore 95.5
beach 94.8
river 94.2
ocean 93.6
action 91.1
people 90.9
travel 90.3
one 89.2
outdoors 88.7
swimming 88
fish 88
lake 87.6
adult 86.7
landscape 86.6
daylight 84.3
painting 84

Imagga
created on 2018-02-09

hippopotamus 67.9
water 58.1
ungulate 34.8
lake 27.5
sea 26
sand 24.3
river 24
wildlife 23.2
beach 23.2
ocean 22.4
alligator 21.8
wild 21.8
travel 21.1
mammal 19.5
landscape 19.4
rock 18.3
summer 17.4
pond 17.3
stream 16.1
bird 15.8
animals 15.8
fountain 14.8
park 14
vacation 13.9
wave 13.8
stone 13.5
shore 12.9
coast 12.6
swim 12.5
spray 12.5
swimming 12.5
outdoor 12.2
waves 12.1
environment 11.5
reptile 11.3
splash 11.2
tropical 11.1
soil 10.8
wet 10.7
sky 10.2
relax 10.1
structure 10.1
hippo 9.9
reflection 9.8
safari 9.6
earth 9.4
rocks 9.4
coastline 9.4
duck 9.3
island 9.2
recreation 9
outdoors 9
hippos 8.9
sun 8.9
birds 8.8
natural 8.7
surf 8.7
pool 8.6
life 8.6
turtle 8.2
danger 8.2
mountain 8
scenic 7.9
holiday 7.9
reserve 7.8
beak 7.7
boat 7.6
adventure 7.6
paradise 7.5
fun 7.5
leisure 7.5
calm 7.3
drop 7.3

Google
created on 2018-02-09

water 96
painting 91.6
wave 81.7
art 80.6
visual arts 62.9
watercolor paint 62.7
sea 60.9
impressionist 60.9
paint 53.8
artwork 53.1
ocean 52.8

Microsoft
created on 2018-02-09

water 98.4
outdoor 95.5
wave 50.4

Color Analysis

Feature analysis

Amazon

Painting

Clarifai

Tree
Boat
Clothing
Human face
Person

AWS Rekognition

Painting 92.1%

Clarifai

Tree 83.3%

Clarifai

Boat 59.3%

Clarifai

Clothing 43.3%

Clarifai

Human face 38.5%

Clarifai

Person 37.5%

Categories

Imagga
created on 2018-02-09

nature landscape 99.2%
beaches seaside 0.5%
paintings art 0.1%
sunrises sunsets 0.1%
pets animals 0.1%

Captions

Microsoft
created by unknown on 2018-02-09

a bird swimming in water 89.5%
a bird swimming in the water 88.2%
a bird swimming in water next to the ocean 88.1%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man in a boat

Created by general-english-image-caption-blip-2 on 2025-06-27

a couple in a boat on a river with snow

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image depicts a serene and delicate scene likely from Japanese art. It shows two figures in traditional Japanese attire seated in a small, wooden boat on a tranquil river. The river appears to be surrounded by partially snow-covered land and trees in bloom, suggesting a transition between winter and spring. The figures are engaged in what appears to be a close and intimate conversation. The overall color palette is soft, with muted blues for the water, gentle browns for the land, and splashes of green and white for the foliage and snow. The scene exudes a peaceful, reflective mood.

Created by gpt-4 on 2024-01-25

The image displays a traditional East Asian style painting. It illustrates a snowy riverscape with a single figure rowing a wooden boat. The environment is depicted with a combination of wintry features—snow clings to the banks, drifts on the surface of the water, and covers the trees—with touches of green foliage suggesting the season is either late fall or early spring. The mood conveyed by the overhanging beige and taupe clouds gives a sense of calm isolation. The style of painting indicates it may be Japanese or Chinese in origin, and the brushwork and texture are suggestive of historical, possibly ancient, artwork. The solitary figure, cloaked in a white garment with black and red detailing, focuses intently on navigating the boat, possibly hinting at a metaphorical journey or a depiction of everyday life in historical times along the river.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a traditional Japanese painting depicting a winter scene. A wooden boat carries passengers across blue waters, with snow-covered rocks or banks visible along the shoreline. There are green trees, likely pine or willow, growing along the water's edge. The composition uses a distinctive style with gold or beige tones in the background, creating an atmospheric effect. The boat's occupants are rendered in traditional Japanese dress of what appears to be the Edo period. Small white dots throughout the image suggest falling snow, adding to the winter atmosphere. The painting demonstrates classical Japanese artistic techniques in its perspective and use of color, particularly in how it handles the water and landscape elements.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a winter landscape with a boat on a snowy river or lake. In the background, there are snowy trees and a cloudy sky. The boat appears to be carrying two figures, one in a red robe and the other wearing a dark outfit. The overall scene has a serene and mystical quality, with the natural elements blending together in an intricate and artful composition.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image depicts a serene winter scene, with a couple in a boat on a river. The woman is dressed in a red kimono and has long black hair, while the man wears a white kimono and a black hat. They are sitting together in the boat, which is positioned in the lower left corner of the image.

In the background, there are several trees and bushes, some of which have green leaves, while others are bare. The sky above is cloudy and gray, with a few snowflakes falling gently from the sky. The overall atmosphere of the image is one of peace and tranquility, with the couple enjoying a romantic moment together in the midst of nature's beauty.

The image appears to be a traditional Japanese painting, possibly from the Edo period (1603-1868). The use of bold brushstrokes and vibrant colors is characteristic of this style, which often featured scenes of everyday life and nature. The image may also be a representation of a famous Japanese folktale or legend, although without more context, it is difficult to say for certain.

Overall, the image is a beautiful and evocative depiction of a winter scene, with a focus on the beauty of nature and the intimacy of the couple's moment together.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a serene scene of a boat navigating through a tranquil river, surrounded by lush trees and a cloudy sky.

  • A boat:
    • The boat is positioned in the center of the image.
    • It appears to be made of wood.
    • The boat is facing to the right.
  • A person in the boat:
    • The person is wearing a white robe with a red sash.
    • They are sitting in the back of the boat.
    • Their face is not visible.
  • Trees:
    • There are several trees on the right side of the image.
    • The trees have green leaves.
    • They appear to be growing out of the water.
  • Clouds:
    • There are several clouds in the sky.
    • The clouds are white and fluffy.
    • They appear to be drifting lazily across the sky.

Overall, the image conveys a sense of peace and tranquility, with the gentle movement of the boat and the serene surroundings creating a calming atmosphere.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a man and a woman sitting on a boat in a river. They are wearing traditional clothing, and the man is holding the woman's hand. The boat is moving on the river, and the river has ripples. The riverbank is covered with snow, and there are trees on the side. The sky is blue, and there are clouds.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a traditional Japanese painting that depicts a serene and romantic scene. The central focus is a small boat on a river, with two figures inside. The figures are dressed in traditional Japanese clothing, with the man wearing a black hat and the woman wearing a red robe. The boat is moving through the water, and the river is surrounded by trees and snow-covered rocks. The sky is clear, with a small black spot that could be a bird or a cloud. The painting is done in a minimalist style, with a focus on the natural beauty of the scene.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image depicts a serene winter scene, likely inspired by Japanese or East Asian art traditions. A small wooden boat is shown moving across a river of a bluish-teal color. In the boat, there are two figures. One is wearing a tall black hat and a white patterned robe and appears to be facing forward, while the second figure is dressed in a darker patterned robe and has a red garment draped over them.

The river is dotted with small, snow-covered islands. The islands are covered in snow. On one island, there are bare trees and patches of straw-colored grass.

Above the river and islands, there are swathes of tan or beige color that suggest clouds or fog, speckled with gold. At the top of the image, there is an area of blue and black that might represent a break in the clouds, revealing the sky or another part of the river.

The overall style of the image is reminiscent of traditional Japanese woodblock prints or ink wash paintings, with its muted colors and focus on capturing a sense of atmosphere and natural beauty.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression:

The image is a traditional Japanese painting or print, likely depicting a scene of a boat ride in a wintry landscape. It has a delicate and serene quality, with a strong emphasis on nature.

Scene:

  • Boat and Figures: A wooden boat is the central focus, carrying two figures dressed in traditional clothing. The figures are facing the water. A red object, maybe a robe or other item, can be seen in the boat.
  • Water: The water is depicted in shades of blue with delicate white specks, suggesting either falling snow or the movement of the water.
  • Landscape: The background shows a snow-covered shoreline with bare trees, suggesting a cold season. Some vegetation with snow are on the riverbanks, possibly evergreens.
  • Sky: The sky is a beige color with gold embellishments.

Style and Technique:

  • The style is typical of traditional Japanese art, with its focus on nature, delicate lines, and subdued colors.
  • The use of gold accents suggests that this could be a painting on silk or paper, potentially a piece of decorative art.

Mood and Atmosphere:

The scene evokes a sense of tranquility, remoteness, and perhaps a touch of melancholy, in keeping with the Japanese aesthetic. The presence of snow contributes to a feeling of cold, winter.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a serene scene of two figures in a small wooden boat on a body of water. The figures are dressed in traditional attire, suggesting a historical or cultural context. One figure appears to be wearing a white garment with intricate patterns, while the other is draped in a darker robe with a red cloth. The boat is floating on calm, blue water, and the background features a landscape with a tree adorned with green leaves, indicating a natural, possibly rural setting. The sky is painted in soft, golden hues with hints of clouds, adding to the tranquil atmosphere of the scene. The overall style of the painting suggests it might be an example of traditional East Asian art, possibly from Japan or China.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-24

This image is a traditional East Asian-style painting, likely from Japan, depicting a serene winter scene. It features a small wooden boat on a river with a person sitting in it, wearing a traditional outfit with a red and black patterned garment and a dark hat. The boat is positioned near a snowy shoreline with sparse trees, some of which are bare and others with green foliage. The background shows a softly rendered sky with a mix of light beige and blue hues, with hints of gold, suggesting a tranquil and possibly winter evening atmosphere. The painting uses subtle colors and delicate brushstrokes, characteristic of classical East Asian art.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-24

This image is a traditional Japanese painting, likely from the Edo period, depicting a serene winter scene. It features two individuals in a small boat on a river, with snow-covered banks and trees in the background. The style suggests it could be a woodblock print or a painting in the ukiyo-e tradition.

Key elements:

  1. Boat and Figures:

    • A wooden boat carries two figures, one dressed in white and the other in a red garment with black accents. Both appear to be wearing traditional Japanese attire, and their postures suggest a conversation or shared activity.
    • The boat is simple and flat-bottomed, typical of small Japanese rowboats.
  2. River and Snow:

    • The river is depicted in a deep blue, with ripples indicating movement. Small white dots scattered across the water suggest falling snow or frost.
    • The banks of the river are partially covered in snow, creating a soft contrast with the darker blue of the water.
  3. Trees and Landscape:

    • On the riverbank, there are sparse trees with dark trunks and sparse green leaves, possibly indicating early spring or late autumn. Snow clings to the branches and ground around the trees.
    • The sky is a soft beige or light gold, with hints of green and blue, giving a calm and slightly dreamy atmosphere.
  4. Artistic Style:

    • The painting uses a combination of soft, muted colors and delicate brushstrokes, typical of traditional Japanese art. The use of gold in the sky and subtle shading adds depth and texture to the scene.
    • The overall composition is balanced, with the boat and figures as the central focus, while the surrounding landscape enhances the peaceful mood.

This artwork likely aims to evoke a sense of tranquility and connection with nature, common themes in Japanese art. The presence of snow and the figures in the boat suggest a quiet, contemplative moment amidst the winter landscape.