Human Generated Data

Title

A Man Laments the Passage of Time (Episode 4) from the "Tales of Ise" (Ise monogatari)

Date

Late 16th-early 17th century

People

Artist: Tosa School,

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Langdon Warner (Gift of Yanagi Sōetsu to Langdon Warner, 1946), 1946.50.2

Human Generated Data

Title

A Man Laments the Passage of Time (Episode 4) from the "Tales of Ise" (Ise monogatari)

People

Artist: Tosa School,

Date

Late 16th-early 17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Langdon Warner (Gift of Yanagi Sōetsu to Langdon Warner, 1946), 1946.50.2

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Advertisement 91.3
Water 84.4
Outdoors 69.3
Steamer 68.9
Paper 62.1
Vessel 60.1
Vehicle 60.1
Transportation 60.1
Watercraft 60.1
Nature 59.5
River 59.5
Boat 58.6
Barge 56.5
Collage 56.5
Flyer 55.3
Brochure 55.3

Clarifai
created on 2020-04-24

people 97.3
vintage 96.4
no person 94.5
retro 92.5
old 91.8
vehicle 91.5
print 90.8
wear 89.3
group 88.4
desktop 88
art 87.5
one 86.9
antique 86.5
watercraft 85.6
man 80.8
texture 80.7
dust 79.2
adult 78.1
paper 78
illustration 77.9

Imagga
created on 2020-04-24

radio telescope 45.8
astronomical telescope 36.6
structure 32.5
fountain 31.6
telescope 27.4
architecture 25.8
building 25.5
city 20.8
backboard 20.1
equipment 19.2
old 18.8
magnifier 18.2
sketch 17.4
shopping cart 15
urban 14.8
house 14.2
window 13.7
drawing 13.6
water 13.3
vintage 13.2
travel 12.7
park 12.5
metal 12.1
glass 11.7
history 11.6
sky 11.5
wall 11.4
handcart 10.4
scene 10.4
wheeled vehicle 10.4
construction 10.3
retro 9.8
outdoors 9.7
grunge 9.4
exterior 9.2
wood 9.2
scientific instrument 9.2
business 9.1
texture 9
antique 8.6
ancient 8.6
black 8.4
tower 8.1
art 7.9
sculpture 7.9
facade 7.7
winter 7.7
tourism 7.4
light 7.3
aged 7.2
representation 7.2
landmark 7.2
tile 7
modern 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

text 99.9
book 98.4
drawing 94.8
sketch 88.7
ship 73.7
cartoon 63.1
painting 60.9
old 48.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 13-23
Gender Female, 54.5%
Fear 45.2%
Happy 48.3%
Angry 50.6%
Surprised 45.5%
Disgusted 45.1%
Sad 45.1%
Calm 45.1%
Confused 45.1%

Feature analysis

Amazon

Poster

Clarifai

Poster
Person
Human face

AWS Rekognition

Poster 91.3%

Clarifai

Poster 92.4%

Clarifai

Person 59.5%

Clarifai

Human face 43%

Categories

Imagga
created on 2020-04-24

paintings art 79.1%
streetview architecture 20.4%

Captions

Microsoft
created by unknown on 2020-04-24

an old photo of a person 26.8%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a woman in a boat on a cloudy day

Created by general-english-image-caption-blip-2 on 2025-06-27

a japanese painting of a woman sitting on a balcony

OpenAI GPT

Created by gpt-4 on 2024-12-04

This image depicts a black and white rendition of an artwork in the style reminiscent of traditional Asian, possibly Japanese, ink and brush painting. We see a figure seated on a wooden veranda or balcony. The person, appearing to be a woman typically dressed in a style that suggests historic or classical attire, gazes out from the veranda.

The surrounding environment implies a lofty elevation, as billowy clouds surround the veranda and trees poking through the clouds seem to be far beneath. The intricate pattern on the railing of the balcony and the detailed clothing texture are visually striking, providing a sense of the craft involved in creating this image. The artwork captures a serene, perhaps contemplative moment, steeped in a dreamy, ethereal atmosphere. Overall, the image conveys a sense of tranquility and detachment from the day-to-day world, potentially inviting the viewer to ponder or appreciate the scene's quiet beauty.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a traditional Japanese artwork, likely from a scroll painting or screen. The scene shows a figure in traditional Japanese attire sitting on what appears to be a wooden veranda or platform of a building. The architecture features typical Japanese design elements with wooden beams and a tiled roof visible. The background shows stylized clouds rendered in a classic Japanese artistic style, creating a dreamy, atmospheric effect. The black and white or monochromatic nature of the image suggests it might be an old photograph of an original artwork or a reproduction. The composition demonstrates the characteristic Japanese artistic technique of depicting architecture and nature together in a harmonious way.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a black and white photograph depicting a traditional Japanese architectural structure, likely a temple or shrine. The structure has a distinctive roof with curved eaves and is surrounded by a serene landscape with clouds and trees in the background. In the foreground, there is a figure sitting on a raised platform or balcony, wearing traditional Japanese clothing and appearing to be engaged in some kind of activity or contemplation. The image has a dreamlike, ethereal quality, with a sense of tranquility and timelessness.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This appears to be a traditional Japanese artwork, likely from a narrative handscroll or screen painting. The black and white image shows a figure seated on what appears to be a wooden veranda or platform with a distinctive architectural roofline visible. The composition includes stylized clouds in the background, which is a common artistic technique in Japanese painting to separate scenes or create atmosphere. The architectural elements show typical Japanese design with wooden beams and a tiled roof section visible. The artwork appears to be quite old and has the characteristic style of classical Japanese narrative painting, possibly from the Heian or Kamakura period. The monochromatic nature of the image suggests this might be a photograph or reproduction of an original color painting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-30

This image is a black-and-white photograph of a traditional Japanese painting. The painting depicts a man sitting on a balcony, surrounded by clouds and trees.

The man is dressed in traditional Japanese clothing, including a kimono and a hat. He is seated on the balcony, which appears to be made of wood and has a railing around it. The balcony is situated in front of a building, which is not fully visible in the image.

In the background, there are several trees and clouds, which add to the serene and peaceful atmosphere of the painting. The overall effect of the image is one of tranquility and calmness, inviting the viewer to step into the serene world depicted in the painting.

The photograph itself appears to be old and worn, with visible signs of aging such as scratches and fading. This adds to the nostalgic and historical feel of the image, suggesting that it may be a rare or valuable artifact from a bygone era.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-25

The image is a black-and-white illustration of a person sitting on a balcony, holding a long object that appears to be a fishing rod. The person is wearing traditional Japanese clothing and has their hair styled in a bun. They are seated on a wooden balcony with a railing, surrounded by clouds in the sky.

The balcony is attached to a building with a tiled roof, and there are trees and other foliage visible in the background. The overall atmosphere of the image suggests a peaceful and serene setting, possibly during a leisurely activity such as fishing or enjoying the view.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a monochromatic painting of a man sitting on a balcony. The man is wearing a traditional robe and a hat. He is sitting on a chair with a pillow, and his right hand is on his chin. The balcony has a railing and a roof. The balcony is surrounded by clouds and trees. The painting has a watermark on the bottom right corner.

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a scene from Japanese art, featuring a person sitting on a balcony with a view of a landscape below. The person is dressed in traditional Japanese attire, possibly indicating a historical or cultural context. The balcony has a roof with intricate details, and the person is seated on a cushion, suggesting a relaxed or contemplative pose. The landscape below includes trees and a cloudy sky, creating a serene and peaceful atmosphere. The image is in black and white, which adds to its timeless and classic aesthetic. Overall, the image evokes a sense of tranquility and introspection, inviting the viewer to imagine the person's thoughts and emotions as they gaze out over the landscape.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The image appears to be a black-and-white photograph or a scanned reproduction of a Japanese or Chinese painting, potentially a scroll or screen panel. It shows a figure, dressed in what seems to be traditional Asian clothing, seated on a raised veranda or balcony. The figure is depicted in a relaxed posture, possibly looking out at the landscape. The scene is stylized, with clouds and foliage forming a backdrop that suggests an elevated or transcendent setting. The architectural elements of the veranda are simple yet elegant, with straight lines and rectangular forms. The composition includes another building in the background and elements of a garden with stylized cloud patterns and foliage. The overall impression is one of tranquility and contemplative observation.

Created by gemini-2.0-flash-lite on 2025-04-27

This is a black and white image of what appears to be a Japanese painting. It depicts a person in traditional Japanese clothing, possibly a nobleman or a member of the imperial court. The person is seated on a balcony or veranda, which is part of a building. The building has a tiled roof and the surrounding scene is filled with clouds. The background is an abstract depiction of land and trees. The style of the painting suggests a traditional Japanese aesthetic, possibly from the Edo period. The image is framed, indicating it's either a print or a scan of the original artwork.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image appears to be a traditional Japanese artwork, likely a painting or an illustration from a historical scroll or screen. It is a black-and-white photograph of the artwork, which shows signs of aging and wear, such as cracks and discoloration.

In the foreground, there is a figure seated on a wooden platform or veranda. The figure is dressed in traditional Japanese attire, which includes a long robe with intricate patterns, suggesting that the person might be of noble or high social status. The figure seems to be looking out into the distance.

The background features a landscape with clouds, trees, and possibly a body of water, giving the scene a serene and contemplative atmosphere. The clouds are depicted in a stylized manner, typical of traditional Japanese art. The structure in the background appears to be part of a larger building, possibly a temple or a noble residence, with a tiled roof and wooden pillars.

Overall, the image captures a moment of quiet reflection, with the figure seemingly lost in thought while gazing at the natural scenery. The artwork reflects the aesthetic and cultural values of traditional Japanese art, emphasizing harmony with nature and a sense of tranquility.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-24

The image depicts a traditional Japanese painting or illustration. It features a figure dressed in historical Japanese attire, sitting in a semi-reclining position on a wooden balcony or elevated platform. The individual is wearing a kimono with intricate patterns and a headpiece, indicative of a person of status, possibly a noble or scholar from a past era.

The background consists of stylized clouds and floral patterns, with a building visible above the balcony. The overall color palette is muted, with shades of gray and subtle hints of other colors that are not easily discernible due to the monochrome nature of the image. The style of the painting suggests it could be from the Edo period (1603–1868), a time when such artistic traditions flourished in Japan.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-24

The image appears to be a traditional Japanese painting, possibly a scroll or a screen painting. It depicts a scene with a person dressed in elaborate traditional attire, possibly a noble or a samurai, seated on a wooden platform that extends outward from a building. The person is holding a fan and appears to be gazing thoughtfully into the distance. The background features a landscape with clouds, trees, and possibly a mountain, all rendered in a stylized manner typical of Japanese art. The overall composition and the attire of the figure suggest a scene of contemplation or observation, possibly in a serene, natural setting. The painting is monochromatic, with shades of gray, which adds to the traditional and timeless feel of the artwork.