Human Generated Data

Title

Auspicious Events of Each Month (Tsukinami no kotobuki) Vol. 1

Date

17th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.558.1

Human Generated Data

Title

Auspicious Events of Each Month (Tsukinami no kotobuki) Vol. 1

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.558.1

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Human 93.4
Jigsaw Puzzle 63.7
Game 63.7

Clarifai
created on 2020-04-23

people 97.9
illustration 97.8
man 96.1
woman 95.7
adult 95.6
desktop 95.2
art 93.2
child 93.1
outdoors 92.7
architecture 92.2
tree 91.8
paper 91.8
summer 91.5
building 91.3
ancient 90.5
fun 90.1
nature 90.1
travel 89.5
old 89.5
family 87.6

Imagga
created on 2020-04-23

envelope 71.8
insulating material 71.5
building material 53.6
container 51.3
grunge 44.3
texture 40.3
old 37.6
vintage 33.1
paper 27.5
aged 26.2
frame 24.1
dirty 23.5
antique 23.4
pattern 22.6
grungy 20.9
rusty 20
wallpaper 19.9
design 19.8
art 19.5
surface 19.4
paint 19
retro 18.8
border 18.1
wall 18
material 17.9
color 17.2
artwork 16.5
rust 16.4
map 16.1
textured 15.8
brown 14.7
blank 14.6
worn 14.3
canvas 14.2
floral 13.6
decorative 13.4
world 13.3
flower 13.1
page 13
atlas 12.7
torn 12.6
decay 12.5
geography 12.5
damaged 12.4
weathered 12.3
backgrounds 12.2
detail 12.1
global 11.9
rough 11.8
backdrop 11.5
colorful 11.5
artistic 11.3
ancient 11.2
card 11.1
yellow 10.6
country 10.5
drawing 10.3
graphic 10.2
space 10.1
earth 10.1
grime 9.8
stationery 9.8
stain 9.6
cardboard 9.6
parchment 9.6
aging 9.6
north 9.6
international 9.6
textures 9.5
empty 9.5
document 9.3
grain 9.2
structure 9.1
decoration 9
collection 9
creative 8.8
scratch 8.8
fracture 8.8
handmade 8.7
messy 8.7
board 8.7
stained 8.7
leaf 8.6
close 8.6
sheet 8.5
globe 8.3
ocean 8.3
world map 7.9
album 7.8
continent 7.8
crack 7.8
england 7.6
planet 7.5
school 7.4
letter 7.3
metal 7.2
decor 7.1

Google
created on 2020-04-23

Green 92.9
Illustration 76.8
Art 62.5
Plant 58.5

Microsoft
created on 2020-04-23

cartoon 99.4
child art 89.8
illustration 86.1
drawing 78
person 56.6
several 13

Color Analysis

Feature analysis

Amazon

Person

Clarifai

Tree
Person
Clothing
Human head

AWS Rekognition

Person 89.4%

AWS Rekognition

Person 74.2%

AWS Rekognition

Person 64.4%

AWS Rekognition

Person 63.7%

AWS Rekognition

Person 61.1%

AWS Rekognition

Person 49.9%

AWS Rekognition

Person 47.4%

AWS Rekognition

Person 47.1%

Clarifai

Tree 88.8%

Clarifai

Tree 74.8%

Clarifai

Tree 64.9%

Clarifai

Tree 64.3%

Clarifai

Tree 52.6%

Clarifai

Tree 38.9%

Clarifai

Tree 38.5%

Clarifai

Tree 36.1%

Clarifai

Person 82.4%

Clarifai

Person 80.2%

Clarifai

Person 79.2%

Clarifai

Person 78.3%

Clarifai

Person 78.1%

Clarifai

Person 76.6%

Clarifai

Person 75.6%

Clarifai

Person 75.1%

Clarifai

Person 74.7%

Clarifai

Person 74%

Clarifai

Person 72.3%

Clarifai

Person 71.9%

Clarifai

Person 70.2%

Clarifai

Person 69.2%

Clarifai

Person 68.1%

Clarifai

Person 64.5%

Clarifai

Person 61.1%

Clarifai

Person 60%

Clarifai

Person 57.6%

Clarifai

Person 57.5%

Clarifai

Person 51.4%

Clarifai

Person 50.6%

Clarifai

Person 48.5%

Clarifai

Person 48.3%

Clarifai

Person 46%

Clarifai

Person 45.6%

Clarifai

Person 45.1%

Clarifai

Person 45%

Clarifai

Person 44.7%

Clarifai

Person 44.4%

Clarifai

Person 44.4%

Clarifai

Person 42%

Clarifai

Person 41.6%

Clarifai

Person 39.8%

Clarifai

Person 38.9%

Clarifai

Person 37.8%

Clarifai

Person 36.3%

Clarifai

Person 34.4%

Clarifai

Person 33.5%

Clarifai

Clothing 44.9%

Clarifai

Clothing 36.8%

Clarifai

Human head 36.6%

Clarifai

Human head 34.5%

Categories

Imagga
created on 2020-04-23

interior objects 95.2%
paintings art 4.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a group of people in a room

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting depicting people in traditional clothing

OpenAI GPT

Created by gpt-4 on 2024-12-03

This appears to be a piece of classical Japanese artwork, likely a painting or print, created in a traditional style. It is a panoramic scene that extends across a long horizontal canvas, suggesting it could be part of a handscroll or a folding screen.

The scene is very detailed and lively, showing a series of vignettes:

  1. On the right side, you have a building with a thatched or tiled roof. Inside, there appears to be a gathering of people, likely of high social status judging by their garments and the decor of the interior. Part of the room seems to be open to the viewing of an outdoor scene or garden.

  2. In the middle, there's another section of what could be the same building with Japanese sliding doors, some of which are open. Within these rooms, more individuals are depicted, each engaged in various activities.

  3. The left side also features individuals inside a building, where one can observe different social interactions and possibly leisure activities.

  4. In front of the buildings is a wide expanse reminiscent of a courtyard or an outdoor setting, where numerous people are shown in various actions: walking, conversing, pushing a cart, and possibly partaking in some form of procession or event.

  5. There are several trees and plants illustrating the outdoor space, providing both a sense of the setting and acting as a compositional element to break up the space and enhance its depth.

The artwork is undoubtedly rich in cultural significance, potentially depicting a historical event, seasonal festival, or scenes from everyday life in a bygone era. The clothing style, architecture, and nature of the activities are traditionally Japanese, reflecting the heritage and artistic conventions of the time. The use of gold, likely real gold leaf, enhances the overall elegance and value of the artwork, indicating that it might have been commissioned by someone of considerable wealth or importance.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a traditional Japanese painting that appears to be depicting a scene of daily life during the Edo period. The artwork shows multiple rooms or sections of what seems to be a building, with various activities taking place both inside and outside. The painting uses the traditional horizontal scroll format known as emakimono.

Inside the rooms, which are divided by traditional architectural elements, there are groups of people engaged in different activities. The outdoor area shows numerous figures walking and interacting, dressed in traditional Japanese clothing including kimono and hakama in various colors like blue, green, and red. Some figures appear to be carrying boxes or other items.

On the right side of the image, there are beautifully rendered pine trees in the traditional Japanese painting style. The overall color palette is subtle and elegant, with a golden background and delicate use of colors for the figures and architectural elements. The painting style is characteristic of Japanese narrative painting, with careful attention to detail in the clothing and architectural features.

This type of artwork would have been used to document and illustrate daily life and activities in historical Japan, providing modern viewers with valuable insights into the culture and customs of the period.

Created by claude-3-haiku-20240307 on 2024-11-27

This appears to be a traditional Japanese painting or woodblock print depicting a lively scene of people engaging in various activities and customs. The image features a panoramic landscape with buildings, trees, and numerous figures dressed in traditional Japanese attire, including kimonos and samurai-style clothing. The figures are engaged in a variety of scenes, such as ceremonial or festive events, interactions, and daily tasks. The overall composition and style suggest this is a representation of Japanese cultural elements and traditions.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This is a traditional Japanese painting or scroll depicting a lively scene of daily life during the Edo period. The artwork shows multiple figures engaged in various activities outside what appears to be a traditional Japanese building or residence. The scene is painted in a horizontal format with delicate colors and details typical of Japanese artistic style.

The composition includes several architectural elements with tatami-floored rooms visible through open walls, and decorative pine trees both inside and outside the building. Various people are shown wearing traditional Japanese clothing like kimonos in different colors - blue, green, and red. Some figures appear to be carrying boxes or other items, while others seem to be engaged in conversation or daily activities.

The background has a warm, golden tone, and the overall style is characteristic of Japanese narrative painting, where multiple events or moments might be depicted within the same continuous scene. The artwork demonstrates the careful attention to detail in depicting architecture, clothing, and natural elements that is typical of Japanese historical paintings.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a traditional Japanese scene, showcasing a large building with multiple rooms and a courtyard. The building features sliding doors and windows, adorned with various symbols and characters. Inside the rooms, people are engaged in various activities such as playing instruments, reading, and socializing.

In the courtyard, several individuals are walking or standing, some carrying objects like boxes or parasols. The atmosphere appears to be one of leisure and relaxation, with people enjoying each other's company in a serene setting. The overall mood of the image is peaceful and tranquil, evoking a sense of traditional Japanese culture and lifestyle.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a traditional Japanese scene, likely from the Edo period (1603-1868), featuring a group of people gathered in a courtyard. The scene is rendered in a style reminiscent of traditional Japanese art, with bold lines and vibrant colors.

Scene Description:

  • The courtyard is surrounded by a low wall, with a large tree on the right side and several smaller trees scattered throughout.
  • A group of people, dressed in traditional Japanese clothing, are gathered in the courtyard. Some are seated on the ground, while others are standing or walking around.
  • In the center of the courtyard, there is a large, ornate gate with a circular symbol above it. The gate appears to be the main entrance to the courtyard.
  • To the left of the gate, there is a small building with a sloping roof. The building appears to be a tea house or a small shrine.
  • In the background, there are several buildings and structures that appear to be part of a larger complex. The buildings are decorated with intricate designs and patterns, and some have large windows or doors.

Color Palette:

  • The dominant colors in the image are shades of green, blue, and brown, which are typical of traditional Japanese art.
  • The sky is depicted as a light blue color, with a few wispy clouds scattered throughout.
  • The ground is shown as a light brown color, with some darker brown patches indicating shadows or dirt.

Overall Impression:

  • The image conveys a sense of serenity and tranquility, with the peaceful atmosphere of the courtyard and the traditional Japanese architecture creating a sense of calm.
  • The use of vibrant colors and intricate designs adds to the overall aesthetic appeal of the image, making it a visually striking representation of traditional Japanese culture.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a traditional Japanese painting, showcasing a bustling scene of people engaged in various activities. The painting is set in an outdoor area with a backdrop of a building adorned with a signboard. The building features a porch with several individuals sitting on tatami mats, engaged in conversation or observing the scene. The scene is lively, with people walking around, some carrying bags, and others interacting with each other. The painting also includes elements of nature, such as trees and plants, adding to the serene and picturesque atmosphere. The overall composition is detailed and vibrant, capturing the essence of daily life in a traditional Japanese setting.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a painting of a group of people in traditional Japanese clothing. The painting is set in an outdoor area with a large building in the background. The building has a large signboard with Japanese characters on it. The people in the painting are walking in a line, and some of them are carrying bags. There are also trees and plants in the area. The painting has a warm color palette with shades of brown, green, and gold.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The image depicts a scene that appears to be of Japanese origin, possibly from the Edo period, given the style of clothing and architecture. A long, low building with a series of connected rooms sits above an open ground level. Inside the building, numerous figures are seated on what appears to be tatami mats, engaging in various activities such as conversation, reading, or writing. Some are gathered around tables, while others are alone.

The exterior space is populated with people dressed in traditional garb, some carrying bundles or boxes on their backs, and others with swords. A few trees are scattered around, and to the right, there's a larger pine tree. The color palette is muted with gold accents, suggesting the image might be from a folding screen or a wall panel.

Created by gemini-2.0-flash-lite on 2025-04-27

Certainly! Here's a description of the image:

Overall Impression:

The image is a Japanese painting or print, likely from the Edo period, depicting a lively scene of people in a traditional setting. It appears to be a horizontal scroll, with gold-colored backgrounds. The style is characterized by flat perspectives, detailed figures, and vibrant colors.

Main Features:

  • Architecture: A long, low building with a tiled roof and open sides dominates the scene. It features a series of interior spaces with tatami mats (traditional woven mats) and simple furnishings.
  • People: The image is filled with numerous figures, all dressed in traditional Japanese clothing. Many are women wearing colorful kimonos, some with elaborate patterns. There are also male figures, including samurai or figures with swords. They are engaged in various activities: some are seated, some are walking, and others are carrying goods or interacting with one another.
  • Setting: The scene takes place both indoors and outdoors. The foreground is a neutral ground where many people are walking around. The outdoors is represented by some pine trees on the right.
  • Composition: The composition is balanced and well-organized. The central building provides a focal point, and the arrangement of the figures creates a sense of movement and energy. The color palette is bright and vibrant.

Possible Interpretations:

This type of image could depict:

  • A gathering or entertainment event.
  • A merchant or artisan district.
  • A scene from daily life in the Edo period.

Let me know if you'd like me to describe any particular element of the image in more detail!

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a traditional Japanese scene, likely from the Edo period, showcasing a bustling courtyard and interior spaces of a house or a palace. The scene is richly detailed and colorful, characteristic of Japanese ukiyo-e art.

  1. Foreground:

    • Several people are engaged in various activities. Some are walking, carrying items, or conversing with each other.
    • The attire of the individuals suggests they are from different social classes, including samurai, merchants, and commoners.
    • A few people are seen carrying baskets, boxes, and other goods, indicating a marketplace or a busy household.
  2. Background:

    • The background shows the interior of a traditional Japanese house with tatami mats, sliding doors, and decorative elements.
    • Various rooms are visible, each with different activities taking place:
      • One room shows women engaged in what appears to be a social gathering or a tea ceremony.
      • Another room has individuals playing a board game, possibly Go or Shogi.
      • A third room depicts a scene where people are preparing or serving food.
    • The exterior of the house features a garden with trees, including a pine tree, which is a common element in Japanese gardens symbolizing longevity and steadfastness.
  3. Artistic Style:

    • The artwork uses a flat perspective, typical of traditional Japanese art, where the scene is depicted from a bird's-eye view without depth.
    • The colors are vibrant, with a focus on greens, blues, and earth tones, enhancing the natural and serene atmosphere.
    • The intricate details in the clothing, architecture, and activities provide a glimpse into the daily life and culture of the period.

Overall, the image is a vivid portrayal of a lively and culturally rich scene from traditional Japanese life, capturing the essence of social interactions, domestic activities, and the aesthetic beauty of the era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-26

This image is a traditional Japanese painting, possibly a scroll or a large rectangular artwork, depicting a lively scene with multiple figures engaged in various activities. The setting appears to be a traditional Japanese interior, possibly a teahouse or a similar establishment, as indicated by the sliding doors, hanging lanterns, and the presence of a large table or counter in the background.

In the background, there is a scene with several individuals gathered around a table, seemingly engaged in a tea ceremony or a social gathering. The figures are dressed in traditional Japanese kimonos, which are often associated with formal or ceremonial occasions. The attire includes a variety of patterns and colors, reflecting the richness of Japanese cultural fashion.

In the foreground, a procession of people is moving towards or away from the building. Some of the figures are carrying traditional Japanese fans or other props, suggesting they are part of a performance or a ceremonial procession. The figures are dressed in colorful, intricately designed kimonos, and some are wearing headwear that is characteristic of specific social roles or ranks in Japanese culture.

The setting is further enhanced by the presence of trees and shrubs on the right side of the image, which are typical of traditional Japanese artwork, often symbolizing harmony and natural beauty. The overall composition of the painting uses a soft palette with gold borders, which is common in Japanese art to signify elegance and tradition.

This painting captures a moment of cultural significance, portraying the interaction between different social groups within a traditional Japanese context. The attention to detail in the clothing, props, and background elements suggests a high level of craftsmanship and artistic intent.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-26

This image appears to be a traditional Japanese painting, likely a scroll or a folding screen, depicting a lively scene at a high-end establishment, possibly a tea house or a brothel. The scene is divided into two main sections: the interior and the exterior.

Interior:

  • The interior is shown in the upper part of the image, with large sliding doors (shoji) open, revealing the rooms inside.
  • Several women in elaborate kimonos are seated and standing inside the rooms, engaged in various activities such as playing music, conversing, and possibly serving tea. The women are adorned with intricate hairpieces and makeup, suggesting they are geishas or courtesans.
  • The rooms are decorated with traditional Japanese elements like hanging scrolls (kakejiku), potted plants, and hanging lanterns.
  • The color palette is soft and pastel, with green, white, and gold tones dominating the scene.

Exterior:

  • The exterior is depicted in the lower part of the image, showing a street scene with numerous people walking and interacting.
  • Many of the figures are dressed in traditional Japanese attire, including kimonos and hakama. Some are carrying items like parasols, fans, and boxes, indicating they may be customers or servants.
  • There are several samurai or warriors in the scene, identifiable by their distinct clothing and swords. They appear to be patrolling or escorting someone.
  • The street is lined with small potted plants and trees, adding to the decorative and elegant atmosphere.
  • The background features a large pine tree, which is a common motif in Japanese art symbolizing longevity and steadfastness.

Overall:

The painting captures the bustling and vibrant atmosphere of a high-class Japanese establishment, showcasing the interactions between various social classes and the intricate details of traditional Japanese life. The use of gold leaf and the detailed rendering of the figures and objects contribute to the luxurious and refined aesthetic of the scene.