Human Generated Data

Title

Orchid Pavilion

Date

17th century

People

-

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.840

Human Generated Data

Title

Orchid Pavilion

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.840

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 88.3
Art 87.7
Wood 84.9
Archaeology 84.2
Flooring 61
Painting 58.4
Architecture 57.9
Building 57.9
Interior Design 57.5
Indoors 57.5
Sculpture 56.6

Clarifai
created on 2023-10-25

people 97.9
architecture 97.6
art 97.1
no person 95.2
ancient 94.4
religion 93.3
painting 93.1
building 92.1
old 91.8
travel 91.7
woman 89.3
temple 88.9
wall 87.8
group 87.7
house 85.4
antique 85.2
adult 85.2
wear 83.3
indoors 83.3
man 82.1

Imagga
created on 2022-01-09

thatch 100
roof 100
protective covering 71.7
covering 47
architecture 41.2
old 31.4
travel 29.6
building 28.3
ancient 27.7
wall 25.6
history 25
temple 22
historic 22
stone 20.2
landmark 19.9
tourism 19
religion 18.8
construction 18.8
city 17.5
vintage 17.4
culture 17.1
house 16.4
grunge 15.3
structure 15.3
art 14.3
brick 14.1
sky 14
landscape 13.4
religious 13.1
historical 12.2
monument 12.1
antique 12.1
tower 11.6
texture 11.1
hanging 10.8
old fashioned 10.5
artistic 10.4
chandelier 10.4
church 10.2
palace 10.2
scenery 9.9
gate 9.7
entrance 9.7
paper 9.4
famous 9.3
window 9.3
town 9.3
vacation 9
monastery 8.9
scenic 8.8
fortress 8.8
castle 8.7
medieval 8.6
traditional 8.3
retro 8.2
interior 8
ruin 7.8
heritage 7.7
holy 7.7
sculpture 7.6
style 7.4
grain 7.4
exterior 7.4
light 7.4
water 7.3
tourist 7.3
sun 7.2
prison 7.2

Google
created on 2022-01-09

Brown 98
Textile 87.4
Wood 86.8
Rectangle 85.4
Art 84
Font 78.4
Tints and shades 74.3
Pattern 73.3
Facade 68.8
Visual arts 68.2
History 66.2
Paper product 66.1
Paper 65
Hardwood 61.9
Painting 61.5
Holy places 59.3
Plywood 58
Illustration 57.1
Collectable 52.3

Microsoft
created on 2022-01-09

text 94.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-36
Gender Male, 55%
Calm 48.1%
Disgusted 31.1%
Angry 8.3%
Happy 7.5%
Surprised 1.8%
Sad 1.4%
Fear 1%
Confused 0.7%

AWS Rekognition

Age 23-33
Gender Female, 99.2%
Calm 56.3%
Angry 27.7%
Sad 7.7%
Fear 2.8%
Disgusted 1.7%
Happy 1.5%
Surprised 1.1%
Confused 1%

AWS Rekognition

Age 21-29
Gender Male, 93.8%
Calm 96.8%
Disgusted 1.4%
Angry 0.4%
Confused 0.4%
Sad 0.3%
Happy 0.2%
Fear 0.2%
Surprised 0.2%

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 88.3%

AWS Rekognition

Person 84.9%

AWS Rekognition

Person 77.5%

AWS Rekognition

Person 73.1%

Categories

Imagga
created on 2022-01-09

streetview architecture 96.8%
paintings art 3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a painting of a man in a suit and tie

OpenAI GPT

Created by gpt-4 on 2024-12-22

This image features an elongated horizontal artwork, which appears to be an example of traditional East Asian painting or printmaking. The artwork is in a landscape format and has several distinct zones with varied content:

  1. On the left side, there is a depiction of what appears to be a mountain or rock formation. This area uses fine, white lines on a dark background, giving the impression of a traditional ink wash or brush painting with reversed colors, likely mimicking the appearance of etching or engraving.

  2. The central part showcases an architectural structure with what appears to be a veranda or balcony. There are people depicted in traditional East Asian attire, likely indicative of a historical period scene. They are engaging with one another or are in contemplative poses. The drawing style maintains the fine, white line work against the dark background.

  3. The right side of the image contains a large block of text in characters that are consistent with Chinese writing. The characters are similarly executed in white lines on a dark background. Their inclusion suggests they may provide context, story, or an explanation related to the visual scene in the center, or possibly a piece of poetry or literature relevant to the image.

The entire artwork seems to have a unifying aesthetic that emphasizes the delicate line work and the contrast between the dark background and the light depictions of the figures, architecture, landscape, and characters. The monochromatic scheme enhances the traditional feel of the work, and the visual balance between image and text indicates that both components are important to the overall message and experience of the artwork.

Created by gpt-4o-2024-05-13 on 2024-12-22

The image depicts an ancient Chinese ink rubbing of a stone engraving that illustrates a serene natural and architectural scene. On the left side, a waterfall cascades down a rocky landscape into a flowing river, where two waterfowl, possibly swans or geese, are swimming.

To the right, there is a detailed depiction of a grand, multi-story pavilion with intricately designed railings and rooftops. Within the pavilion, a few figures are visible; one is observing the natural scenery while another appears to be engaged in conversation or contemplation inside.

The background and borders are black, possibly indicating the stone's natural hue from which the engraving was taken. To the far right side, there are columns of Chinese calligraphy, potentially describing the scene or giving context about its historical or cultural significance. The architectural elements and natural composition reflect traditional Chinese aesthetics and artistic techniques.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-22

The image appears to be an ornate Chinese painting or etching on a wooden or lacquered surface. It depicts a scene from what seems to be an ancient or traditional Chinese setting, with various figures or characters visible in different areas of the composition. The overall aesthetic has a monochromatic, sepia-toned quality, with intricate patterns, calligraphic elements, and architectural details visible throughout the scene. The figures are shown engaged in what looks like various activities or interactions, though I cannot identify any specific individuals due to the instructions provided. The artwork has a distinct historical and cultural feel, evoking a sense of traditional Chinese artistic styles and themes.

Created by claude-3-5-sonnet-20241022 on 2024-12-22

This appears to be a traditional East Asian artwork, likely Chinese, executed in a classical style. The image shows a night scene on what appears to be a terrace or balcony of a building, rendered in light tones against a dark background. Several figures are depicted in traditional dress, seated and standing on what looks like an elevated wooden platform or pavilion. The architectural details are delicately rendered, showing traditional curved roof elements and railings. On both sides of the image, there are columns of Chinese characters, suggesting this might be part of a narrative scroll or historical document. The overall composition uses a technique that appears to be ink or paint on a darker ground, creating an ethereal, moonlit effect. The style and execution suggest this is a historical piece, possibly from several centuries ago.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-30

This appears to be a traditional East Asian artwork, likely Chinese, rendered in a distinctive style with light figures against a dark background. The scene depicts several figures on what appears to be a covered bridge or pavilion structure. The architectural details are delicately rendered with fine lines showing the roof beams and railings. On the left side of the image, there appears to be a landscape element with stylized trees or foliage. The image includes Chinese calligraphy text panels on both sides, which appear to be annotations or descriptions of the scene. The overall composition has a horizontal scroll format, which was common in classical Chinese painting. The technique appears to be ink or similar medium on what might be silk or paper, with the figures and architecture depicted in a light color against the darker background, creating a striking contrast.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-22

The image depicts a section of an ancient Chinese scroll, likely from the Song Dynasty (960-1279 AD). The scroll is divided into three panels, each with a distinct scene.

Panel 1:
The leftmost panel features a serene landscape with a large tree and a body of water. The tree's branches stretch across the top of the panel, while the water flows from the bottom left corner. A few characters are inscribed in the top-left corner, but they are too small to decipher.

Panel 2:
The middle panel showcases a grand building with a balcony and a staircase leading up to it. Three figures are seated on the balcony, while two others stand on the stairs. The building's architecture is ornate, with intricate carvings and patterns adorning its walls. A few characters are written in the top-right corner, but they are also too small to read.

Panel 3:
The rightmost panel contains a block of text written in traditional Chinese calligraphy. The text appears to be a poem or passage from a literary work, but its meaning is unclear due to the lack of context and translation.

Overall:
The image provides a glimpse into the artistic and literary traditions of ancient China. The scroll's intricate designs, ornate architecture, and elegant calligraphy demonstrate the high level of craftsmanship and cultural sophistication of the time. However, without further context or translation, the specific meaning and significance of the image remain unclear.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-22

The image depicts a traditional Chinese-style artwork, featuring a scene with multiple figures and a prominent staircase. The artwork is rendered in a sepia tone, with intricate details and calligraphy.

Key Elements:

  • Figures: There are several figures depicted in the artwork, each with distinct attire and poses. Some appear to be engaged in conversation or contemplation, while others seem to be observing their surroundings.
  • Staircase: A grand staircase dominates the center of the composition, leading up to a platform or balcony. The staircase is adorned with ornate carvings and railings, adding to the overall sense of opulence and grandeur.
  • Calligraphy: The artwork features extensive calligraphy, which appears to be a form of Chinese poetry or prose. The text is written in a flowing script, with each character carefully rendered to convey meaning and emotion.
  • Background: The background of the artwork is a deep, rich brown color, which provides a striking contrast to the lighter tones of the figures and staircase. The background also features subtle texture and pattern, adding depth and visual interest to the composition.

Overall Impression:

The image presents a captivating and intricate artwork that showcases the beauty and elegance of traditional Chinese art. The combination of figures, staircase, and calligraphy creates a sense of drama and storytelling, inviting the viewer to explore the narrative and symbolism embedded within the artwork.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-02-25

The image depicts a traditional Chinese painting with a black and gold color scheme. The painting is divided into two main sections. On the left side, there is a landscape featuring a waterfall and a tree. The waterfall is depicted in flowing lines, and the tree is intricately detailed, suggesting a serene natural setting. On the right side of the painting, there is a scene of people gathered in a hall. The hall has a traditional Chinese architectural style with a roof and pillars. The people are dressed in traditional clothing, and some are engaged in conversation, while others are sitting. The scene appears to be a formal gathering or a meeting. The painting also includes Chinese characters, which are written in gold and provide additional context or description of the scene. Overall, the painting combines elements of nature and human activity, showcasing the traditional Chinese aesthetic and cultural values.

Created by amazon.nova-pro-v1:0 on 2025-02-25

The image is a painting with a golden color scheme, depicting a scene with a person sitting on a chair on the balcony of a building. There are a few other people standing on the balcony and in the room. The balcony has a railing and a roof. The building is situated near a river, and there are some trees on the other side of the river.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression: The image is a reproduction of a classical Chinese artwork. It appears to be a woodcut or engraving on a dark background, likely depicting a scene from Chinese history or literature. The style is traditional, with detailed linework and a focus on conveying a sense of elegance and historical significance.

Composition: The artwork is divided into distinct visual sections:

  • Left Section: A landscape is displayed. There is a waterfall and a river. Some cranes are also depicted in the river.
  • Middle Section: A complex architectural structure dominates this area. It's likely a pavilion or a palace, showing figures. This is the central focus of the composition.
  • Right Section: A large block of Chinese calligraphy text fills this space. The text appears to be a narrative or explanatory information associated with the central scene.

Main Elements & Details:

  • Figures: The scene likely depicts several figures within the pavilion, possibly engaged in a literary or social gathering. The figures' clothing, hairstyles, and posture suggest a historical period.
  • Architecture: The detailed rendering of the pavilion is crucial to the piece. The intricate patterns, rooflines, and supports showcase the precision of the technique.
  • Calligraphy: The text is expertly written in classical Chinese characters. The calligraphy is an essential part of the artwork, not only providing information but also complementing the visual style and conveying the culture of the scene.

Technique & Style:

  • Medium: The artwork seems to be a woodcut or engraving due to the sharp lines, the high contrast between the dark background and the light-colored lines, and the overall flat appearance.
  • Color Palette: The use of a dark background and lighter, detailed lines create a strong contrast.

Interpretation:

  • The image could be a depiction of a famous historical event, a literary scene, or a celebration. The text provides clues to the specific details, if the image is correctly identified.

If you'd like, give me more details about the artwork, and I can provide a more detailed description.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

This is an artwork depicting an East Asian scene, potentially Chinese or Japanese, rendered in a style reminiscent of traditional printmaking or ink wash painting. The overall palette is dark, with beige or tan lines providing the detailed imagery against a dark background.

On the left of the image, there is a natural landscape featuring mountains and a waterfall cascading into a body of water. Two stylized birds, possibly cranes, are also visible near the water.

Moving towards the right, the scene transitions to an architectural setting, a building with ornate structural elements, seemingly built above water. Several figures are present within this structure. One figure is seated at a table, possibly writing or engaged in some form of scholarship. Other figures stand or sit around, seemingly observing or assisting.

On the right side of the artwork, there is an area filled with vertical columns of East Asian text. The text is written in a traditional calligraphic style.

The style and composition of the artwork suggest a narrative or historical scene, potentially depicting a moment of cultural or intellectual activity. The precise details and symbolism of the scene would require a deeper understanding of East Asian history and art.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a traditional Chinese painting, likely from the Song or Ming dynasty, depicting a serene and scholarly scene. Here is a detailed description:

  1. Setting: The painting shows a pavilion or a small building set in a natural landscape. The structure is situated on a raised platform, accessible by a bridge over a stream or river. The surrounding area is lush with trees and mountains in the background, creating a tranquil atmosphere.

  2. Characters: Inside the pavilion, there are several figures engaged in what appears to be a scholarly gathering or a meeting. The figures are dressed in traditional Chinese attire, suggesting they are scholars or officials. One figure is seated, possibly reading or writing, while others stand around, engaged in conversation or observing.

  3. Architecture: The pavilion has a traditional Chinese architectural style, with a tiled roof and open sides, allowing for a view of the natural surroundings. The structure is supported by wooden pillars and has intricate detailing on the roof.

  4. Nature: The natural elements in the painting are prominent, with flowing water, trees, and mountains. The water is depicted with delicate lines, showing movement and fluidity. The trees and mountains add depth to the scene, enhancing the sense of tranquility and harmony with nature.

  5. Calligraphy: There is Chinese calligraphy on the right side of the painting, which likely provides context or a poetic description of the scene. The text is written in a traditional style, adding to the cultural and historical significance of the artwork.

Overall, the painting captures a moment of intellectual and cultural exchange in a serene natural setting, reflecting the importance of scholarship and nature in traditional Chinese culture.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

This image appears to be a traditional Chinese ink painting on paper. The artwork depicts a scene with figures on a balcony or elevated platform, which is surrounded by architectural elements that suggest a palace or imperial setting. The figures are dressed in traditional attire, possibly from a historical period, and are engaged in what seems to be a ceremonial or courtly activity.

The left side of the image features a dramatic, stylized depiction of a waterfall or a large cascade, which adds a dynamic element to the composition. The right side of the image contains text, likely a narrative or commentary related to the scene, which is written in a script that is characteristic of Chinese calligraphy. The text is neatly arranged and appears to provide historical or cultural context for the painting.

The overall style and technique suggest that this is a piece of classical Chinese art, possibly from the Tang or Song dynasties, known for their rich artistic tradition and detailed depiction of scenes and characters.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This image is a detailed illustration from an East Asian artistic tradition, likely Chinese or Japanese, depicting a scene of a gathering in an elegant, traditional architectural setting. The composition is divided into three main sections:

  1. Left Section: This part shows a natural landscape with stylized mountains and a flowing river. The mountains are depicted with intricate line work, and the river has ripples, suggesting movement. There are also some birds flying over the river, adding to the serene atmosphere.

  2. Middle Section: This section features a multi-tiered building, possibly a palace or a temple, with ornate architectural details. The building has several balconies and a roof with traditional East Asian design elements. There are several figures seated and standing on the balconies, engaged in conversation or observing the scene. The figures are dressed in traditional attire, and the scene suggests a formal gathering or a scholarly discussion.

  3. Right Section: This part contains vertical columns of text written in a traditional East Asian script, likely Chinese or Japanese. The text is neatly arranged and appears to be annotations or descriptions related to the scene depicted in the middle section. The text is written in a formal, calligraphic style, indicating its importance.

Overall, the image combines elements of nature, architecture, and human interaction, creating a harmonious and balanced composition. The detailed line work and the integration of text and illustration suggest that this is a piece of classical art, possibly related to a historical or literary work.

Text analysis

Amazon

M
is
-
f
S
9
BAZ
1
-N
#
AND
FAX
the
Kape
UP

Google

右 王羲之嘀板楔帖, |自唐以来摹損相尚各有 不同而傳之 |久速者惟后刻存故後世有定武椅逐 -良治家不雪影+'本屬者九泉惟以定 武本為逼真具他点有可觀者予閔之 今書法弟一 以定武本 三褚逐良本一唐模 |井石復書諸肾詩倣李伯 赐本 時之面魚禊帖諸家之說共為一卷讀 書之暇惟自以荔清玩非敢遗永于人 以為楷式也 永黎+五年 歳在丁酉七月 中 澎書 1+↓人詩两篇成 一十 五人詩一篇成 一+ 六人詩不成备 飲酒三能
王羲之
,
|
以来
各有
不同
後世
-
治家
+
'
九泉
逼真
可觀
書法
李伯
一卷
以為
五年
丁酉
七月
1
两篇
一篇
不成
飲酒