Human Generated Data

Title

One of the Ten Kings of Hell

Date

15th - 16th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Claudia Brown and Emily Rabiner in memory of Donald N. Rabiner and in honor of Robert D. Mowry, 2002.57

Human Generated Data

Title

One of the Ten Kings of Hell

Date

15th - 16th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Claudia Brown and Emily Rabiner in memory of Donald N. Rabiner and in honor of Robert D. Mowry, 2002.57

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 93.7
Person 93.7
Person 93.5
Art 93
Painting 93
Person 90.1
Person 82.9
Building 79.7
Architecture 79.7
Person 78.6
Person 75.6
Person 70.6
Person 65.9
Monastery 63.3
Housing 63.3
Worship 58.8
Person 58.5
Shrine 58.2
Temple 58.2

Clarifai
created on 2018-02-19

painting 99.5
art 99.3
illustration 99.3
religion 97.2
saint 96.6
people 95
church 93.4
Renaissance 89.1
cross 88.3
man 88.3
god 88
decoration 87.1
old 87
fresco 86.3
Gothic 84.5
picture frame 83.8
symbol 83.4
ancient 82.7
woman 82
manuscript 81.1

Imagga
created on 2018-02-19

vintage 41.4
old 35.6
retro 34.5
texture 33.4
grunge 29.8
tile 28.7
antique 28.6
art 28.2
pattern 27.4
paper 26.7
mosaic 26
decoration 23.6
wallpaper 23
ancient 21.6
design 21.5
floral 19.6
flower 18.5
transducer 18.2
color 17.3
aged 17.2
binding 16.7
decorative 15
frame 14.2
element 14.1
stamp 13.7
paint 13.6
dirty 13.6
cotton 13.4
material 13.4
bookmark 13.4
surface 13.2
backdrop 13.2
graphic 13.2
postmark 12.8
postage 12.8
border 12.7
brown 12.5
mail 12.5
letter 11.9
graffito 11.7
textile 11.4
canvas 11.4
detail 11.3
covering 10.9
postal 10.8
textured 10.5
post 10.5
plant 10.5
fabric 10.4
blank 10.3
colorful 10
rough 10
jacket 10
collection 9.9
travel 9.9
envelope 9.8
decor 9.7
obsolete 9.6
puzzle 9.6
grungy 9.5
patterns 9.5
symbol 9.4
device 8.9
torn 8.7
stained 8.7
map 8.7
stain 8.7
empty 8.6
leaf 8.6
page 8.4
game 8.4
historic 8.3
style 8.2
backgrounds 8.1
creative 8
blackboard 7.9
philately 7.9
printed 7.9
wall 7.8
flowers 7.8
artistic 7.8
ornament 7.8
drawing 7.7
decay 7.7
collage 7.7
parchment 7.7
worn 7.6
damaged 7.6
set 7.6
seamless 7.6
close 7.4
note 7.4

Google
created on 2018-02-19

art 95.2
painting 87.1
tapestry 82.1
modern art 65.8
artwork 63.8
mural 56
visual arts 55.2
paint 54.9
history 52.2
stock photography 52.2

Microsoft
created on 2018-02-19

fabric 10.1

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 10-15
Gender Male, 84.9%
Disgusted 1.4%
Calm 4.3%
Angry 1.8%
Happy 1.4%
Confused 3.2%
Sad 81.2%
Surprised 6.6%

AWS Rekognition

Age 23-38
Gender Male, 97%
Angry 3.4%
Happy 1.3%
Calm 84.1%
Disgusted 1.1%
Surprised 3.1%
Sad 4.6%
Confused 2.4%

AWS Rekognition

Age 29-45
Gender Female, 58.7%
Disgusted 30.5%
Confused 6%
Happy 14.6%
Angry 25%
Calm 7.9%
Surprised 8.1%
Sad 8%

AWS Rekognition

Age 26-44
Gender Female, 51.5%
Happy 45.6%
Sad 48.6%
Confused 45.3%
Surprised 45.3%
Calm 46.2%
Angry 47.5%
Disgusted 46.5%

AWS Rekognition

Age 48-68
Gender Male, 53.4%
Surprised 45.4%
Disgusted 52.3%
Sad 45.3%
Angry 45.4%
Happy 45.2%
Confused 45.7%
Calm 45.6%

AWS Rekognition

Age 45-63
Gender Male, 86.7%
Confused 3.1%
Sad 4.3%
Surprised 3%
Angry 19.1%
Calm 45%
Happy 1.5%
Disgusted 24%

AWS Rekognition

Age 57-77
Gender Male, 54.6%
Surprised 45.2%
Happy 45.5%
Disgusted 45.4%
Confused 45.3%
Sad 52%
Angry 45.9%
Calm 45.7%

AWS Rekognition

Age 6-13
Gender Female, 54.4%
Calm 45.5%
Happy 46%
Surprised 45.4%
Confused 45.3%
Disgusted 46%
Sad 50%
Angry 46.8%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting
Person 93.7%
Person 93.5%
Person 90.1%
Person 82.9%
Person 78.6%
Person 75.6%
Person 70.6%
Person 65.9%
Person 58.5%
Painting 93%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man in a suit and a woman in a red dress -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-30

The image is an ancient Chinese painting depicting a scene reminiscent of the afterlife or a celestial court. The central figure is seated, wearing elaborate traditional attire and a prominent headdress, possibly signifying an emperor, deity, or judge. Surrounding the central figure are several attendants and officials, adorned in various robes. The setting includes intricate patterns, mythical creatures such as dragons in the background, and ethereal clouds, adding to the divine or otherworldly atmosphere.

Below the main assembly, there are vivid and dramatic representations of punishment scenes, suggesting depictions of hell or the underworld. Figures are engaged in tormenting others, and some are seen in dioramas or circular frames, emphasizing their suffering. There are also rocky formations, with figures huddled in a cave-like enclosure at the bottom right corner, adding to the sense of a moralistic or judgmental scene. The overall composition conveys a moral narrative, possibly illustrating themes of justice, retribution, and the cosmic order as viewed in traditional Chinese culture.

Created by gpt-4 on 2024-11-18

This is an intricate painting that appears to be influenced by East Asian artistic traditions. The image exhibits multiple scenes and layers of activity, presumably depicting various aspects of historical or mythological narratives.

In the upper section, cloud motifs and a flying mythical creature resembling a dragon suggest the setting could be celestial or relate to divinity. Below this, figures in elaborate traditional attire are gathered around a platform, possibly engaging in a ritual or ceremony.

The middle section shows a tumultuous scene with figures engaging in what seems to be a violent confrontation. The dynamic poses of the characters and the display of weapons imply action and conflict.

The lower portion of the painting portrays a stark contrast with an underground or cavern-like setting. Figures appear to be toiling or engaged in a task, with one of them operating a lever or pump that affects a trap with a tiger. There are rocky outcrops, suggestive of a rugged terrain or punishment/penitence scenario.

Though the setting is fantastical, the meticulous detailing of clothing, objects, and environment elements indicate a rich narrative context, potentially drawn from historical legends or cultural epics. The artwork provides a visually captivating story across three distinct layers, likely holding significant cultural and allegorical meaning.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-27

This appears to be a traditional East Asian painting, likely Chinese, depicting what seems to be a court or judgment scene. The composition is vertically organized, with a central elevated platform or desk where an important figure sits in official robes and a distinctive headdress. Below this central figure are various scenes showing figures in different activities.

The painting uses traditional Chinese artistic techniques and colors, with browns and reds dominating the palette. There are decorative elements like clouds in the upper portion and mountains or rocky formations shown in white on the lower right side. Dragons appear to be depicted in the upper portion of the painting.

The scene includes multiple smaller figures engaged in various activities, some appearing to be in conflict or struggle, while others seem to be observing or participating in some form of ceremony or official proceeding. The style and composition suggest this is likely from a historical narrative or religious story, possibly depicting a scene from Chinese mythology or historical literature.

The artwork shows careful attention to detail in the clothing and architectural elements, which appear to be from a traditional Chinese setting. The overall mood of the painting seems to convey both authority and drama, with the various levels of action creating a dynamic visual narrative.

Created by claude-3-haiku-20240307 on 2024-11-18

The image appears to be a complex traditional Chinese or East Asian painting depicting a religious or mythological scene. In the center, there is a figure seated on a throne-like structure, surrounded by other figures, some of whom seem to be engaged in ritual or ceremonial activities. The painting contains a wealth of detailed imagery, including clouds, animals, and other fantastical elements. The overall composition is intricate and visually striking, showcasing the skilled artistry of the painter.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-24

This image is a painting of a Chinese deity, likely from the Ming dynasty (1368-1644), depicting a scene of judgment and punishment. The central figure, seated on a throne, wears a black robe with a red sash and a blue hat adorned with feathers and a tassel. He holds a white scroll in his left hand, symbolizing his role as a judge or ruler.

In front of the throne, a red table supports a white scroll, while a smaller table to the left holds various objects, including a book, a brush, and an inkstone. Two attendants stand on either side of the throne, one holding a fan and the other a book.

The background of the painting features a dark brown color with clouds and a dragon, adding to the sense of drama and power. The overall atmosphere of the painting conveys a sense of authority, wisdom, and justice, as the deity presides over the scene with a stern yet compassionate expression.

The painting's style and composition suggest that it may be a representation of a specific deity or mythological figure from Chinese culture, possibly associated with the underworld or the afterlife. The level of detail and craftsmanship evident in the painting indicates that it was created by a skilled artist during the Ming dynasty.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a traditional Chinese painting, likely from the Ming or Qing dynasty, featuring a large gathering of people in a room. The scene is set against a brown background with red pillars and a large table at the center, adorned with a white ribbon.

In the foreground, a group of men are seated around the table, engaged in conversation. One man stands out, wearing a blue hat and holding a scepter, while another man in a red robe sits on a throne-like chair. The room is filled with various objects, including a drum, a fan, and a vase, which add to the sense of opulence and grandeur.

The background of the painting features a series of clouds and dragons, which are typical motifs in traditional Chinese art. The overall atmosphere of the painting is one of elegance and refinement, suggesting that it may have been created for a royal or noble patron.

The painting's style is reminiscent of traditional Chinese art, with bold lines, vibrant colors, and intricate details. The use of symbolism and metaphor is also characteristic of Chinese art, with the dragon and clouds likely representing good fortune and prosperity.

Overall, the image presents a vivid and detailed depiction of a traditional Chinese gathering, showcasing the country's rich cultural heritage and artistic traditions.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image depicts a scene of a court where a man is sitting on a throne, and a woman is standing beside him. The man is wearing a crown and a robe, and the woman is wearing a traditional dress. A few people are standing around them, and some are sitting on the floor. A few objects are placed on the desk, and a few people are standing near it.

Created by amazon.nova-lite-v1:0 on 2025-01-04

This image depicts a scene from the Chinese opera, "The Story of the Stone," also known as "Dream of the Red Chamber." The painting shows a courtroom scene with the emperor seated on a throne, wearing a crown and holding a scepter. The emperor is surrounded by court officials and advisors, who are dressed in traditional Chinese clothing. The courtroom is decorated with red pillars and a red curtain, and there are several figures in the foreground, including a man in a red robe who appears to be a judge or magistrate. The painting is done in a traditional Chinese style, with a focus on the use of color and symbolism to convey meaning. The overall mood of the painting is solemn and serious, reflecting the importance of the legal proceedings taking place.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is a traditional Chinese painting, possibly depicting a scene from Chinese mythology or folklore. It has an overall sepia tone, with lighter shades in the background and darker, more intense colors in the foreground.

At the top of the painting is a tableau of what seems to be deities or important figures. A central, bearded figure with a large hat sits on a throne, flanked by other figures. The scene is set against a backdrop of swirling clouds and what appears to be a dragon.

Below them is a scene with a table or altar where various actions are taking place. People are being dragged, and others are being judged or processed. The overall mood of this section is chaotic and turbulent.

At the bottom of the painting, there are scenes that seem to depict punishment or suffering. One scene involves people being tortured, while another shows figures huddled in a mountainous landscape.

The painting is filled with intricate details, and the figures are rendered with a sense of expressiveness. The painting has a border with repeating cloud-like patterns.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression:

This is a traditional East Asian painting, likely of Chinese origin, depicting a scene of judgement or divine authority. The style suggests it could be a depiction of a religious or mythological narrative. The use of color, composition, and figures evokes a sense of formality and symbolic meaning.

Key Elements and Composition:

  • Upper Tier (Judgement Scene): The top section features a central figure of authority, possibly a judge, surrounded by attendants.
    • A majestic figure with a long beard, likely the main judge.
    • Other figures are in attendance, possibly advisors or scribes.
    • There is a table/altar-like structure with a scroll, possibly a record or judgment.
    • A dark, swirling background filled with dragons, possibly signifying heaven or a divine realm.
  • Middle Tier (Scenes of Suffering/Justice): The mid-section shows figures engaged in actions related to punishment or justice.
    • Figures in combat and torturous acts are present.
    • Figures are being judged, possibly as a result of the scroll on the altar.
    • The presence of figures in the scene and in the background suggests a story of punishment and recompense.
  • Lower Tier (Scenes of Suffering): The bottom section likely depicts some of the fates of those being judged.
    • Scenes of punishment, torture, and hellish actions are shown.
    • Figures being tortured are shown with anguish on their faces.

Color Palette:

The painting uses a muted color palette dominated by earthy tones, browns, reds, and blues. This subdued color scheme creates a sense of solemnity and draws attention to the figures and their actions.

Overall Meaning:

The painting's overall narrative appears to be a portrayal of judgement and the consequences of one's actions. It shows a celestial judgement, along with the results of good or evil deeds. The painting seems to be a cautionary tale with a religious undertone.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image is a traditional Chinese painting that appears to depict a scene from a historical or mythological narrative. Here are some detailed observations:

  1. Central Figure: At the top center of the painting, there is a prominent figure seated on a throne. This person is dressed in elaborate robes and headgear, suggesting they are of high status, possibly an emperor or a deity.

  2. Surrounding Figures: Around the central figure, there are several other individuals, some of whom are also dressed in elaborate attire, indicating they might be court officials or advisors.

  3. Lower Scene: The lower part of the painting shows a more chaotic scene with various figures engaged in different activities. Some appear to be in distress or conflict, suggesting a battle or a dramatic event.

  4. Architectural Elements: The painting includes architectural details such as pillars and a raised platform, which could be part of a palace or a temple.

  5. Symbolic Elements: There are circular insets on either side of the lower scene, which contain smaller depictions of figures, possibly representing additional narrative elements or symbolic meanings.

  6. Color and Style: The painting uses a rich palette of colors, with a predominance of earth tones and accents of red, blue, and gold. The style is intricate and detailed, characteristic of traditional Chinese art.

Overall, the painting seems to convey a complex narrative, possibly from a historical event, a legend, or a mythological story, with a focus on the central figure's authority and the dramatic events unfolding below.