Human Generated Data

Title

The Summons

Date

1856

People

Artist: Emanuel Gottlieb Leutze, American 1816 - 1868

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Theodore E. Stebbins Jr., 2007.224

Human Generated Data

Title

The Summons

People

Artist: Emanuel Gottlieb Leutze, American 1816 - 1868

Date

1856

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Theodore E. Stebbins Jr., 2007.224

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Human 99.1
Person 99.1
Art 96.6
Painting 96.4
Person 96.3
Person 93.4
Person 88.5
Person 87.6
Person 87.4
Crypt 85.9
Person 60.6
Person 55.7

Clarifai
created on 2018-04-18

people 99.4
religion 97.6
church 97.5
art 96.7
painting 93.5
adult 93.2
woman 92.7
group 92.4
architecture 90.8
indoors 90.1
travel 84.6
cathedral 84.2
building 84
museum 84
man 82.1
bedrock 81.1
arch 80.3
home 79.8
city 78.8
monastery 78.2

Imagga
created on 2018-04-18

vault 92.3
roof 70.4
architecture 60.5
protective covering 52.7
building 50
church 44.5
religion 41.3
cathedral 40.5
old 39.8
covering 35.8
ancient 35.5
arch 34
stone 31.4
historic 28.5
hall 26.3
monastery 25.2
history 24.2
door 23.8
wall 22.6
tourism 22.3
historical 21.7
travel 21.2
medieval 21.1
window 21.1
religious 19.7
landmark 19
catholic 18.9
interior 18.6
city 18.3
monument 16.8
house 16.3
culture 16.3
tourist 15.4
light 15.4
palace 15.2
anteroom 14.8
arches 14.7
column 14.7
faith 14.4
god 14.4
art 14.3
chapel 13.8
castle 13.5
cross 13.2
street 12.9
entrance 12.6
tower 12.6
religious residence 12.4
brick 12.3
place 12.1
altar 12.1
town 12.1
residence 12
fortress 11.8
holy 11.6
architectural 11.6
construction 11.1
abbey 10.9
columns 10.8
antique 10.4
worship 9.7
detail 9.7
spirituality 9.6
corridor 8.9
stained 8.7
temple 8.3
inside 8.3
vacation 8.2
structure 8
catholicism 7.9
sacred 7.8
saint 7.7
traditional 7.5
famous 7.5
decoration 7.2
night 7.1

Google
created on 2018-04-18

Microsoft
created on 2018-04-18

building 91.9
arch 39.6
stone 21
colonnade 14.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Happy 45.2%
Sad 46.2%
Disgusted 45.5%
Calm 52.4%
Angry 45.4%
Confused 45.1%
Surprised 45.2%

AWS Rekognition

Age 35-52
Gender Female, 54.3%
Angry 45%
Happy 45%
Calm 45%
Disgusted 45%
Confused 45%
Sad 54.9%
Surprised 45%

AWS Rekognition

Age 14-23
Gender Female, 54.6%
Sad 54.2%
Confused 45%
Disgusted 45.1%
Happy 45.6%
Angry 45.1%
Surprised 45%
Calm 45%

AWS Rekognition

Age 16-27
Gender Male, 50.5%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%
Confused 49.6%
Happy 49.5%
Calm 49.5%
Sad 50.2%

AWS Rekognition

Age 6-13
Gender Female, 50.1%
Disgusted 49.6%
Sad 49.8%
Calm 49.9%
Happy 49.6%
Angry 49.6%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Confused 45.2%
Surprised 45.2%
Calm 50.4%
Sad 48.6%
Angry 45.3%
Happy 45.1%
Disgusted 45.3%

AWS Rekognition

Age 29-45
Gender Female, 50.1%
Angry 49.6%
Confused 49.6%
Calm 49.7%
Sad 49.9%
Disgusted 49.6%
Happy 49.6%
Surprised 49.6%

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting
Person 99.1%
Person 96.3%
Person 93.4%
Person 88.5%
Person 87.6%
Person 87.4%
Person 60.6%
Person 55.7%
Painting 96.4%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man in a castle -100%

OpenAI GPT

Created by gpt-4 on 2024-01-25

This image depicts a richly detailed scene set within an ornate architectural space that appears to be from a historical period. The architecture includes elegant arched ceilings, a column with intricate carvings, and a large window that allows natural light to illuminate the interior. The room is adorned with a hunting trophy, paintings, wall sconces, and statues, conveying a sense of opulence and attention to artistic detail.

In the foreground, a figure stands confidently with one hand on their hip. Near the center of the room, there appears to be a group of figures gathered around a table, engaged in a social activity. The interaction among them suggests a moment of leisure and conversation. The daylight casts soft shadows and highlights throughout the space, enhancing the textures and materials of the various objects, from the tapestries to the furnishings. A dog is lying on the floor, contributing to the domestic feel of the scene.

In the lower right corner of the image, a pair of thrown objects and a sword with a richly decorated hilt add a sense of action or reaction to the artwork, suggesting a narrative or a moment captured in time. The interior is furnished with period-appropriate furniture, including chairs upholstered with dark material and accented with studs, adding to the historical ambiance of the setting.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

This image depicts a grand, ornate interior space with intricate Gothic-style architecture. The scene shows a group of people engaged in what appears to be a social gathering or celebration. In the center, a number of well-dressed individuals are seated around a table, suggesting a formal meal or gathering. A man in a burgundy robe stands to one side, gesturing or interacting with the group. The overall atmosphere conveys a sense of elegance and historical setting, with the ornate columns, arched ceilings, and antique furnishings creating a richly detailed and visually striking scene.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a painting of a scene from the play "Hamlet" by William Shakespeare. The painting is set in a grand, ornate room with high ceilings and large windows. In the foreground, Hamlet is standing in front of a screen, looking at his father's ghost, who is standing behind the screen.

Hamlet is dressed in a black and red costume, while his father's ghost is wearing a white shirt and black pants. To the right of the screen, there is a group of people sitting at a table, including Hamlet's mother, Queen Gertrude, and his uncle, Claudius. They are all dressed in formal attire and appear to be engaged in conversation.

In the background, there are several other characters from the play, including Ophelia, Polonius, and Laertes. They are all dressed in period clothing and are standing or sitting in various poses. The overall atmosphere of the painting is one of drama and tension, as Hamlet grapples with the revelation that his father's death was a murder.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a scene from William Shakespeare's play "Hamlet," specifically Act 3, Scene 4, where Polonius is hiding behind a curtain to observe Hamlet's behavior. The painting shows Polonius standing behind a dark curtain, watching Hamlet, who is standing in the center of the room. Hamlet is holding a letter and appears to be deep in thought. The room is filled with other characters, including Ophelia, who is sitting on the floor, and Rosencrantz and Guildenstern, who are standing near the window. The atmosphere is tense and suspenseful, with Polonius's presence adding to the sense of drama and intrigue. The painting captures the intensity of the scene, with the characters' emotions and actions conveyed through their facial expressions and body language. The use of muted colors and dramatic lighting adds to the overall mood of the painting, creating a sense of foreboding and tension. Overall, the image effectively conveys the complexity and depth of Shakespeare's play, inviting the viewer to explore the characters and their motivations.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a scene from Shakespeare's "The Taming of the Shrew." It is an oil painting by Charles Landseer, created in 1840. The painting captures a moment in the play where Petruchio, the main character, is trying to tame his wife, Katherina, through various means. In this scene, Petruchio is seen standing in a grand, arched room, dressed in a costume with a mask, while Katherina is seated at a table with other people. The room has a medieval-inspired design, with intricate carvings on the columns and walls. The atmosphere is tense, with Petruchio's mask and Katherina's seated position suggesting a power struggle between them. The painting effectively captures the dramatic and comedic elements of the play, showcasing the complex relationship between the two characters.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a scene in a room with a high ceiling and arched windows. The room is divided into two sections by a large column in the middle. On the left side, a man in a black robe stands near the door, and a man in a red and green costume is standing near the column. On the right side, a group of people is sitting at a table.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the painting:

The painting depicts a dramatic scene within a grand, arched interior. The architecture is notable for its Gothic-inspired vaulted ceilings and ornate columns. The space is divided into a foreground and background, with an archway serving as a natural frame.

In the foreground, to the left, a figure wearing a mask stands by a screen, pointing towards a man dressed in period attire who is in mid-gesture, seemingly surprised or caught in the act. Scattered on the floor nearby are pieces of paper, hinting at a potential disturbance or secret being revealed.

Through the archway, a group of people is gathered around a table, bathed in soft, natural light from a window. They appear to be engaged in conversation or a light meal. A man in period attire leans against the door.

To the right side of the painting, in the foreground, there are chairs, a fallen garment, and a hat, suggesting a hurried or recent departure. On the wall, a framed portrait is hung, along with a set of antlers and a helmet, adding to the historical ambiance of the scene.

The overall atmosphere is one of intrigue and drama, with a sense of secrets being uncovered and lives intersecting in a complex and revealing manner.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression:

The image is a large, classically-styled painting with a rich, historical atmosphere. It depicts an interior scene, likely in a grand hall or a part of a castle, with multiple figures and activities suggesting a scene of intrigue or drama. The lighting is warm and focused, drawing the eye to the central action.

Composition:

  • Architecture: The painting's defining feature is the elaborate Gothic-style architecture. It features a vaulted ceiling, ornate columns, and archways.
  • Layers of Space: The scene is layered, with different areas suggesting separate rooms or spaces within the structure. The primary focus is on the foreground, then the middle ground where the seated family is, and finally the background that is a portal to the outside world.
  • Light and Shadow: The artist uses dramatic lighting, with strong sunlight coming from a window and illuminating the central figures. This creates contrasting areas of light and shadow, enhancing the three-dimensional effect and the drama.

Key Elements and Figures:

  • Foreground:
    • A man in the center of the image, dressed in a costume of the time, is gesturing expressively. He's possibly an actor.
    • A figure wearing a black cloak and a mask stands near the screen, seemingly in a supporting role or with hidden intentions.
    • A few papers are on the floor, possibly discarded stage notes or other communication.
  • Middle Ground:
    • Through an archway, a family scene takes place. This includes what seems to be a mother holding a baby, other adults and children.
  • Background:
    • A window with sunlight coming through
    • Another figure in a soldier-like outfit.
  • Additional Details:
    • Decorations on the walls, including portraits and an armorial.
    • A sword.
    • A musical instrument.
    • Furniture, including chairs.

Mood and Interpretation:

The painting evokes a sense of mystery, theater, and historical drama. The presence of the masked figure, expressive gestures, and the architectural setting suggest a scene of intrigue. The family portrait in the center ground and the classical style of the painting imply it's a depiction of historical life, with the main figures having a theatrical presence.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image is a detailed painting depicting a scene from what appears to be a medieval or Renaissance-era interior. The setting is a grand room with Gothic architectural features, including ribbed vaulted ceilings and ornate columns. The room is illuminated by natural light streaming through a window, casting a warm glow on the figures within.

In the foreground, a man dressed in elaborate period clothing, including a red and black outfit with a cape, stands holding a document or letter. He appears to be in the midst of a dramatic moment, possibly delivering news or making a declaration. To his left, another figure, partially obscured by a doorway, is holding a piece of paper, suggesting a conversation or exchange of information.

In the background, a group of people is gathered around a table, engaged in what seems to be a lively discussion or meal. The table is laden with food and drink, and the individuals are dressed in rich, colorful attire, indicative of their social status. One person is seated, while others stand, creating a dynamic composition.

The room is adorned with various objects that add to the historical ambiance, including a portrait on the wall, a chandelier, and scattered items on the floor, such as a sword and a hat. The overall mood of the painting is one of intrigue and drama, capturing a moment of significant interaction among the characters. The artist's signature is visible in the bottom right corner, though it is not entirely legible in this image.