Human Generated Data

Title

Monmouth before James II

Date

c. 1795

People

Artist: John Singleton Copley, American 1738 - 1815

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1917.67

Human Generated Data

Title

Monmouth before James II

People

Artist: John Singleton Copley, American 1738 - 1815

Date

c. 1795

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1917.67

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 99.7
Human 96.8
Leisure Activities 58.1

Clarifai
created on 2018-03-16

people 99.8
art 99.6
group 98.8
painting 98.4
adult 98.1
religion 97.3
woman 97.3
man 96.8
dancer 96
Renaissance 94.5
child 94.2
dancing 94
kneeling 93.2
son 92.1
baby 91.7
royalty 91
wear 90.8
veil 90.6
gown (clothing) 90.3
position 88.8

Imagga
created on 2018-03-16

religion 26
throne 22.7
religious 22.5
temple 21.9
culture 21.4
traditional 19.9
art 18.3
metropolitan 18.2
chair of state 18.2
person 18.1
costume 17
spiritual 16.3
old 16
palanquin 15.8
gold 15.6
faith 15.3
chair 14.9
travel 14.8
golden 14.6
god 14.3
tradition 13.8
holy 13.5
church 12.9
people 12.8
color 12.8
belief 12.6
litter 12.6
spirituality 12.5
decoration 12.3
colorful 12.2
ancient 12.1
man 12.1
musical instrument 11.9
portrait 11.6
pray 11.6
worship 11.6
statue 11.4
antique 11.2
sculpture 11
architecture 10.9
sacred 10.7
drum 10.7
east 10.3
historic 10.1
fan 10
holiday 10
seat 9.9
male 9.9
tourism 9.9
prayer 9.7
saint 9.6
percussion instrument 9.6
adult 9.5
conveyance 9.5
historical 9.4
dancer 9.1
bangkok 8.8
bible 8.8
cultural 8.8
palace 8.7
festival 8.6
tourist 8.2
follower 8.1
interior 8
oriental 7.9
animal 7.9
face 7.8
scene 7.8
bull 7.7
mask 7.7
meditation 7.7
monument 7.5
catholic 7.3
detail 7.2
dress 7.2
history 7.2

Google
created on 2018-03-16

art 88.8
painting 77.3
middle ages 61
history 59.5

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 16-27
Gender Male, 53.3%
Disgusted 46.3%
Sad 46.4%
Calm 49.2%
Surprised 45.6%
Happy 46.9%
Confused 45.2%
Angry 45.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 47%
Calm 47.9%
Angry 46.6%
Surprised 45.4%
Confused 45.4%
Happy 46%
Disgusted 46.8%

AWS Rekognition

Age 45-66
Gender Female, 51.4%
Sad 54.9%
Disgusted 45%
Surprised 45%
Calm 45%
Angry 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 30-47
Gender Female, 53.2%
Surprised 45.1%
Disgusted 45.1%
Calm 45.1%
Confused 45.1%
Angry 45.2%
Happy 45.1%
Sad 54.3%

AWS Rekognition

Age 11-18
Gender Female, 52.7%
Disgusted 45.1%
Angry 45.4%
Calm 47%
Sad 52%
Happy 45.2%
Confused 45.2%
Surprised 45.1%

AWS Rekognition

Age 20-38
Gender Male, 50%
Angry 49.5%
Disgusted 49.5%
Calm 50.1%
Happy 49.6%
Sad 49.7%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 14-23
Gender Male, 52.2%
Calm 45%
Sad 45%
Confused 45%
Disgusted 54.9%
Happy 45%
Surprised 45%
Angry 45.1%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Calm 49.6%
Sad 49.8%
Confused 49.5%
Happy 49.6%
Disgusted 49.6%
Angry 49.8%
Surprised 49.6%

Microsoft Cognitive Services

Age 11
Gender Female

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Painting
Person

Clarifai

Clothing
Person
Human face
Human hair
Footwear

AWS Rekognition

Painting 99.7%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 94.8%

AWS Rekognition

Person 92.8%

AWS Rekognition

Person 88.7%

AWS Rekognition

Person 87.6%

AWS Rekognition

Person 86.4%

AWS Rekognition

Person 86.3%

AWS Rekognition

Person 85%

AWS Rekognition

Person 63.8%

AWS Rekognition

Person 63.2%

AWS Rekognition

Person 48.9%

Clarifai

Clothing 78%

Clarifai

Clothing 72.8%

Clarifai

Clothing 68.4%

Clarifai

Clothing 54.5%

Clarifai

Clothing 51.9%

Clarifai

Clothing 46.5%

Clarifai

Clothing 34.5%

Clarifai

Person 60.9%

Clarifai

Person 59.4%

Clarifai

Person 52.2%

Clarifai

Person 47.1%

Clarifai

Person 40.2%

Clarifai

Person 34.1%

Clarifai

Human face 46.5%

Clarifai

Human face 42.7%

Clarifai

Human face 42.3%

Clarifai

Human face 41.5%

Clarifai

Human face 38.5%

Clarifai

Human face 38.2%

Clarifai

Human face 35.5%

Clarifai

Human hair 35.2%

Clarifai

Footwear 34.5%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man in a suit and a woman in a red dress

Created by general-english-image-caption-blip-2 on 2025-06-27

the coronation of king william IV of wales by william watson

OpenAI GPT

Created by gpt-4 on 2024-12-03

This is an oil painting depicting an 18th or 19th-century scene where a chaotic, violent confrontation is taking place. A group of men, wearing period clothing, are engaged in what appears to be a dramatic and perhaps politically charged altercation. Some are dressed in red uniforms with gold trimmings, indicating they might be soldiers or guards, while others are in civilian attire with coats and breeches in various colors. The setting seems to be a grand interior with arches and columns, possibly a palace or government building, hinting that the event is of significant importance. A sense of movement and urgency is conveyed through the dynamic poses and expressions of the figures.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a classical oil painting depicting a dramatic scene with multiple figures in period dress from what looks to be the 17th or 18th century. The composition shows several people in an ornate architectural setting with columns and archways. The figures are wearing elaborate costumes typical of the period, with many in bright red coats and others in white and darker colored clothing. The scene appears to be quite dynamic, with the figures in animated poses suggesting movement or action. The painting has a theatrical quality, with dramatic lighting and a rich color palette dominated by reds, browns, and creamy whites. The setting appears to be some kind of grand interior space, possibly a palace or noble residence, with classical architectural elements visible in the background. The style and composition are characteristic of Baroque period painting.

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a historical painting depicting a dramatic scene in what looks like a palatial or grand architectural setting. The composition shows two distinct groups of figures: on the left, several men in bright red uniforms appear to be in an aggressive or confrontational pose, while on the right, figures in white and more formal attire stand on elevated steps, seemingly in a defensive or authoritative position.

The setting features classical architecture with columns and arches, and there's a decorative curtain draping in the upper right corner. The painting's style and clothing suggests it's from the late 17th or early 18th century. The contrast between the two groups is emphasized by their clothing - the red-coated figures versus the more formally dressed ones in white and darker colors.

The scene appears to be depicting some sort of historical confrontation or dramatic moment, possibly a political or military incident. The composition and dramatic poses of the figures suggest this is a significant historical event being portrayed.

The painting technique shows characteristics of Baroque style, with dynamic movement, dramatic lighting, and theatrical composition typical of that period.

Created by claude-3-haiku-20240307 on 2024-11-27

This painting depicts a formal, ceremonial scene taking place in an ornate, palace-like setting. The central figures appear to be nobles or members of royalty, dressed in elaborate, colorful robes and garments. They are surrounded by attendants, guards, and other figures, creating a bustling, dramatic composition. The overall style and composition suggest this is a historical or mythological scene, rather than a realistic depiction of a specific event. The use of rich colors, dramatic lighting, and intricate architectural details contribute to the grand, theatrical nature of the image.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a painting of a group of people in 18th-century attire, with some holding swords and others appearing to be in a state of distress. The scene is set in a grand room with columns and archways, suggesting a formal or ceremonial setting.

Key Elements:

  • A group of people dressed in 18th-century clothing
  • Some individuals are holding swords, while others appear to be in a state of distress
  • The scene is set in a grand room with columns and archways
  • The atmosphere suggests a formal or ceremonial setting

Possible Interpretation:

  • The painting may be depicting a historical event or scene from a play
  • The use of swords and the formal setting suggest a sense of drama and tension
  • The image may be intended to convey a message or tell a story about the people and events depicted

Overall Impression:

  • The image is a detailed and intricate painting that captures a moment in time
  • The use of color and composition creates a sense of depth and atmosphere
  • The image invites the viewer to explore the story and meaning behind the scene.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a painting of a group of people in 18th-century attire, engaged in a dramatic scene. The painting is likely a depiction of a historical event or a scene from a play.

  • People:
    • There are approximately 12 people in the painting.
    • They are all dressed in 18th-century clothing, with men wearing coats, waistcoats, and breeches, while women wear dresses and hats.
    • Some of the men are holding swords or other weapons, suggesting that the scene may be a battle or a duel.
  • Setting:
    • The background of the painting appears to be a large room with stone walls and columns.
    • There are several archways and windows visible, which add to the sense of grandeur and drama.
  • Action:
    • The people in the painting are engaged in various actions, such as fighting, talking, and gesturing.
    • Some of the men are standing on a raised platform or stage, while others are standing on the floor.
  • Mood:
    • The overall mood of the painting is one of tension and drama.
    • The use of bright colors and dynamic poses adds to the sense of energy and movement.

Overall, the painting appears to be a depiction of a significant historical event or a dramatic scene from a play. The use of 18th-century clothing and settings adds to the sense of authenticity and historical accuracy.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image shows a group of people in a room, possibly a theater, engaged in a play. Some of them are standing, while others are sitting on the red carpet. They are all wearing costumes. The man in the middle, who is wearing a cape, is standing on the red carpet and is probably the main character of the play. The room has a curtain, a column, and a window.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a painting depicting a scene from history, likely set in a grand hall or a courtroom. The composition is crowded with figures, each engaged in various activities, suggesting a moment of tension or conflict. The central figure, a man dressed in a white coat and holding a sword, appears to be addressing the group. His posture and the direction of his gaze suggest he is speaking or gesturing towards someone. Surrounding him are several other figures, some in red coats, others in white, and a mix of both genders, indicating a diverse gathering.

The background features architectural elements such as columns and drapes, suggesting a formal setting. The lighting in the painting is dramatic, with a strong contrast between light and shadow, adding to the sense of urgency and drama in the scene. The overall atmosphere is one of confrontation or debate, with the figures' body language and expressions contributing to this interpretation. The painting's style and composition suggest it is a historical or narrative artwork, capturing a specific moment in time with a focus on the interactions and emotions of the characters involved.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The painting presents a dramatic scene inside a grand, classical building. On the left, figures clad in red and black appear to be in a state of heightened agitation. One of them raises a weapon, possibly a sword, creating a sense of impending conflict. In contrast, on the right, a group of elegantly dressed individuals are gathered under a canopy. They appear composed, though their expressions suggest concern or shock. The contrast between the two groups, coupled with the architectural setting, implies a narrative of political intrigue or a moment of historical significance. The building's arches and columns contribute to the grandeur of the scene, while the canopy adds a touch of regality.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Scene:

The image is a historical painting, likely from the 18th century, depicting a dramatic scene within an architectural setting. It features a group of figures, some in elaborate historical attire, engaged in a dynamic and potentially violent interaction. The color palette is dominated by warm earth tones, reds, and creams, creating a sense of grandeur and drama.

Key Elements:

  • Central Figures: The focal point is a figure in a white suit with a dark cape, standing on a raised platform. He is pointing with an outstretched arm, seemingly directing the action.
  • Action and Violence: A group of men dressed in red coats with blue accents are in a state of confrontation, some holding swords. One figure appears to be being restrained.
  • Setting: The scene takes place in an architectural space, perhaps a hall or throne room. There are classical architectural elements like columns and arches. A curtain hangs in the background, potentially indicating a throne or raised seating area.
  • Secondary Figures: A woman dressed in a golden gown appears to be seated on the raised platform. Other figures are looking on with concern or attention.

Possible Interpretation:

The painting appears to depict a historical event, possibly a scene of conflict, an arrest, or a moment of political significance. The expressions and gestures of the figures contribute to the narrative, conveying tension, authority, and potential danger.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a dramatic and intense scene, likely from a historical or theatrical context. The setting appears to be a grand hall or palace with classical architectural elements, including columns and arches. The scene is filled with action and tension, featuring several figures in elaborate period costumes.

In the center of the image, a man dressed in white and gold stands on a raised platform, holding a sword and pointing towards the right. He seems to be in a position of authority or command. Surrounding him are other figures, some of whom are dressed in red and black attire, possibly indicating they are guards or soldiers. One of the soldiers is holding a spear, and another is holding a sword, suggesting a confrontation or impending violence.

To the right, a woman in a flowing white gown is being supported by another figure, possibly indicating distress or vulnerability. The overall mood of the painting is one of conflict and drama, with the figures' gestures and expressions conveying a sense of urgency and tension. The rich colors and detailed costumes add to the theatrical and historical atmosphere of the scene.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

This image is a painting that depicts a scene with multiple figures, likely from the Baroque period, based on the style of clothing and architecture. The setting appears to be an indoor space with classical architectural elements, such as columns and an archway in the background.

In the foreground, there are several individuals dressed in elaborate, colorful attire with rich fabrics and designs. One person is wearing a red and black costume with gold accents, possibly indicating a high rank or official role. Another individual, dressed in lighter tones, appears to be the central figure, possibly engaging in a formal or official act, such as a presentation or announcement.

The figures are engaged in a dynamic scene, with some figures holding what appear to be ceremonial items, such as a staff or a rod, suggesting a ritual, ceremony, or a moment of political or social significance. The use of light and shadow, as well as the detailed rendering of clothing and fabrics, enhances the dramatic and formal atmosphere of the scene. The painting style suggests a formal, possibly historical, narrative, commonly found in Baroque art.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This is a classical painting depicting a scene of high drama and tension, likely from a historical or theatrical context. The composition is rich in detail and movement, with several key elements:

  1. Setting: The scene takes place in an opulent, grand hall with classical architecture, featuring columns and arches. The background suggests an indoor setting with red and gold drapery, indicating a royal or noble setting.

  2. Central Figures:

    • On the right side, a man in white and green attire, possibly a king or nobleman, is pointing or gesturing emphatically. He is surrounded by several women in elaborate dresses, one of whom appears to be fainting or collapsing onto the floor. Another woman is reaching out towards the central figure.
    • On the left side, a group of men in red and black uniforms is actively moving forward. They appear to be soldiers or guards, as they are carrying weapons, including a sword and what looks like a spear or staff.
  3. Action and Expression:

    • The men in red uniforms are advancing towards the central figure and the women, creating a sense of urgency and conflict. One of the men in red is holding a sword aloft, suggesting a threat or confrontation.
    • The women appear distressed, with one fainting and another looking towards the central figure, possibly in desperation or fear.
  4. Color and Lighting:

    • The colors are vibrant, with the red uniforms and the white and gold attire of the central figures standing out against the more muted background.
    • The lighting is dramatic, with shadows and highlights emphasizing the tension and drama of the scene.

Overall, the painting captures a moment of high emotional intensity, possibly a scene from a historical event, a play, or a royal drama, where a confrontation or crisis is unfolding. The artist has used dynamic composition, vivid colors, and expressive figures to convey the urgency and drama of the moment.