Human Generated Data

Title

Evening in Venice

Date

1826-1828

People

Artist: Richard Parkes Bonington, British 1802-1828

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.182

Human Generated Data

Title

Evening in Venice

People

Artist: Richard Parkes Bonington, British 1802-1828

Date

1826-1828

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.182

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Adult 98.5
Bride 98.5
Female 98.5
Person 98.5
Wedding 98.5
Woman 98.5
Adult 98.3
Bride 98.3
Female 98.3
Person 98.3
Woman 98.3
Female 94.4
Person 94.4
Child 94.4
Girl 94.4
Adult 92
Bride 92
Female 92
Person 92
Woman 92
Face 90.8
Head 90.8
Person 82.5

Clarifai
created on 2018-08-20

people 99.6
religion 99.2
painting 98.8
group 98.8
art 98.5
baby 98.4
saint 98.1
adult 97.5
veil 97.3
wear 96.1
Renaissance 95.9
Mary 95.7
woman 95.1
child 93.9
gown (clothing) 93.5
two 93.1
cross 92.8
son 92.7
seat 92.4
furniture 91.6

Imagga
created on 2018-08-20

religion 43.9
temple 38
throne 37.6
sculpture 32.9
statue 31.6
culture 31.6
chair of state 30.1
religious 29
art 28.4
ancient 24.2
travel 23.9
god 23.9
spiritual 23
gold 23
chair 21.6
old 20.9
traditional 20.8
pray 20.4
architecture 20.3
ruler 19.9
spirituality 19.2
faith 19.1
church 18.5
history 17.9
metropolitan 17.9
worship 17.4
holy 17.3
seat 17.1
sacred 16.6
golden 16.3
prayer 15.4
monument 14.9
antique 13.8
meditation 13.4
historical 13.2
east 13.1
stone 12.7
decoration 12.4
colorful 12.2
historic 11.9
peace 11.9
oriental 11.7
color 11.7
tourism 11.5
face 11.4
figure 11.2
tradition 11.1
belief 10.7
carving 10.4
building 10.3
fan 10.1
bangkok 9.8
monastery 9.8
lady 9.7
grand 9.7
person 9.7
detail 9.7
style 9.6
saint 9.6
scene 9.5
symbol 9.4
famous 9.3
people 8.9
mosaic 8.9
virgin 8.9
palace 8.7
holiday 8.6
portrait 8.4
vintage 8.3
follower 8.1
bible 7.8
costume 7.8
cathedral 7.7
covering 7.7
mother 7.7
furniture 7.5
design 7.3
landmark 7.2
interior 7.1

Google
created on 2018-08-20

Microsoft
created on 2018-08-20

book 94.9
text 94.4
old 61

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 81.7%
Calm 94.8%
Surprised 6.4%
Fear 6%
Sad 2.2%
Confused 1.6%
Happy 1.3%
Disgusted 1.2%
Angry 0.2%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Calm 98.6%
Surprised 6.4%
Fear 5.9%
Sad 2.3%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 34-42
Gender Female, 92%
Calm 62.7%
Confused 31.4%
Surprised 6.6%
Fear 5.9%
Sad 3.9%
Happy 0.5%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 2-10
Gender Female, 76.5%
Calm 57%
Sad 25.6%
Fear 14.1%
Surprised 6.9%
Confused 3.8%
Happy 1.8%
Disgusted 1.3%
Angry 1.1%

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Child
Girl
Adult 98.5%
Adult 98.3%
Adult 92%
Bride 98.5%
Bride 98.3%
Bride 92%
Female 98.5%
Female 98.3%
Female 94.4%
Female 92%
Person 98.5%
Person 98.3%
Person 94.4%
Person 92%
Person 82.5%
Woman 98.5%
Woman 98.3%
Woman 92%
Child 94.4%
Girl 94.4%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man and woman in a white dress -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image is a painting depicting four figures dressed in period clothing. One figure stands on the left, resting their head on a stone ledge, dressed in a yellowish outfit with red leggings. The central figure wears a white gown, while the two other figures are dressed in Renaissance-style attire, with one in a pink voluminous sleeve dress and the other in green and gold garments. In the background, there is a glimpse of the sky and a balustrade or railing. The scene appears to be set in an outdoor or veranda-like space.

Created by gpt-4 on 2024-01-25

The image appears to be a classic painting depicting a scene with three individuals in an interior space that opens to a balcony with a view of the sea. On the left, a young child dressed in a yellow outfit with red accents leans tiredly against a wall, possibly dozing off. The child's face rests on their left arm while the right arm dangles lifelessly by their side, showcasing bright red stockings and brown shoes.

To the right, two other figures are present, one in a white gown, the other in a yellow-greenish dress. The figure in white stands on the balcony, with hands placed near the waist, facing the sea. The other figure's posture indicates a possible interaction of looking outward, yet details are unclear due to the standing position.

Behind these figures, the right side of the painting reveals a seaside landscape visible through the balcony, featuring a vast sky with gentle clouds and a calm sea. A part of a railing is also discernible, hinting at a higher vantage point. The overall scene is composed with a blend of realism and impressionistic touches, captured through free brushwork that evokes a sense of fleeting moments and emotions.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a scene from what appears to be a historical or theatrical setting. In the center, a woman is seated on a chair, wearing an ornate, red robe. She is surrounded by several other figures, including a younger woman in a white dress and another woman in a yellow dress. The background features a dark, wooden wall and a nighttime landscape visible through a window. The overall composition and the detailed costumes and setting suggest this is a painting from a period setting, though I cannot identify any specific individuals shown.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image depicts a painting of a group of people in Renaissance attire, with a man and woman at the center. The man is dressed in a red tunic and black hat, while the woman wears a white dress. To their left stands another woman in a yellow dress, and behind them are two men, one wearing an orange hat and the other a green tunic. On the far left, a young boy leans against a wall, clad in a yellow tunic and red stockings.

In the background, a blue sky with clouds is visible, suggesting that the scene takes place outdoors. The overall atmosphere of the painting appears to be one of elegance and refinement, with the characters' elaborate clothing and dignified poses contributing to this impression.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a painting of a group of people in Renaissance attire, with the focus on a woman in a white dress and a man in a red shirt. The woman is standing on a staircase, holding the hand of the man, who is dressed in a red shirt and black hat. To her left, a man in a yellow shirt and red tights is leaning against the wall, while to her right, a woman in a green dress and a man in a yellow shirt are standing together. In the background, a blue sky with clouds can be seen through a window.

This painting is likely a work by Edgar Degas, a French artist known for his Impressionist and Realist works. The style of the painting, with its focus on everyday life and the use of muted colors, is characteristic of Degas' work. The painting may be titled "The Balcony" or "The Staircase," although the exact title is not certain.

Overall, the image presents a serene and intimate scene of people interacting in a domestic setting, with a focus on the relationships between the individuals depicted. The use of muted colors and the emphasis on everyday life give the painting a sense of realism and authenticity.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a scene from William Shakespeare's play "Romeo and Juliet." The painting captures a moment in the balcony scene, where Juliet is on her balcony, and Romeo is below her, unseen. Juliet is depicted as a young woman in a white gown, standing on a balcony with a railing. She is looking down, lost in thought, and appears to be contemplating her feelings for Romeo. In the background, there are other characters, including a woman in a yellow dress and a man in a red hat, who are engaged in conversation. The painting is set against a backdrop of a blue sky with clouds, adding to the romantic and poetic atmosphere of the scene. The use of light and shadow in the painting creates a sense of depth and drama, emphasizing the emotional intensity of the moment. Overall, the image captures the essence of the balcony scene and the love story between Romeo and Juliet.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a scene with a group of people, possibly in a palace. A man in the middle is holding the hand of a woman standing next to him. The woman is wearing a white dress, while the man is wearing a red outfit. Another woman is standing next to them. On the left, a child is leaning on the pillar, and another woman is standing behind them. In the distance, there is a sea.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here is a description of the image:

The image is a painting that appears to depict a scene from a historical play or story, likely set in the Renaissance era. It is a medium shot, with a palette of muted, warm colors and a brushstroke style that suggests a work of art.

The focal point of the painting features several figures. A woman in a white gown is the central figure, standing on a raised platform, the hem of her dress flows down and touches the ground. She has long, flowing hair and seems to be the object of attention.

To the left of the woman stands a man wearing a rose-colored outfit with a red cap. He looks to be in conversation with the woman. Behind the couple, other figures can be seen in the background, also dressed in period clothing. There is a sense of them eavesdropping or observing the main interaction.

To the lower left, a young boy in a gold-colored outfit, leaning against the wall appears to be weary or asleep, which could suggest the scene is prolonged or tiring for him.

The background consists of a dark, wooden wall that transitions into a balcony with a view of a calm sea or lake under a cloudy sky, adding to the scene's depth and setting. The painting has a theatrical quality to it, with figures arranged on a stage-like setting. A deep red, draped fabric adds an element of drama to the scene.

Created by gemini-2.0-flash-lite on 2025-04-26

The image is a painting depicting a scene with several figures in Renaissance-style clothing. The focal point appears to be a woman in a white gown, standing on a raised platform or balcony with a man in a pink doublet and red pants. They are positioned close together, with the man gesturing slightly towards her.

Behind them, another woman in a yellow gown and a man with a red hat stand on the balcony, suggesting they are observers of the scene.

To the left, a young person is leaning against a pillar or wall, dressed in a costume with a peach-colored top and a flared skirt, and wearing bright red stockings.

The background shows a glimpse of a seascape through an open doorway. The style suggests an artistic rendering with visible brushstrokes and a focus on light and shadow, which could mean the artist was influenced by Romanticism.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image is a painting that depicts a scene from what appears to be a Renaissance or early modern period. It features several figures dressed in elaborate, period-appropriate attire, suggesting a scene of nobility or high society.

  1. Setting: The scene takes place indoors, possibly in a palace or a grand house, indicated by the rich drapery and the presence of a window showing a seascape in the background.

  2. Figures:

    • Central Figure: A man dressed in a red and gold outfit stands in the center. He is wearing a black hat and appears to be engaged in conversation or interaction with a woman in a white dress.
    • Woman in White: The woman in the white dress is standing to the right of the central figure. She has her back to the viewer and seems to be facing the central figure.
    • Child: A young child in the foreground is leaning against a wall or a piece of furniture, dressed in white and orange clothing. The child appears to be asleep or resting.
    • Background Figures: Two additional figures are visible in the background. One is dressed in red and appears to be a cardinal or a high-ranking clergy member, while the other is a woman in a yellow dress who is engaged in conversation with the clergy member.
  3. Details: The painting is rich in detail, with intricate clothing, expressive poses, and a sense of depth created by the positioning of the figures and the use of light and shadow.

  4. Mood: The overall mood of the painting is one of intrigue and elegance, with a sense of narrative that invites the viewer to speculate about the relationships and conversations between the figures.

The painting showcases the artist's skill in capturing the nuances of human interaction and the opulence of the period.