Human Generated Data

Title

Saint Mark Rescuing a Slave, after Tintoretto

Date

1892

People

Artist: Robert David Gauley, American 1875 - 1943

Artist after: Jacopo Tintoretto, Italian 1519 - 1594

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.353

Human Generated Data

Title

Saint Mark Rescuing a Slave, after Tintoretto

People

Artist: Robert David Gauley, American 1875 - 1943

Artist after: Jacopo Tintoretto, Italian 1519 - 1594

Date

1892

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.353

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Art 99.9
Painting 99.9
Human 68.1
Person 68.1
Person 66.1
Mural 55.2
Person 45.4

Clarifai
created on 2019-11-09

people 99.8
painting 99.8
group 99.5
art 99.5
adult 98.9
religion 98.6
illustration 98.5
woman 96.4
wear 96.3
child 95
veil 94.4
man 93.1
many 92.9
kneeling 92.3
dancing 88.9
war 87.8
recreation 86.4
baby 85.1
flame 85
Renaissance 84.2

Imagga
created on 2019-11-09

graffito 89.5
comic book 87.2
decoration 61.4
print media 34.9
art 28.7
grunge 17.9
light 16.7
design 16
old 15.3
color 15
church 14.8
religion 14.3
silhouette 13.2
wall 12.8
man 12.1
artwork 11
figure 10.9
dark 10.9
painting 10.8
black 10.8
bible 10.8
people 10.6
graphic 10.2
dirty 9.9
night 9.8
lantern 9.8
detail 9.7
dance 9.5
colorful 9.3
texture 9
style 8.9
pattern 8.9
disco 8.7
saint 8.7
faith 8.6
party 8.6
friends 8.5
window 8.2
ancient 7.8
travel 7.7
person 7.7
drawing 7.7
holy 7.7
cathedral 7.7
god 7.7
religious 7.5
city 7.5
group 7.2
paint 7.2
music 7.2
architecture 7

Google
created on 2019-11-09

Microsoft
created on 2019-11-09

drawing 98.6
text 97.3
indoor 91
art 86.1
person 73.2
cartoon 68.9
sketch 56.9
painting 50.8
painted 28.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 35-51
Gender Male, 54.4%
Angry 45.1%
Fear 45%
Confused 45%
Sad 50.7%
Happy 45%
Calm 49.2%
Surprised 45%
Disgusted 45%

AWS Rekognition

Age 38-56
Gender Male, 52.3%
Calm 45.3%
Angry 45.1%
Confused 45.1%
Happy 45.1%
Sad 52.4%
Surprised 45.1%
Disgusted 45%
Fear 46.9%

AWS Rekognition

Age 25-39
Gender Female, 51.4%
Fear 45%
Sad 45.2%
Happy 45%
Disgusted 45.1%
Confused 45%
Calm 45.6%
Surprised 45%
Angry 54%

AWS Rekognition

Age 40-58
Gender Male, 52.8%
Surprised 45%
Calm 45.1%
Angry 45.1%
Fear 45.6%
Happy 45%
Disgusted 45%
Sad 54.2%
Confused 45%

AWS Rekognition

Age 24-38
Gender Male, 54.6%
Calm 47.4%
Angry 50.2%
Happy 45.1%
Confused 45.2%
Disgusted 45.1%
Fear 45.1%
Surprised 45.1%
Sad 46.7%

AWS Rekognition

Age 35-51
Gender Female, 50.1%
Surprised 45%
Angry 45.3%
Confused 45%
Happy 45%
Disgusted 45%
Sad 54.6%
Fear 45%
Calm 45.1%

AWS Rekognition

Age 36-54
Gender Male, 54.9%
Fear 54.5%
Sad 45%
Confused 45%
Angry 45.1%
Disgusted 45%
Calm 45%
Happy 45.1%
Surprised 45.1%

Feature analysis

Amazon

Painting
Person
Painting 99.9%
Person 68.1%
Person 66.1%
Person 45.4%

Captions

Microsoft
created on 2019-11-09

a painting on the wall 62.3%
a painting of a person 50.4%
a painting on a wall 50.3%

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a painting of a man on a horse -100%

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image depicts an intricate oil painting featuring a dramatic scene. It is set in a historical context, likely biblical, considering the traditional attire of the figures and the classical architectural elements present. The color palette is rich with deep reds, somber greens, and muted earth tones, contributing to the overall seriousness of the scene.

There are numerous figures in the painting, displaying a range of dynamic actions and emotional expressions. The characters are clothed in garments that suggest different statuses and roles, with some wearing elaborate headgear such as turbans. On the right-hand side, a character in a red robe appears to be commanding attention, possibly in a position of authority.

The setting of the artwork seems to be outdoors, as indicated by a glimpse of a pastoral landscape in the background. The scene appears to be a critical moment, with gestures and interactions among the figures conveying tension or conflict. The painting is characterized by vigorous brushwork and a masterful use of chiaroscuro to enhance the dramatic effect.

Overall, the artwork is evocative and narrative-rich, inviting viewers to contemplate the story unfolding among the characters.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a classical religious or historical painting depicting a dramatic scene. The composition shows a large group of figures gathered around a central area where someone lies on the ground. Most notable is a figure suspended in mid-air or falling, wearing red/orange colored clothing, creating a striking visual element against the darker green background. The painting uses rich colors, particularly deep reds, greens, and golds, and appears to be created in a Renaissance or Baroque style. The setting seems to be architectural, with columns visible on the left side. The scene is full of movement and tension, with the gathered crowd's postures suggesting strong emotional reactions to whatever event is unfolding. The atmospheric quality and dramatic lighting contribute to the painting's intense mood and narrative quality.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a complex and dramatic scene with many figures engaged in what appears to be a religious or mythological event. In the center, there is a central figure suspended upside down, surrounded by a crowd of figures in elaborate robes and costumes. The background features a detailed landscape with architectural elements. The overall composition and use of color create a moody, intense atmosphere. Without identifying any individuals, the painting seems to convey a sense of spiritual or supernatural significance in the depicted event.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-28

The image depicts a painting of a chaotic scene, with a man suspended in mid-air and a crowd of people gathered around him. The man is dressed in a red robe and appears to be falling or being thrown from a height. He is surrounded by a group of people who are looking up at him in shock and horror.

In the background, there is a building with columns and arches, which suggests that the scene is taking place in an ancient or classical setting. The overall atmosphere of the painting is one of drama and tension, with the central figure of the falling man drawing the viewer's attention.

The painting style is reminiscent of Renaissance art, with bold brushstrokes and vivid colors used to create a sense of movement and energy. The use of chiaroscuro, a technique that uses strong contrasts between light and dark to create a sense of volume and depth, adds to the dramatic effect of the scene.

Overall, the image suggests that the painting is a depiction of a dramatic and intense moment, possibly from a mythological or biblical story. The use of classical architecture and the dramatic pose of the central figure suggest that the painting may be a representation of a famous scene from ancient history or literature.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a painting of a chaotic scene, with a large group of people in the foreground and a man suspended in mid-air above them. The man is dressed in a red robe and appears to be falling or being thrown, while the people on the ground are reacting with shock and alarm. Some are trying to catch the falling man, while others are running away in fear.

In the background, there is a building with a doorway and windows, as well as some trees and foliage. The overall atmosphere of the painting is one of drama and tension, with a sense of urgency and chaos.

The painting is rendered in muted colors, with shades of brown, green, and red dominating the palette. The brushstrokes are bold and expressive, with thick layers of paint creating a textured, almost three-dimensional effect.

Overall, the image suggests a dramatic and intense scene, possibly from a historical or biblical event. The use of muted colors and bold brushstrokes creates a sense of tension and drama, drawing the viewer's eye to the central figure of the falling man.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

This oil painting depicts a chaotic scene with multiple figures engaged in various actions. At the center, a man is performing a handstand, his body suspended in mid-air, drawing attention to his precarious position. Surrounding him, a crowd of people is depicted in a state of turmoil, with some figures falling and others reaching out in confusion or distress. The setting appears to be an outdoor area, possibly a marketplace or public square, indicated by the presence of architectural elements like columns and a distant building. The overall atmosphere is one of chaos and confusion, with the figures' expressions and body language conveying a sense of panic and urgency.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a painting depicting a scene of chaos and violence. It is a historical or religious painting, possibly representing a biblical event. The painting is composed of various figures, some of whom are engaged in violent acts. The central figure is a man who is being thrown into the air, possibly by a group of people. The man is wearing a robe and has a beard. The people around him are dressed in different clothing, and some are holding weapons. The background of the painting is a mix of green and brown, with a few trees and buildings visible. The painting is in a rectangular frame, and the edges are slightly worn, indicating that it is an old piece of art.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

The painting shows a chaotic scene with a large group of people in a crowded setting, depicted with an intense and dramatic style. The colors are rich and earthy, dominated by dark tones and a sense of turmoil. In the lower part of the painting, there is a figure lying on the ground. At the top of the image, there is a man falling upside down into the mass of people. To the right, a seated man in a red cloak observes the scene with a look of horror on his face.

Created by gemini-2.0-flash-lite on 2025-04-27

The image is a painting depicting a dramatic scene, likely from a historical or biblical narrative. It features a crowd of figures in a chaotic composition, rendered in a style that suggests a classical or Renaissance influence.

Key features and observations:

  • Central Action: The focal point appears to be a figure in the air, possibly falling or being thrown, dominating the upper portion of the painting. This figure is draped in a reddish-brown garment, creating a sense of dynamism and movement.
  • Figure Interactions: The bottom half of the painting is filled with a dense crowd of figures. Some are interacting with each other, while others seem to be reacting to the central figure's movement. The figures are wearing a variety of clothing and head coverings. There is a man lying on the ground, with people gathering near him.
  • Background: Behind the crowd, a building with classical architectural elements can be seen, suggesting a specific location, and a backdrop of trees are present, too.
  • Color Palette and Style: The painting utilizes a palette of warm, earthy tones—reds, browns, yellows, and greens dominate. The brushstrokes appear somewhat rough, contributing to the dramatic and emotional intensity of the scene. The painting style could be described as expressive, and potentially oil on canvas.
  • Mood/Interpretation: The scene evokes a sense of conflict, violence, or high drama. The artist effectively uses composition, figure placement, and color to convey the emotional impact of the event. The lighting and the downward movement of the central figure may suggest a moment of suffering or a climactic event.

Without knowing the exact subject matter, one can infer that the painting tells a story with a strong narrative component, highlighting moments of tension, action, and human interaction.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a dramatic and chaotic scene, likely from a historical or biblical narrative. The central figure appears to be a man suspended in the air, possibly being thrown or falling, which suggests a moment of intense action or violence. The surrounding figures are engaged in various activities, with some appearing to be in distress or conflict. The overall atmosphere is tense and turbulent, with a sense of urgency and disorder.

The background includes architectural elements, such as columns and buildings, which may indicate an urban setting. The color palette is dark and muted, with shades of brown, green, and red, contributing to the somber and intense mood of the scene. The painting style is reminiscent of Renaissance or Baroque art, characterized by its dramatic use of light and shadow, as well as the dynamic poses of the figures.