Human Generated Data

Title

Miracle of Saint Mark (left plate)

Date

18th century

People

Artist: John Baptist Jackson, British 1701 - 1780

Artist after: Jacopo Tintoretto, Italian 1519 - 1594

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R7528

Human Generated Data

Title

Miracle of Saint Mark (left plate)

People

Artist: John Baptist Jackson, British 1701 - 1780

Artist after: Jacopo Tintoretto, Italian 1519 - 1594

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R7528

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Painting 99.4
Art 99.4
Person 85
Human 85
Angel 58.5
Archangel 58.5

Clarifai
created on 2023-10-27

art 99.9
baroque 99.1
Renaissance 97.7
people 97
painting 96.9
religion 96.7
group 96.3
saint 95.8
sword 95.8
man 94.6
woman 94.1
god 93.4
ancient 92.4
veil 92.3
nude 92
sculpture 91.9
illustration 91.4
print 89.9
Gothic 88.8
allegory 88.1

Imagga
created on 2022-01-23

sculpture 100
carving 73.5
statue 53.2
art 52.7
architecture 44.2
plastic art 34.7
monument 34.6
column 33.5
history 32.3
culture 31.7
stone 31.2
ancient 29.5
temple 28.9
religion 27.8
figure 26.8
landmark 24.4
god 24
old 23.7
famous 23.3
tourism 21.5
fountain 21.1
city 20.8
building 20
travel 19.8
religious 18.8
marble 17.9
historical 17
structure 16.9
decoration 16.8
palace 16.7
carved 16.7
tourist 16.3
detail 16.1
statues 14.8
church 13.9
historic 13.8
antique 13.6
support 13.5
sculptures 12.9
holy 12.5
museum 12
mythology 11.8
traditional 11.7
face 11.4
golden 11.2
gold 10.7
king 10.7
worship 10.7
heritage 10.6
spiritual 10.6
spirituality 10.6
style 10.4
exterior 10.2
facade 10.1
symbol 10.1
roman 10
baroque 9.8
catholic 9.7
bracket 9.6
artistic 9.6
east 9.4
corbel 9.2
design 9
century 8.8
attraction 8.6
wall 8.6
oriental 8.5
head 8.4
arch 8.4
altar 8.2
water 8
holiday 7.9
royal 7.7
door 7.6
details 7.6
decorative 7.5
ornate 7.3
bronze 7.2
relief 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 100
book 99.8
drawing 97.1
sketch 91.1
illustration 90.9
person 88.4
cartoon 86.2
clothing 81
old 78.4
painting 77.1
engraving 65.1
poster 56.4
vintage 49.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Female, 62.1%
Calm 85.4%
Angry 6.9%
Disgusted 4.2%
Sad 1%
Confused 0.9%
Happy 0.8%
Surprised 0.6%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 83.8%
Calm 98%
Fear 0.8%
Happy 0.6%
Disgusted 0.2%
Angry 0.1%
Sad 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 28-38
Gender Male, 90%
Calm 93.5%
Confused 1.9%
Fear 1.3%
Sad 1.2%
Surprised 1%
Angry 0.5%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 16-24
Gender Female, 98.5%
Calm 97.9%
Sad 0.7%
Fear 0.5%
Disgusted 0.4%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Happy 0.1%

Feature analysis

Amazon

Painting
Person
Painting 99.4%
Person 85%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-15

a photograph of a painting of a man in a suit and a woman in a dress -100%

OpenAI GPT

Created by gpt-4 on 2024-12-23

The image displays a chaotic and dramatic scene depicted in a style reminiscent of classical or Renaissance art. A group of people is gathered in what appears to be an interior space with classical architectural elements, such as columns and arches. The expressions on the faces of the individuals and their gesturing hands suggest a moment of intense activity or confrontation.

Several characters in the scene are dressed in attire that could signify a historical or allegorical context. Some are wearing armor, suggesting they might be soldiers or warriors. A figure in the foreground is slumped on the ground, implying they may have collapsed or been struck down. The overall composition, with its many dynamic angles and movements, conveys a sense of urgency and tumult.

The artwork includes intricate details in the clothing, the architectural elements, and the physiques of the individuals portrayed. Despite the motion implied in the scene, each character is rendered with careful attention to detail which adds to the intensity and emotional impact of the scene.

Created by gpt-4o-2024-05-13 on 2024-12-23

The image is a detailed, classical scene featuring a number of dramatic figures. It includes dynamic human forms, depicting a sense of intense action and emotion. There are various elements such as individuals in robes and head coverings, some of whom appear to be aiding or confronting others. The scene takes place against the backdrop of large architectural columns and pillars, suggesting a historical or ancient setting. The composition is filled with movement and tension, with one figure lying on the ground while others appear to be actively engaged above and around him. The overall atmosphere is chaotic and intense.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-23

The image appears to depict a religious or historical scene, with a large group of figures gathered around a central figure. The style seems to be from an earlier period, with a dramatic and intense rendering of the scene. The image is in a sepia or monochrome tone, giving it an aged and somber appearance. While there are many human figures present, I will refrain from identifying or naming any of them specifically, as per the instructions provided.

Created by claude-3-5-sonnet-20241022 on 2024-12-23

This appears to be a historical artistic print or engraving in sepia tones depicting a dramatic scene. The composition shows a chaotic moment inside what appears to be a classical building with columns. There's a crowd of figures in period clothing, some appearing to be in distress or conflict. The architectural setting includes tall columns and what looks like an interior space. In the upper right portion of the image, there's a figure shown in an unusual position, possibly falling or floating. The style and composition suggest this might be depicting a historical or religious event. The clothing and architectural elements appear to be from several centuries ago. The image has a dynamic, swirling quality to its composition, with figures arranged in various poses creating a sense of movement and tension.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-23

The image depicts a scene from the biblical story of Jacob's Ladder, as illustrated by Rembrandt van Rijn in 1634. The painting is titled "Jacob's Ladder" and is part of the collection at the Rijksmuseum in Amsterdam.

In the foreground, Jacob is shown lying on the ground, surrounded by his family and servants. He is holding onto a ladder that stretches up to heaven, where angels are descending and ascending. The ladder is depicted as a central element, symbolizing the connection between heaven and earth.

The background of the painting features a cityscape with buildings and trees, which adds depth and context to the scene. The overall atmosphere of the painting is one of drama and tension, as Jacob struggles to maintain his grip on the ladder.

Rembrandt's use of light and shadow creates a sense of depth and dimensionality, drawing the viewer's eye to the central figure of Jacob. The painting's composition and use of color are characteristic of Rembrandt's style, which is known for its emotional intensity and dramatic flair.

Overall, "Jacob's Ladder" is a powerful and evocative painting that captures the essence of the biblical story. It is a testament to Rembrandt's skill as an artist and his ability to convey complex emotions and themes through his work.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image is a sepia-toned illustration of a chaotic scene, likely depicting a biblical event. The scene is set in a grand, ornate building with columns and arches, suggesting a temple or palace.

In the foreground, a group of people are gathered around a central figure, who appears to be lying on the ground. The figure is surrounded by several others, some of whom are kneeling or standing over them. The atmosphere is one of urgency and concern, as if the people are trying to help the fallen individual.

To the left of the central figure, a man is standing on a pedestal, looking down at the scene below. He is dressed in a long robe and has a serious expression on his face. Behind him, a large column rises up, supporting the roof of the building.

On the right side of the image, a group of people are gathered around a window, looking out at something outside. They appear to be watching a scene unfold, possibly a battle or a procession.

In the background, the sky is visible through the windows and arches, adding to the sense of depth and perspective in the image. The overall effect is one of drama and tension, as if the scene is about to unfold into something more significant.

The illustration style is reminiscent of 17th-century engravings, with intricate details and textures that give the image a sense of age and authenticity. The use of sepia tones adds to the nostalgic feel, evoking a sense of history and tradition.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-02-27

The image depicts a scene from the Bible, specifically the story of the Massacre of the Innocents, where King Herod ordered the killing of all male infants in Bethlehem to eliminate the newborn Jesus. The image is a vintage artwork with a brown and white color scheme. It shows a group of people gathered in a room, with some lying on the floor and others standing. Some of them are holding weapons, and there are two people standing on the left side of the image.

Created by amazon.nova-lite-v1:0 on 2025-02-27

The image is a historical painting depicting a scene from the martyrdom of St. James the Greater. The painting is set in a grand, ornate room with a high ceiling, featuring intricate architectural details. In the foreground, a group of people are gathered around a central figure who is lying on the ground, appearing to be in a state of agony or death. The central figure is St. James, who is being stoned to death by a crowd of people. The crowd is diverse, with individuals wearing various types of clothing and headgear, reflecting the multicultural setting of the scene. In the background, there is a figure of a man standing on a column, possibly representing a Roman soldier or a figure of authority. The painting is framed in a sepia tone, giving it an antique and historical feel.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

The image is an engraving of a religious or historical scene.

In the top right corner, a figure is depicted falling from the sky, surrounded by a bright light or cloud.

The central portion of the engraving shows a large group of people in various poses of shock and supplication. Some are kneeling, some are prostrate on the ground, and others are leaning forward or turning away in apparent distress. The figures are clothed in a variety of garments, which appear to be historical in nature.

To the left, there is a column or pillar of a building, with figures standing on or near it, watching the scene unfold. The background includes a glimpse of what appears to be a building with windows and a strong light emanating from it.

In the bottom left corner, there is text, which is part of the engraving.

Created by gemini-2.0-flash-lite on 2025-05-08

This appears to be an old engraving or etching, rendered in sepia tones. It depicts a dramatic scene with numerous figures, likely a historical or religious narrative. Here are some observations:

  • Scene: The scene seems to take place in an architectural setting with columns and a building in the background. There's a sense of a crowd gathered around figures, some of whom are in distress.
  • Figures: Several figures are actively engaged in the action. One prominent figure appears to be falling from the sky. Others are kneeling, reaching, or attending to those on the ground. The figures are dressed in period clothing, likely indicative of the time period in which the scene is set.
  • Light and Shadow: The light source seems to be emanating from the upper right corner of the image, where a bright burst of light is visible, highlighting some of the figures and casting shadows.
  • Composition: The composition is dynamic, with figures in motion and a clear focal point near the bottom center of the image.
  • Technique: The artwork appears to be created using etching or engraving techniques, judging from the fine lines and the use of hatching to create tone and texture.
  • Details: On the lower left side of the image, some text is visible, probably the name of the artist.

Based on these observations, the image likely represents a significant historical or religious event, possibly involving some form of divine intervention or revelation, judging by the figure falling from above. It is also possible that the subject may reference a scene in which someone is martyred. The exact subject could likely be identified by researching the artist and the context of the text, or by consulting with an art expert.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a dramatic and chaotic scene, likely from a historical or religious context, rendered in a sepia tone. The setting appears to be an interior space, possibly a temple or a palace, with architectural elements such as columns and arches visible in the background.

In the foreground, a group of people is engaged in a violent confrontation. Several figures are armed with swords and other weapons, and some are in the midst of combat. One person is seen falling or being pushed to the ground, while others are in dynamic poses, suggesting movement and struggle.

In the background, a figure is seen standing on a raised platform, possibly addressing or observing the scene below. Above this figure, there is a celestial element, with clouds and a radiant light, suggesting a divine or supernatural presence.

The overall mood of the image is intense and tumultuous, conveying a sense of conflict and drama. The detailed rendering of the figures and the use of light and shadow add to the dramatic effect of the scene.

Text analysis

Amazon

EDUARDO
Jacobi
vel
Robusti
in
.ab
EDUARDO WEIGHT.
soliertissimo
300 Jacobi Robusti
COG
adidas vel soliertissimo
WEIGHT.
Artium
Arm
interella
et
rectarion opus in
milerarin, Artium COG
D
NCB .ab
communiter interella
opus
DX
Per Mustri DX D
Arm rolo,
the et
communiter
Per Mustri
milerarin,
adidas
300
rectarion
the
rolo,
NCB

Google

Perlllustri D D EDUARDO WEKGHT Arnolo, lerarin rtum e trori vel soliertiama Jacobi Robusti miniter lintorcike
Perlllustri
D
EDUARDO
WEKGHT
Arnolo,
lerarin
rtum
e
trori
vel
soliertiama
Jacobi
Robusti
miniter
lintorcike