Human Generated Data

Title

Saint Jerome, with Saints Christopher and Louis of Toulouse, after Bellini

Date

1889

People

Artist: Joseph Lindon Smith, American 1863 - 1950

Artist after: Giovanni Bellini, Italian c. 1459 - 1516

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.127

Human Generated Data

Title

Saint Jerome, with Saints Christopher and Louis of Toulouse, after Bellini

People

Artist: Joseph Lindon Smith, American 1863 - 1950

Artist after: Giovanni Bellini, Italian c. 1459 - 1516

Date

1889

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.127

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Art 99.8
Painting 99.8
Person 98
Human 98
Person 96.1
Building 65.8
Architecture 61.7
Archangel 55.3
Angel 55.3

Clarifai
created on 2019-05-31

painting 99.8
art 99.8
religion 99.6
saint 99.6
god 98.8
aura 98.7
church 97.8
Mary 97.3
holy 97.3
virgin 96.8
fresco 96.4
book 96.2
religious 95.8
chapel 95.2
Renaissance 94.9
illustration 94.9
sacred 94.6
spirituality 94.6
people 94.5
interior 93

Imagga
created on 2019-05-31

sculpture 58.8
altar 57.9
art 47.7
carving 47.6
structure 44.3
religion 43
temple 35.2
church 30.5
ancient 26.8
culture 25.6
religious 25.3
old 25.1
statue 23.7
architecture 22.8
god 22
plastic art 21.9
painter 21.8
holy 20.2
icon 19.8
history 18.8
decoration 18.4
historic 18.3
spirituality 18.2
faith 18.2
travel 17.6
figure 16.7
antique 15.9
bible 15.7
museum 15.7
gold 15.6
sacred 15.6
spiritual 15.4
vintage 14.9
prayer 14.5
saint 14.4
painted 14.3
masterpiece 13.8
golden 13.8
symbol 13.5
graffito 13.5
historical 13.2
renaissance 12.8
pray 12.6
letter 11.9
postmark 11.8
postage 11.8
stamp 11.6
worship 11.6
mail 11.5
mosaic 11.5
post 11.4
door 11.4
stone 11.4
face 11.4
detail 11.3
monument 11.2
east 11.2
colorful 10.8
belief 10.7
artist 10.6
building 10.4
column 10.3
design 10
landmark 9.9
shows 9.9
printed 9.8
bangkok 9.8
postal 9.8
paintings 9.8
envelope 9.7
one 9.7
palace 9.6
unique 9.5
tourism 9.1
post mail 8.9
zigzag 8.9
fame 8.9
known 8.9
oriental 8.8
catholic 8.8
delivery 8.8
cutting 8.7
communications 8.6
fine 8.6
black 8.4
color 8.3
traditional 8.3
artwork 8.2
global 8.2
paint 8.2
man 8.1
monastery 8.1
stamps 7.9
praying 7.8
cathedral 7.8
letters 7.7
heritage 7.7
famous 7.4
closeup 7.4
ornate 7.3
office 7.2
interior 7.1

Google
created on 2019-05-31

Microsoft
created on 2019-05-31

text 96.9
drawing 96.7
book 91.9
person 84.2
old 70.6
painting 69.7
picture frame 59
sketch 58.7
painted 26

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 83.8%
Confused 1.3%
Disgusted 55.5%
Calm 27.9%
Angry 1.3%
Sad 7.3%
Happy 4.9%
Surprised 1.8%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Surprised 45.1%
Confused 45.1%
Disgusted 45.1%
Happy 45.2%
Sad 46.3%
Calm 53%
Angry 45.1%

AWS Rekognition

Age 48-68
Gender Male, 54.4%
Calm 46.9%
Disgusted 45.4%
Confused 45.3%
Surprised 45.3%
Happy 49.5%
Sad 47.1%
Angry 45.5%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.8%
Person 98%
Person 96.1%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created by unknown on 2019-05-31

a painting of a person 82.7%
a painting of a person 77.3%
a painting of a book 56.9%

Clarifai
created by general-english-image-caption-blip on 2025-05-14

a photograph of a painting of a man with a sword and a sword -100%

OpenAI GPT

Created by gpt-4 on 2025-03-07

The image depicts a painting with a Renaissance or classical style. The setting seems to be an arched stone structure that frames a landscape scene in the background, with clear skies and foliage. In the foreground, within the architecture, there appears to be an interior space with ornate design elements, including columns and what could be depictions of doors or panels.

To the left, we see a standing figure draped in what looks like a classical robe, appearing to lean on a staff or a walking stick. The attire and pose suggest a person of significance or wisdom, possibly a philosopher or a hermit in contemplation or teaching.

On the right, there is another figure adorned with intricate garments indicative of wealth or high status, potentially religious or royal, holding an object that might be a scepter or a ceremonial staff. This figure stands beside a pillar within the interior space, seemingly opposite the first figure, creating a visual balance in composition.

The overall artwork carries a historical or religious narrative vibe, typical of paintings from periods where such themes were prevalent in art. Elements of the painting, like clothing, architecture, and accessories, hold symbolic significance, pointing to a detailed scene with potentially allegorical or historical references.

Created by gpt-4o-2024-05-13 on 2025-03-07

This image depicts a religious scene set within an architectural frame featuring an archway. The vivid blue sky and distant landscape form the background. The scene appears to be taking place outdoors, with lush greenery and natural elements visible. Two figures dressed in elaborate, colorful robes and ecclesiastical attire stand on either side of the archway. One holds a staff, while the other carries a book and a crosier, hinting at their religious significance and roles. The central figure is seated on what seems to be a raised platform, contributing to the serene and contemplative atmosphere of the composition. The use of rich, earthy colors adds depth and warmth to the image.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-01-15

This appears to be a religious painting, likely a fresco or tempera work from the Renaissance period. The composition shows several figures arranged under an arched doorway or entrance. On the right stands a bishop or church official wearing formal religious vestments in green and red, holding a staff and book. On the left is a figure in simpler clothing holding a long staff or pole. Above them, seated on what appears to be a rocky outcrop or elevated position, is another figure in red and light-colored robes.

The scene is set against a background with a turquoise sky and distant landscape with mountains or hills. The architectural framing includes a decorative arch with some ornamentation at the top. The color palette consists predominantly of reds, greens, and earth tones, with that distinctive turquoise blue sky creating a striking contrast.

The style and composition are typical of religious art from this period, with its hierarchical arrangement of figures and symbolic religious elements. The painting appears to be depicting a scene from Christian religious history or hagiography (the study of saints' lives).

Created by claude-3-opus-20240229 on 2025-01-15

The image depicts a religious scene, likely from the Bible, painted in a Renaissance or Baroque style. On the left, a man in red and green robes stands reaching up towards a tree branch. In the center, another figure in a red robe and hat stands atop a small stone structure, also gesturing towards the tree. The background shows a landscape with hills, trees and a blue sky. The painting has an arched frame with intricate patterns and designs around the edges. The colors are rich and vibrant, giving the scene a sense of drama and importance. Based on the religious subject matter and artistic style, this appears to be a significant work of art from several centuries ago depicting a well-known biblical narrative.

Created by claude-3-haiku-20240307 on 2025-01-15

The image appears to be a painting depicting a religious or biblical scene. It shows a central figure, likely Jesus Christ, standing in an archway or portal, surrounded by several other figures. The figures are dressed in ornate and colorful robes, and the scene is set against a landscape with trees and mountains in the background. The painting has a vibrant and expressive style, with bold colors and dynamic brushstrokes. Overall, the image seems to be a representation of a significant religious or historical event.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-15

The image depicts a painting of four figures, including two saints and two other individuals, set within an arched doorway. The scene is rendered in muted colors, with the figures standing in front of a landscape backdrop.

In the foreground, the figure on the left is depicted as a bearded man wearing a red robe, holding a staff in his right hand and a baby in his left arm. To his right stands another bearded man, dressed in a white robe and red cape, seated on a rocky outcropping. Behind him, a third figure is visible, clad in a green robe and gold hat, grasping a staff in his right hand and holding a book in his left. The fourth figure, positioned to the right of the central group, wears a green robe and gold hat, holding a staff in his right hand and a book in his left.

The background of the painting features a serene landscape, complete with trees, mountains, and a blue sky dotted with clouds. The overall atmosphere of the image exudes a sense of tranquility and reverence, suggesting that it may be a religious or devotional artwork.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-01-15

The image is a painting of a scene featuring three men and a child. The man on the left is dressed in a brown robe, holding a staff, and appears to be looking up at the child. The child is positioned on a ledge or platform, seemingly gazing at the man on the left. The man on the right wears a red and gold robe, holding a staff and a book, and is positioned in front of a doorway. The background of the painting features a landscape with mountains, trees, and a blue sky.

This description provides a detailed account of the scene depicted in the painting, highlighting the key elements and figures present in the image.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-15

The image depicts a painting that features a man holding a child on his shoulder. He is standing next to another man, possibly a bishop, who is wearing a mitre and holding a crosier. Behind them is a stone archway with a carving of a man sitting on a rock, possibly Jesus Christ. The painting is in a vintage style, with a watermark in the bottom right corner.

Created by amazon.nova-lite-v1:0 on 2025-01-15

The image is a painting depicting a scene with three figures. The central figure is a man dressed in a red and white robe, seated on a stone pedestal. He is holding a book and appears to be in a contemplative pose. To his left stands a man holding a staff and carrying a child on his shoulder. To the right, another man dressed in a green and red robe, holding a staff and a book, is looking at the central figure. Behind them is an archway with a painting of a tree and a landscape, and the archway is framed by a decorative border.

Created by amazon.nova-lite-v1:0 on 2025-01-10

This image is a painting of a scene from the life of St. Nicholas, a prominent figure in Christian tradition. The painting depicts St. Nicholas, dressed in his bishop's attire, standing on the right side of the image. He is holding a book and a staff, symbols of his ecclesiastical authority and spiritual guidance. On the left side of the image, a man is carrying a child on his shoulders, likely representing a scene from St. Nicholas's life where he saved a child from drowning. Behind them, there is an archway with a painting of St. Nicholas sitting on a rock, possibly symbolizing his spiritual journey or his role as a protector of the innocent. The painting is framed in a dark brown border, adding to its artistic and historical significance.

Created by amazon.nova-pro-v1:0 on 2025-01-10

The painting depicts a scene with several people. In the foreground, there are two men standing on either side of a stone structure. One of them is holding a child. Above them, there is a man with a long beard sitting on the stone structure. The man is wearing a red robe and a green shirt. He is holding a scroll and a staff. The painting has a watermark with the text "John Linnell 1844" in the bottom right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

The image is a watercolor painting that features three figures arranged in a tiered composition, all framed within an arch.

At the bottom left stands a man with dark skin, wearing a reddish-brown cloth draped around his lower body, and he's barefoot. He holds a staff, and a child is perched on his shoulder.

To the right of this figure, in the lower right of the painting, is a figure adorned in the attire of a bishop. This figure wears a tall mitre on their head, a book in one hand, and holds a staff with an ornate emblem in the other.

Above them, in the backdrop and framed by the arch, an elderly man with a long beard is seated in what appears to be a mountainous landscape. He is clad in robes and appears to be writing or reading. A tree and a serene pink-tinged sky with gentle clouds are visible in the background behind him.

The arch framing the scene is decorated with an inscription and a circular emblem at the top, adding to the overall religious and historical context of the painting. The colors used are warm and earthy, and the painting seems to have an aged quality. At the bottom right of the image, a signature is visible, reading "Joseph Linden Smith".

Created by gemini-2.0-flash-lite on 2025-05-08

Here is a description of the image:

This is a watercolor painting with a biblical or religious theme. The composition is structured with a layered, almost theatrical quality.

Foreground:

  • On the left, a man with dark skin and a beard is depicted, wearing a loose reddish robe and a white shirt. He carries a stick and a child is on his shoulder. He has a serious expression and looks upwards.
  • On the right, a bishop-like figure is presented. He is wearing an elaborate gold and white hat, a red sash or stole, and a green and gold embroidered vestment. He holds a staff with a decorative top and a small book or tablet. He has a composed and serious expression.

Midground:

  • A raised platform or architectural element provides a backdrop for the figures. Behind this is a landscape and under an archway.

Background:

  • Inside an arched opening, a bearded man in a red robe is seated. He is writing or reading from a book. He appears to be in a natural setting, perhaps a hillside, and the background contains a landscape of rolling hills.

Overall:

  • The painting has a classical, somewhat Renaissance-influenced style.
  • The colors are muted with a range of earthy tones, soft blues, and golden hues.
  • The artwork is detailed, with particular attention to the facial expressions and the draping of the robes.
  • The composition is carefully structured to guide the viewer's eye through different layers. The setting suggests a spiritual narrative.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

The image depicts a religious scene, likely from the Renaissance period, featuring three figures. The setting appears to be a landscape viewed through an archway, with a serene sky and distant hills in the background.

  1. Left Figure: A man carrying a large wooden cross. He is barefoot and dressed in a draped garment. This figure is likely meant to represent Jesus Christ carrying the cross, a common depiction in Christian art.

  2. Center Figure: A bearded man in a red cloak, seated on a rocky outcrop. He is holding a book and appears to be in a contemplative pose. This figure could represent a saint or a biblical prophet, given the traditional attire and the presence of the book, which might symbolize scripture or wisdom.

  3. Right Figure: A figure dressed in elaborate, colorful robes and a mitre, holding a crosier (a staff with a hooked top). This figure is likely a bishop or a high-ranking cleric, given the ecclesiastical attire and the crosier, which is a symbol of pastoral office.

The overall composition and the use of rich colors and detailed attire suggest that this painting is part of a religious narrative, possibly illustrating a scene from the Bible or the lives of saints. The archway framing the scene adds depth and draws the viewer's attention to the central figures.