Human Generated Data

Title

Study for North Wall, Special Collection Hall, Boston Public Library

Date

1890 - 1895

People

Artist: John Singer Sargent, American 1856 - 1925

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Francis Ormond, 1937.215

Human Generated Data

Title

Study for North Wall, Special Collection Hall, Boston Public Library

People

Artist: John Singer Sargent, American 1856 - 1925

Date

1890 - 1895

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Francis Ormond, 1937.215

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Architecture 99.7
Building 99.7
Art 99.4
Apse 97.5
Church 65
Human 61

Clarifai
created on 2020-04-23

religion 99.9
church 99.9
painting 99.8
saint 99.7
art 99.7
fresco 99.6
cathedral 99.2
Mary 99.2
arch 99.1
architecture 98.7
spirituality 98.6
chapel 98.3
god 98.2
sacred 97.5
cross 97.4
mosaic 97.1
Byzantine 96.7
worship 96.7
Gothic 96.4
Renaissance 96.1

Imagga
created on 2020-04-23

altar 100
structure 100
church 60.2
architecture 57.4
cathedral 48.9
religion 47.6
building 37.1
old 34.2
historic 30.3
catholic 28.3
religious 28.2
arch 28
travel 27.5
window 26.3
landmark 26.2
art 25.3
history 25.1
city 21.7
ancient 21.7
monument 21.5
tourism 21.5
saint 21.2
holy 20.3
famous 19.6
entrance 19.4
historical 18.9
stone 18.6
facade 18.5
detail 17.7
sculpture 17.5
god 17.3
faith 16.3
culture 15.4
door 15.2
decoration 15.2
cross 15.1
chapel 14.7
sacred 14.6
interior 14.2
glass 14
worship 13.6
ceiling 12.8
st 12.6
vault 12.6
stained 12.5
spirituality 12.5
medieval 12.5
pray 11.7
prayer 11.6
spiritual 11.5
gold 11.5
tourist 10.9
catholicism 10.8
attraction 10.5
urban 10.5
style 10.4
exterior 10.2
roof 10.1
tower 9.9
column 9.9
basilica 9.9
arches 9.8
statue 9.5
wall 9.4
light 9.4
traditional 9.2
dome 8.9
roman 8.8
antique 8.7
architectural 8.7
golden 8.6
brick 8.5
carving 8.4
inside 8.3
painting 8.1
symbol 8.1
mosaic 8.1
palace 8
museum 7.9
bible 7.8
carved 7.8
marble 7.8
house 7.6
england 7.6
temple 7.6
icon 7.1

Google
created on 2020-04-23

Microsoft
created on 2020-04-23

church 92.2
indoor 91.7
baroque 83
museum 80.6
fresco 73.9
statue 73.1
art 71.2
altar 63.4
person 58.1
old 55.6
arch 23.6
painting 17.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 60-76
Gender Male, 50.4%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Surprised 49.5%
Angry 49.6%
Sad 50.4%
Calm 49.5%

AWS Rekognition

Age 43-61
Gender Male, 50.3%
Confused 49.5%
Happy 49.5%
Disgusted 49.5%
Calm 50%
Fear 49.5%
Surprised 49.5%
Sad 49.9%
Angry 49.6%

AWS Rekognition

Age 32-48
Gender Female, 50.2%
Surprised 49.5%
Angry 50%
Sad 49.8%
Happy 49.5%
Fear 49.5%
Calm 49.6%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.1%
Disgusted 49.5%
Calm 49.5%
Sad 49.5%
Happy 49.5%
Surprised 49.8%
Confused 49.5%
Angry 49.6%
Fear 50%

Feature analysis

Amazon

Painting
Person

Clarifai

Building
Person
Human face
Clothing

AWS Rekognition

Painting 99.4%

AWS Rekognition

Person 61%

AWS Rekognition

Person 46.5%

AWS Rekognition

Person 45.5%

Clarifai

Building 86.3%

Clarifai

Person 60.1%

Clarifai

Person 55.4%

Clarifai

Person 55.3%

Clarifai

Person 51%

Clarifai

Person 46.7%

Clarifai

Person 46.1%

Clarifai

Person 44.7%

Clarifai

Person 44.2%

Clarifai

Person 42.8%

Clarifai

Person 41.2%

Clarifai

Person 40.5%

Clarifai

Person 40.3%

Clarifai

Person 40%

Clarifai

Person 39.4%

Clarifai

Person 39.4%

Clarifai

Person 39.1%

Clarifai

Person 37%

Clarifai

Person 36.6%

Clarifai

Person 34.6%

Clarifai

Human face 37.2%

Clarifai

Clothing 36.4%

Categories

Imagga
created on 2020-04-23

paintings art 100%

Captions

Microsoft
created by unknown on 2020-04-23

a painting of a church 84.8%
a painting of an old church 74.5%
a painting of an old building 74.4%

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a church with a large painting on the wall

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man on a balcony

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image is a painting that appears to be an incomplete or unfinished work, done in a loose, impressionistic style. It depicts an architectural setting with a series of figures. The top section features a rounded archway adorned with various colors, predominantly in shades of blue and red. Inside the arch, there are indistinct, somewhat abstract forms suggesting human figures and other elements.

Below the arch, there is a row of more discernible human figures that seem to be part of a relief or a fresco panel. These figures are rendered in a muted palette of browns, whites, and grays, and they appear to be standing in niches or compartments along a horizontal line. The lower part of the image contains architectural elements, perhaps columns or supports, rendered in a more sketchy and transparent manner.

Overall, the image gives an impression of a dynamic, partially realized scene, where the artist's brushstrokes and use of color suggest movement and depth, but the details remain deliberately vague and fluid.

Created by gpt-4 on 2024-01-25

The image depicts a painting of an arched architectural structure, appearing unfinished. At the top, a vibrant semi-circular (lunette) section shows a lively scene with figures in motion, possibly engaged in a dramatic or religious event given their gestures and the presence of an individual in a blue outfit that dominates the central position.

Below the lunette, dividing the composition, is a more restrained section portraying a series of standing figures, similar in stature, painted in more subdued colors, giving the impression of statues or people within niches or alcoves. They are dressed in various styles, suggesting a range of periods or statuses.

The whole scene is executed with loose brushwork and appears to be a study or a draft, with the raw canvas still visible in areas, particularly around the edges. There is evidence of the painting being aged, with staining or discoloration especially noticeable at the bottom.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-28

This appears to be a religious artwork, likely a fresco or mural painting, featuring a semi-circular arched composition typical of church architecture. The painting is divided into two main sections: an upper semi-circular portion (lunette) with vibrant blues and golds depicting a dynamic scene, and a lower register showing a row of figures in robes and religious garments standing in what appears to be an arcade or gallery.

The color palette includes rich blues, golds, browns, and whites, with the upper portion being more colorful and energetic in its composition compared to the more subdued and formal arrangement of figures below. The painting style suggests it might be from a medieval or early Renaissance period, with the architectural framing device being characteristic of church decoration from that era.

The overall composition is architectural in nature, with the curved arch creating a frame for the sacred scene above, while the lower portion presents a more formal, processional arrangement of figures. The painting shows signs of age, with some areas appearing faded or worn, giving it a historical patina characteristic of ancient church artwork.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

This image appears to be a painting depicting a religious or spiritual scene. At the center of the image is an arched opening or window, filled with a colorful, abstract scene that seems to represent some kind of divine or supernatural element. Beneath this central opening is a series of figures, depicted in a more realistic style, who appear to be engaged in some kind of religious ritual or ceremony. The overall composition and style of the painting suggest it is a work of religious art, though I cannot identify any specific individuals shown in the image.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

This image is a painting of a mural, depicting a large archway with a colorful design. The archway is painted in shades of blue, red, and yellow, with a large figure in the center. Below the archway, there are several people standing in front of a wall, dressed in robes and tunics. The overall atmosphere of the painting suggests a sense of grandeur and importance, possibly depicting a religious or historical scene. The style of the painting appears to be impressionistic, with loose brushstrokes and vivid colors. The background of the painting is a warm beige color, which adds to the overall sense of warmth and elegance. Overall, the painting is a beautiful and evocative work of art that invites the viewer to step into its world.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a painting of a large arched window with a vibrant mural inside, set against a yellowish-brown wall. The mural features a diverse array of figures in various poses, including some with their arms raised and others with their hands clasped together. The figures are dressed in robes and appear to be engaged in a scene of worship or celebration.

The arched window is adorned with a decorative border, adding to the overall sense of grandeur and elegance. The background of the painting is a warm, earthy tone, which complements the colors used in the mural.

Overall, the image presents a serene and contemplative atmosphere, inviting the viewer to reflect on the beauty and significance of the scene depicted.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image depicts a painting of a group of people standing in front of a wall. The painting is on a canvas with a white border. The painting depicts a group of people standing in front of a wall. The wall has a design of a rainbow with a person standing in the middle of the rainbow. The person is wearing a white robe and is holding a flower.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a detailed sketch of an architectural element, likely a fresco, with a combination of vibrant colors and intricate designs. The central focus is an arched section adorned with a colorful, multi-layered design. Above the arch, there is a depiction of an angel with wings, possibly holding a flower vase, and a figure that might be a saint or a religious figure. Below the arch, there is a row of figures, possibly monks or religious devotees, dressed in traditional attire. The background features a combination of blue, red, and yellow hues, creating a dynamic and visually engaging composition. The sketch appears to be a preparatory work for a larger mural or fresco, showcasing the artist's preliminary ideas and color schemes.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is a painting or sketch of a religious scene. The style appears to be Byzantine or Romanesque, given the composition and the subject matter.

The painting is divided into two main sections:

  1. Upper Section: This is an arched area, possibly depicting a tympanum of a church. Inside the arch, there is a scene with several figures. Central to this scene appears to be a representation of God or Christ, surrounded by angels or other divine beings. The style is stylized and uses bold colors like blue, red, and gold.
  2. Lower Section: This area seems to show a row of figures, likely saints, prophets, or other religious figures. They are arranged along a horizontal line, and the details of their faces are not highly defined, suggesting a focus on collective representation rather than individual portraits.

The overall impression is of a religious fresco or painting that could be found in an ancient church or cathedral. The style is somewhat rough and unfinished, which might indicate that this is a preparatory sketch or a study rather than a finished work.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

This is an oil painting or a study for a painting, depicting a religious scene within a classic architectural framework. The composition is dominated by a large arched space, likely representing an apse or a decorative architectural element.

Central Scene within the Arch:

  • Colors: The painting makes use of vibrant colors, particularly blues, yellows, and reds. This adds to the intensity of the scene.
  • Figures: The top of the arch appears to be populated by a celestial scene or a moment of great importance.
  • Subjects: There are figures present in the arch.

Lower Section:

  • Figures: Beneath the arch, there's a row of figures, possibly saints or significant religious figures. They are rendered in a more muted color palette, suggesting they are less prominent than the scene above.
  • Architecture: There is a suggestion of classical architecture, with a frieze or a similar horizontal element, and columns or side walls.

Overall Impression:

The style is reminiscent of a sketch or study for a mural or a large-scale painting. The brushstrokes are visible, and the overall impression is that this is a work in progress or an initial draft. The painting seems to be depicting a biblical or religious scene, possibly an event from the New Testament, or another religious occasion. The details and subjects require further interpretation to fully understand the exact narrative.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a detailed and colorful fresco or mural, likely of religious significance, set within an architectural framework. The artwork appears to be a study or preparatory sketch for a larger piece, possibly for a church or cathedral.

Here are the key elements of the image:

  1. Architectural Setting: The fresco is framed by an arched structure, which includes columns and a decorative border. The arch is adorned with intricate patterns and possibly inscriptions.

  2. Central Scene: The central part of the fresco features a dramatic and dynamic scene with multiple figures. The figures are engaged in what appears to be a significant event, possibly a religious or mythological narrative. The use of vibrant colors and expressive brushstrokes suggests movement and emotion.

  3. Figures: Below the central scene, there is a row of standing figures, likely saints or apostles, each depicted in a distinct pose. These figures are more static and solemn compared to the central scene, adding a sense of reverence and contemplation.

  4. Color and Style: The artwork uses a rich palette of colors, including blues, reds, yellows, and greens. The style is expressive and somewhat abstract, with bold brushstrokes and a focus on capturing the essence of the scene rather than precise detail.

  5. Background: The background above the arch shows a landscape with buildings, possibly indicating a city or town. This adds depth and context to the scene, suggesting a broader setting for the narrative depicted.

Overall, the image is a vivid and expressive representation of a religious or historical scene, combining architectural elements with figurative art to create a compelling visual narrative.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

This image appears to be a水彩画 (watercolor painting) depicting a religious or ceremonial scene, likely from a biblical or historical context. The composition is divided into two main sections: an upper triangular arch and a lower rectangular area.

In the upper section:

  • The arch is filled with vibrant colors, primarily blues and reds, and contains symbolic elements such as a cross with a sun and a moon superimposed on it, suggesting themes of faith, divine light, and celestial significance.
  • There are figures in the upper section, possibly depicting angels or divine beings, with one figure holding a staff, which could symbolize a religious or authoritative figure.

In the lower section:

  • The rectangular area shows a group of figures in robes, possibly priests, saints, or other religious figures, standing on a platform or altar. They appear to be in a state of procession or participation in a ritual.
  • The figures are rendered with flowing and dynamic brushstrokes, giving a sense of movement and spiritual energy.

The overall style of the painting is expressive and symbolic, with a focus on conveying spiritual and religious themes through color and form. The use of light and shadow enhances the dramatic and emotive quality of the scene.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This image appears to be a sketch or a preliminary design for a religious fresco or mural. The composition is divided into two main sections:

  1. Upper Section: This part features a central figure on a cross, likely representing the crucifixion of Jesus Christ. Surrounding this figure are various other figures, possibly angels or other biblical characters, depicted in a somewhat abstract and expressive style. The background includes swirling patterns and what appears to be a halo or radiant light around the central figure.

  2. Lower Section: This section shows a group of people, possibly disciples or followers, standing in a line and facing the upper scene. They are dressed in robes and appear to be observing the crucifixion. The figures are less detailed compared to the upper section, suggesting a focus on the central event above.

The entire scene is framed within an arched structure, which could be part of a church or cathedral. The colors used are muted and earthy, with some brighter elements in the upper section to draw attention to the central figure. The overall style suggests that this is a sketch or a conceptual drawing rather than a finished piece of art.