Human Generated Data

Title

Dossal: The Virgin and Child with Saints Matthew and Hilarion

Date

c. 1310

People

Artist: Deodato Orlandi, Italian 1284 - 1317

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Arthur Sachs, 1938.129

Human Generated Data

Title

Dossal: The Virgin and Child with Saints Matthew and Hilarion

People

Artist: Deodato Orlandi, Italian 1284 - 1317

Date

c. 1310

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Arthur Sachs, 1938.129

Machine Generated Data

Tags

Amazon
created on 2022-05-03

Person 97
Human 97
Person 95.4
Architecture 94.8
Building 94.8
Person 93.8
Art 93
Painting 91.7
Altar 85.5
Church 85.5

Clarifai
created on 2023-10-22

painting 99.6
art 99.4
religion 99.4
people 99.3
book 97.8
church 97.7
aura 96.8
god 95.9
woman 95.6
illustration 95.3
man 95
adult 95
Mary 94.6
saint 94.2
book series 93.9
veil 93.4
gown (clothing) 93.2
baby 89.7
son 88.2
portrait 87.6

Imagga
created on 2022-05-03

chest 62
container 55.8
box 52.5
prayer rug 37.6
rug 31.9
wallet 24.1
floor cover 22.8
furnishing 22.7
art 19.6
old 19.5
case 19.4
covering 17.8
decoration 15.8
pattern 15
ancient 14.7
money 14.4
design 14.4
gold 14
culture 13.7
currency 13.4
vintage 13.2
golden 12.9
travel 12.7
bag 12.3
close 12
texture 11.8
paper 11.8
painting 11.7
religion 11.6
retro 11.5
detail 11.3
antique 11.2
finance 11
cash 11
traditional 10.8
symbol 10.8
painted 10.5
dollar 10.2
jigsaw puzzle 10.1
business 9.7
style 9.6
color 9.4
pay 8.6
ornament 8.6
face 8.5
fashion 8.3
tourism 8.2
wealth 8.1
object 8.1
history 8
puzzle 8
colorful 7.9
banknote 7.8
decorative 7.5
savings 7.5
brown 7.4
yellow 7.3
black 7.2
financial 7.1
interior 7.1
decor 7.1
architecture 7

Google
created on 2022-05-03

Picture frame 92.8
Temple 88.2
Textile 87.8
Art 83.1
Wood 83
Wall 81.4
Painting 79.2
Mural 73
Visual arts 70.6
History 68.8
Drawing 68.4
Illustration 67.8
Event 67.4
Mythology 67.4
Holy places 67.1
Antique 65.2
Religious item 65.1
Room 64.4
Stock photography 63.7
Carving 61.8

Microsoft
created on 2022-05-03

painting 99.2
text 96.2
drawing 95.2
art 93.5
human face 89
person 87.5
clothing 70.7
picture frame 70.4
museum 56.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 91.8%
Confused 37.6%
Calm 34.3%
Sad 8.9%
Angry 8.1%
Surprised 7.9%
Fear 6.6%
Happy 2.7%
Disgusted 2.2%

AWS Rekognition

Age 38-46
Gender Female, 99.8%
Fear 75.5%
Calm 17.8%
Disgusted 11%
Surprised 10.9%
Sad 2.9%
Confused 2.3%
Angry 0.9%
Happy 0.8%

AWS Rekognition

Age 25-35
Gender Male, 92.5%
Calm 77.8%
Fear 9.9%
Surprised 7.1%
Sad 6.1%
Disgusted 2.3%
Confused 0.9%
Angry 0.7%
Happy 0.7%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 96.3%
Surprised 6.5%
Fear 5.9%
Sad 2.4%
Angry 1%
Confused 0.6%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 98.2%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 97%
Person 95.4%
Person 93.8%
Painting 91.7%

Captions

Microsoft
created by unknown on 2022-05-03

an old photo of a person 39.7%

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a woman holding a baby -100%

OpenAI GPT

Created by gpt-4 on 2024-12-04

The image shows a segment of a traditional religious triptych painting, where two figures depicted in red robes are visible on either side of a central figure. The painting seems to be quite old, with visible cracking and aging of the material, typical of aged artwork. The figures on the sides appear to be holding scrolls or books, which are common attributes for saints or religious scholars in such artwork. The central figure and the figure on the left have halos around where their heads would be, suggesting their depiction as holy figures. Above them, there is an arch decorated with intricate patterns and small angelic figures are present in the top corners of the side panels. The painting is displayed against a plain background and appears to be under restoration or examination, as evidenced by the wooden planks and padded supports underneath.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This is a medieval religious painting, appearing to be an altarpiece or decorative panel from a church. The artwork features a central figure in a dark blue cloak holding a child dressed in red. The painting is set within an ornate architectural framework with Gothic arches and decorative patterns. On either side of the central figures are other religious figures - on the left appears to be a figure in red and gray robes, and on the right is what appears to be a bishop or religious figure wearing red vestments and a miter (ceremonial headpiece). The painting shows characteristics of medieval Italian art, with its gold background, stylized figures, and religious iconography. The work appears to be somewhat aged, with visible cracking in the paint surface. The overall composition is arranged in a triangular or peaked format, typical of religious artworks meant to be displayed above an altar.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a religious painting depicting the Virgin Mary holding the infant Jesus. The Virgin Mary is shown wearing a black robe with a red headdress, and the infant Jesus is dressed in a red robe. They are surrounded by a decorative, ornate frame with intricate patterns and designs. On either side of the central figures, there are two other figures, also wearing red robes, who appear to be religious figures or saints. The overall composition and style of the painting suggest it is a work of religious art, likely from a historical period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

The image depicts a painting of the Virgin Mary and Child, accompanied by two saints. The painting is displayed on an easel or wall, with the top portion slightly angled to the right.

Key Features:

  • Virgin Mary and Child: The central figures are depicted in a traditional pose, with the Virgin Mary holding the Christ child.
  • Saints: Two saints are positioned on either side of the Virgin Mary, each with distinct attire and attributes.
  • Background: The background of the painting features a decorative pattern, adding depth and visual interest to the composition.
  • Display: The painting is displayed on an easel or wall, with the top portion slightly angled to the right, creating a sense of dynamic movement.

Overall Impression:

The image presents a serene and reverent depiction of the Virgin Mary and Child, surrounded by two saints. The use of traditional iconography and symbolism adds to the painting's religious significance, while the decorative background and display create a visually appealing composition.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a painting of the Virgin Mary and the infant Jesus, surrounded by two saints. The painting is displayed on a wooden board, with a white cloth underneath it.

  • Virgin Mary and Infant Jesus
    • The Virgin Mary is depicted wearing a black robe with a red dress underneath, holding the infant Jesus in her arms.
    • The infant Jesus is dressed in a red robe and appears to be looking up at the Virgin Mary.
  • Saints
    • To the left of the Virgin Mary is a saint holding a scroll with illegible writing.
    • To the right of the Virgin Mary is a saint wearing a red robe and a gold crown, holding a staff in his right hand.
  • Background
    • The background of the painting features a brown color with a diamond pattern.
    • There are also some decorative elements, such as leaves and flowers, surrounding the Virgin Mary and the infant Jesus.
  • Display
    • The painting is displayed on a wooden board, which is placed on a white cloth.
    • The board has a triangular shape, with the top pointing upwards.
    • There are two small wooden blocks at the bottom of the board, which may be used to support it.

In summary, the image shows a beautiful painting of the Virgin Mary and the infant Jesus, surrounded by two saints, displayed on a wooden board with a white cloth underneath. The painting features a brown background with a diamond pattern and decorative elements, and is displayed in a triangular shape with two small wooden blocks at the bottom.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image shows a medieval painting of the Madonna and Child, with St. John the Baptist and St. Nicholas of Bari. The painting is mounted on a wooden frame and appears to be displayed in a museum or gallery setting. The painting depicts the Virgin Mary holding the infant Jesus, with St. John the Baptist on the left and St. Nicholas on the right. The painting has a dark, brownish color scheme and appears to be in a state of disrepair, with some parts of the painting missing or damaged.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The painting is displayed on a wooden surface with a yellow wall in the background. It features a woman in the center wearing a black robe and holding a child in her arms. The child is wearing a red robe. On the left side, there is a man wearing a red robe and holding a scroll. On the right side, there is another man wearing a red robe and holding a book. There are two angels on the top corners.

Google Gemini

Created by gemini-2.0-flash on 2025-04-27

Here is a description of the image:

The image shows a multi-panel religious painting, likely a medieval altarpiece, currently undergoing restoration or conservation. The piece is mounted on a neutral-colored background, with wooden supports visible along the top and bottom edges, held in place by what appears to be white conservation paper.

The painting itself is composed of three distinct sections under a triangular roof. The central panel features the Virgin Mary holding the Christ Child. Mary is depicted wearing a dark blue cloak and a red dress, her face expressing a gentle sorrow. The Christ Child, dressed in red, looks towards the viewer. Both figures have halos, and the background behind them is patterned with diamond shapes.

Flanking the central panel are two side panels, each depicting a saint. The figure on the left holds a scroll with faded script, and the figure on the right appears to be a bishop, distinguished by his bishop's hat and staff. Above the saints are angels, depicted in the upper corners.

The painting shows signs of aging, including cracks and damage to the paint. The colors are somewhat muted, giving the piece an antique appearance. The overall composition and style suggest a work from the 14th or 15th century.

Created by gemini-2.0-flash-lite on 2025-04-27

Here's a description of the image:

The image showcases a medieval-style religious panel painting, likely an altarpiece. It features a central depiction of the Virgin Mary holding the Christ Child. The figures are positioned within a stylized architectural framework with gothic arches.

Here's a breakdown of the visible elements:

  • Composition: The artwork is symmetrical with the Virgin Mary and Child at the center, flanked by two other figures on either side. Angels with wings can also be seen above the figures.
  • Central Figures: The Virgin Mary is the focal point, wearing a dark robe. The Christ Child is in a red garment, held by his mother. Both have halos.
  • Side Figures: On either side of Mary and Jesus are figures of saints. One is holding a scroll, while the other is dressed in a bishop's vestments and holding a book and a staff.
  • Style: The style suggests a medieval or early Renaissance period, with flattened perspective and stylized facial features. There is significant cracking or damage to the painting surface, suggesting age.
  • Condition: The image is attached to a board. Pieces of wood are fastened to the top and bottom, possibly as part of restoration or conservation efforts. The condition suggests that the painting is old and is either undergoing or has undergone restoration.

In summary, the image captures a significant religious artwork from a historical period, likely from an art museum or restoration workshop.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a religious artwork, likely a fresco or panel painting, featuring a central figure of the Virgin Mary with the Christ Child, flanked by two other figures. The artwork is richly decorated with intricate patterns and vibrant colors.

  1. Central Figures:

    • Virgin Mary: She is seated and holding the Christ Child on her lap. Mary is dressed in traditional robes, with a dark blue or black mantle over a red garment. She has a serene expression and is depicted in a frontal pose.
    • Christ Child: He is shown as a young child, dressed in a red garment, and is held closely by Mary.
  2. Flanking Figures:

    • Left Figure: This figure is dressed in red robes and appears to be a saint or religious figure. The figure holds a scroll with an inscription, which might identify them. The scroll reads "SANCTVS IOHANNES," suggesting this could be Saint John.
    • Right Figure: This figure is also dressed in red robes and wears a mitre, indicating that he is likely a bishop or a saint. He holds a book, which is a common attribute for saints and bishops in religious art.
  3. Background and Decoration:

    • The background features an ornate, patterned design with geometric shapes and possibly floral motifs. The use of gold and rich colors adds to the opulence of the scene.
    • Above the central figures, there are two small angels or cherubs, each holding an object, possibly a crown or a symbol of sanctity.
  4. Architectural Elements:

    • The artwork is framed by an arch, giving it the appearance of being part of a larger architectural structure, such as a church or a chapel.
    • The arch is decorated with intricate patterns and possibly small figures or symbols.

Overall, the image is a detailed and colorful representation of a religious scene, likely from the medieval or Renaissance period, showcasing the Virgin Mary with the Christ Child and two accompanying saints or religious figures.

Text analysis

Amazon

Wild

Google

PRIM
PRIM