Human Generated Data

Title

Virgin and Child with Saints Sebastian, Francis, John the Baptist, Jerome, an unidentified female saint, Saint Anthony of Padua and two donors

Date

c. 1515

People

Artist: Giovanni Bellini, Italian c. 1459 - 1516

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Woodner Family Collection, Inc., 2000.24

Human Generated Data

Title

Virgin and Child with Saints Sebastian, Francis, John the Baptist, Jerome, an unidentified female saint, Saint Anthony of Padua and two donors

People

Artist: Giovanni Bellini, Italian c. 1459 - 1516

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Date

c. 1515

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Woodner Family Collection, Inc., 2000.24

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Person 99.1
Person 98.7
Baby 98.7
Person 98.5
Person 98.3
Adult 98.3
Female 98.3
Woman 98.3
Person 98.2
Person 97.9
Boy 97.9
Child 97.9
Male 97.9
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 95.4
Adult 95.4
Female 95.4
Woman 95.4
Face 94.9
Head 94.9
Accessories 94.4
Jewelry 94.4
Necklace 94.4
Person 92.3
Baby 92.3

Clarifai
created on 2018-08-20

people 99.8
group 99.7
religion 99.4
adult 99.3
woman 98.9
son 98.8
painting 98.3
Mary 97.9
saint 97.9
baby 97.7
art 97.2
man 97
child 97
Renaissance 96.3
church 94.6
god 94.5
aura 91.5
family 91.2
seat 90.3
cross 88.9

Imagga
created on 2018-08-20

throne 35.4
chair of state 28.4
temple 26.5
child 24
chair 22.3
people 19
old 18.8
person 18.7
religion 17.9
man 17.5
mother 16.5
male 16
seat 16
architecture 15.6
rustic 15.2
ancient 14.7
sitting 14.6
happy 13.2
religious 13.1
portrait 12.9
family 12.4
art 12.3
mosaic 12.2
wall 12
culture 12
love 11.8
stone 11.8
adult 11.7
smiling 10.8
holding 10.7
travel 10.6
fashion 10.5
lady 10.5
statue 10.5
expression 10.2
smile 10
together 9.6
couple 9.6
god 9.6
historical 9.4
two 9.3
sculpture 9.3
window 9.2
attractive 9.1
furniture 8.9
boy 8.7
lifestyle 8.7
spiritual 8.6
happiness 8.6
face 8.5
fun 8.2
parent 8.2
outdoors 8.2
life 8.1
history 8
colorful 7.9
transducer 7.8
worship 7.7
spirituality 7.7
sofa 7.7
casual 7.6
human 7.5
fan 7.5
city 7.5
juvenile 7.5
room 7.4
vintage 7.4
tourism 7.4
style 7.4
church 7.4
emotion 7.4
group 7.2
oriental 7.2
building 7.1

Google
created on 2018-08-20

Microsoft
created on 2018-08-20

person 92.4
posing 40.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 19-27
Gender Female, 98.1%
Calm 94.5%
Surprised 6.4%
Fear 6.1%
Sad 2.8%
Confused 1.8%
Angry 0.3%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 13-21
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 4.7%
Confused 1%
Disgusted 0.8%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Male, 95.1%
Calm 84.3%
Surprised 8.1%
Sad 7.4%
Fear 6%
Confused 1.6%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.1%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 37-45
Gender Female, 95.6%
Calm 84.1%
Surprised 10.1%
Fear 6.3%
Angry 4.6%
Sad 2.9%
Confused 1.6%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Female, 99.8%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Female, 70.8%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 91.6%
Surprised 6.5%
Fear 6%
Confused 3.4%
Sad 2.5%
Disgusted 1.9%
Angry 0.9%
Happy 0.3%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.6%
Angry 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Baby
Adult
Female
Woman
Boy
Child
Male
Man
Necklace
Person 99.1%
Person 98.7%
Person 98.5%
Person 98.3%
Person 98.2%
Person 97.9%
Person 97.6%
Person 95.4%
Person 92.3%
Baby 98.7%
Baby 92.3%
Adult 98.3%
Adult 97.6%
Adult 95.4%
Female 98.3%
Female 95.4%
Woman 98.3%
Woman 95.4%
Boy 97.9%
Child 97.9%
Male 97.9%
Male 97.6%
Man 97.6%
Necklace 94.4%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a painting of a woman holding a baby -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-29

This image depicts a religious scene, likely a Renaissance painting, featuring a group of individuals gathered around a central female figure holding a child. The background includes a rural landscape with trees, buildings, and a winding path. The central figure is positioned against a richly decorated tapestry. The other figures are dressed in a mix of classical and religious attire, with some holding objects such as books or branches. The composition and style suggest a focus on significant religious or historical themes.

Created by gpt-4 on 2024-01-26

This is a Renaissance painting featuring a central figure draped in blue and red garments, holding a child on their lap. To the left and right of the central figure are characters dressed in period clothing, and in the background, there are serene landscape scenes depicting rolling hills, trees, structures, and a clear sky. The middle panel showcases a patterned background, while the outer panels display outdoor settings that contribute to the painting's tranquil and bucolic atmosphere.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a religious scene featuring the Virgin Mary holding the infant Jesus, surrounded by several other figures. In the center, the Virgin Mary is seated, wearing a red robe and white veil, holding the baby Jesus on her lap. She is flanked by two male figures, one elderly and one younger, who appear to be Saint Joseph and another male saint. In the foreground, there are several other figures, including a young man with long hair and a halo, possibly representing one of the apostles, and two women, one with a white headdress and one with long blonde hair. The background features a detailed, ornate tapestry or textile hanging, as well as a pastoral landscape with buildings in the distance. The overall composition and style suggest this is a Renaissance-era religious painting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image is a painting of the Madonna and Child, surrounded by various saints and figures. The central figure is the Madonna, who is depicted holding the infant Jesus in her arms. She is dressed in a red robe with a white veil covering her head, and her gaze is directed downward toward the child.

To the left of the Madonna is a group of male figures, including Saint John the Baptist, who is depicted as a young man with long hair and a loincloth. He is holding a staff in his right hand and has a gentle expression on his face. Next to him is another male figure, who is dressed in a green robe and appears to be a saint or apostle.

On the right side of the painting, there are several female figures, including Saint Catherine of Alexandria, who is depicted as a young woman with a crown on her head and a sword in her hand. She is standing next to an older man with a long white beard, who may be Saint Joseph or another saint.

In the background of the painting, there are several buildings and trees, which suggest a rural or countryside setting. The sky above is blue with a few clouds, adding to the serene and peaceful atmosphere of the scene.

Overall, the painting appears to be a devotional work, intended to honor the Virgin Mary and the saints depicted in the scene. The use of rich colors and detailed imagery suggests that the artist was skilled and experienced in their craft.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image is a painting of the Virgin Mary holding the infant Jesus, surrounded by several figures. The Virgin Mary is depicted wearing a red dress with a white head covering and blue skirt. She is holding the infant Jesus in her lap. The infant Jesus is naked and has a white cloth wrapped around his waist.

To the left of the Virgin Mary is Saint John the Baptist, who is depicted as a young man with long hair and a green robe. He is holding a staff in his right hand. To the right of the Virgin Mary is Saint Joseph, who is depicted as an older man with a long white beard and a brown robe. He is holding a staff in his right hand.

In front of the Virgin Mary are two other figures. One is a woman with a white head covering and a black dress, who is holding a book in her left hand. The other is a man with a white head covering and a black robe, who is holding a staff in his right hand.

In the background of the painting are several buildings and trees. The sky is blue with white clouds.

The overall atmosphere of the painting is one of serenity and reverence. The Virgin Mary and the infant Jesus are depicted in a peaceful and calm manner, surrounded by the other figures who are looking at them with devotion and admiration. The painting is likely a depiction of the Holy Family and their followers, and it conveys a sense of unity and harmony among the figures.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The painting depicts the Holy Family with Sts John the Baptist, Elizabeth, Joseph, and Catherine of Alexandria. The painting was executed for private devotion. The Virgin and Child are in the centre, with the other saints on either side. The donor, a woman in a black dress, is on the right, while St John the Baptist is on the left. The landscape in the background is painted in a style similar to that of the Flemish masters.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a group of people, including a woman holding a baby, who are probably saints. They are gathered in front of a green curtain with gold floral designs. On the left side of the painting, there is a tree and a man in a robe. On the right side, there is a man with a beard and a woman with a feather in her hair. Behind them, there are houses and trees.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is a Renaissance-style oil painting featuring the Madonna and Child surrounded by various figures, set against a detailed landscape backdrop.

In the center, the Madonna, dressed in red and blue robes with a white veil, holds the infant Jesus, who is nude with red hair. Her gaze is directed downwards, conveying a sense of solemnity. Behind the Madonna is a brocaded tapestry with an intricate pattern of floral motifs in gold on a dark background.

To the left of the Madonna, a bare-chested male figure with red curly hair stands draped in a white cloth. Next to him is a man in a light-colored monastic robe, looking down with an introspective expression. Another male figure with a beard and green robe stands next to the robed man. In front of them, a balding man in a black robe looks up with his hands clasped in prayer.

To the right of the Madonna, an elderly man with a long white beard holds a book and looks towards the Madonna and Child. Beside him is a woman in a red veil, looking down with a serene expression. Next to her, a man in a grey monastic robe holds a palm frond. In front of the group on the right, a woman with blonde hair looks to the side with a calm expression.

The background consists of a pastoral landscape with rolling hills, trees, and buildings, creating depth and context to the scene. The sky is a muted blue with hints of clouds. The painting is executed in a style that emphasizes realism and detailed rendering of the figures and their clothing. The overall tone of the painting is one of reverence and serenity, typical of Renaissance religious art.

Created by gemini-2.0-flash-lite on 2025-04-26

The image is a Renaissance-era religious painting depicting the Madonna and Child surrounded by saints and other figures. Here's a breakdown of the scene:

  • Central Figures: The Virgin Mary, seated and wearing a blue robe with a red undershirt and a white headdress, cradles the infant Jesus. The baby is nude, as is common in this era's depictions, and has curly red hair.
  • Surrounding Figures:
    • To the left, there is Saint John the Baptist, partially nude, with long curly hair and an accompanying figure.
    • On Mary's right side there's an old man with a long white beard, likely St. Joseph. There are multiple female saints as well as a monk holding a lily and a book.
    • A man dressed in dark garments kneels at the front of the painting, looking up at Mary, with another woman nearby.
  • Setting and Background: A detailed background with rolling hills, a few buildings in the distance, and a decorative tapestry behind Mary and the child.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a religious painting, likely from the Renaissance period, characterized by its detailed and realistic portrayal of figures and landscape. Here's a detailed summary:

  1. Central Figures:

    • Mary and Jesus: At the center of the painting, the Virgin Mary is seated with the infant Jesus on her lap. Mary is dressed in a red robe with a blue cloak, while Jesus is depicted as a cherubic baby.
    • Joseph: To the right of Mary, an older man, likely Saint Joseph, is portrayed with a beard and holding a staff.
  2. Surrounding Saints:

    • Saint Sebastian: On the far left, a young man with a bare torso and a white cloth wrapped around his waist is depicted. He is Saint Sebastian, identifiable by the arrows in his body, symbolizing his martyrdom.
    • Saint Anthony Abbot: Next to Saint Sebastian, a man with a tonsure (a shaved head) and wearing a brown robe is holding a T-shaped staff, indicating Saint Anthony Abbot.
    • Saint John the Baptist: Next to Saint Anthony, a bearded man in green and red robes, likely Saint John the Baptist, is depicted.
    • Saint Catherine of Alexandria: In the foreground, a woman with a crown and a red dress, holding a palm frond, represents Saint Catherine of Alexandria.
    • Saint Francis of Assisi: On the far right, a man in a gray robe with a tonsure and holding a book and a palm frond is Saint Francis of Assisi.
    • Unidentified Female Saint: Behind Saint Francis, a woman in a red dress and white headdress is present, possibly another saint or a donor figure.
  3. Background:

    • The background features a serene landscape with rolling hills, trees, and a few buildings, suggesting a rural setting. The sky is clear with a few clouds, adding to the tranquil atmosphere.
  4. Artistic Style:

    • The painting exhibits characteristics of Renaissance art, including realistic depictions of the human form, detailed clothing, and a sense of depth and perspective in the landscape.

This painting is a sacred conversation (sacra conversazione), a type of devotional painting popular during the Renaissance, where the Virgin and Child are depicted with a group of saints.