Human Generated Data

Title

Virgin and Child with Saints Sebastian, Francis, John the Baptist, Jerome, an unidentified female saint, Saint Anthony of Padua and two donors

Date

c. 1515

People

Artist: Giovanni Bellini, Italian c. 1459 - 1516

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Woodner Family Collection, Inc., 2000.24

Human Generated Data

Title

Virgin and Child with Saints Sebastian, Francis, John the Baptist, Jerome, an unidentified female saint, Saint Anthony of Padua and two donors

People

Artist: Giovanni Bellini, Italian c. 1459 - 1516

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Date

c. 1515

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Woodner Family Collection, Inc., 2000.24

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Person 99.1
Person 98.7
Baby 98.7
Person 98.5
Person 98.3
Adult 98.3
Female 98.3
Woman 98.3
Person 98.2
Person 97.9
Boy 97.9
Child 97.9
Male 97.9
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 95.4
Adult 95.4
Female 95.4
Woman 95.4
Face 94.9
Head 94.9
Accessories 94.4
Jewelry 94.4
Necklace 94.4
Person 92.3
Baby 92.3

Clarifai
created on 2018-08-20

people 99.8
group 99.7
religion 99.4
adult 99.3
woman 98.9
son 98.8
painting 98.3
Mary 97.9
saint 97.9
baby 97.7
art 97.2
man 97
child 97
Renaissance 96.3
church 94.6
god 94.5
aura 91.5
family 91.2
seat 90.3
cross 88.9

Imagga
created on 2018-08-20

throne 35.4
chair of state 28.4
temple 26.5
child 24
chair 22.3
people 19
old 18.8
person 18.7
religion 17.9
man 17.5
mother 16.5
male 16
seat 16
architecture 15.6
rustic 15.2
ancient 14.7
sitting 14.6
happy 13.2
religious 13.1
portrait 12.9
family 12.4
art 12.3
mosaic 12.2
wall 12
culture 12
love 11.8
stone 11.8
adult 11.7
smiling 10.8
holding 10.7
travel 10.6
fashion 10.5
lady 10.5
statue 10.5
expression 10.2
smile 10
together 9.6
couple 9.6
god 9.6
historical 9.4
two 9.3
sculpture 9.3
window 9.2
attractive 9.1
furniture 8.9
boy 8.7
lifestyle 8.7
spiritual 8.6
happiness 8.6
face 8.5
fun 8.2
parent 8.2
outdoors 8.2
life 8.1
history 8
colorful 7.9
transducer 7.8
worship 7.7
spirituality 7.7
sofa 7.7
casual 7.6
human 7.5
fan 7.5
city 7.5
juvenile 7.5
room 7.4
vintage 7.4
tourism 7.4
style 7.4
church 7.4
emotion 7.4
group 7.2
oriental 7.2
building 7.1

Google
created on 2018-08-20

Microsoft
created on 2018-08-20

person 92.4
posing 40.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 98.1%
Calm 94.5%
Surprised 6.4%
Fear 6.1%
Sad 2.8%
Confused 1.8%
Angry 0.3%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 13-21
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 4.7%
Confused 1%
Disgusted 0.8%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Male, 95.1%
Calm 84.3%
Surprised 8.1%
Sad 7.4%
Fear 6%
Confused 1.6%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.1%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 37-45
Gender Female, 95.6%
Calm 84.1%
Surprised 10.1%
Fear 6.3%
Angry 4.6%
Sad 2.9%
Confused 1.6%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Female, 99.8%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Female, 70.8%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 91.6%
Surprised 6.5%
Fear 6%
Confused 3.4%
Sad 2.5%
Disgusted 1.9%
Angry 0.9%
Happy 0.3%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.6%
Angry 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Baby 98.7%
Adult 98.3%
Female 98.3%
Woman 98.3%
Boy 97.9%
Child 97.9%
Male 97.9%
Man 97.6%
Necklace 94.4%

Captions

Azure OpenAI

Created on 2024-01-26

This is a Renaissance painting featuring a central figure draped in blue and red garments, holding a child on their lap. To the left and right of the central figure are characters dressed in period clothing, and in the background, there are serene landscape scenes depicting rolling hills, trees, structures, and a clear sky. The middle panel showcases a patterned background, while the outer panels display outdoor settings that contribute to the painting's tranquil and bucolic atmosphere.

Anthropic Claude

Created on 2024-03-29

The image depicts a religious scene featuring the Virgin Mary holding the infant Jesus, surrounded by several other figures. In the center, the Virgin Mary is seated, wearing a red robe and white veil, holding the baby Jesus on her lap. She is flanked by two male figures, one elderly and one younger, who appear to be Saint Joseph and another male saint. In the foreground, there are several other figures, including a young man with long hair and a halo, possibly representing one of the apostles, and two women, one with a white headdress and one with long blonde hair. The background features a detailed, ornate tapestry or textile hanging, as well as a pastoral landscape with buildings in the distance. The overall composition and style suggest this is a Renaissance-era religious painting.

Meta Llama

Created on 2024-11-23

The image is a painting of the Virgin Mary holding the infant Jesus, surrounded by several figures. The Virgin Mary is depicted wearing a red dress with a white head covering and blue skirt. She is holding the infant Jesus in her lap. The infant Jesus is naked and has a white cloth wrapped around his waist. To the left of the Virgin Mary is Saint John the Baptist, who is depicted as a young man with long hair and a green robe. He is holding a staff in his right hand. To the right of the Virgin Mary is Saint Joseph, who is depicted as an older man with a long white beard and a brown robe. He is holding a staff in his right hand. In front of the Virgin Mary are two other figures. One is a woman with a white head covering and a black dress, who is holding a book in her left hand. The other is a man with a white head covering and a black robe, who is holding a staff in his right hand. In the background of the painting are several buildings and trees. The sky is blue with white clouds. The overall atmosphere of the painting is one of serenity and reverence. The Virgin Mary and the infant Jesus are depicted in a peaceful and calm manner, surrounded by the other figures who are looking at them with devotion and admiration. The painting is likely a depiction of the Holy Family and their followers, and it conveys a sense of unity and harmony among the figures.