Human Generated Data

Title

Virgin and Child with Saints Sebastian, Francis, John the Baptist, Jerome, an unidentified female saint, Saint Anthony of Padua and two donors

Date

c. 1515

People

Artist: Giovanni Bellini, Italian c. 1459 - 1516

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Woodner Family Collection, Inc., 2000.24

Human Generated Data

Title

Virgin and Child with Saints Sebastian, Francis, John the Baptist, Jerome, an unidentified female saint, Saint Anthony of Padua and two donors

People

Artist: Giovanni Bellini, Italian c. 1459 - 1516

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Date

c. 1515

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of the Woodner Family Collection, Inc., 2000.24

Machine Generated Data

Tags

Amazon
created on 2023-10-10

Art 100
Painting 100
Person 99.1
Person 98.7
Baby 98.7
Person 98.5
Person 98.3
Adult 98.3
Female 98.3
Woman 98.3
Person 98.2
Person 97.9
Boy 97.9
Child 97.9
Male 97.9
Person 97.6
Adult 97.6
Male 97.6
Man 97.6
Person 95.4
Adult 95.4
Female 95.4
Woman 95.4
Face 94.9
Head 94.9
Accessories 94.4
Jewelry 94.4
Necklace 94.4
Person 92.3
Baby 92.3

Clarifai
created on 2018-08-20

people 99.8
group 99.7
religion 99.4
adult 99.3
woman 98.9
son 98.8
painting 98.3
Mary 97.9
saint 97.9
baby 97.7
art 97.2
man 97
child 97
Renaissance 96.3
church 94.6
god 94.5
aura 91.5
family 91.2
seat 90.3
cross 88.9

Imagga
created on 2018-08-20

throne 35.4
chair of state 28.4
temple 26.5
child 24
chair 22.3
people 19
old 18.8
person 18.7
religion 17.9
man 17.5
mother 16.5
male 16
seat 16
architecture 15.6
rustic 15.2
ancient 14.7
sitting 14.6
happy 13.2
religious 13.1
portrait 12.9
family 12.4
art 12.3
mosaic 12.2
wall 12
culture 12
love 11.8
stone 11.8
adult 11.7
smiling 10.8
holding 10.7
travel 10.6
fashion 10.5
lady 10.5
statue 10.5
expression 10.2
smile 10
together 9.6
couple 9.6
god 9.6
historical 9.4
two 9.3
sculpture 9.3
window 9.2
attractive 9.1
furniture 8.9
boy 8.7
lifestyle 8.7
spiritual 8.6
happiness 8.6
face 8.5
fun 8.2
parent 8.2
outdoors 8.2
life 8.1
history 8
colorful 7.9
transducer 7.8
worship 7.7
spirituality 7.7
sofa 7.7
casual 7.6
human 7.5
fan 7.5
city 7.5
juvenile 7.5
room 7.4
vintage 7.4
tourism 7.4
style 7.4
church 7.4
emotion 7.4
group 7.2
oriental 7.2
building 7.1

Google
created on 2018-08-20

Microsoft
created on 2018-08-20

person 92.4
posing 40.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Female, 98.1%
Calm 94.5%
Surprised 6.4%
Fear 6.1%
Sad 2.8%
Confused 1.8%
Angry 0.3%
Disgusted 0.3%
Happy 0.3%

AWS Rekognition

Age 13-21
Gender Female, 99.9%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 4.7%
Confused 1%
Disgusted 0.8%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 30-40
Gender Male, 95.1%
Calm 84.3%
Surprised 8.1%
Sad 7.4%
Fear 6%
Confused 1.6%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 1.1%
Confused 0.3%
Angry 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 99.8%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Angry 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 37-45
Gender Female, 95.6%
Calm 84.1%
Surprised 10.1%
Fear 6.3%
Angry 4.6%
Sad 2.9%
Confused 1.6%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Female, 99.8%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Female, 70.8%
Calm 97.9%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.4%
Disgusted 0.2%
Happy 0.2%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 91.6%
Surprised 6.5%
Fear 6%
Confused 3.4%
Sad 2.5%
Disgusted 1.9%
Angry 0.9%
Happy 0.3%

AWS Rekognition

Age 54-62
Gender Male, 100%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Confused 0.6%
Angry 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 21
Gender Female

Microsoft Cognitive Services

Age 34
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Baby 98.7%
Adult 98.3%
Female 98.3%
Woman 98.3%
Boy 97.9%
Child 97.9%
Male 97.9%
Man 97.6%
Necklace 94.4%

Captions

Azure OpenAI

Created on 2024-01-26

This is a Renaissance painting featuring a central figure draped in blue and red garments, holding a child on their lap. To the left and right of the central figure are characters dressed in period clothing, and in the background, there are serene landscape scenes depicting rolling hills, trees, structures, and a clear sky. The middle panel showcases a patterned background, while the outer panels display outdoor settings that contribute to the painting's tranquil and bucolic atmosphere.

Anthropic Claude

Created on 2024-03-29

The image depicts a religious scene featuring the Virgin Mary holding the infant Jesus, surrounded by several other figures. In the center, the Virgin Mary is seated, wearing a red robe and white veil, holding the baby Jesus on her lap. She is flanked by two male figures, one elderly and one younger, who appear to be Saint Joseph and another male saint. In the foreground, there are several other figures, including a young man with long hair and a halo, possibly representing one of the apostles, and two women, one with a white headdress and one with long blonde hair. The background features a detailed, ornate tapestry or textile hanging, as well as a pastoral landscape with buildings in the distance. The overall composition and style suggest this is a Renaissance-era religious painting.