Human Generated Data

Title

Virgin and Child with the Infant Saint John

Date

15th century

People

Artist: Francesco di Simone Ferrucci, Italian 1437 - 1493

Previous attribution: Francesco Rizzi da Santacroce, active late 15th century - early 16th century

Previous attribution: Marco Bello, active early 16th century - d. 1523

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1900.5

Human Generated Data

Title

Virgin and Child with the Infant Saint John

People

Artist: Francesco di Simone Ferrucci, Italian 1437 - 1493

Previous attribution: Francesco Rizzi da Santacroce, active late 15th century - early 16th century

Previous attribution: Marco Bello, active early 16th century - d. 1523

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1900.5

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.8
Person 97.8
Person 97.5
Person 97.3
Art 92.8
Painting 91.8
People 73.3
Drawing 73
Female 71.6
Photo 63.2
Portrait 63.2
Photography 63.2
Face 63.2
Sketch 57.9
Baby 56
Girl 55.8

Clarifai
created on 2020-04-24

people 100
two 99.3
adult 99.1
group 99
three 98.8
portrait 98.5
baby 98.2
child 97
woman 96.3
offspring 96.1
man 94.4
affection 94.1
family 93.6
four 93.3
art 93.2
wear 92.1
print 88.2
religion 87.7
administration 87.1
son 87

Imagga
created on 2020-04-24

mother 54.4
kin 43.5
parent 42.6
child 26.6
portrait 26.5
people 25.7
man 23.5
male 22.5
love 22.1
happy 20.7
couple 19.2
family 18.7
face 18.5
adult 18.1
attractive 17.5
hair 17.4
grandma 17.3
sibling 16.2
black 15.6
smile 15
daughter 14.8
smiling 14.5
together 14
sexy 13.7
person 13.4
lady 13
skin 12.7
happiness 12.5
model 12.4
lifestyle 12.3
father 12.1
body 12
pretty 11.9
old 11.8
human 11.3
senior 11.2
youth 11.1
husband 10.7
fashion 10.6
one 10.5
boy 10.4
home 10.4
dad 10.3
cute 10
antique 9.5
eyes 9.5
sitting 9.5
world 8.9
kid 8.9
hug 8.7
women 8.7
affection 8.7
married 8.6
close 8.6
togetherness 8.5
relationship 8.4
vintage 8.3
romantic 8
baby 8
men 7.7
girlfriend 7.7
brother 7.7
outdoor 7.6
two 7.6
bed 7.6
beach 7.6
erotic 7.6
head 7.6
house 7.5
lying 7.5
relaxed 7.5
outdoors 7.5
relaxing 7.3
looking 7.2
grandfather 7.2
holiday 7.2
childhood 7.2
romance 7.1
posing 7.1
summer 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

person 97.8
drawing 97.3
sketch 96.7
human face 96.6
text 95.8
window 93.4
baby 92.2
painting 88.5
clothing 72.9
child 71.6
black and white 67.4
toddler 58.4
old 40.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Female, 78.3%
Disgusted 0.1%
Sad 0.2%
Angry 0%
Confused 0%
Calm 98.9%
Happy 0%
Surprised 0.8%
Fear 0%

Feature analysis

Amazon

Person
Painting
Person 97.8%

Categories

Captions

Microsoft
created on 2020-04-24

a vintage photo of a baby 72.6%
a vintage photo of a girl 72.5%
a vintage photo of a boy 72.4%

OpenAI GPT

Created by gpt-4 on 2024-12-04

This is a greyscale image depicting a classical painting featuring three figures which appear to be two children and a grown-up, seated indoors. One child is positioned on the left knee of the adult, who appears to be wearing traditional religious attire, which suggests that the figure might represent a nun or a religious woman from a bygone era. The other child is seated slightly in front, clutching a bird. The background of the painting reveals a landscape with rugged mountains and a fortified structure with multiple towers, positioned atop a cliff. The aged quality of the painting is evident through the cracked texture on its surface. The painting is enclosed within a simple, wooden frame.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a classical religious painting, likely from the Renaissance period. The composition shows three figures - a woman in traditional nun's habit with a white headdress, an infant wrapped in light-colored cloth, and a young child wearing what appears to be a laurel wreath. In the background, there's a landscape with mountains and what looks like a castle or fortress with towers on a hill. The painting has some visible cracks in its surface, suggesting its age, and is shown in a frame. The style is characteristic of 15th or 16th century Italian religious art, with its careful attention to drapery and the serene, contemplative mood of the scene. The black and white photograph of the painting adds to its historical quality.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a religious scene with a Madonna figure cradling a sleeping infant, accompanied by another child seated in the foreground. The woman is dressed in a dark hooded robe, and the background features a castle-like structure on a hilltop. The overall tone is somber and contemplative, with the figures appearing in a monochrome palette.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

This image depicts a black and white painting of the Virgin Mary, the infant Jesus, and a young girl. The Virgin Mary is dressed in a dark robe with a white head covering, while the infant Jesus is wearing a white cloth. The young girl, positioned to the right, is adorned with a laurel wreath on her head and wears a sleeveless dress. In the background, a serene landscape unfolds, featuring mountains and a castle situated atop a hill. The overall atmosphere of the painting exudes a sense of peace and tranquility, capturing a tender moment between the Virgin Mary, the infant Jesus, and the young girl.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a black and white photograph of a painting depicting the Virgin Mary holding the infant Jesus, with Saint John the Baptist standing to the right. * The Virgin Mary is wearing a dark robe and a white head covering. * She is holding the infant Jesus in her left arm. * Her right hand is holding a cloth. * The infant Jesus is wearing a white tunic. * He is looking down at his left hand. * Saint John the Baptist is wearing a light-colored tunic and a crown of leaves. * He is looking up at the Virgin Mary. * The background of the painting shows a landscape with mountains and a building in the distance. * The sky is cloudy. The painting appears to be an old work of art, possibly from the Renaissance period. The Virgin Mary and the infant Jesus are depicted in a classical style, while Saint John the Baptist has a more modern appearance. The painting is framed in a light-colored wood frame.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image is a black-and-white painting depicting a religious scene. In the center, a woman dressed in a nun's habit is holding a baby in her arms. The baby is looking towards the viewer, and the woman's gaze is directed downward, suggesting a tender and nurturing moment. On the right side, a young child with a wreath of leaves on his head stands next to the woman and the baby. The background features a castle or fortress with a tower, adding a sense of grandeur and historical context to the scene. The painting is framed in a white frame, enhancing its artistic and historical significance.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image is a black-and-white painting of a woman and two children. The woman is wearing a veil and a robe. She is holding a baby with both hands. The baby is looking down. On the right side, there is a child with a laurel wreath on his head. He is holding a stick. In the distance, there is a castle on top of a mountain.