Human Generated Data

Title

Virgin and Child with the Infant Saint John

Date

15th century

People

Artist: Francesco di Simone Ferrucci, Italian 1437 - 1493

Previous attribution: Francesco Rizzi da Santacroce, active late 15th century - early 16th century

Previous attribution: Marco Bello, active early 16th century - d. 1523

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1900.5

Human Generated Data

Title

Virgin and Child with the Infant Saint John

People

Artist: Francesco di Simone Ferrucci, Italian 1437 - 1493

Previous attribution: Francesco Rizzi da Santacroce, active late 15th century - early 16th century

Previous attribution: Marco Bello, active early 16th century - d. 1523

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1900.5

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.8
Person 97.8
Person 97.5
Person 97.3
Art 92.8
Painting 91.8
People 73.3
Drawing 73
Female 71.6
Portrait 63.2
Photography 63.2
Face 63.2
Photo 63.2
Sketch 57.9
Baby 56
Girl 55.8

Clarifai
created on 2020-04-24

people 100
two 99.3
adult 99.1
group 99
three 98.8
portrait 98.5
baby 98.2
child 97
woman 96.3
offspring 96.1
man 94.4
affection 94.1
family 93.6
four 93.3
art 93.2
wear 92.1
print 88.2
religion 87.7
administration 87.1
son 87

Imagga
created on 2020-04-24

mother 54.4
kin 43.5
parent 42.6
child 26.6
portrait 26.5
people 25.7
man 23.5
male 22.5
love 22.1
happy 20.7
couple 19.2
family 18.7
face 18.5
adult 18.1
attractive 17.5
hair 17.4
grandma 17.3
sibling 16.2
black 15.6
smile 15
daughter 14.8
smiling 14.5
together 14
sexy 13.7
person 13.4
lady 13
skin 12.7
happiness 12.5
model 12.4
lifestyle 12.3
father 12.1
body 12
pretty 11.9
old 11.8
human 11.3
senior 11.2
youth 11.1
husband 10.7
fashion 10.6
one 10.5
boy 10.4
home 10.4
dad 10.3
cute 10
antique 9.5
eyes 9.5
sitting 9.5
world 8.9
kid 8.9
hug 8.7
women 8.7
affection 8.7
married 8.6
close 8.6
togetherness 8.5
relationship 8.4
vintage 8.3
romantic 8
baby 8
men 7.7
girlfriend 7.7
brother 7.7
outdoor 7.6
two 7.6
bed 7.6
beach 7.6
erotic 7.6
head 7.6
house 7.5
lying 7.5
relaxed 7.5
outdoors 7.5
relaxing 7.3
looking 7.2
grandfather 7.2
holiday 7.2
childhood 7.2
romance 7.1
posing 7.1
summer 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

person 97.8
drawing 97.3
sketch 96.7
human face 96.6
text 95.8
window 93.4
baby 92.2
painting 88.5
clothing 72.9
child 71.6
black and white 67.4
toddler 58.4
old 40.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Female, 78.3%
Disgusted 0.1%
Sad 0.2%
Angry 0%
Confused 0%
Calm 98.9%
Happy 0%
Surprised 0.8%
Fear 0%

AWS Rekognition

Age 8-18
Gender Male, 78.2%
Happy 0.1%
Disgusted 0%
Calm 99.6%
Angry 0%
Fear 0%
Surprised 0%
Sad 0.2%
Confused 0%

AWS Rekognition

Age 10-20
Gender Female, 68.7%
Sad 11.3%
Angry 10.2%
Happy 0.8%
Fear 2.3%
Disgusted 1.1%
Calm 71%
Confused 1.3%
Surprised 2%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Painting 91.8%

Categories

Captions

Microsoft
created on 2020-04-24

a vintage photo of a baby 72.6%
a vintage photo of a girl 72.5%
a vintage photo of a boy 72.4%

Azure OpenAI

Created on 2024-12-04

This is a greyscale image depicting a classical painting featuring three figures which appear to be two children and a grown-up, seated indoors. One child is positioned on the left knee of the adult, who appears to be wearing traditional religious attire, which suggests that the figure might represent a nun or a religious woman from a bygone era. The other child is seated slightly in front, clutching a bird. The background of the painting reveals a landscape with rugged mountains and a fortified structure with multiple towers, positioned atop a cliff. The aged quality of the painting is evident through the cracked texture on its surface. The painting is enclosed within a simple, wooden frame.

Anthropic Claude

Created on 2024-11-27

The image depicts a religious scene with a Madonna figure cradling a sleeping infant, accompanied by another child seated in the foreground. The woman is dressed in a dark hooded robe, and the background features a castle-like structure on a hilltop. The overall tone is somber and contemplative, with the figures appearing in a monochrome palette.

Meta Llama

Created on 2024-11-24

The image is a black and white photograph of a painting depicting the Virgin Mary holding the infant Jesus, with Saint John the Baptist standing to the right. * The Virgin Mary is wearing a dark robe and a white head covering. * She is holding the infant Jesus in her left arm. * Her right hand is holding a cloth. * The infant Jesus is wearing a white tunic. * He is looking down at his left hand. * Saint John the Baptist is wearing a light-colored tunic and a crown of leaves. * He is looking up at the Virgin Mary. * The background of the painting shows a landscape with mountains and a building in the distance. * The sky is cloudy. The painting appears to be an old work of art, possibly from the Renaissance period. The Virgin Mary and the infant Jesus are depicted in a classical style, while Saint John the Baptist has a more modern appearance. The painting is framed in a light-colored wood frame.