Human Generated Data

Title

Madonna

Date

19th century

People

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1294

Human Generated Data

Title

Madonna

People

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G1294

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Human 98.7
Person 98.7
Person 98.2
Person 97.8
Art 93.9
Person 92.3
Painting 80.7
Photo 61.4
Photography 61.4
Portrait 61.4
Face 61.4

Clarifai
created on 2019-10-30

people 98.3
child 97.6
woman 97.6
love 94.7
family 94.2
adult 92.5
baby 92.2
portrait 92.1
two 91
group 90.2
man 88.3
girl 88.2
son 87.9
sit 85.9
indoors 85.5
three 85.1
young 84.3
affection 82.9
art 80.4
retro 80.3

Imagga
created on 2019-10-30

kin 47.4
sexy 37.8
attractive 30.1
love 30
body 29.6
child 28.5
people 26.8
adult 26.5
couple 26.2
man 25.7
model 24.9
sensual 23.7
fashion 23.4
pretty 22.4
portrait 20.7
erotic 20.6
skin 20.4
male 20.4
sibling 20
hair 19.8
person 19.4
passion 18.8
lady 18.7
sex 17.5
sensuality 17.3
bed 17.1
face 16.4
black 16.2
lingerie 16.1
lifestyle 15.9
romance 15.2
two 14.4
seductive 14.4
romantic 14.3
relationship 14.1
happy 13.8
boyfriend 13.5
human 13.5
girlfriend 13.5
blond 13.1
women 12.7
naked 12.6
sexual 12.5
desire 12.5
one 12
style 11.9
underwear 11.6
parent 11.5
together 11.4
hands 11.3
lying 11.3
home 11.2
mother 11
gorgeous 10.9
intimate 10.8
kiss 10.8
nude 10.7
togetherness 10.4
emotion 10.2
cute 10.1
husband 9.9
life 9.8
fun 9.7
hug 9.7
lovers 9.7
bedroom 9.7
looking 9.6
brunette 9.6
muscular 9.6
baby 9.3
smile 9.3
tattoo 9.2
make 9.1
interior 8.9
embracing 8.8
lover 8.8
boy 8.7
happiness 8.6
relaxation 8.4
hot 8.4
lips 8.3
girls 8.2
valentine 8.2
daughter 8.1
father 8
handsome 8
family 8
indoors 7.9
heterosexual 7.9
kissing 7.9
bra 7.8
provocative 7.8
hugging 7.8
eyes 7.8
tan 7.7
married 7.7
glamor 7.7
loving 7.6
studio 7.6
hand 7.6
elegance 7.6
healthy 7.6
feminine 7.5
care 7.4
pumpkin 7.4
cheerful 7.3
dad 7.3
relaxing 7.3
posing 7.1

Google
created on 2019-10-30

Microsoft
created on 2019-10-30

baby 96.7
human face 94.2
text 92.4
person 88.1
art 83.4
clothing 76.9
painting 76.5
toddler 62.3
posing 45

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 5-15
Gender Female, 98.1%
Fear 0.3%
Confused 0.5%
Angry 0.4%
Happy 2.4%
Sad 1.1%
Calm 94%
Surprised 1%
Disgusted 0.2%

AWS Rekognition

Age 6-16
Gender Female, 92.8%
Fear 0%
Confused 0.1%
Angry 0.2%
Happy 0.5%
Sad 0.2%
Calm 98.2%
Surprised 0.3%
Disgusted 0.5%

AWS Rekognition

Age 1-7
Gender Female, 94.8%
Happy 9.8%
Fear 1.3%
Disgusted 2.2%
Angry 42.8%
Sad 2.2%
Surprised 5.5%
Confused 3.9%
Calm 32.2%

AWS Rekognition

Age 32-48
Gender Male, 70.6%
Happy 3.8%
Angry 0.4%
Disgusted 0.1%
Calm 62.8%
Sad 32.7%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 5-15
Gender Female, 99.3%
Angry 0.5%
Sad 10.2%
Disgusted 0.5%
Fear 0.3%
Calm 86.5%
Happy 0.2%
Confused 1.5%
Surprised 0.3%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 98.7%
Person 98.2%
Person 97.8%
Person 92.3%
Painting 80.7%

Categories

Imagga

pets animals 93.1%
people portraits 6.3%

Captions

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-30

The image appears to be a detailed engraving of a religious scene featuring four figures with halos, indicating their saintliness or divinity. The central figure, a woman in traditional biblical attire, is holding a young child. To her side, another seated woman in similar attire interacts with the child. To the right, another child, somewhat older, holds a cross-like object. The scene is rich with classical drapery and the background features arches and architectural elements that are typical of Renaissance-style religious artwork. The text at the bottom dedicates the work to "Sua Eccellenza Don Carlo Michele Stuart" and mentions other details such as titles and roles, which suggest the print was made in honor of a notable individual.

Created by gpt-4 on 2025-01-30

This is a grayscale image of an engraving that appears to represent a scene with religious or historical significance. In the foreground, two infants are depicted, one sitting and the other slightly raised in the lap of a seated adult figure. The adult figure is wearing traditional clothing that includes a draped fabric or mantle. To the left, another figure (partially obscured) appears to be in a seated or kneeling position, facing towards the central figures. These figures seem to be within an interior setting, indicated by the architectural elements like a window or doorway in the background to the right. The bottom of the image contains an inscription. It appears to be a dedication or attribution to a person of distinction, though the specific details are not mentioned. The formality and style of the text suggest that the image may have been produced as an official or commemorative piece, possibly during the late 18th or early 19th centuries, as suggested by the style of the characters' clothing and the engraving technique. The composition of the image, with careful attention to the rendering of textiles and anatomy, suggests it's probably a work based on religious art, intended for an audience that appreciates finely detailed engravings. The solemnity of the figures and the intimate interaction between them indicate that the scene may portray a moment of tenderness, care, or reverence.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-01-30

This appears to be a religious artwork rendered as an engraving or print, likely from the Renaissance period. It depicts a sacred scene featuring figures with halos, suggesting their divine or holy nature. The composition shows several individuals, including what appears to be the Madonna and Child in the center, accompanied by other holy figures. The artwork is executed in a monochromatic style with fine line work typical of engravings from this era. At the bottom of the image, there is text in Italian dedicating the work to "Don Carlo Michele Stuart." The scene has a tender, intimate quality, with the figures arranged in close proximity to each other within an architectural setting suggested by an arched window in the background.

Created by claude-3-opus-20240229 on 2025-01-30

The image depicts a classic religious painting or engraving titled "A Sua Eccellenza Don Carlo Michele Stuart" (To His Excellency Don Carlo Michele Stuart). It shows the Virgin Mary tenderly holding the infant Jesus, surrounded by three angelic cherubs or putti figures. Mary and the cherubs have halos, signifying their holy status. They are posed in an intimate, familial arrangement with the Christ child at the center. The artwork has a soft, ethereal quality achieved through the delicate shading and drapery folds. It exemplifies the reverential, idealized portrayal of the Madonna and Child that was common in Italian Renaissance and Baroque religious art.

Created by claude-3-haiku-20240307 on 2025-01-30

The image depicts a religious scene featuring the Virgin Mary with the infant Jesus, along with two other figures, likely representing saints or angels. The figures are rendered in a classical, academic style characteristic of religious art from the 19th century or earlier. The overall composition and style suggest this is a reproduction or print of a painting or engraving from a religious or historical source.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-03-14

The image is a black and white engraving of the Madonna and Child with Saint Elizabeth and John the Baptist. The Madonna is seated, wearing a dark veil and robe, with her right arm around the child and her left arm around Saint Elizabeth. The child is nude and reaching out to Saint Elizabeth, who is also nude and holding a basket. John the Baptist is sitting on the right, holding a cross and looking at the Madonna. The background is dark, with a window visible behind the figures. The engraving is signed "A Sua Eccellenza Don Carlo Michele Stuart" and dated "Anno 1781." It appears to be a reproduction of a famous painting, possibly by Raphael or another artist from the Renaissance period.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-03-14

The image is a black-and-white engraving of the Virgin Mary and the Christ child surrounded by other figures. The Virgin Mary is seated in the center, wearing a dark robe with a halo around her head. She holds the Christ child on her lap, who is also wearing a halo. To the left of the Virgin Mary is an older woman, possibly Saint Anne, who is looking at the Christ child. On the right side of the image is a young boy, possibly John the Baptist, who is holding a cross. At the bottom of the image is a caption in Italian that reads "A Sua Eccellenza Don Carlo Michele Stuart" and includes other text that is difficult to read. The background of the image is dark, with a window visible behind the figures. The overall atmosphere of the image is one of reverence and devotion, with the figures depicted in a formal and dignified manner.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-30

The image depicts a vintage black-and-white photograph of a painting of four people, possibly a family. The painting is titled "A Sua Eccellenza Don Carlo Michele Stuart" and has a white border. The painting depicts a woman, possibly the Virgin Mary, holding a baby, possibly Jesus, in her arms. On the left side, a woman, possibly Saint Elizabeth, is holding a baby, possibly John the Baptist. On the right side, a boy, possibly Jesus as a child, is holding a cross.

Created by amazon.nova-lite-v1:0 on 2025-01-30

The image is a black-and-white etching titled "A Sua Eccellenza Don Carlo Michele Stuart." It depicts a religious scene featuring the Virgin Mary, who is seated and holding a baby Jesus in her lap. The baby Jesus is reaching out to a young boy on the right side of the image. On the left side, an elderly woman is kneeling and holding the baby Jesus's hand. The image also includes a window with an arch and a curtain, and there is a text inscription at the bottom of the image.

Text analysis

Amazon

STUART
DON
SUA
ECCELLENZA
MICHELE
A SUA ECCELLENZA DON CARLO MICHELE STUART
A
CARLO
anonma
prima
Conte
mpanmt
dh
de
Blase
Grande
261.
da
mantassimo
Nodeea
anonma tm :. mpanmt
.3049 261.
Belel
Duea dh Berwrckhe d Wla Conte dh Nodeea Grande de Goagma dh prima Blase da ae
mantassimo Ppetettlere dll Belel otis
Ppetettlere
otis
Bmamed
dll
Berwrckhe
:.
.3049
tm
Goagma
1.
d
g
9
cheeh Bmamed SSi 1. g 9
Duea
Wla
cheeh
Sing
Sing mprove
mprove
ae
SSi

Google

Mdonna dte dell Impannata A SUA ECCELLENZA DON CARLo MICHELE STUART Duau de Breowick edeMa Conte de odhen Grande de ge de feoma Clase Na deae eAmantisine Retettore dell Bell h Emered Copuial de Si Lg Barde npe DD.D
Mdonna
dte
dell
Impannata
A
SUA
ECCELLENZA
DON
CARLo
MICHELE
STUART
Duau
de
Breowick
edeMa
Conte
odhen
Grande
ge
feoma
Clase
Na
deae
eAmantisine
Retettore
Bell
h
Emered
Copuial
Si
Lg
Barde
npe
DD.D