Human Generated Data

Title

The Virgin and Child with Saints Jerome and Francis (after Raphael's painting in the Gemaldegalerie, Staatliche Museum, Berlin, No 145)

Date

1500-1520

People

Artist: Raphael, Italian 1483 - 1520

Previous attribution: Raphael, Italian 1483 - 1520

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of The Felix M. and Frieda Schiff Warburg Foundation, 1959.36

Human Generated Data

Title

The Virgin and Child with Saints Jerome and Francis (after Raphael's painting in the Gemaldegalerie, Staatliche Museum, Berlin, No 145)

People

Artist: Raphael, Italian 1483 - 1520

Previous attribution: Raphael, Italian 1483 - 1520

Date

1500-1520

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of The Felix M. and Frieda Schiff Warburg Foundation, 1959.36

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 97.5
Human 97.5
Art 95.9
Person 95.3
Painting 95.1
Person 94.5
Apparel 93.3
Clothing 93.3
Hat 93.3
Person 85.9
Drawing 85.5
Female 68
Photography 67.4
Photo 67.4
Face 67.4
Portrait 67.4
People 64.3
Sketch 58.2

Clarifai
created on 2020-04-24

people 100
portrait 98.8
child 98.5
baby 98.3
adult 97.6
son 97.5
two 97.2
three 96.8
group 96.3
administration 96
affection 95.8
man 95.1
offspring 95
family 93.4
art 89.6
wear 87.6
reproduction 87
retro 86.3
facial expression 86
four 85.3

Imagga
created on 2020-04-24

brother 42.8
mother 36.6
sibling 34
child 31.4
parent 30.5
love 26.8
family 22.2
portrait 22
people 21.2
man 20.8
male 20.1
person 17.5
happy 16.9
father 16.4
grandfather 16
dad 15.5
adult 14.9
couple 14.8
black 14.4
kid 14.2
old 13.9
face 13.5
smile 12.8
grandma 12.8
human 12.7
boy 12.2
hair 11.9
husband 11.4
together 11.4
wife 11.4
kin 11.3
happiness 11
smiling 10.8
lady 10.5
daughter 10.4
home 10.4
life 10.3
cute 10
baby 10
house 10
childhood 9.9
ancient 9.5
skin 9.3
religion 9
looking 8.8
body 8.8
married 8.6
loving 8.6
attractive 8.4
dark 8.3
vintage 8.3
one 8.2
dress 8.1
light 8
antique 7.8
model 7.8
hug 7.7
expression 7.7
youth 7.7
hand 7.6
relationship 7.5
emotion 7.4
sexy 7.2
art 7.2
little 7.1

Google
created on 2020-04-24

Photograph 97
People 93.4
Picture frame 83.4
Portrait 81.2
Child 80.1
Painting 73.7
Stock photography 70.9
Art 69.5
Photography 67.8
Family 55.7

Microsoft
created on 2020-04-24

baby 97.9
text 96.5
human face 96.2
sketch 95.1
drawing 94.7
painting 93.7
person 93.4
toddler 90
child 68.4
picture frame 64.2
old 64.2
clothing 63.5
art 54.1
vintage 40.6
posing 39.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Male, 99.2%
Angry 0.5%
Calm 90.5%
Disgusted 0.2%
Happy 0%
Fear 0%
Confused 2.6%
Surprised 0.1%
Sad 6.2%

AWS Rekognition

Age 22-34
Gender Female, 86.7%
Angry 0.1%
Sad 0.1%
Fear 0%
Surprised 0.1%
Happy 0.1%
Confused 0%
Calm 99.4%
Disgusted 0.1%

AWS Rekognition

Age 49-67
Gender Male, 95.4%
Confused 0.1%
Sad 2.4%
Calm 97.3%
Fear 0%
Happy 0%
Disgusted 0.1%
Angry 0.1%
Surprised 0%

AWS Rekognition

Age 21-33
Gender Female, 58.1%
Surprised 0.1%
Angry 0%
Disgusted 0.3%
Calm 98.2%
Fear 0%
Confused 0.1%
Happy 0.3%
Sad 1%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 50
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Hat
Person 97.5%
Person 95.3%
Person 94.5%
Person 85.9%
Painting 95.1%
Hat 93.3%

Categories

Imagga

people portraits 98.3%
paintings art 1.4%

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-04

The image shows a classic artwork framed by a simple border. The painting is in grayscale, depicting a figure in robes with visible hands. One hand is gesturing while the other appears to be holding something. In the background, a distant landscape with slight architectural structures can be observed. The painting exhibits characteristics of Renaissance art in its attention to detail and the use of sfumato, a technique that allows tones and colors to gradually fade into one another, producing softened outlines or hazy forms.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This appears to be a religious painting from the Renaissance period, shown in black and white. The composition shows four figures: a woman in dark clothing with a head covering in the center, an infant, a figure wearing a cap on the left, and another figure in what appears to be monk's robes on the right. The painting has the characteristic style and subject matter of religious art from that era, with a tender, contemplative mood. There's a faint background visible showing what appears to be architectural elements like a church spire. The painting is framed and the photograph shows some aging or wear typical of old artworks.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a religious scene featuring a central figure of a woman holding a young child in her arms. The woman appears to be the Virgin Mary, as indicated by her serene expression and the childlike figure she is cradling. Flanking the central figures are two older men, likely representing religious figures such as saints or apostles. The overall composition and somber tones suggest a Renaissance-style religious painting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-29

The image depicts a black-and-white painting of the Virgin Mary holding the infant Jesus, surrounded by two men. The Virgin Mary is positioned centrally in the image, wearing a dark dress and a headscarf that covers her hair. She holds the infant Jesus in her arms, who is depicted as a naked baby. To the left of the Virgin Mary stands a man with a long beard, wearing a hat and a dark robe. He is shown with his right hand raised to his chin, as if in contemplation or prayer. On the right side of the Virgin Mary is another man, who is balding and also dressed in dark attire. His hands are clasped together in front of him, conveying a sense of reverence or devotion. In the background of the painting, there appears to be a landscape or cityscape, although it is not clearly defined due to the black-and-white nature of the image. The overall atmosphere of the painting suggests a religious or devotional theme, with the Virgin Mary and the infant Jesus being the central figures. The presence of the two men adds a sense of depth and context to the scene, and their facial expressions and body language convey a sense of reverence and admiration for the holy figures.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-25

The image is a black-and-white photograph of an oil painting depicting the Holy Family, featuring Mary holding the infant Jesus, Joseph on her left, and John the Baptist on her right. The painting is framed in a white border. * **Mary** * She is dressed in dark robes and a head covering. * Her face is serene, with her eyes cast downward toward the baby. * She holds the baby Jesus in her lap. * **Joseph** * He is positioned on Mary's left side. * He wears a dark robe and a hat. * His face is calm, with his eyes closed in prayer. * **John the Baptist** * He stands on Mary's right side. * He is dressed in dark robes. * His face is solemn, with his eyes fixed intently on the baby. * **Baby Jesus** * He is held by Mary in her lap. * He is depicted as a naked infant. * His face is peaceful, with his eyes closed. * **Background** * The background of the painting is a light-colored sky. * There are no other figures or objects visible in the background. * **Frame** * The painting is framed in a white border. * The frame is simple and unadorned. In summary, the image is a black-and-white photograph of an oil painting depicting the Holy Family, featuring Mary, Joseph, John the Baptist, and the infant Jesus. The painting is framed in a white border and features a serene and peaceful scene.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a painting of the Holy Family, featuring Mary, Joseph, and the infant Jesus. The painting is framed in a traditional, ornate frame with a white border. The figures are rendered in a monochromatic style, giving the image a timeless and serene quality. Mary, dressed in a flowing robe, is holding the infant Jesus in her lap, while Joseph stands to her left, gazing at the child with reverence. The infant Jesus, with a gentle expression, reaches out his hand towards Joseph, symbolizing the bond between the family members. The background is intentionally kept simple, allowing the focus to remain on the Holy Family. The overall composition exudes a sense of tranquility and devotion, capturing the essence of the Holy Family's love and unity.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The painting depicts a man, a woman, and a baby. The man is wearing a hat and is holding the baby. The woman is looking at the baby. The baby is wearing a white cloth and is looking at the man. The man and woman are wearing long-sleeved shirts. The painting is framed with a white border. In the distance, there is a blurry view of a city with a tower.