Human Generated Data

Title

The Virgin and Child with Saint James Major

Date

c. 1510

People

Artist: Andrea Previtali (called Il Cordeliaghi), Italian c. 1480-1528

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Previous attribution: Sebastiano del Piombo, Italian c. 1485 - 1547

Previous attribution: Francesco Bissolo, c. 1470 - 1554

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.101

Human Generated Data

Title

The Virgin and Child with Saint James Major

People

Artist: Andrea Previtali (called Il Cordeliaghi), Italian c. 1480-1528

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Previous attribution: Cima da Conegliano, Italian c. 1460 - c. 1517

Previous attribution: Sebastiano del Piombo, Italian c. 1485 - 1547

Previous attribution: Francesco Bissolo, c. 1470 - 1554

Date

c. 1510

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1939.101

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Painting 99.2
Art 99.2
Person 99.1
Human 99.1
Person 98.1
Person 97.9

Clarifai
created on 2018-03-16

religion 99.9
people 99.8
adult 99.5
woman 99.5
gown (clothing) 98.8
baby 98.7
son 98.6
two 98.2
Mary 98
painting 97.8
child 97.8
god 97.2
group 97.1
sit 96.8
family 96.6
offspring 96.6
wear 96.1
art 95.8
Renaissance 95.7
three 95.6

Imagga
created on 2018-03-16

monk 94.8
adult 26.5
man 24.9
portrait 23.9
religion 23.3
people 21.7
male 21.3
face 19.9
happy 19.4
person 19.1
couple 18.3
prayer rug 17.1
love 16.6
lady 16.2
fashion 15.8
pretty 14.7
attractive 14.7
art 13.7
rug 13.6
church 12.9
mother 12.9
culture 12.8
old 12.5
handsome 12.5
smile 12.1
covering 11.9
dress 11.7
traditional 11.6
fun 11.2
sitting 11.2
model 10.9
family 10.7
spiritual 10.6
faith 10.5
together 10.5
boy 10.4
metropolitan 10.4
religious 10.3
men 10.3
furnishing 10.3
floor cover 10.2
expression 10.2
happiness 10.2
catholic 10.1
god 9.6
ethnic 9.5
smiling 9.4
lifestyle 9.4
youth 9.4
leisure 9.1
alone 9.1
costume 8.9
sexy 8.8
hair 8.7
worship 8.7
prayer 8.7
holy 8.7
saint 8.7
casual 8.5
black 8.4
joy 8.4
clothing 8.3
interior 8
autumn 7.9
cute 7.9
bible 7.8
ancient 7.8
glass 7.8
pray 7.8
jacket 7.7
cathedral 7.7
husband 7.6
head 7.6
passion 7.5
vintage 7.4
sensual 7.3
temple 7.2

Google
created on 2018-03-16

painting 94.2
art 93.2
religion 83.8
modern art 71.9
artwork 63.5
girl 59.2
child 56.4
middle ages 52.2
disciple 51.8
visual arts 51.7
family 50.6
portrait 50.6

Microsoft
created on 2018-03-16

person 99.6
sitting 97.3
sofa 96.1
posing 35.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Female, 97.5%
Calm 83.7%
Disgusted 1.6%
Angry 3.4%
Happy 0.4%
Confused 2.2%
Surprised 2.1%
Sad 6.6%

AWS Rekognition

Age 26-43
Gender Male, 93.7%
Calm 63.5%
Surprised 1.3%
Happy 2.6%
Sad 24.5%
Disgusted 2.1%
Confused 2.4%
Angry 3.6%

AWS Rekognition

Age 4-7
Gender Female, 79.4%
Calm 10.9%
Surprised 7.5%
Angry 20.3%
Sad 18.1%
Disgusted 4.3%
Confused 36%
Happy 2.9%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 17
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.2%
Person 99.1%
Person 98.1%
Person 97.9%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man and a woman -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-04

This image is a classic painting depicting three figures. Two are seated adults, one of whom is holding a small, partially clothed child on their lap. The adult on the left is wearing an orange and green robe and is holding a staff. The adult on the right is dressed in a red and blue attire with a white head covering, possibly a traditional or religious garb. The background features a green curtain with decorative gold patterns. The setting appears to be indoors, given the architectural elements such as columns visible in the background. The overall composition suggests a serene and possibly sacred scene.

Created by gpt-4 on 2024-12-03

This is a classical painting showing two individuals, presumably from a religious scene, sitting next to each other. The person on the left is clothed in a vibrant orange robe with green drapery and appears to be holding a long, wooden staff. Seated next to this figure is an individual wearing a blue garment with a deep scarlet cloak draped over one shoulder. The figure is seated behind a formal parapet, indicating this scene might take place in a traditional or significant setting. A dark green fabric adorned with golden motifs serves as the backdrop, suggesting a scene of importance or reverence. This work, with its rich colors and evident historical context, is likely rooted in religious iconography, and both figures have a serene and composed demeanor.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a classical religious painting depicting the Holy Family. The composition shows three figures against an ornate background featuring columns and a green cloth with gold decorative patterns. The painting showcases rich, vibrant colors - particularly the yellow and green robes on the left figure, and the blue and red garments of the figure on the right, who wears a white head covering. Between them is an infant. The figure on the left holds what appears to be a staff or walking stick. The painting style and subject matter suggest this is from the Renaissance period, with its characteristic attention to fabric textures, architectural elements, and religious themes. The background includes classical architectural elements like columns, and the overall composition demonstrates the formal, symmetrical arrangement typical of religious art from this era.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a religious scene showing the Virgin Mary holding the infant Jesus, with a man believed to be Saint Joseph standing beside them. The Virgin Mary is shown wearing a white veil and a red robe, while the infant Jesus is cradled in her arms. Saint Joseph is depicted in a green and yellow robe, holding what appears to be a staff or walking stick. The background features ornate, decorative elements, creating a rich and elaborate setting for the sacred figures.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

This image is a painting of the Holy Family, depicting Jesus Christ, Mary, and Joseph.

The painting features Jesus as a baby, being held by Mary, who is wearing a blue robe with a red and gold cloak. Joseph is standing to the left of Mary, wearing an orange robe with a green cloak. He is holding a staff in his right hand and has his left hand on his chest.

The background of the painting is a wall with a column and a green curtain with gold designs. The overall atmosphere of the painting is one of serenity and devotion, capturing a tender moment between the Holy Family.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a painting of the Holy Family, consisting of Jesus, Mary, and Joseph. Jesus is on the left, holding a staff in his right hand and wearing an orange robe with a green sash. He has long brown hair and a beard. Mary is on the right, wearing a red robe with a white head covering and a blue dress underneath. She is holding a baby Jesus in her lap, who is naked and waving his right hand. Joseph is standing behind Mary, wearing a yellow robe with a green sash. The background of the painting features a green curtain with gold designs and a stone wall with a column. The overall atmosphere of the painting is one of serenity and reverence, capturing a moment of intimacy and love within the Holy Family.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a man, a woman, and a baby. The man is holding a stick, and the woman is holding a baby. The baby is wearing a cross necklace. The woman is wearing a white veil. Behind them is a column, and a curtain is hanging on the wall. The curtain has a golden design. The painting has a brown border.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The painting depicts the Holy Family with St. Joseph holding a staff, the Virgin Mary holding the Christ Child, and the Christ Child looking up at St. Joseph. The Virgin Mary wears a red robe with a white veil, while St. Joseph wears a green robe. The painting is framed by a green curtain with gold patterns.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The painting depicts a religious scene with three figures: Joseph, Mary, and the infant Jesus. Joseph stands on the left, holding a staff and wearing a yellow robe with a green lining. Mary is positioned in the center, cradling the baby Jesus in her arms. She is dressed in a blue robe with a red cloak draped over her shoulders, and her head is covered with a white veil. The infant Jesus is naked and raises his right hand in a gesture.

The background features a column on the left, a curtain with a patterned design behind Mary, and a marble ledge at the bottom of the painting. The style of the painting is reminiscent of Renaissance art, with attention to detail in the clothing, facial expressions, and composition of the scene.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression: The image is a religious painting, likely depicting a scene from the New Testament, possibly the Presentation of Jesus at the Temple or a similar event. It appears to be an older artwork, possibly from the Renaissance or Baroque period, based on its style and composition.

Key Elements and Composition:

  • Figures: The central figures are Mary, the Virgin Mother, holding a naked baby, presumably Jesus. Saint Joseph is to Mary's left, holding a staff.
  • Mary: She wears a white veil, and a blue dress. She is wrapped in a red cloak with gold trim. Her expression is serene.
  • Jesus: A baby, held by Mary, is looking at Saint Joseph. His arm is up, pointing at Joseph.
  • Saint Joseph: He has a beard and holds a staff in his left hand. His expression is thoughtful. He wears a yellow shirt under a green cloak.
  • Background: A draped backdrop in dark green is behind Mary. It has a golden pattern.
  • Setting: They are positioned behind a brown stone structure.

Artistic Style and Technique:

  • Colors: The painting uses rich, vibrant colors, particularly the reds, greens, yellows, and blues.
  • Lighting: The light appears to be coming from the left side of the painting, casting soft shadows.
  • Details: The details, such as the folds of the fabrics and the expressions on the figures' faces, are well-rendered.

Overall, the painting is a classic religious composition with a focus on the figures and their expressions. The artwork showcases skillful execution and a reverence for religious themes.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a religious painting, specifically a representation of the Holy Family. The scene includes three figures:

  1. Mary: She is seated on the right side of the image, holding the infant Jesus. Mary is dressed in traditional robes, with a blue undergarment and a red outer robe, and she wears a white head covering.

  2. Jesus: The infant Jesus is depicted as a small child, held by Mary. He is making a gesture with his right hand, possibly in blessing or communication.

  3. Joseph: He is on the left side of the image, standing and leaning on a staff. Joseph is dressed in a yellow robe with a green inner garment. His expression appears contemplative as he looks at the infant Jesus.

The background features architectural elements such as columns and a decorative drapery with gold patterns, suggesting a setting of reverence and solemnity. The overall style and composition of the painting indicate it is likely from the Renaissance period, characterized by its detailed rendering and use of perspective.