Human Generated Data

Title

The Mater Dolorosa

Date

mid 1490s

People

Artist: Aelbert Bouts, Netherlandish c. 1451/54 - 1549

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, The Kate, Maurice R. and Melvin R. Seiden Special Purchase Fund in honor of Marjorie B. Cohn, 2001.171

Human Generated Data

Title

The Mater Dolorosa

People

Artist: Aelbert Bouts, Netherlandish c. 1451/54 - 1549

Date

mid 1490s

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, The Kate, Maurice R. and Melvin R. Seiden Special Purchase Fund in honor of Marjorie B. Cohn, 2001.171

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 88.6
Apparel 88.6
Art 83.2
Person 77.9
Human 77.9
Finger 73.1
Painting 63

Clarifai
created on 2018-03-16

people 98.7
one 96.4
portrait 96
woman 95.4
adult 92.1
child 91.3
scarf 90.4
veil 87.6
wear 87.4
man 85.9
girl 85.7
adolescent 85.5
fashion 83.8
lid 83
cap 82.6
cute 80.4
young 80.2
traditional 80
religion 79.7
face 78.3

Imagga
created on 2018-03-16

person 45.7
white 37.5
portrait 33
face 27.7
hat 27.6
attractive 27.3
eyes 25.8
smile 25.7
child 25.3
adult 25.2
cute 25.1
people 23.5
expression 22.2
smiling 21
happy 20.7
youth 20.5
fashion 20.4
pretty 20.3
man 20.2
male 18.3
hair 18.2
clothing 16.5
casual 16.1
boy 15.7
model 15.6
teenager 15.5
looking 15.2
blond 14.9
lady 13.8
lifestyle 13.7
sexy 13.7
black 12.7
ethnic 12.4
teen 12
handsome 11.6
skin 11
girls 10.9
gorgeous 10.9
studio 10.6
cap 10.6
facial 10.5
cold 10.3
women 10.3
head 10.1
dark 10
childhood 9.9
cheerful 9.8
human 9.8
brunette 9.6
closeup 9.4
close 9.1
sweater 9.1
covering 9.1
make 9.1
garment 9
fun 9
one 9
sweatshirt 8.8
ethnicity 8.7
hairstyle 8.6
wearing 8.6
winter 8.5
long 8.3
guy 8.1
kid 8
love 7.9
look 7.9
happiness 7.8
diversity 7.7
serious 7.6
gesture 7.6
lips 7.4
warm 7.4

Google
created on 2018-03-16

portrait 88.5
painting 88.1
art 82.2
abbess 62.6
modern art 61
artwork 59.1
girl 54.2
window 50.3
visual arts 50.3

Microsoft
created on 2018-03-16

person 92

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Female, 96.7%
Angry 2.2%
Happy 11%
Calm 48.5%
Surprised 9.5%
Confused 5.1%
Disgusted 2.7%
Sad 20.9%

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 77.9%
Painting 63%

Captions

Microsoft
created on 2018-03-16

a person wearing a hat 84.5%
a person taking a selfie 84.4%
a person looking at the camera 84.3%

OpenAI GPT

Created by gpt-4 on 2024-01-27

The image depicts a classic painting with a figure clothed in a blue garment with a golden trim and a white inner garment. The person is posed with hands pressed together in a gesture of prayer or devotion. The background has a golden, dotted texture, and the figure is framed within an arched structure. The style of the clothing and the nature of the pose suggest a religious or historical theme.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image appears to depict a pious and sorrowful woman wearing a blue hooded cloak. Her face is shown in close-up, with tears streaming down her cheeks as she gazes intently and pensively. The background is a golden, honeycomb-like pattern, which creates a sense of religious atmosphere and symbolism around the central figure. The woman's hands are clasped in prayer, conveying a sense of devotion and supplication. The overall impression is one of deep emotion and contemplation.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a painting of the Virgin Mary, characterized by her blue hooded cloak and white head covering. Her hands are clasped together in prayer, with her eyes cast downward. The background of the painting is a warm, golden color, which serves to accentuate the somber and contemplative mood of the scene. The overall effect of the painting is one of reverence and devotion, inviting the viewer to reflect on the significance of the Virgin Mary in religious tradition.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a painting of the Virgin Mary, titled "The Virgin Mary in Prayer" or "The Virgin Mary Weeping," created by Albrecht Dürer in 1495. It is an oil on panel painting that measures 31.1 cm x 24.1 cm. In this painting, Mary is depicted wearing a blue robe with gold trim and a white head covering. Her hands are clasped together in prayer, and her face is filled with sorrow and compassion. She has tears streaming down her cheeks, which are a testament to her deep emotional state. The background of the painting is a warm, golden yellow, which adds to the overall sense of warmth and intimacy. The frame of the painting is made of wood and has a simple, yet elegant design. Overall, "The Virgin Mary in Prayer" is a beautiful and poignant painting that captures the essence of Mary's devotion and compassion. It is a testament to Dürer's skill as an artist and his ability to convey deep emotions through his work.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a painting of a woman in a prayerful pose. The woman is dressed in a blue robe with a white hood, and she is clasping her hands together in front of her chest. Her face is turned to the left, and she has a serene and contemplative expression. The background of the painting is a gold-colored cloth with a pattern of small dots. The painting is framed in a wooden frame with a dark brown border.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image depicts a painting of a woman with a sad face, probably crying. She is wearing a white veil, a blue robe, and a black shawl. She is probably praying, with her hands clasped together. The background is a yellow-orange color with a dotted pattern. The woman's face is illuminated by a light that is probably coming from the right side. The painting is framed with a red border.