Human Generated Data

Title

Drawing

Date

19th century

People

Artist: Joseph Mallord William Turner, British 1775 - 1851

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Frederick W. Fish, 1944.22.45

Human Generated Data

Title

Drawing

People

Artist: Joseph Mallord William Turner, British 1775 - 1851

Date

19th century

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Frederick W. Fish, 1944.22.45

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Painting 99.8
Art 99.8
Human 96
Person 96
Person 92
Person 86.2
Home Decor 71.5
Linen 71.5
Photography 60.1
Photo 60.1
Face 60.1
Portrait 60.1
Person 44.2

Clarifai
created on 2019-05-31

painting 100
art 99.9
religion 99.9
saint 99.8
Renaissance 99.7
baby 99.6
god 99.5
people 99.4
illustration 99.3
book 99
adult 98.4
aura 98.3
Mary 98.1
veil 97.5
holy 97
man 96.5
print 96.2
woman 95.9
kneeling 95.6
facial hair 94.8

Imagga
created on 2019-05-31

cadaver 56.2
religion 26.9
person 26.1
book jacket 21.2
art 21
fan 19.1
people 17.8
monk 17.6
man 17.5
jacket 17.5
god 17.2
religious 16.9
old 16
sculpture 15.9
church 15.7
male 15.6
temple 15.2
follower 14.7
adult 13.6
pray 13.6
prayer 13.5
sitting 12.9
face 12.8
statue 12.6
wrapping 12.5
holy 12.5
spiritual 12.5
faith 12.4
culture 12
portrait 11.6
traditional 10.8
colorful 10.7
belief 10.7
saint 10.6
travel 10.6
fashion 10.5
happy 10
color 10
bible 9.8
attractive 9.8
sacred 9.7
worship 9.7
spirituality 9.6
antique 9.5
love 9.5
costume 9.4
orange 9.2
peace 9.1
covering 9.1
mother 9
catholic 8.8
hair 8.7
scene 8.7
cathedral 8.6
gold 8.2
dress 8.1
lady 8.1
ancient 7.8
model 7.8
golden 7.7
wall 7.7
pretty 7.7
figure 7.6
historical 7.5
human 7.5
east 7.5
tourism 7.4
smile 7.1
interior 7.1
dancer 7
architecture 7

Google
created on 2019-05-31

Painting 98.1
Art 89.2
Prophet 66.5
Mythology 61.3
Visual arts 55
Tapestry 52.7

Microsoft
created on 2019-05-31

text 96.8
book 95.6
person 90.9
drawing 90
human face 74.6
museum 63
mythology 54.4
painting 31.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 85.5%
Disgusted 0.7%
Happy 0.8%
Surprised 0.7%
Sad 19.4%
Angry 1.7%
Confused 0.8%
Calm 75.9%

AWS Rekognition

Age 26-43
Gender Female, 51.2%
Disgusted 9.2%
Calm 74.2%
Sad 3.1%
Confused 3.3%
Angry 3.6%
Surprised 3.1%
Happy 3.6%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Angry 45.3%
Happy 45.2%
Calm 53.2%
Surprised 45.3%
Sad 45.6%
Confused 45.3%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Sad 49.5%
Calm 49.5%
Surprised 49.5%
Angry 49.6%
Disgusted 50.2%
Happy 49.5%
Confused 49.5%

AWS Rekognition

Age 14-25
Gender Male, 50.4%
Angry 49.5%
Sad 49.6%
Happy 49.6%
Confused 49.5%
Surprised 49.6%
Calm 50.2%
Disgusted 49.5%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.8%
Person 96%
Person 92%
Person 86.2%
Person 44.2%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2025-03-10

This is a classic-style painting featuring a scene with multiple figures. In the foreground, there are two children; one is lying down, while the other is sitting up and seems to be holding something. They appear to be resting on a golden drapery that covers a blue garment. A tree trunk is part of the background, splitting the scenery into two segments. On the right-hand side, a group of figures is depicted in the upper section, some standing while others are kneeling or sitting, also with drapery elements in red and blue shades, seemingly engaged in some sort of activity. The rich use of colors and flowing draperies suggest a dynamic and possibly dramatic narrative moment within the painting.

Created by gpt-4o-2024-05-13 on 2025-03-10

This image depicts a classical or biblical scene featuring multiple figures in a natural setting. In the foreground, a female figure dressed in a blue garment is seated with an infant on her lap. This infant is nursing, while another young child next to her is offering a vessel or jug to the seated woman. Behind them, a male figure in a red and blue robe raises their hands in a gesture of supplication or praise. In the background, other figures are engaged in various activities, possibly descending a slope or involved in a different narrative element. The image conveys a sense of pastoral serenity and familial interaction.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2025-01-15

This is a religious painting, likely from the Baroque period, depicting a holy family scene. The composition shows figures in classical dress, with a woman in blue robes seated with children, and a man in red and blue garments standing behind them with his arms raised. The painting features rich colors, particularly deep blues, reds, and golds. In the background, there are additional figures gathered on a hillside. The style is dramatic and emotional, characteristic of Baroque religious art, with dynamic poses and theatrical lighting. The painting appears to be executed with oil or tempera, showing the sophisticated modeling and luminous quality typical of this period's artistic techniques.

Created by claude-3-opus-20240229 on 2025-01-15

The image depicts a religious scene, likely from the Bible. In the center, a woman in a blue dress is seated, holding a baby. A bearded man in red and blue robes stands behind her with his arms outstretched, as if preaching or blessing those around him. Several cherub-like figures surround them, some sitting at the woman's feet. The color palette features rich earth tones of brown, red, and gold. The style appears to be from the Baroque period, with dramatic lighting and expressive poses characteristic of that artistic movement. Overall, the painting conveys a sense of reverence and depicts an important moment or lesson being imparted.

Created by claude-3-haiku-20240307 on 2025-01-15

The image appears to depict a religious or mythological scene. In the center, a woman in blue robes is shown surrounded by cherubs or child figures. A man in colorful, elaborate robes stands beside her, gesturing with his hands. In the background, there are several other figures, some of whom seem to be observing the central scene. The overall composition and style suggest this is likely a painting or artistic representation of a symbolic or allegorical subject, though I cannot identify the specific subject or characters depicted.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-01-15

The image is a painting of a family scene, with a man and woman surrounded by children. The man is dressed in a blue shirt with gold accents and a pink robe, while the woman wears a blue dress and a white head covering. She is breastfeeding one child, while another child plays with a jug nearby. In the background, there are several other people, some of whom appear to be angels or other supernatural beings. The overall atmosphere of the painting is one of warmth and intimacy, with the family members interacting with each other in a loving and nurturing way.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-01-15

The image is a painting of the Holy Family, depicting Mary, Joseph, and Jesus. The painting is in the style of Renaissance art, with vivid colors and detailed brushwork. Mary is seated on the ground, holding Jesus in her lap, while Joseph stands behind them, looking out at the viewer with a sense of concern. The background of the painting is a warm, earthy tone, with hints of green and blue.

The overall mood of the painting is one of serenity and devotion, capturing the intimate moment between the Holy Family. The use of light and shadow adds depth and dimension to the scene, drawing the viewer's eye to the central figures. The painting is a beautiful representation of the Holy Family, conveying a sense of love, care, and protection.

Answer: The image is a painting of the Holy Family, depicting Mary, Joseph, and Jesus in a serene and intimate moment.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-15

In the painting, a man and a woman are sitting on the ground, possibly in a forest. The man is wearing a red and blue robe, while the woman is wearing a blue robe and a white veil. She is holding a baby in her arms, while the man is holding a baby in his arms. The man is raising his hand, possibly in prayer. In the distance, there are people sitting on the ground.

Created by amazon.nova-lite-v1:0 on 2025-01-15

The image depicts a painting of a family scene with religious undertones. In the foreground, a man and a woman are seated on the ground, surrounded by their children. The man, dressed in a regal outfit, is gesturing towards the woman, who is cradling a baby in her arms. The baby is looking up at the man, while another child, a boy, is holding a jug in his hands. The family is positioned in a natural setting, with a tree trunk behind them and a few angels in the background, possibly indicating a heavenly presence. The painting has a warm and intimate atmosphere, with the family members appearing to be engaged in a tender moment together.

Google Gemini

Created by gemini-2.0-flash on 2025-05-15

The painting depicts a scene with a man and a woman surrounded by children, with a group of people in the background. The man stands on the left with his hands raised in what appears to be a gesture of supplication or prayer. He has a beard and is wearing a tunic with blue and gold accents, covered by a reddish cloak.

To the right of the man, the woman is seated, wearing a blue dress and a white head covering. She is holding a container, possibly pouring its contents. Lying in her lap or on a cloth nearby are two children, one of whom she is cradling, while the other is drinking from a container. Another child is seen kneeling on the left, also interacting with a container.

In the background, there is a cluster of people with various gestures and expressions, some appearing to point or raise their hands. The backdrop consists of dark, possibly rocky or tree-covered terrain. The lighting in the painting is soft, which casts a gentle illumination on the figures and the scene.

Created by gemini-2.0-flash-lite on 2025-05-15

Here's a description of the image:

Overall Impression: The image is a classical painting, likely from the Renaissance or Baroque era, depicting a biblical scene. It features a group of figures in a landscape setting.

Central Figures:

  • Woman: A woman, likely Mary, is seated and holds a baby in her arms. She wears a blue dress and a white head covering.
  • Man: A man, presumably Joseph, is kneeling beside her and is holding a jug. He wears a costume typical of the era, which could be a Roman or Greek military attire, or a robe. He has a long dark hair and a beard.
  • Infant/Child: In the arms of the woman, a baby is shown.

Other Figures & Setting:

  • Additional Figures: In the background, other figures are depicted, which may be angels or other biblical characters.
  • Background: The background seems to consist of a landscape with trees or rocks.

Color and Style:

  • Color Palette: The painting utilizes a rich and warm color palette, with prominent reds, blues, yellows, and browns.
  • Style: The artwork appears to be painted in a style reminiscent of classical art, with an emphasis on drapery, anatomy, and composition. The brushstrokes seem soft and blended.

Interpretation/Subject Matter:

  • The painting's central figures (a woman, a man, and a child) suggest a depiction of the Holy Family (Mary, Joseph, and Jesus), possibly during the flight to Egypt.
  • The scene could represent a moment of rest or respite during their journey. The foreground figures are in the center. The background shows other figures and an unspecified setting.