Human Generated Data

Title

The First Steps

Date

c. 1780-1785

People

Artist: Jean-Honoré Fragonard, French 1732 - 1806

Artist: Marguerite Gérard, French 1761 - 1837

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles E. Dunlap, 1961.166

Human Generated Data

Title

The First Steps

People

Artist: Jean-Honoré Fragonard, French 1732 - 1806

Artist: Marguerite Gérard, French 1761 - 1837

Date

c. 1780-1785

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles E. Dunlap, 1961.166

Machine Generated Data

Tags

Amazon
created on 2019-07-16

Art 99.9
Painting 99.9
Person 99.7
Human 99.7
Person 99
Person 97.8
Person 89.8
Person 69.1

Clarifai
created on 2019-07-16

people 99.8
religion 99.1
adult 99
woman 98.7
group 97.4
art 96.6
wear 95.2
painting 94.6
one 90.4
two 87.8
child 87.4
sit 86.6
reclining 86.6
furniture 86.2
man 86.1
position 85.7
three 84.2
veil 83.8
seat 83.8
recreation 82.8

Imagga
created on 2019-07-16

person 31
dancer 25.1
adult 23
people 20.6
performer 20.6
attractive 20.3
male 19.9
man 19.5
couple 19.2
happy 18.2
portrait 16.2
fashion 15.8
fan 15.7
lifestyle 15.2
smile 15
entertainer 14.8
model 14.8
lady 14.6
love 14.2
style 14.1
couch 13.5
religion 13.4
sitting 12.9
kin 12.8
hair 12.7
follower 12.7
together 12.3
sexy 12
pretty 11.9
elegance 11.8
happiness 11.7
dress 11.7
room 11.2
art 11.1
sensuality 10.9
holiday 10.7
human 10.5
looking 10.4
men 10.3
culture 10.3
traditional 10
face 9.9
life 9.9
statue 9.8
old 9.8
interior 9.7
black 9.6
body 9.6
home 9.6
antique 9.5
two 9.3
oriental 9.3
stage 9.1
gold 9
handsome 8.9
posing 8.9
sculpture 8.7
mother 8.7
smiling 8.7
god 8.6
elegant 8.6
religious 8.4
joy 8.3
vintage 8.3
makeup 8.2
romantic 8
women 7.9
cute 7.9
sofa 7.8
pray 7.8
luxury 7.7
spiritual 7.7
faith 7.7
relax 7.6
erotic 7.6
tradition 7.4
peace 7.3
indoor 7.3
sensual 7.3
child 7.3
romance 7.1
father 7.1
night 7.1
look 7

Google
created on 2019-07-16

Microsoft
created on 2019-07-16

painting 98.8
person 90.6
art 88.6
clothing 78.4
woman 73.5
human face 63.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 60-90
Gender Female, 89.1%
Surprised 4.4%
Happy 28.8%
Disgusted 1.6%
Sad 47.3%
Angry 5.9%
Confused 2.4%
Calm 9.6%

AWS Rekognition

Age 16-27
Gender Female, 82.8%
Disgusted 1%
Calm 15.4%
Happy 10.2%
Confused 1%
Surprised 1.3%
Sad 68.9%
Angry 2.2%

AWS Rekognition

Age 20-38
Gender Female, 57.1%
Calm 56.3%
Surprised 4.3%
Happy 10.7%
Angry 3.9%
Sad 20.2%
Disgusted 0.8%
Confused 3.8%

AWS Rekognition

Age 4-7
Gender Male, 54.8%
Disgusted 45.3%
Surprised 45.5%
Confused 45.6%
Happy 45.1%
Calm 49.3%
Sad 47.9%
Angry 46.3%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 16
Gender Female

Microsoft Cognitive Services

Age 71
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Painting
Person
Painting 99.9%
Person 99.7%
Person 99%
Person 97.8%
Person 89.8%
Person 69.1%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a woman in a dress and a baby in a basket -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2024-12-31

This image is a painting depicting an outdoor scene with intricate details, possibly from the late 18th or early 19th century based on the clothing style. The scene includes:

  • Two women dressed in elaborate, elegant dresses with period-appropriate attire. One woman is standing while the other is seated on the right side.
  • A baby is learning to walk and is taking steps between the two women, depicting a tender and nurturing moment.
  • There is a large woven basket by the standing woman’s side, draped with fabric and flowers nearby, suggesting a pastoral or domestic setting.
  • The background is lush with dense foliage, trees, and flowers, providing a serene and picturesque environment.
  • A small dog or cat can be seen at the bottom left, adding a touch of domesticity to the scene.

The painting captures a moment of gentle interaction and care within a tranquil, natural setting.

Created by gpt-4 on 2024-01-27

This image depicts an idyllic scene set in a lush garden. Two elegantly dressed women and a young child are present in a clearing amidst the foliage. One woman is standing and turning towards her left with her arms slightly raised, dressed in a green skirt and white blouse with a bonnet, indicating a servant's attire. Another, in a luxurious yellow dress with a ruffled white collar and cuffs, is seated on the right, reaching out to the child. The child, dressed in white garments, seems to be stepping towards the seated woman. In the foreground, there is a woven basket covered with cloth, next to which rests a calico cat. The painting is rich in detail, with flowering shrubs and trees providing a dark, dense backdrop, giving a strong sense of depth and tranquility to the setting.

Anthropic Claude

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image depicts a decorative garden scene with several figures. In the center, there is a woman dressed in an elaborate gown with a white lace headdress, gesturing expressively. To her right, a young woman in a pink dress is seated, holding a small child. In the foreground, there is a large woven basket containing a sleeping infant. The overall scene has a lush, romantic quality, with a backdrop of dense foliage and flowers.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

This image is a painting of a woman in a pink dress sitting on the ground, with another woman in a green dress standing next to her. The woman in the pink dress is wearing a white headband and has her hands outstretched as if she is talking to the other woman. The woman in the green dress is wearing a white headscarf and has her hands raised as if she is gesturing while speaking.

In the background, there are several people, including a baby who is standing up and holding onto the woman in the green dress's skirt. There is also an older woman sitting on the ground behind the woman in the green dress, and a man sitting on the ground behind the woman in the pink dress.

The scene appears to be set in a garden or outdoor setting, with trees and flowers visible in the background. The overall atmosphere of the painting seems to be one of conversation and interaction between the two women, with the other people in the background adding to the sense of community and social gathering.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-21

The image depicts a painting of a woman in a green dress standing next to a wicker basket, with a baby in a white shirt and diaper standing on a red rug in front of her. The woman is gesturing towards the baby with her hands, while another woman in a yellow dress sits on a bench to the right, looking at the baby. In the background, there are trees and flowers, as well as a few other people and animals, including a dog and a cat.

The overall atmosphere of the painting is one of warmth and intimacy, with the motherly figure and the baby at the center of the scene. The use of soft colors and gentle brushstrokes adds to the sense of calm and serenity, creating a peaceful and idyllic scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a scene in a garden, with a woman sitting on the ground, holding the hand of a baby. Another woman stands beside her, with a baby in her arms. An older woman is sitting on the ground, looking at the baby. A basket is placed beside her, and a cat is sitting beside it. A few plants are grown behind them, and the sky is clear.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image depicts a scene of a young woman kneeling down to a toddler who is standing on a red rug in a garden. The woman is wearing a white dress and a white bonnet, while the toddler is dressed in a blue shirt. Behind them, a woman in a white bonnet and a green dress is standing, looking at the toddler. In the background, there is a basket with a white cloth, a cat, and a baby lying in a basket. The scene is set in a garden with flowers and trees, and the sky is blue with some clouds.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The painting is of a historical scene with several figures in an outdoor garden setting. The primary focus is on a baby, who is standing and reaching out towards a woman on the right side of the frame. This woman is kneeling and holding out her hands, appearing to encourage the baby forward. She has reddish hair adorned with flowers, and she is wearing a pale yellow gown with pink underskirt.

Behind the baby are two other figures, one a young woman in a white top and olive-green skirt with a white headscarf, and an older woman who is peering over a flower-covered fence. To the left is a wicker cradle with draped white fabric. A cat is sitting near the bottom of the cradle. The painting has a dark, soft tone, typical of the era it represents, with a visible texture and brushstrokes that contribute to the depth and realism of the piece. The flowers and lush foliage in the background suggest a romantic or idyllic setting.

Created by gemini-2.0-flash-lite on 2025-04-26

Here is a description of the image:

The image is a classical painting that depicts a scene in an outdoor garden.

Composition and Setting:

  • Garden Setting: The scene takes place in a lush garden with flowering bushes and trees, creating a sense of depth and enclosure. The lighting is soft, with shadows suggesting twilight or a shaded area.
  • Central Focus: The focal point is a young child taking their first steps across a red rug. The child is being guided, their arms outstretched.

Characters:

  • Child: The child is small, blonde, and appears to be in their infancy, taking tentative steps across a red rug.
  • Young Woman on Left: This woman is standing, with her arms outstretched, eyes focused on the child. She is dressed in an elegant gown, with a ruffled neckline. She wears a white headscarf.
  • Young Woman on Right: Another woman is kneeling, also reaching towards the child, with a welcoming posture. She also wears an elegant gown with a ruffled neckline.
  • Elderly Woman: An older woman is partially visible on the left, peering over a bassinet. She is in a more muted colored dress.

Other Elements:

  • Bassinet: A woven bassinet or baby carriage is positioned near the elderly woman, suggesting the child's association with this object.
  • Cat: A cat is seated in the lower left of the scene.

Overall Impression:

The painting evokes a sense of tenderness and familial care. It suggests a moment of a child's first steps, with the watchful care of family. The artwork likely emphasizes the beauty and importance of familial bonds and childhood milestones.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image is a classic oil painting depicting a scene of four figures in a lush, outdoor setting. The scene appears to be set in a garden or a forest clearing, with dense foliage and flowers surrounding the figures.

  1. Figures:

    • Leftmost Figure: An elderly woman dressed in traditional attire, wearing a white bonnet and an apron. She is seated on the ground, leaning over a basket filled with cloth and flowers.
    • Second Figure from the Left: A young woman standing next to the elderly woman. She is wearing a light green dress with a white bodice and a white headscarf. She appears to be gesturing with her hands, possibly in conversation or explanation.
    • Third Figure from the Left: A young child, possibly a toddler, who is standing and reaching out towards the seated woman on the right. The child is dressed in simple clothing.
    • Rightmost Figure: A seated woman in an elegant dress with a pink underskirt and a green overdress. She is looking towards the child with an attentive expression.
  2. Setting:

    • The background is filled with dense, dark green foliage, suggesting a natural, secluded environment.
    • The ground is covered with a red cloth, adding a touch of color to the scene.
    • There is a basket of flowers and cloth near the elderly woman, indicating a possible activity related to gardening or gathering.
  3. Interaction:

    • The young woman and the elderly woman seem to be engaged in a conversation or activity related to the basket.
    • The child is reaching out towards the seated woman, suggesting a familial or nurturing relationship.
    • The overall mood of the painting is serene and intimate, capturing a moment of interaction and connection among the figures.

The painting showcases detailed clothing, expressive gestures, and a rich, natural setting, typical of classical artworks that focus on everyday life and human interactions.