Human Generated Data

Title

The Artist's Family

Date

17th century

People

Artist: Wallerant Vaillant, Dutch 1623 - 1677

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan in honor of Clifford Ackley, 751.1983

Human Generated Data

Title

The Artist's Family

People

Artist: Wallerant Vaillant, Dutch 1623 - 1677

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Loan in honor of Clifford Ackley, 751.1983

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.7
Art 97.4

Clarifai
created on 2023-10-26

people 99.9
portrait 99.8
adult 99.6
art 99.3
painting 98.9
man 98.1
group 97.8
woman 97.5
two 97
print 96.3
wear 95.8
one 95.8
illustration 91.3
music 91.3
three 91.1
retro 91
vintage 89.8
facial expression 89.6
baby 88.1
leader 86.2

Imagga
created on 2022-01-22

adult 38.2
sexy 35.4
attractive 32.9
portrait 29.1
erotic 28.1
body 28
model 27.2
people 26.8
love 24.5
passion 24.5
fashion 24.1
hair 23.8
skin 23.1
sensual 22.7
black 22.6
world 22.5
pretty 22.4
dark 21.7
person 21.2
couple 20.9
man 20.2
brunette 19.2
brother 19.2
lingerie 18.7
studio 18.2
male 17.9
lady 17.9
happy 16.9
face 16.3
sensuality 15.4
seductive 15.3
expression 14.5
passionate 13.7
makeup 13.7
human 13.5
wife 13.3
sibling 13.3
husband 13.1
make 12.7
one 12.7
girlfriend 12.5
posing 12.4
kin 12.4
gorgeous 11.8
sex 11.7
naked 11.6
boyfriend 11.6
desire 11.5
loving 11.5
two 11
dress 10.8
cute 10.8
smile 10.7
hug 10.7
lovers 10.7
sexual 10.6
style 10.4
women 10.3
child 10.3
lips 10.2
holding 9.9
romance 9.8
nude 9.7
happiness 9.4
youth 9.4
elegance 9.2
emotion 9.2
romantic 8.9
lovely 8.9
intimacy 8.9
topless 8.8
bra 8.8
temptation 8.7
eyes 8.6
close 8.6
hand 8.4
fun 8.2
girls 8.2
clothing 8.1
looking 8
lifestyle 8
foreplay 7.9
breasts 7.9
hands 7.8
splashes 7.8
underwear 7.7
sitting 7.7
tattoo 7.7
married 7.7
mother 7.6
rain 7.5
relationship 7.5
slim 7.4
water 7.3
cheerful 7.3
wet 7.2
vessel 7.2
tub 7

Google
created on 2022-01-22

Jaw 87.8
Art 85
Painting 76.5
Vintage clothing 73.7
Visual arts 70.7
Room 68.8
Drawing 67.9
Beard 67.5
Illustration 67.2
Event 66.3
Monochrome 65.6
Stock photography 62.6
History 61.7
Fun 60.5
Portrait 59.6
Facial hair 59.3
Still life 58.1
Collection 57.4
Photographic paper 57.1
Chest 56.4

Microsoft
created on 2022-01-22

text 99.7
drawing 98.3
human face 97.6
sketch 97.1
painting 96.3
posing 95.9
person 94.4
window 84.1
black 82.8
woman 81.1
clothing 80.2
old 74.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-12
Gender Female, 97.5%
Calm 50.5%
Sad 38.8%
Fear 3.5%
Surprised 2.1%
Disgusted 2%
Angry 1.7%
Confused 1%
Happy 0.5%

AWS Rekognition

Age 20-28
Gender Female, 60.2%
Calm 97.8%
Sad 1.3%
Fear 0.4%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 16-22
Gender Female, 99.6%
Calm 99.7%
Sad 0.3%
Disgusted 0%
Fear 0%
Angry 0%
Happy 0%
Surprised 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Female, 97.6%
Sad 53.5%
Calm 36.1%
Fear 2.7%
Happy 1.7%
Disgusted 1.6%
Confused 1.5%
Surprised 1.4%
Angry 1.4%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 12
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting

Clarifai

Human face
Clothing
Picture frame
Woman
Human mouth
Human eye
Human nose
Human hand

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 94.2%

AWS Rekognition

Person 92.9%

AWS Rekognition

Painting 72.4%

Clarifai

Human face 97.3%

Clarifai

Human face 96.8%

Clarifai

Human face 93.8%

Clarifai

Human face 89.2%

Clarifai

Clothing 88.7%

Clarifai

Clothing 74.6%

Clarifai

Clothing 44.2%

Clarifai

Picture frame 83.9%

Clarifai

Woman 75.4%

Clarifai

Woman 73.2%

Clarifai

Woman 61.9%

Clarifai

Woman 59.9%

Clarifai

Human mouth 45.5%

Clarifai

Human mouth 34.2%

Clarifai

Human mouth 33.7%

Clarifai

Human eye 44.9%

Clarifai

Human eye 41%

Clarifai

Human eye 39.8%

Clarifai

Human eye 39.4%

Clarifai

Human eye 39.2%

Clarifai

Human eye 34.5%

Clarifai

Human eye 33.9%

Clarifai

Human nose 42.5%

Clarifai

Human nose 40.4%

Clarifai

Human nose 39.3%

Clarifai

Human nose 38.2%

Clarifai

Human hand 35.4%

Categories

Imagga
created on 2022-01-22

paintings art 65.9%
people portraits 27.7%
interior objects 2.5%
food drinks 1.8%
pets animals 1.2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

portrait of a family, by painting artist.

Salesforce

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of people standing around a woman

OpenAI GPT

Created by gpt-4 on 2024-12-23

The image displays a monochromatic artwork featuring two figures set against a dark background. The individual on the left appears to be wearing a renaissance-style dress with a detailed bodice and puffed sleeves. An intricate hairstyle or headdress is visible, indicating a level of formality or sophistication related to the period. The figure on the right is draped in flowing garments that give the impression of volume and texture. Both figures are positioned in front of what seems to be a shadowy forest or grove, underlined by the presence of tree branches in the setting. The artwork has a classic feel to it, reminiscent of historical portraiture and scenes from the past. The paper or canvas presents signs of aging or weathering around the edges, reinforcing the notion that this artwork may have some historical significance or is styled to look as such.

Created by gpt-4o-2024-05-13 on 2024-12-23

This image depicts an old black-and-white portrait engraving of three individuals. The central figure is dressed in 17th-century attire, featuring a lace-collared dress and voluminous sleeves. The person to the right is wrapped in a swaddling blanket or cloth, suggesting an infant. The clothing and style reflect the fashion of a bygone era, and the overall scene appears to be set against a dark backdrop, emphasizing the figures in the foreground.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-29

This is a historical black and white portrait, appears to be a mezzotint print, showing four figures in what seems to be a 17th-century style. The composition features a central female figure wearing an elegant dress with a decorative collar and long curled hair. To her left are two younger figures, and to the right is an infant or young child wrapped in swaddling clothes or blankets. The artwork demonstrates the formal portrait style typical of the period, with careful attention to details in the clothing and facial features. The dark background and dramatic lighting create a sense of depth and emphasize the subjects' faces and clothing. The print quality and style suggest this is likely from the Baroque period of art history.

Created by claude-3-haiku-20240307 on 2024-12-23

The image appears to be a black and white engraved portrait depicting three human figures. In the center is a woman with elaborate, curled hair wearing an ornate dress. She is surrounded by two other figures, one on each side, who appear to be children or young adults also dressed in period clothing. The figures have an introspective, pensive expression on their faces. The overall style and tone of the image suggest it is a historical or artistic work from an earlier era.

Created by claude-3-5-sonnet-20241022 on 2024-12-23

This is a historical black and white portrait, appearing to be a mezzotint print, likely from the 17th century. It shows a family group consisting of what appears to be several siblings. The central figure wears an elegant dress with a decorative collar and has long curled hair in the style of the period. To the left are two younger figures, and on the right is what appears to be an infant wrapped in swaddling clothes or blankets. The composition is formal and typical of baroque-era portraiture, with dramatic lighting against a dark background. The technique used creates rich, velvety dark tones characteristic of mezzotint printing, which was particularly popular for portraiture during this period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-12-23

The image is a black and white drawing of a woman and three children. The woman is standing in the center of the image, wearing a dark dress with a light-colored collar. She has curly hair and is looking to her right. To her left is a man with curly hair, wearing a dark hat and a dark jacket. He is also looking to his right. On the right side of the woman is a baby wrapped in a blanket, being held by the woman. The baby is sleeping and has a small hat on its head. On the far left of the image is another child, who appears to be a girl. She is wearing a dark dress and has curly hair. She is looking down at something in her hand.

The background of the image is dark, with some branches visible behind the people. The overall atmosphere of the image is one of warmth and intimacy, as the woman and children are all gathered together in a close-knit group. The use of dark colors and muted tones adds to the sense of coziness and comfort.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-23

The image is a black-and-white print of a painting, featuring four women and an infant. The woman in the center has long, curly hair and wears a dark dress with a white collar and a bow at the neckline. She holds her right hand up, with her palm facing outward. To her left stands a woman with long, dark hair, wearing a dark dress and looking to the right. On the right side of the central figure is another woman, also with long, dark hair, who is holding a swaddled infant. The background of the painting is dark, with some lighter areas that may represent drapery or other elements. The overall atmosphere of the image is somber and contemplative.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-02-28

The image is a black-and-white portrait of three women, possibly from the 17th century. The woman in the middle is wearing a white lace collar and a necklace, while the woman on the left is wearing a bonnet. The woman on the right is wearing a shawl and has her eyes closed. The image has a white border on the top and bottom, and the background is dark, with the women's faces illuminated by a light source.

Created by amazon.nova-pro-v1:0 on 2025-02-28

The image shows a black-and-white photograph of three women standing next to each other. The woman in the middle is wearing a necklace and a dress with a lace collar. The woman on the left is wearing a hat and a dress, while the woman on the right is wearing a shawl. They are standing in front of a curtain, and the woman in the middle seems to be looking at something.

Google Gemini

Created by gemini-2.0-flash on 2025-05-04

The sepia-toned print shows a scene with five figures, possibly a family, standing in front of a dark backdrop suggestive of drapery or a curtain.

At the center, a fair-skinned woman with light brown or blonde curly hair stands looking at the viewer. She wears a dress with a decorative collar and bodice, and her right hand is raised as if in a gesture of introduction or presentation.

To the left of the woman, there are two other figures. The closest to the viewer is a young boy with curly hair, wearing a dark hat or cap. Behind him and slightly above is another child with curly hair looking directly forward, creating a sense of depth.

To the right of the woman, she holds a baby wrapped in swaddling clothes. The baby's eyes are closed, suggesting it is asleep or peacefully resting.

The composition of the print, combined with the limited value range, creates a dramatic effect, drawing attention to the individuals in the scene. The print is executed in a style reminiscent of earlier portraiture, focusing on the faces and figures against a shadowed backdrop.

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

The image is a monochrome print, likely a mezzotint or a similar printmaking technique, given the soft tonal transitions. It portrays a group of figures, likely a family, in a somewhat formal or stylized setting.

Composition and Figures:

  • Center: The central figure is a woman, appearing to be the mother. She's the most prominent figure, looking directly at the viewer with a composed expression. She is wearing a simple dress with a decorative collar.
  • Right: Beside her, held in an embrace, is an infant wrapped in swaddling clothes. The baby's eyes are closed.
  • Left: Two other figures, likely older children, are positioned on the left side. The one in the foreground is looking at the main woman. One of the children is also wearing a hat.
  • Background: The background is dark, but it features drapery or a curtain, which suggests an interior setting.

Style and Tone:

  • Lighting: The lighting seems to be focused on the figures, particularly the woman and the baby, which creates contrast.
  • Emotion: The overall mood appears to be one of quiet contemplation, perhaps tenderness and concern. The closed eyes of the baby and the expressions of the other figures contribute to this.
  • Overall Impression: It feels like a portrait or a depiction of a family scene, possibly from the 17th or 18th century. The technique and style suggest an artwork that was created through careful shading and attention to detail.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black and white print depicting a dramatic scene with four figures. The central figure is a young woman with curly hair, dressed in a historical costume, possibly from the 17th or 18th century. She is looking directly at the viewer with a serious expression, holding her hands near her chest.

To her right, there is a woman wrapped in a cloak, appearing to be asleep or unconscious. The woman's head is tilted back, and her eyes are closed.

To the left of the central figure, there is a man with curly hair, looking intently at the central figure. His expression seems to be one of concern or contemplation.

In the foreground, another woman with long, flowing hair is looking up at the central figure with an expression of awe or reverence.

The background is dark, which creates a stark contrast with the figures, emphasizing their expressions and gestures. The overall mood of the image is somber and intense, suggesting a moment of significant emotional or dramatic importance. The scene appears to be set in a dimly lit, possibly outdoor environment, adding to the dramatic effect.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-14

This is an etching or engraving of a group of four individuals. The central figure is a woman with her hair styled in curls, wearing a dark dress with a lace collar. She is holding the hands of two children, one on each side. The child on the left appears to be a boy with curly hair, wearing a dark outfit with a decorative hairband. The child on the right appears to be a girl wearing a white cap and is wrapped in a shawl, giving the impression of being a sleeping or ill child. The background is dark with what seems to be the silhouette of a tree, adding a somber tone to the scene. The overall style suggests it may be from the 17th or 18th century, given the clothing and artistic technique.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-14

This artwork is a monochromatic print, possibly an etching or engraving, featuring a group of four figures. The central figure is a woman with a composed expression, wearing a detailed, period-style dress with a lace collar. She has long, curly hair that frames her face and is partially covered by a headpiece. Her right hand is raised, with her fingers delicately positioned as if gesturing or touching something.

To her right (viewer's left), there is a young boy with short, curly hair, looking attentively towards the woman. He is dressed in a dark outfit with a light collar. To the woman's left (viewer's right), there is another young boy with a serious expression, also dressed in a dark outfit with a light collar. He is leaning slightly towards the woman.

On the far right of the image, there is a baby wrapped in a swaddling cloth, appearing to be asleep. The baby is held close to the woman's chest, adding a sense of intimacy and care to the scene.

The background is dark and indistinct, which helps to focus attention on the figures. The overall composition and style suggest a familial theme, possibly depicting a mother with her children. The attention to detail in the clothing and the expressions of the figures indicates a high level of craftsmanship in the artwork.