Human Generated Data

Title

Untitled (woman with bonnet and children)

Date

1930s

People

Artist: Dorothea Lange, American 1895 - 1965

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Sedgewick Memorial Collection, 2.2002.709

Human Generated Data

Title

Untitled (woman with bonnet and children)

People

Artist: Dorothea Lange, American 1895 - 1965

Date

1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Sedgewick Memorial Collection, 2.2002.709

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99
Apparel 99
Human 98.5
Newborn 94.3
Baby 94.3
Sleeve 82.4
Face 82.2
Female 81.2
Finger 76.3
Woman 66.6
People 65.9
Portrait 63.1
Photography 63.1
Photo 63.1
Girl 58.6
Bonnet 57.1

Clarifai
created on 2023-10-26

child 99.8
baby 99.6
people 99.3
two 98.8
family 98.7
portrait 97.8
offspring 97.7
son 97.2
love 96.3
three 96.1
sibling 94.6
wear 94.5
facial expression 94.2
monochrome 93.6
affection 91.7
group 91.4
adult 90.5
woman 89.7
four 88.9
elderly 88.2

Imagga
created on 2022-01-22

mother 100
parent 81.8
happy 32
kin 30.3
portrait 29.8
people 29.6
family 28.5
love 27.6
happiness 27.4
couple 26.1
child 25.6
home 25.5
adult 23.3
daughter 23.2
smiling 22.4
man 21.5
attractive 20.3
grandma 20.1
together 19.3
face 19.2
male 18.8
father 17.2
cute 17.2
smile 17.1
husband 16.2
fashion 15.8
women 15
sitting 14.6
lifestyle 14.5
casual 14.4
loving 14.3
kid 14.2
boy 13.9
cheerful 13.8
dress 13.6
couch 13.5
bride 13.4
married 13.4
model 13.2
pretty 12.6
elderly 12.5
indoors 12.3
senior 12.2
relationship 12.2
sexy 12.1
dad 11.9
aged 11.8
person 11.4
wife 11.4
looking 11.2
old 11.2
hair 11.1
expression 11.1
wedding 11
two 11
indoor 11
joy 10.9
caring 10.8
blond 10.8
lady 10.6
sofa 10.5
human 10.5
females 10.4
adults 10.4
youth 10.2
baby 10.2
girls 10
holding 9.9
groom 9.7
clothing 9.6
day 9.4
camera 9.2
elegance 9.2
20s 9.2
one 9
sibling 8.4
mature 8.4
studio 8.4
room 8.2
posing 8
body 8
bonding 7.8
eyes 7.8
hug 7.8
affection 7.7
jeans 7.6
skin 7.6
laughing 7.6
togetherness 7.6
house 7.5
son 7.5
close 7.4
adorable 7.4
joyful 7.4
children 7.3
sensuality 7.3
gorgeous 7.3
black 7.2
childhood 7.2
romance 7.1
handsome 7.1
lovely 7.1
look 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

human face 98.4
person 98.2
baby 97.9
text 94.1
toddler 91.6
clothing 90.8
child 82.7
smile 73.7
black and white 66
woman 61.8
picture frame 6.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-51
Gender Female, 100%
Calm 89.4%
Sad 10.5%
Confused 0%
Angry 0%
Fear 0%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 4-12
Gender Male, 99.8%
Sad 95.8%
Fear 3.5%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Calm 0.1%
Surprised 0%
Happy 0%

AWS Rekognition

Age 0-6
Gender Female, 84.2%
Sad 49.6%
Happy 45.7%
Calm 1.3%
Fear 1%
Angry 0.9%
Disgusted 0.6%
Surprised 0.6%
Confused 0.5%

AWS Rekognition

Age 29-39
Gender Male, 99.4%
Happy 65.1%
Calm 28.6%
Angry 2.4%
Sad 2.3%
Confused 0.5%
Disgusted 0.4%
Surprised 0.4%
Fear 0.2%

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Hat
Person

Clarifai

Human face
Clothing
Man
Human nose
Human eye
Human mouth

AWS Rekognition

Hat 98.7%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 88.5%

AWS Rekognition

Person 48.9%

Clarifai

Human face 98%

Clarifai

Human face 93.2%

Clarifai

Human face 92.3%

Clarifai

Human face 89%

Clarifai

Clothing 76.1%

Clarifai

Clothing 66%

Clarifai

Clothing 62.4%

Clarifai

Clothing 56.8%

Clarifai

Man 60.6%

Clarifai

Human nose 45.6%

Clarifai

Human nose 40.4%

Clarifai

Human nose 38.6%

Clarifai

Human nose 36.9%

Clarifai

Human eye 40.5%

Clarifai

Human eye 39.7%

Clarifai

Human eye 37.5%

Clarifai

Human eye 35.3%

Clarifai

Human mouth 37.6%

Clarifai

Human mouth 35.5%

Categories

Imagga
created on 2022-01-22

paintings art 78.4%
pets animals 10.2%
people portraits 6.4%
food drinks 2.2%
interior objects 1.4%

Captions

Microsoft
created by unknown on 2022-01-22

an old photo of a woman 90.1%
old photo of a woman 88.9%
a woman holding a baby 62%

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of a mother and child.

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a woman in a bonnetie hat and a baby in a blanket

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts a monochromatic scene of individuals sitting closely together. One person is wearing patterned clothing and appears to have a head covering that drapes around their face. There is a blanket or fabric covering part of their lap and arms. Additional individuals can be seen partially visible alongside them. The lighting suggests it might be outdoors under bright sunlight. The composition appears intimate and captures a moment of close interaction.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a vintage black-and-white photograph of a mother and children sitting closely together. The mother is wearing a patterned shirt and has a cloth over her head, possibly to provide shade from the sun. She holds a child's blanket in her lap, while another child is seated beside her. The overall scene suggests a moment of togetherness and care.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a woman wearing a floral patterned dress and a hooded shawl, holding a swaddled infant in her arms. There is also a young child standing next to her. The image has a black and white, documentary-style aesthetic, suggesting it may be an older photograph. The woman appears to have a serious, contemplative expression on her face as she holds the infant. The overall scene conveys a sense of care and protection.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be from the Depression era. The image shows a woman wearing a light-colored bonnet or sunbonnet and a patterned dress or blouse. She is holding an infant wrapped in a blanket, and there appears to be another child visible on the right side of the frame. In the background, partially visible, is someone wearing a dark fedora hat. The photograph has a documentary style quality typical of 1930s social realism photography, capturing what appears to be a rural or working-class family. The composition is intimate and the lighting is natural, creating strong contrasts in the black and white image.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a woman holding a baby, with a man and a child visible in the background.

The woman is wearing a floral blouse and a hat with a ruffled brim. She has a strap across her body, possibly holding a bag or another child. The baby she is holding is wrapped in a blanket and appears to be sleeping.

In the background, there is a man wearing a hat and a child with curly hair. The sky is bright and overexposed, making it difficult to discern any details.

The overall atmosphere of the image suggests that it was taken in a rural or outdoor setting, possibly during a sunny day. The woman's attire and the presence of a baby and children suggest that the scene may be related to family or community activities.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a woman holding a baby, with two children standing behind her. The woman wears a floral blouse and a head covering, while the baby is wrapped in a blanket. The child on the right has short hair, and the one on the left wears a hat. The background is a plain white sky.

The image appears to be a vintage photograph, possibly from the early 20th century, given the clothing and hairstyles of the individuals depicted. The overall atmosphere of the image suggests a sense of simplicity and innocence, with the woman and children posing for the camera in a natural and unposed manner.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph of a family, possibly taken in the 1930s. The woman in the center is holding a baby in her arms, while a young boy stands beside her. The woman is wearing a bonnet and a floral dress, while the boy is wearing a hat. Behind them, a man is standing, wearing a hat and a jacket. The photo has a vintage feel, and the image is slightly blurred, giving it a nostalgic and timeless quality.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a black-and-white photograph of a woman holding a baby, with a young boy standing beside her. The woman is wearing a bonnet and a dress with a floral pattern. She is holding the baby in her arms, who is wrapped in a blanket and appears to be sleeping. The young boy is looking directly at the camera, with a serious expression on his face. Behind them, there is a man wearing a hat.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression: The image is a black and white photograph featuring a mother with two of her children, and an unknown man, looking out to the right, from a position of a field or an open plain. The photograph evokes a sense of hardship and resilience.

Central Figure:

  • A woman is the main subject of the photograph. She appears to be the mother and wears a head covering (possibly a bonnet or a sun bonnet), and a floral-print shirt. Her expression is somber, and she is gazing directly towards the viewer.

Children:

  • A sleeping infant is held close to the mother, wrapped in a blanket.
  • A slightly older child, presumably a boy, is beside the mother, his face visible.

Background Figure:

  • In the background is a man, only his profile visible, wearing a hat. It's hard to determine his relationship to the others without more context.

Lighting and Composition:

  • The lighting appears to be natural and perhaps harsh, casting shadows and highlighting the subjects' features.
  • The composition is straightforward, with the figures positioned in the center and right of the frame, which helps draw the viewer's attention to the faces.

Historical Context (Possible):

  • The photograph style, dress of the woman, and overall mood suggest a time of hardship or social unrest, such as the Great Depression or another era.

Overall, the image is a powerful and poignant portrait of a family, likely facing difficult circumstances.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The black and white photo captures a poignant family portrait. The main focus is a woman with a resolute expression. She wears a patterned floral shirt, what seems to be an apron, and a bonnet that frames her face. She holds a sleeping infant wrapped in a light-colored blanket, the hands cradling the baby.

Behind her and slightly to the left is the profile of a man wearing a fedora, his face lined with age. To the right of the woman, partly obscured, is a young boy with freckles, looking towards the camera with a thoughtful gaze.

The backdrop is a clear, bright sky that accentuates the figures in the foreground. The composition and tone of the photograph suggest a scene of hardship and resilience.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a woman with two children. The woman is wearing a bonnet and a patterned dress, and she appears to be protecting her face from the sun with her hand. She is holding a baby wrapped in a cloth, and a young child is standing beside her, looking directly at the camera. The young child is wearing a sleeveless dress and appears to be slightly dirty or dusty. The background is bright and mostly washed out, suggesting a sunny outdoor setting. The photograph captures a moment of hardship and resilience, likely reflecting the conditions of the Great Depression era in the United States. The expressions and postures of the individuals convey a sense of weariness and endurance.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph featuring a woman dressed in a patterned blouse and a wide-brimmed sun hat. She is holding a baby wrapped in a blanket. To her right, there is another individual, possibly a young child, with a somber expression. The background is plain and lacks details, which draws attention to the subjects in the foreground. The overall tone of the image suggests it could be from an earlier time period, possibly the mid-20th century, given the clothing and the style of the photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a woman holding a baby in her arms. The woman is wearing a patterned dress and a headscarf. She has a solemn expression on her face. To her right, there is another child peeking into the frame. In the background, partially obscured, is a man wearing a hat. The photograph appears to be from an earlier time period, possibly the early to mid-20th century, given the clothing styles and the black-and-white format. The image conveys a sense of hardship and resilience.