Human Generated Data

Title

Family of rehabilitation client, Boone County, Arkansas

Date

1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3061

Human Generated Data

Title

Family of rehabilitation client, Boone County, Arkansas

People

Artist: Ben Shahn, American 1898 - 1969

Date

1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3061

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Nature 99.7
Person 99.5
Human 99.5
Outdoors 99.5
Person 99.1
Building 98.4
Housing 97.4
Countryside 96.9
Hut 95.1
Rural 95.1
Shack 94
Shelter 92.2
House 90.9
Clothing 86.5
Apparel 86.5
Cabin 82.5
Female 62.1
Woman 55.7

Clarifai
created on 2023-10-15

people 99.9
adult 99.3
home 99.1
portrait 98.9
one 98.9
woman 97.3
barn 97.3
two 96.8
house 95.8
shed 95.6
wear 92.8
family 92.5
log cabin 91.2
vintage 91.2
farmhouse 90.6
building 89
man 88.8
child 87.8
group 87.8
monochrome 87.5

Imagga
created on 2021-12-15

roof 32.6
thatch 26.7
protective covering 21.8
roofing 20.7
building 20.2
brick 19.9
structure 18.6
old 16.7
adult 16.2
material 15.9
house 15.9
architecture 15.9
attractive 14.7
covering 14.6
person 14
people 13.9
wall 13.3
black 13.2
window 13.1
equipment 12.9
sexy 12.8
man 11.4
fashion 11.3
human 11.2
building material 11.2
body 11.2
portrait 11
sensuality 10.9
model 10.9
sky 10.8
lifestyle 10.8
dress 10.8
shelter 10.7
pretty 10.5
outdoors 10.4
home 10.4
hair 10.3
happy 9.4
umbrella 9.2
face 9.2
love 8.7
hut 8.4
relaxation 8.4
world 8.3
city 8.3
alone 8.2
one 8.2
lady 8.1
life 8
posing 8
greenhouse 7.9
urban 7.9
tile 7.5
tourism 7.4
smiling 7.2
women 7.1
male 7.1

Google
created on 2021-12-15

Smile 89.6
Black 89.6
Hat 88.7
Flash photography 88.3
Dress 86.6
Sunglasses 85.4
Gesture 85.3
Style 83.9
Wood 83.8
Black-and-white 83.1
Happy 82.9
Headgear 82.1
Adaptation 79.2
People 77.6
Tints and shades 77.3
Monochrome photography 73.9
Vintage clothing 72.2
Landscape 70.2
Event 70
Child 69.8

Microsoft
created on 2021-12-15

building 99
outdoor 97.2
clothing 94.3
person 90.7
smile 87.6
woman 84.7
dress 78.1
human face 77.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-37
Gender Male, 95.5%
Sad 72.4%
Calm 12%
Confused 6.4%
Fear 5%
Surprised 2.1%
Angry 1.6%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 13-25
Gender Female, 94%
Calm 90.7%
Confused 4%
Sad 3.9%
Happy 0.6%
Surprised 0.4%
Angry 0.4%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 3-11
Gender Female, 77.2%
Calm 62.7%
Sad 12.8%
Surprised 9.8%
Happy 7.4%
Angry 3.7%
Fear 1.6%
Disgusted 1%
Confused 0.9%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.5%
Person 99.1%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a woman in a white dress standing in front of a house -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image features a rustic scene with a log cabin that has a weathered wooden roof and walls made of logs and mud. Outside the cabin, there are objects such as a broom and kitchen items, suggesting humble living conditions. A woman is standing in front wearing a light-colored patterned dress, while part of an additional figure and a small child can be seen near the doorway. The overall atmosphere suggests a rural lifestyle, potentially in the early 20th century.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a woman standing in front of a rustic log cabin. She is wearing a sleeveless, patterned dress and has her arms raised in front of her. The cabin behind her is made of logs with a wooden shingle roof. To the left of the door, there is a small shelf or ledge that holds various household items, including a kettle and a broom. In the doorway, there are two children visible. The exterior of the cabin has a rough and simplistic appearance, suggesting an older or rural setting. To the right of the doorway, a piece of fabric or towel is draped over the logs. The overall composition suggests a scene of everyday life in a rural or historic context.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image depicts two women standing in the doorway of a rustic, wooden structure. The woman in the foreground appears distressed, with her hand covering her face. The woman in the background has a more neutral expression. The setting suggests a rural, impoverished environment, with the wooden structure and its dilapidated roof visible. The image has a somber, melancholic tone, capturing a moment of emotional distress or hardship experienced by the women.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white photograph that appears to be from the Depression era or early 20th century. It shows a rustic log cabin or wooden structure with a shingled roof. In the doorway, there are two people - one in a white sleeveless dress in the foreground who has her hand to her forehead in what appears to be a gesture of distress or weariness. Behind her, partially visible in the doorway, is another person in what looks like a patterned dress. The image captures a sense of rural poverty and hardship typical of documentary photography from this period. The composition and lighting create a powerful emotional impact, highlighting the difficult living conditions and human struggle of the time.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image depicts a black-and-white photograph of a woman and a child standing in the doorway of a rustic log cabin or small house. The woman, positioned centrally, has her right hand raised to her forehead, with her elbow bent and her arm angled across her body. She wears a sleeveless white dress adorned with lace at the top and a patterned fabric at the bottom. Behind her, a young girl stands in the doorway, partially obscured by the woman's arm. The girl is dressed in a long-sleeved dress and appears to be holding a broom.

The building's exterior is constructed from rough-hewn logs, and the roof is composed of wooden shingles. A shelf on the left side of the image holds a few items, including a metal bucket and a bottle. The overall atmosphere of the image suggests a rural or impoverished setting, with the woman and child appearing to be engaged in some form of domestic activity.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a woman standing in front of a log cabin, with another woman and a child visible inside. The woman in the foreground has dark hair pulled back and is wearing a white dress with lace details on the top. She is holding her right hand to her forehead, possibly due to fatigue or stress.

Behind her, a woman and a child are standing in the doorway of the log cabin. The woman has dark hair and is wearing a light-colored dress, while the child is partially obscured by the woman's arm. The cabin appears to be made of rough-hewn logs, with a sloping roof covered in shingles. A broom is leaning against the wall to the left of the doorway, and a shelf with various items is visible on the left side of the image.

The overall atmosphere of the image suggests a sense of hardship and struggle, possibly during the Great Depression era. The woman's pose and expression convey a sense of exhaustion and worry, while the rustic surroundings and simple clothing suggest a life of poverty and hardship.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of a woman standing in front of a log cabin. The woman is wearing a white dress and has her hand on her forehead, appearing to be in distress or deep thought. Behind her, another woman stands in the doorway of the cabin, looking at the woman in front. The cabin has a wooden roof and walls made of logs, with a small window on the side. The image has a vintage feel, suggesting it was taken in the past.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white photo shows a woman standing in front of a house with her hands on her face. She is wearing a dress and seems to be looking at something. Behind her, there is a woman standing in the doorway, and a child is standing in front of her. On the left, there is a table with a bucket, a broom, and a bottle.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression: The photograph is a black and white shot of a woman standing in the doorway of a rustic cabin. It evokes a sense of hardship and perhaps desperation.

Foreground:

  • Woman: A woman is the primary focus. She is positioned in the doorway. She is wearing a light-colored dress with a pattern and appears to be holding her hand to her head, as if in distress or thought. Her expression is somber.
  • Doorway: The doorway is a dark rectangle, leading into the interior of the cabin.

Background:

  • Girl: Behind the woman, inside the doorway, is a young girl. She appears to be looking out or watching. She is wearing a simple dress.
  • Cabin: The cabin is constructed from rough-hewn logs. The roof is shingled and weathered. There are hints of a shelf or ledge near the door, with what appear to be a jar, bucket, and a broom resting on it. The overall impression is of poverty and a rural setting.

Atmosphere: The black and white format and the subjects' expressions give the photo a documentary feel. The composition and lighting, combined with the environment, suggest a narrative of struggle and resilience. The photograph may have been taken during the Great Depression, and captures the hardship faced by many rural families during that era.

Created by gemini-2.0-flash on 2025-05-16

The black and white photograph shows a woman standing in the doorway of a rustic cabin, with a younger girl behind her. The woman in the foreground has a concerned expression and is holding her hand to her forehead. She wears a light-colored dress with a subtle pattern.

The girl in the background stands inside the cabin's entrance, partly obscured by the doorframe. She looks downward, with a solemn demeanor. The cabin is made of rough logs and has a weathered, shingled roof. A shelf with a few household items, including a container and a broom, is visible to the left of the door. A white cloth hangs on the right side of the door. The overall tone of the image is somber and evocative of hardship.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting two women standing in the doorway of a rustic, wooden house with a shingled roof. The house appears to be constructed from rough, uneven logs, suggesting a rural or traditional setting.

The woman in the foreground is wearing a light-colored dress with a floral or dotted pattern. She has her hand on her forehead, a gesture that often indicates worry, fatigue, or distress. Her expression appears somber or troubled.

Behind her, another woman stands in the doorway, partially obscured by the door frame. She is wearing a dress with a different pattern and is holding onto the door frame with one hand. Her expression is not clearly visible, but her posture suggests she is observing something outside the house.

The scene conveys a sense of hardship or concern, possibly reflecting the challenges of rural life or a difficult situation the women are facing. The overall atmosphere of the photograph is somber and reflective.