Human Generated Data

Title

Drought Refugees from Oklahoma Camping by the Roadside, Blythe, California, August 1936

Date

1936

People

Artist: Dorothea Lange, American 1895 - 1965

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.718

Human Generated Data

Title

Drought Refugees from Oklahoma Camping by the Roadside, Blythe, California, August 1936

People

Artist: Dorothea Lange, American 1895 - 1965

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.718

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.6
Clothing 85.3
Apparel 85.3
Face 83.6
Wood 79
Urban 74.3
Sitting 73.1
People 71.1
Outdoors 68
Building 65.1
Portrait 63.2
Photography 63.2
Photo 63.2
Shelter 62.3
Nature 62.3
Countryside 62.3
Rural 62.3
Porch 60.8
Furniture 56.1

Clarifai
created on 2023-10-26

people 100
two 99.5
adult 99.3
portrait 97.8
man 95.7
woman 95.4
furniture 95.4
one 94.6
three 94.5
group 94
war 90.9
wear 90.3
offspring 90
child 89.8
son 88.2
group together 87.9
reclining 87.8
campsite 87.5
soldier 86.1
military 83.2

Imagga
created on 2022-01-22

kin 69.3
mother 41.2
family 40.1
child 34.9
parent 34
happy 33.9
father 27.4
people 26.8
happiness 25.9
together 24.5
man 24.2
adult 23.9
brother 23.5
sibling 23.5
male 23
love 22.9
smiling 22.4
sitting 22.3
portrait 22
couple 21.8
dad 21.1
daughter 21
kid 20.4
smile 20
home 17.6
cute 16.5
husband 16.3
baby 16
lifestyle 15.9
boy 15.7
attractive 15.4
childhood 15.2
wife 15.2
togetherness 15.1
relationship 15
pretty 14.7
relaxing 14.6
looking 14.4
loving 14.3
casual 13.6
relaxed 13.2
youth 12.8
playing 12.8
children 12.8
fun 12.7
joy 12.5
person 12.5
sofa 11.7
affectionate 11.6
couch 11.6
little 11.5
hair 11.1
adorable 11.1
model 10.9
face 10.7
bed 10.6
lady 10.6
resting 10.5
outdoors 10.5
son 10.1
old 9.8
affection 9.7
women 9.5
senior 9.4
rest 9.3
fashion 9.1
cheerful 8.9
caring 8.8
sexy 8.8
hug 8.7
elderly 8.6
relax 8.4
grandma 8.4
relaxation 8.4
mature 8.4
hand 8.4
care 8.2
girls 8.2
handsome 8
romantic 8
indoors 7.9
brunette 7.8
living room 7.8
play 7.8
summer 7.7
two 7.6
park 7.4
toy 7.4
room 7.3
group 7.3
gorgeous 7.3
aged 7.2
life 7.2

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 98.1
clothing 92
outdoor 88.7
text 88.1
black and white 87.3
human face 78.9
drawing 62.7
old 56.6
woman 55.4
man 52.9
sofa 36.3
picture frame 6.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 43-51
Gender Male, 99.7%
Calm 59.4%
Confused 31.5%
Angry 2.5%
Disgusted 2.1%
Happy 1.8%
Sad 1.4%
Fear 0.7%
Surprised 0.7%

AWS Rekognition

Age 31-41
Gender Female, 100%
Sad 72.7%
Confused 19.9%
Calm 2.8%
Fear 1.7%
Disgusted 1%
Angry 1%
Surprised 0.6%
Happy 0.3%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

No features identified

AWS Rekognition

Person 99.6%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 59.6%

Categories

Imagga
created on 2022-01-22

paintings art 96.1%
people portraits 3.3%

Captions

Microsoft
created by unknown on 2022-01-22

an old photo of a man 86.5%
a man sitting on a bench 64.7%
an old photo of a boy 64%

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts a somber and raw scene of hardship. In the foreground, a person rests their arm on what looks like a makeshift wooden platform, wearing weathered and dirty clothing that suggests labor or poverty. Their posture and body language convey fatigue or deep thought. In the background, another individual holds a young child in their lap under a shaded area created by a tarp and a tree. Various items such as containers and fabric appear scattered around, hinting at a modest and rudimentary living situation. The overall composition evokes a sense of struggle and resilience within an outdoor environment.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a scene in black and white that suggests a setting of hardship. There is a makeshift shelter created with a tarp over some wooden planks, likely representing a temporary or impoverished living situation. Two individuals are present, one sitting on the left holding a young child, while another is on the right, resting their arms on the wooden surface, suggesting fatigue. The environment includes sparse vegetation in the background, which might be part of a rural or camp environment. There are a few scattered items in the background, possibly indicating the possessions of the individuals. The scene invokes a sense of struggle and resilience.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to depict a man and a woman sitting on a makeshift bed or platform outdoors, surrounded by foliage. The man has a serious, contemplative expression on his face as he rests his arms on the platform. The woman is holding a young child in her arms. The scene suggests a sense of hardship or displacement, with the makeshift nature of their living situation. The black and white photograph conveys a somber, documentary-style mood.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph that appears to be from the Great Depression era. The image shows people in what looks like a makeshift shelter or tent. In the foreground, there's someone resting on what appears to be a wooden platform or table, wearing work clothes. In the background, there's a person holding a baby or small child. The setting appears quite modest and basic, which was typical of migrant worker camps during this period in American history. The photo has a documentary style quality to it, similar to the famous Depression-era photographs that captured the struggles of that time.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a man and woman with a baby sitting on a wooden platform under a canopy.

The man is sitting on the right side of the image, with his head resting on his left hand. He has short hair and is wearing a long-sleeved shirt. The woman is sitting on the left side of the image, holding the baby on her lap. She has dark hair and is wearing a dress. The baby is wearing a diaper and has a pacifier in its mouth.

The wooden platform they are sitting on has a few items on it, including a blanket or towel, a cup, and a bottle. In the background, there are trees and other foliage visible through the canopy. The overall atmosphere of the image suggests that the family is living in a temporary or makeshift setting, possibly a camp or a shelter.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black and white photograph of a family sitting under a makeshift shelter. The man, with his hand resting on his head, sits at a wooden table, while the woman holds a baby in her lap. The background features a tree and a field, suggesting a rural setting. The overall atmosphere of the image conveys a sense of hardship and resilience, as the family appears to be living in challenging circumstances.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

This is a black-and-white photograph of a family sitting under a tree. The family consists of a man, a woman, and a child. The man is sitting on a wooden table with his head resting on his hand. The woman is sitting on the ground with the child on her lap. The child is looking at the man. The man and woman are both wearing long-sleeved shirts. There is a canopy above them, and a jacket is hanging on the tree.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white photograph shows a man and a woman sitting under a tree. The man is leaning on a wooden table, resting his head on his hand, while the woman is sitting on the ground behind him, holding a baby. The woman is wearing a dress, while the man is wearing a long-sleeve shirt. Behind them is a tarp hanging from the tree, and some clothes are hanging on it.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

The black and white image, a poignant representation of hardship, features a family of three, with a man in the foreground, a woman holding a baby in the background, and a weathered outdoor setting.

The man in the foreground, fair-skinned with a full head of hair, is resting his head on his hand, which is propped up on a worn wooden surface. The wooden surface appears to be a makeshift table or platform, and it takes up a substantial portion of the lower part of the image. His expression is one of weary resignation. His work-worn hands, marked with scars and blemishes, are clearly visible. He wears a long-sleeved, button-up shirt, rolled up to the elbows.

Behind him, partially obscured, sits a fair-skinned woman holding a small baby. She is gazing off to the side with a look of concern. The background beyond the woman is blurry, but it appears to be a rural landscape with trees and a tent, a makeshift shelter visible above them. The composition of the photo is striking, and it captures the sense of struggle and resilience of the family. The photo is taken from a slightly low angle, which makes the figures appear more imposing. The lighting is soft and natural, which helps to create a sense of intimacy.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

This is a poignant black and white photograph, likely from the Great Depression era, depicting a family under what appears to be a makeshift shelter.

  • Focus and Composition: The photograph centers on a man resting his head on his hand and looking directly at the camera. He appears weary and has a serious expression, possibly indicating hardship. The composition is intimate, with the man filling a good portion of the frame.
  • Setting and Family: Behind the man, a woman cradles a baby, seated beneath a simple awning or covering. The lighting suggests they are outdoors, possibly in a rural or temporary camp setting. The background is soft and blurred, indicating trees and a natural environment.
  • Mood and Impression: The image evokes a sense of poverty, exhaustion, and perhaps resilience. The rough wooden table and the simple clothing reinforce the challenging conditions they are likely enduring. The photograph captures a moment of quiet contemplation, offering a glimpse into the lives of ordinary people struggling through difficult times.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The black-and-white photograph depicts a scene that appears to be from the early to mid-20th century, likely during the Great Depression era. The image shows a family of three: a man, a woman, and a baby.

  • The man is in the foreground, lying on a wooden platform, possibly the bed of a truck or a makeshift shelter. He has a weathered appearance with a serious expression, wearing a long-sleeved shirt and pants. His hands and arms are dirty, suggesting manual labor or difficult living conditions.
  • The woman is sitting in the background, holding a baby in her lap. She has a somber expression and is wearing a sleeveless dress. Her hair is short and appears to be unkempt.
  • The setting seems to be outdoors, under a tarp or makeshift tent, with some foliage visible above them. The overall mood of the image is somber, reflecting the hardships and struggles of the time.

This photograph is reminiscent of the iconic images taken by photographers like Dorothea Lange during the Great Depression, capturing the plight of migrant workers and families affected by economic hardship.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-30

The image is a black-and-white photograph depicting a rural, possibly agricultural setting. In the foreground, a man is leaning on a wooden structure, possibly a table or counter, with his hands resting on his lower back. He appears to be in a contemplative or resting posture. The background shows a woman seated and holding a baby in her arms. She is dressed in a simple, possibly handmade, outfit. The area around them includes a makeshift shelter or tent made from cloth or tarps, partially supported by wooden poles, and some greenery is visible in the background, suggesting a natural outdoor environment. The overall atmosphere of the image conveys a sense of simplicity and hardship, possibly indicative of a rural or displacement setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-30

This black-and-white photograph depicts a somber scene with three individuals in a rural or makeshift setting. In the foreground, a man with a rugged appearance, possibly a laborer or farmer, is lying on a wooden platform, resting his head on his hand. His expression appears serious and contemplative.

In the background, a woman is sitting on the ground, holding a baby. She is partially shaded by a tarp or makeshift shelter, and her expression is one of concern or weariness. The surrounding environment includes some foliage and trees, suggesting an outdoor setting, possibly during a time of hardship or displacement. The overall mood of the image is one of hardship and resilience.