Human Generated Data

Title

Untitled (Trische family, tenant farmers, Plaquemines Parish, Louisiana)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1316

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Trische family, tenant farmers, Plaquemines Parish, Louisiana)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1316

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Face 100
Head 100
Photography 100
Portrait 100
Clothing 100
Shorts 100
Dress 99.1
Wood 99.1
Blouse 98.9
People 98.5
Architecture 91.1
Building 91.1
House 91.1
Housing 91.1
Porch 91.1
Footwear 91.1
Outdoors 90.7
Pants 90.2
Nature 79.4
Bathing 77.9
Skirt 76.7
Countryside 66.3
Barefoot 57.9
Rural 57.6
Hut 57.3
Door 56.7
Shelter 56.4
Happy 55.9
Smile 55.9
Water 55.8
Shirt 55.7
Shack 55.5
Bathtub 55.1
Tub 55.1

Clarifai
created on 2018-05-11

people 100
child 99.9
group 99.8
offspring 99.2
sibling 99.1
family 99
four 97.5
group together 97.5
five 97.2
adult 96.7
son 96.4
home 96.3
wear 95.5
three 95.5
several 95.3
man 94.7
administration 94.4
boy 94.4
woman 94.2
portrait 93.7

Imagga
created on 2023-10-05

kin 40
child 39.9
man 27.5
person 26
male 23.5
people 23.4
smiling 19.5
standing 18.2
world 16.4
portrait 16.2
juvenile 16.2
group 16.1
couple 15.7
happy 15.7
adult 15
mother 15
old 14.6
family 14.2
smile 13.5
men 12.9
parent 12.5
building 12.1
boy 11.3
school 11.3
outdoors 11.2
team 10.8
together 10.5
sibling 10.3
business 10.3
tradition 10.2
walking 9.5
two 9.3
mature 9.3
park 9.1
classroom 8.8
40s 8.8
women 8.7
daughter 8.7
ancient 8.6
happiness 8.6
brother 8.5
vacation 8.2
dress 8.1
home 8
businessman 7.9
black 7.8
architecture 7.8
staff 7.7
summer 7.7
30s 7.7
attractive 7.7
senior 7.5
student 7.3
room 7.3
cheerful 7.3
lifestyle 7.2
hospital 7.2
father 7.2
love 7.1
to 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.2
outdoor 97.9
standing 95.6
posing 90.1
old 79.2
white 77.2
black 72.1
group 68
vintage 33.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 6-14
Gender Female, 96.3%
Sad 100%
Surprised 6.4%
Fear 6%
Disgusted 3.1%
Confused 1.9%
Calm 0.6%
Angry 0.4%
Happy 0.1%

AWS Rekognition

Age 0-6
Gender Male, 98%
Sad 91%
Calm 41.6%
Angry 9.4%
Surprised 7%
Fear 6.3%
Confused 1.6%
Disgusted 1.4%
Happy 0.7%

AWS Rekognition

Age 6-16
Gender Female, 99.9%
Calm 98.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.9%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 30-40
Gender Male, 96.9%
Sad 80.2%
Calm 22.9%
Confused 15.1%
Angry 12.6%
Fear 8.5%
Surprised 7.4%
Disgusted 2.6%
Happy 2.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Angry 98.3%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Calm 0.3%
Disgusted 0.1%
Happy 0.1%
Confused 0.1%

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 13
Gender Female

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Child
Female
Girl
Shoe
Coat

Clarifai

Clothing
Human face
Footwear
Girl
Woman
Human leg
Human arm

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.3%

AWS Rekognition

Child 98.9%

AWS Rekognition

Child 98.6%

AWS Rekognition

Child 98.3%

AWS Rekognition

Female 98.9%

AWS Rekognition

Female 98.6%

AWS Rekognition

Female 98.3%

AWS Rekognition

Girl 98.9%

AWS Rekognition

Girl 98.6%

AWS Rekognition

Girl 98.3%

AWS Rekognition

Shoe 91.1%

AWS Rekognition

Shoe 87.9%

AWS Rekognition

Shoe 80.4%

AWS Rekognition

Coat 68.2%

Clarifai

Clothing 90.2%

Clarifai

Clothing 76.6%

Clarifai

Clothing 52.1%

Clarifai

Human face 81.8%

Clarifai

Human face 77.1%

Clarifai

Human face 76.6%

Clarifai

Human face 74.5%

Clarifai

Human face 60.6%

Clarifai

Footwear 81.2%

Clarifai

Footwear 79.2%

Clarifai

Footwear 77.7%

Clarifai

Footwear 76.1%

Clarifai

Footwear 68.2%

Clarifai

Footwear 64.4%

Clarifai

Footwear 60.8%

Clarifai

Footwear 57%

Clarifai

Footwear 54.8%

Clarifai

Footwear 34.6%

Clarifai

Girl 79.4%

Clarifai

Girl 65.6%

Clarifai

Girl 57.1%

Clarifai

Woman 64.5%

Clarifai

Human leg 45.6%

Clarifai

Human leg 42.5%

Clarifai

Human leg 42.5%

Clarifai

Human leg 40.8%

Clarifai

Human leg 38.8%

Clarifai

Human leg 37.8%

Clarifai

Human arm 40.1%

Categories

Imagga
created on 2023-10-05

people portraits 99.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of people standing in front of a house

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of a family standing in front of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts a family standing in front of a wooden building, likely a rural home. The individuals are barefoot, wearing simple clothing, suggesting a modest or impoverished lifestyle. The structure features weathered wood and a partially open doorway. There is a metal wash tub on the left and rough wooden beams supporting the porch. The scene conveys a sense of life in a rustic or early 20th-century setting.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a group of five individuals standing on a wooden porch in front of a rustic wooden building. The group consists of three children and two adults. The adult on the far left is wearing a striped dress and has a small child standing in front of them wearing shorts and a shirt. Next to them are three children, each wearing simple dresses; two of them are barefoot and the third has shoes. The background shows a wooden wall with visible planks and an open door that is part of the structure. To the left, there's a metal tub on the wooden floor.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows a group of four children and one adult woman standing in the doorway of a wooden building. The children appear to be of varying ages, ranging from a young boy to three girls. The woman is wearing a striped dress and the children are dressed in simple clothing. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-18

The black and white photograph depicts a group of five children standing in the doorway of a wooden structure, likely a rural home or cabin. The children appear to range in age, with the youngest being a toddler held by an older girl, and the oldest appearing to be a teenage girl. They are wearing simple, modest clothing typical of an earlier era, possibly the early to mid 20th century. The expressions on the children's faces are serious, and they are looking directly at the camera. The wooden structure behind them has weathered boards and appears rustic and aged.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a historical black and white photograph, likely from the early 20th century. The image shows a family standing on what appears to be a wooden porch of a rustic log cabin or wooden house. There's an adult in a striped dress standing with several children of varying heights. The children are wearing simple, light-colored dresses and casual clothing typical of the era. Most of the children appear to be barefoot. The setting suggests a rural, possibly impoverished environment, with rough wooden walls visible in the background. The photograph has the documentary style characteristic of Depression-era photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a family standing in front of a wooden house. The family consists of a woman and four children, with the woman holding a young child in her left arm and standing beside another young child. The woman is dressed in a striped dress with a belt around her waist, while the children wear simple clothing, with the two younger children barefoot and the two older children wearing shoes.

The family stands on a wooden porch, with a large wooden door behind them that is slightly ajar. To the left of the image, a metal bucket sits on the porch floor. The background of the image features the wooden exterior of the house, which appears to be made of weathered planks.

Overall, the image presents a poignant and intimate portrayal of a family in a rural setting, with the worn and weathered wooden house serving as a backdrop to their everyday lives.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a woman and four children standing in front of a wooden building. The woman, positioned on the left, wears a long dress with a striped pattern and has short hair. She is accompanied by a young child, who is dressed in a short-sleeved shirt and shorts, and appears to be holding the child's hand.

To the right of the woman are three additional children, all barefoot. The child closest to the woman wears a white dress, while the next child is dressed in a light-colored dress. The child farthest to the right wears a dark-colored dress.

In the background, the wooden building features a large open doorway and a window covered with wooden boards. A metal tub is visible in the bottom-left corner of the image. The overall atmosphere of the photograph suggests that it was taken during a time of economic hardship or poverty, likely in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph of a family standing on the porch of a wooden house. The family consists of an adult woman, a young boy, and three young girls. They are all barefoot and dressed in simple, old-fashioned clothing. The woman is standing on the left side of the image, and the children are standing behind her. The boy is standing in front of the woman, and the girls are standing behind him. The house has a wooden wall and a wooden door.

Created by amazon.nova-pro-v1:0 on 2025-06-05

A black-and-white image of a woman and four children standing in front of a wooden door. The woman is wearing a striped dress, while the children are barefoot and wearing dresses. The woman is holding the hand of the child on the left, who is holding something in his mouth. The woman is smiling, while the children are looking straight ahead. The wooden door has a window and a bucket on the floor.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-24

Here is a description of the image:

This black and white photograph appears to be a portrait of a woman and four children posed in front of a wooden structure. The woman, who appears to be the mother, stands slightly to the left and is dressed in a striped dress. She holds the youngest child, who is wearing shorts and a shirt. The other three children are standing in a row to the right of the mother. They are all barefoot and dressed in simple, light-colored clothing. The structure they are standing in front of looks like a doorway or porch, with weathered wooden planks. A metal basin is partially visible in the lower left corner. The overall impression is one of poverty and hardship, likely taken during the Great Depression era. The image is stark and evokes a sense of resilience in the face of difficult times.

Created by gemini-2.0-flash on 2025-05-24

This is a black and white photograph of a woman and four children standing in front of a weathered wooden building. The woman is standing on the left, wearing a striped dress with a v-neck and short sleeves. A young child stands in front of her, wearing a shirt and shorts. To the woman's right, there are three more children standing in a line. They are all barefoot and wearing simple dresses.

The building behind them is made of rough wooden planks. There is a dark opening behind them that could be a doorway or window. To the right of the children, there is a wooden post.

In the bottom left corner of the photo, there is a metal bucket or tub. The overall impression of the photograph is one of poverty and hardship.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a woman and four children standing in front of a rustic wooden house. The setting appears to be rural and possibly from an earlier time period, likely the early to mid-20th century.

  1. The Woman:

    • She is standing on the left side of the image.
    • She is wearing a striped dress with short sleeves and has her hair pulled back.
    • She is holding a young child, who is wearing a light-colored shirt and shorts.
  2. The Children:

    • There are four children in total.
    • The child being held by the woman appears to be the youngest.
    • The other three children are standing beside the woman. They are dressed in simple clothing:
      • The first child (from left to right) is wearing a light-colored dress.
      • The second child is wearing a lighter dress with a floral pattern.
      • The third child is wearing a darker dress.
    • All three children standing beside the woman are barefoot.
  3. The House:

    • The house has a wooden exterior with visible planks and a simple construction.
    • The doorway is open, revealing a dark interior.
    • There is a wooden post visible to the right of the doorway.
    • The porch floor is made of wooden planks.

The overall atmosphere of the image suggests a simple, possibly impoverished, rural lifestyle. The clothing and the condition of the house indicate modest living conditions.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This black-and-white photograph depicts a family group consisting of a woman and four children standing on a wooden porch in front of a rustic wooden house. The woman, positioned on the left, is wearing a striped dress and appears to be holding a young child in her arms. Next to her, from left to right, are three young girls standing with their hands at their sides. The girls are dressed in simple dresses, and the two on the right are barefoot. The porch is made of wooden planks, and a metal washtub is visible on the ground to the left. The overall scene suggests a modest, rural lifestyle.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white image depicts a family standing on the porch of a wooden house. The woman on the left is holding a young child, and there are three older children standing next to her. The house appears to be modest, with a simple wooden structure and a dark interior. A metal basin is visible on the ground to the left. The overall scene suggests a rural or modest living environment.