Human Generated Data

Title

Untitled (Red House, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1188

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Red House, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1188

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Formal Wear 100
Suit 100
People 100
Architecture 99.2
Building 99.2
Outdoors 99.2
Shelter 99.2
Person 99
Person 99
Adult 99
Male 99
Man 99
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.7
Person 98.4
Person 98.3
Person 98.1
Male 98.1
Boy 98.1
Child 98.1
Person 97.5
Person 96.4
Adult 96.4
Male 96.4
Man 96.4
Person 96.2
Person 96
Person 94.9
Person 93.8
Person 93.5
Male 93.5
Boy 93.5
Child 93.5
Person 91.4
Ball 89.4
Rugby 89.4
Rugby Ball 89.4
Sport 89.4
Footwear 89.3
Shoe 89.3
Shoe 85.9
Face 84.4
Head 84.4
Shoe 84.1
Photography 82.9
Portrait 82.7
Shoe 82.7
Shorts 80.5
Shoe 79.9
Person 78.6
Shoe 78.5
Coat 77.9
Jacket 77.3
Person 74.6
Shoe 73.3
Person 73.2
Nature 73
Shoe 70.3
Dress 68.6
Machine 65.6
Wheel 65.6
Person 60.7
City 60.7
Shoe 59.6
Housing 57.9
Pants 57.7
Hat 57.7
Urban 57.7
Shirt 57.5
Overcoat 57
Road 56.7
Street 56.7
Tuxedo 56.4
Crowd 56.4
Skirt 56.3
Bus Stop 55.7
Accessories 55.5
Bag 55.5
Handbag 55.5
House 55.5
Countryside 55.4
Hut 55.4
Rural 55.4
Shoe 55.3
Tie 55.1
Neighborhood 55.1

Clarifai
created on 2018-05-11

people 100
group 99.6
many 99.4
group together 98.9
child 97.7
adult 96.4
woman 96.1
administration 93.7
man 91.9
war 88.5
several 88.2
boy 86.4
military 83.8
leader 81.3
crowd 80.5
wear 80
street 78.1
recreation 77.3
vehicle 74.1
five 73.3

Imagga
created on 2023-10-06

kin 44.3
man 24.2
people 21.7
old 18.1
person 15.7
male 15.7
ancient 14.7
uniform 14
city 13.3
soldier 12.7
world 12.2
men 12
black 12
travel 12
street 12
army 11.7
group 11.3
room 10.9
history 10.7
building 10.7
military 10.6
business 10.3
vintage 9.9
family 9.8
scene 9.5
statue 9.5
monument 9.3
child 9.2
tourism 9.1
war 8.7
antique 8.6
sculpture 8.6
architecture 8.6
culture 8.5
military uniform 8.3
clothing 8.2
danger 8.2
landmark 8.1
art 7.9
urban 7.9
boy 7.8
walking 7.6
happy 7.5
traditional 7.5
adult 7.5
mother 7.5
symbol 7.4
historic 7.3
girls 7.3
protection 7.3
aged 7.2
dirty 7.2
home 7.2
portrait 7.1
women 7.1
interior 7.1
weapon 7.1
businessman 7.1
spectator 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 99.9
outdoor 98.8
group 91.9
people 89
standing 82.4
posing 70.9
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 10-18
Gender Female, 100%
Calm 78.3%
Happy 15%
Surprised 6.8%
Fear 6%
Sad 2.4%
Confused 2.3%
Angry 1.2%
Disgusted 1%

AWS Rekognition

Age 7-17
Gender Male, 60.5%
Happy 98.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Calm 0.8%
Angry 0.3%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99%
Calm 95.6%
Surprised 6.4%
Fear 5.9%
Sad 2.9%
Disgusted 0.9%
Angry 0.4%
Happy 0.3%
Confused 0.3%

AWS Rekognition

Age 26-36
Gender Female, 84%
Calm 76%
Surprised 6.6%
Fear 6.1%
Angry 5.9%
Confused 4.7%
Sad 4.6%
Happy 3.5%
Disgusted 3.1%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 77.5%
Sad 27.8%
Surprised 6.5%
Fear 5.9%
Confused 1%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 100%
Angry 80%
Sad 10.2%
Calm 6.6%
Surprised 6.5%
Fear 6%
Confused 0.5%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 19-27
Gender Female, 89.4%
Happy 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 99.7%
Sad 100%
Calm 8.4%
Surprised 6.3%
Fear 6%
Angry 0.8%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 90.2%
Calm 99.7%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 58.4%
Calm 97%
Surprised 6.3%
Fear 6%
Sad 2.3%
Happy 1.1%
Confused 0.5%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Male, 99.4%
Calm 84.7%
Sad 9.6%
Surprised 6.5%
Fear 6.1%
Confused 1.4%
Disgusted 1.1%
Happy 0.4%
Angry 0.4%

AWS Rekognition

Age 6-14
Gender Female, 99.7%
Sad 99.3%
Calm 34.9%
Surprised 6.5%
Fear 6%
Confused 2.4%
Disgusted 0.5%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Female, 98.8%
Sad 97%
Fear 54%
Surprised 6.5%
Disgusted 1.9%
Calm 1.2%
Angry 0.7%
Confused 0.6%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Female, 59.1%
Calm 67.3%
Sad 18.9%
Happy 12.2%
Surprised 7.3%
Fear 6.2%
Confused 0.6%
Disgusted 0.4%
Angry 0.3%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Boy
Child
Rugby Ball
Shoe
Coat
Wheel
Person 99%
Person 99%
Person 98.8%
Person 98.7%
Person 98.4%
Person 98.3%
Person 98.1%
Person 97.5%
Person 96.4%
Person 96.2%
Person 96%
Person 94.9%
Person 93.8%
Person 93.5%
Person 91.4%
Person 78.6%
Person 74.6%
Person 73.2%
Person 60.7%
Adult 99%
Adult 98.8%
Adult 96.4%
Male 99%
Male 98.8%
Male 98.1%
Male 96.4%
Male 93.5%
Man 99%
Man 98.8%
Man 96.4%
Boy 98.1%
Boy 93.5%
Child 98.1%
Child 93.5%
Rugby Ball 89.4%
Shoe 89.3%
Shoe 85.9%
Shoe 84.1%
Shoe 82.7%
Shoe 79.9%
Shoe 78.5%
Shoe 73.3%
Shoe 70.3%
Shoe 59.6%
Shoe 55.3%
Coat 77.9%
Wheel 65.6%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people standing around a truck -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This black-and-white image depicts a group of people gathered around a truck, with some individuals inside the truck and others standing outside. The truck appears to have a wooden or metal enclosure at the back, with children climbing and interacting with it. Many of the individuals outside the truck appear to be children or young adults, dressed in casual or work-like clothing typical of earlier decades, such as skirts, overalls, and button-down shirts. In the background, there is a house with a sloped roof and visible windows, surrounded by a yard or open area. The scene gives the impression of a communal or social gathering.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts an assembly of children and a few adults gathered around a vehicle with an open back. Several children are situated inside the truck, while others are standing around it, some reaching towards the back of the truck. The adults appear to be overseeing the group, and the environment suggests a rural or suburban setting, with a house visible in the background. The individuals are dressed in attire typical of mid-20th century, featuring sweaters, dresses, and coats. The scene conveys a sense of activity or preparation, possibly for an outing or event involving the group.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a group of children and young people gathered outside a building, likely a rural home or farmhouse. The group appears to be a mix of boys and girls of varying ages, all dressed in clothing typical of the mid-20th century. Some of the children are standing, while others are sitting or leaning on a wooden structure. The background includes a wooden building with shuttered windows. The overall scene suggests a casual, informal gathering of a community or group of acquaintances.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a black and white historical photograph, likely from the 1930s or 1940s, showing a group of children and a few adults gathered outside what looks like a residential building or school. The clothing styles are indicative of that era, with the women wearing polka dot dresses and the children in casual period attire. The image has a candid quality to it, with people standing in an informal group formation. In the background, you can see what appears to be a white house or building with windows. The photograph has the grainy, slightly faded quality typical of images from that time period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

This image is a black and white photograph of a group of children gathered around a truck. The truck appears to be filled with wooden crates, and some children are standing on the back of the truck or inside it.

The children are dressed in casual clothing, including dresses, shirts, pants, and jackets. Some of them are barefoot, while others wear shoes.

In the background, there is a house with a porch and a car parked nearby. The overall atmosphere of the image suggests that it was taken during a time of economic hardship or migration, possibly during the Great Depression or World War II.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image depicts a group of children and adults gathered around a truck, with the children appearing to be in a state of excitement or chaos. The truck is parked on a dirt road, and the children are standing or sitting on the back of the truck, some of whom are holding onto the wooden slats that make up the truck's bed. The adults are standing nearby, watching the children with a mix of concern and amusement.

In the background, a house and a field can be seen, suggesting that the scene is taking place in a rural or suburban area. The overall atmosphere of the image is one of joy and freedom, as the children seem to be enjoying themselves and the adults appear to be relaxed and unbothered by the commotion.

The image may have been taken during a special event or celebration, such as a birthday party or a school field trip, or it could simply be a candid shot of everyday life in a small town or village. Regardless of the context, the image captures a moment of carefree happiness and innocence, which is both charming and nostalgic.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-25

A black-and-white photo shows a group of people standing outside, with a truck in the background. Some people are standing inside the truck, and a few children are sitting on the truck's railings. The people standing outside are looking at the truck, and one of them is holding a ball. A house is in the background, with a chair in front of it.

Created by amazon.nova-pro-v1:0 on 2025-05-25

The black-and-white photo shows a group of children and adults standing in front of a truck. Some of the children are inside the truck, while others are standing outside. The children are wearing different clothes, while the adults are wearing hats. The children are standing on the ground, while the adults are standing on the wooden platform. Behind them is a house with a window and a door.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

In a grainy black-and-white photograph, a large group of children and a few adults are gathered around a truck, with a house visible in the background.

The truck is positioned on the left side of the frame. The children are climbing up onto the back of the truck, one child has their hands raised into the air, looking as if they are cheering. An adult in a hat and jacket is standing near the front of the truck, looking toward the group.

In the foreground, more children are standing. One is wearing overalls and holding a ball-shaped object. Another is wearing a polka-dot dress and jacket, with their back turned to the camera.

The house in the background is a single-story structure with a gable roof and a small porch. There are windows on the front and side of the house.

The ground appears to be dirt or gravel, and there are some bushes and plants scattered around. The overall impression is one of rural life and community gathering.

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Impression: This is a black and white photograph capturing a group of children and a few adults, likely taken during the mid-20th century. The scene appears to be outdoors, possibly a school or community event. There's a mix of excitement and casualness among the children.

Key Elements:

  • The Group of Children: A large group of children is the central focus. Some are inside a wooden truck, while others are gathered on the ground around it. Their expressions and poses vary, with some raising their arms and others looking directly at the camera.
  • The Truck/Vehicle: A wooden truck, possibly a wagon or transport vehicle, is in the background. Some children are inside it.
  • Adults: There are a few adults present, seemingly supervising or involved. They are dressed in attire typical of the era, and they appear to be watching the children.
  • Setting: The photo appears to be taken in a rural or semi-rural area. There is a building in the background and the surrounding environment looks like a field.

Possible Interpretation: The image may depict a scene from a school outing, a community gathering, or a historical event related to children and transportation. It evokes a sense of nostalgia and provides a glimpse into a specific moment in the past.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-26

The black-and-white photograph depicts a group of children gathered around the back of a large truck, which appears to be serving as a makeshift stage or platform. The setting looks like a rural or small-town area, possibly during the mid-20th century, given the clothing styles and the general atmosphere.

Here are some detailed observations:

  1. Children: The children are dressed in typical mid-20th-century clothing. The boys are wearing overalls, jackets, and caps, while the girls are in dresses and skirts. Some children are smiling, while others appear more serious or curious.

  2. Truck: The truck has its back open, and several children are standing on or near the platform. One child is waving from the truck, and another is leaning out, possibly engaging with the crowd.

  3. Adults: There are a few adults present, including a man in a hat and jacket who seems to be assisting or supervising the children on the truck.

  4. Background: The background includes a house with a gabled roof and a yard, suggesting a residential area. The overall setting gives a sense of a community gathering or event.

  5. Atmosphere: The scene conveys a sense of camaraderie and community, with children and adults interacting in what appears to be a casual, outdoor event.

This photograph captures a moment of community life, likely from a bygone era, showcasing the simplicity and togetherness of the time.