Human Generated Data

Title

Untitled (Branchville, Maryland)

Date

November 1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1912

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Branchville, Maryland)

People

Artist: Ben Shahn, American 1898 - 1969

Date

November 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1912

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.5
Hat 99.5
Pants 96.5
Coat 96.5
Face 89.1
Head 89.1
Cap 81.6
Railway 75.8
Transportation 75.8
Footwear 68.3
People 64.5
Terminal 61.7
Train 57.5
Train Station 57.5
Vehicle 57.5
Accessories 56.2
Photography 56.1
Portrait 56.1
Baseball Cap 55.7
Helmet 55.5
Sunglasses 55.3

Clarifai
created on 2018-05-11

people 100
group 98.6
group together 98.5
adult 98.2
many 98.1
man 96.5
military 96.4
war 95.8
soldier 94.9
administration 94
woman 93.4
wear 92.3
vehicle 91.4
uniform 88.8
transportation system 88
child 86.7
outfit 83.7
crowd 83.6
boy 83.4
veil 83.3

Imagga
created on 2023-10-06

helmet 34.1
war 27.9
mask 27.3
protection 26.4
soldier 25.4
military 25.1
man 24.9
armor 22.4
warrior 19.5
male 19.2
person 18.5
clothing 17.6
covering 17.1
weapon 17
history 17
shield 16.3
protective covering 15.8
people 15.6
historical 14.1
army 13.6
suit 13.5
uniform 12.9
knight 12.8
statue 12.7
danger 12.7
battle 12.7
city 12.5
photographer 12.3
safety 12
disaster 11.7
gas 11.5
old 11.1
sword 11.1
attendant 10.7
protective 10.7
headdress 10.5
horse 10.4
ancient 10.4
men 10.3
culture 10.2
gun 10.2
equipment 10.2
vehicle 10.1
sport 10
toxic 9.8
human 9.7
portrait 9.7
metal 9.7
urban 9.6
medieval 9.6
pedestrian 9.4
religion 9
radiation 8.8
conflict 8.8
fight 8.7
travel 8.4
stone 8.4
black 8.4
traditional 8.3
breastplate 8.3
street 8.3
historic 8.2
world 8
football helmet 7.9
back 7.9
radioactive 7.8
adult 7.8
fear 7.7
chemical 7.7
fire 7.5
outdoors 7.5
vintage 7.4
security 7.3
art 7.3
costume 7.3
conveyance 7.2
day 7.1
architecture 7

Microsoft
created on 2018-05-11

person 99.5
outdoor 95
people 67.6
posing 41
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 22-30
Gender Male, 100%
Sad 100%
Calm 8.3%
Surprised 6.3%
Fear 5.9%
Confused 0.3%
Angry 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Calm 94.5%
Surprised 6.4%
Fear 6.1%
Sad 2.5%
Angry 1.8%
Confused 0.7%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Male, 100%
Happy 95.5%
Surprised 6.4%
Fear 5.9%
Sad 3.5%
Confused 0.2%
Angry 0.2%
Calm 0.2%
Disgusted 0.1%

AWS Rekognition

Age 25-35
Gender Male, 91.5%
Disgusted 37.2%
Sad 32.1%
Fear 13.5%
Surprised 12.2%
Confused 11.9%
Angry 2.7%
Happy 2.3%
Calm 2.2%

AWS Rekognition

Age 21-29
Gender Male, 85.7%
Calm 88.1%
Disgusted 8.8%
Surprised 6.6%
Fear 5.9%
Sad 2.4%
Confused 0.6%
Angry 0.5%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Male, 86%
Calm 93.5%
Surprised 6.3%
Fear 5.9%
Sad 4.4%
Confused 0.4%
Happy 0.4%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 23-31
Gender Male, 90.9%
Calm 66.1%
Confused 15.3%
Surprised 8.5%
Fear 8.2%
Sad 3.1%
Happy 3%
Angry 2.6%
Disgusted 1.2%

AWS Rekognition

Age 25-35
Gender Male, 56.8%
Calm 95.4%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Confused 2%
Angry 0.7%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Male, 87.5%
Sad 99.9%
Angry 15.4%
Surprised 6.4%
Fear 6.3%
Calm 3.5%
Disgusted 0.5%
Confused 0.5%
Happy 0.3%

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Calm 73.5%
Sad 18.3%
Surprised 7.8%
Fear 6%
Disgusted 2.8%
Confused 1.8%
Happy 1.4%
Angry 1.1%

Microsoft Cognitive Services

Age 45
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Jeans
Jacket
Shoe

Clarifai

Man
Clothing
Human face
Footwear

AWS Rekognition

Adult 99.1%

AWS Rekognition

Adult 98.8%

AWS Rekognition

Adult 98.2%

AWS Rekognition

Adult 83.3%

AWS Rekognition

Male 99.1%

AWS Rekognition

Male 98.8%

AWS Rekognition

Male 98.2%

AWS Rekognition

Male 83.3%

AWS Rekognition

Man 99.1%

AWS Rekognition

Man 98.8%

AWS Rekognition

Man 98.2%

AWS Rekognition

Man 83.3%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 94.7%

AWS Rekognition

Person 93.8%

AWS Rekognition

Person 93.7%

AWS Rekognition

Person 93.3%

AWS Rekognition

Person 92.8%

AWS Rekognition

Person 92.7%

AWS Rekognition

Person 90.6%

AWS Rekognition

Person 85.1%

AWS Rekognition

Person 83.3%

AWS Rekognition

Person 64.8%

AWS Rekognition

Person 61.1%

AWS Rekognition

Jeans 96.5%

AWS Rekognition

Jacket 92.2%

AWS Rekognition

Shoe 68.3%

AWS Rekognition

Shoe 57.1%

Clarifai

Man 91.7%

Clarifai

Man 86.2%

Clarifai

Man 76.8%

Clarifai

Man 75.3%

Clarifai

Man 73.1%

Clarifai

Man 71.1%

Clarifai

Man 68.5%

Clarifai

Man 65%

Clarifai

Man 64.1%

Clarifai

Man 63.8%

Clarifai

Man 59.8%

Clarifai

Man 59.7%

Clarifai

Man 53.6%

Clarifai

Man 53.3%

Clarifai

Man 48.8%

Clarifai

Man 47.5%

Clarifai

Man 44.2%

Clarifai

Man 41.7%

Clarifai

Man 40.5%

Clarifai

Clothing 86%

Clarifai

Clothing 79%

Clarifai

Clothing 45.2%

Clarifai

Clothing 37.6%

Clarifai

Clothing 36.2%

Clarifai

Clothing 34.7%

Clarifai

Human face 59.3%

Clarifai

Human face 55.9%

Clarifai

Human face 54.1%

Clarifai

Human face 51%

Clarifai

Human face 48.6%

Clarifai

Human face 44.6%

Clarifai

Human face 41.6%

Clarifai

Human face 38.4%

Clarifai

Human face 36%

Clarifai

Human face 33.1%

Clarifai

Footwear 58.3%

Clarifai

Footwear 57.9%

Clarifai

Footwear 43.7%

Clarifai

Footwear 37.6%

Categories

Imagga
created on 2023-10-06

paintings art 89.3%
people portraits 8.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people sitting on a bench in a train station

Created by general-english-image-caption-blip-2 on 2025-07-04

black and white photo of men sitting on a train platform

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts a group of men, likely workers, gathered near railway tracks. Some men are sitting on a wooden bench or platform, while others are standing in the background and engaging in conversation. The men wear uniforms and clothing typical of laborers, such as overalls, jackets, and caps. The environment and attire suggest a worksite or an industrial setting. Visible train tracks and wooden railroad ties are nearby, implying a connection to railway or construction work. The scene exudes a sense of camaraderie and daily life during an era where manual labor was prevalent.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a group of men gathered near a set of train tracks. The men are dressed in work clothes, with several wearing overalls and jackets. Many are seated on what appears to be a wooden bench or cart, while others stand around. In the background, more men can be seen engaged in conversation or milling about. The setting appears to be an industrial or railroad environment, likely from a historical period given the black-and-white nature of the photograph and the style of clothing. The overall mood suggests a break time or a gathering among workers.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to depict a group of men, likely workers, gathered at a train station or railway platform. The men are wearing work clothes, such as overalls and hats, and seem to be waiting or resting. There is a crowd of people in the background, suggesting this is a busy transportation hub. The image has a black and white, historical aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-18

The black and white image shows a group of African American men sitting together on a bench or platform near some railroad tracks. They are wearing caps, overalls, and work clothes, suggesting they may be railroad workers taking a break. The men have serious expressions and some are looking directly at the camera. In the background, other people can be seen standing or walking along the tracks. The setting appears to be an outdoor rail yard or station area.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white historical photograph showing railroad workers taking a break. Two African American men are seated in the foreground, both wearing overalls and caps typical of laborers in what appears to be the early-to-mid 20th century. They're dressed in work clothes including denim overalls, jackets, and flat caps. In the background, there are other workers gathered around what appears to be a railroad area, with some railroad tracks visible. The image captures what seems to be a moment during a work break or rest period during railroad construction or maintenance work.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of two men sitting on a bench, surrounded by a group of people in the background. The men are dressed in casual attire, with one wearing overalls and a jacket, while the other wears overalls and a shirt. They sit on a wooden bench, with their hands resting on their laps.

In the background, a group of people are gathered, some standing and others sitting on benches. The scene appears to be set in a rural or industrial area, with railroad tracks visible in the distance. The overall atmosphere of the image suggests a sense of community and camaraderie among the individuals present.

The photograph is likely a historical image, given its black-and-white format and the style of clothing worn by the subjects. It may have been taken during a specific event or gathering, such as a labor strike or a community meeting. The image provides a glimpse into the lives of working-class individuals during a particular time period, highlighting their daily struggles and interactions.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a group of men gathered near railroad tracks. The men are dressed in casual attire, with some wearing hats and jackets. They appear to be engaged in conversation or simply sitting together.

In the background, there are railroad tracks and what appears to be a building or structure. The overall atmosphere of the image suggests a sense of community and camaraderie among the men.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image shows a black-and-white photograph of a group of people gathered around a railway track. Some of them are sitting on a bench, while others are standing behind them. The two men sitting on the bench are wearing hats and appear to be engaged in conversation. The man on the left is wearing a long-sleeve shirt, while the man on the right is wearing a jacket. Behind them, there are several people standing, some of whom are also wearing hats.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black-and-white photo shows a group of people gathered in an outdoor area. They are wearing hats and uniforms. Some of them are sitting on a wooden bench, while others are standing. The person sitting on the bench in front is wearing a hat and a belt. Behind them are several people standing near the train tracks. Some of them are wearing hats and glasses. There is a pole in the middle.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-25

Here's a description of the image:

Overall Impression:

The image is a vintage, black and white photograph. It appears to be a candid shot of a group of men, likely laborers, gathered near railroad tracks. The photo is slightly grainy, adding to the historical feel.

Key Elements and Details:

  • Subject: The main focus is on two African American men seated on a wooden bench. Both are wearing overalls, work jackets, and caps, suggesting they are manual laborers. The man on the left is facing the camera directly and appears to be quite large, with his hands in his pockets. The man on the right has a more serious look on his face, he is also wearing overalls and a jacket but with his hands in his pockets.
  • Setting: The setting appears to be next to railroad tracks. In the background, there are other men, some standing, some seemingly talking, and others milling about. The presence of the tracks indicates a job site or a place where the men are likely waiting for work or a break.
  • Atmosphere: The image conveys a sense of historical realism and perhaps a moment of respite or waiting in the workers' daily lives. The photograph evokes a feeling of early to mid-20th-century America.

Additional Observations:

  • The men's clothing suggests they are engaged in physical labor.
  • The expressions on the men's faces, which may show a mixture of anticipation, exhaustion, and camaraderie.

Possible Context:

Given the era and setting, this photograph might depict:

  • Railroad workers.
  • Men waiting for work during the Great Depression.
  • A scene from a time when labor conditions and racial dynamics were significantly different than today.

Created by gemini-2.0-flash on 2025-05-25

Here is a description of the image:

The black-and-white photograph shows several men in what appears to be an outdoor setting, possibly near railroad tracks. In the foreground, two African American men are sitting on a wooden structure, which looks like a piece of railroad equipment.

The man on the left has a larger build and is wearing a newsboy cap, overalls with a plaid pattern, and a dark jacket. His hands are casually placed in his pockets. The man on the right is wearing a similar newsboy cap, denim overalls, and a light-colored jacket. He also has one hand in his pocket, and the other hangs casually to the side.

In the background, there is a crowd of people, mostly men, wearing hats and coats. Some are standing near railroad tracks, suggesting a train station or industrial area. The atmosphere is somewhat somber and suggests a time of economic hardship or labor-related setting, possibly from the mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a group of men, likely laborers or workers, sitting on a bench near a railway track. The men are dressed in work clothes typical of the early to mid-20th century, including overalls, jackets, and hats. Their attire and the setting suggest they might be involved in manual labor, possibly related to the railroad industry.

The men appear to be taking a break or waiting for something. The background shows more people standing and sitting, indicating a gathering or a work site. The overall atmosphere suggests a scene of hardworking individuals, possibly during a period of economic hardship or significant labor activity. The photograph captures a moment of rest and camaraderie among the workers.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This black-and-white photograph depicts a group of men sitting on a wooden bench in what appears to be a railway yard or a similar industrial setting. The men are dressed in work attire, including overalls and caps, which suggests they might be involved in manual labor or railway work. The men are positioned in the foreground, while other workers can be seen in the background, some standing and others engaged in various activities. The setting conveys a sense of industriousness and labor, possibly capturing a moment of rest or a break in their workday.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph portrays a group of men, likely workers, sitting and standing near a railway track in what appears to be an industrial or working-class setting. The foreground features two men seated on a wooden bench. The man on the left wears a checkered shirt with a dark overcoat and a cloth cap. He appears to be looking directly at the camera with a neutral expression. The man on the right is dressed in a light shirt and overalls, also wearing a cloth cap, and has a contemplative expression as he looks slightly away from the camera. Behind them, several other men are standing or sitting, some wearing hats and coats, suggesting a cool weather. The background includes railway tracks, gravel, and a few other people in the distance, indicating a busy, possibly transient environment. The overall atmosphere of the image suggests a moment of rest or waiting, possibly during a workday.