Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2821

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2821

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.8
Person 99.8
Person 99.8
Person 99.7
Person 99.6
Person 99.6
Person 99.5
Nature 99.4
Outdoors 99.4
Person 99.4
Person 99.2
Person 98.6
Agriculture 97.5
Field 97.5
Countryside 97.5
Person 97.2
Soil 93.3
Rural 82.8
Worker 76.9
Farm 75.7
Planting 71.3
Ground 57.3
Harvest 56

Clarifai
created on 2018-03-23

people 99.9
group together 99.5
group 99.5
adult 99.5
many 98.9
military 98.3
war 98.3
man 98.1
cropland 97.9
vehicle 96.2
several 95.8
soldier 95.1
two 94.1
administration 92.3
three 92.3
four 91.9
one 90.7
skirmish 89.9
transportation system 88.9
wear 88.7

Imagga
created on 2018-03-23

maze 40.9
landscape 32.7
travel 30.3
sky 28.7
mountain 25.8
tourist 22.8
tourism 22.3
architecture 21.9
trees 20.5
private 20.3
park 18.1
hill 17.8
building 16.8
scenery 16.2
stone 16.1
outdoor 15.3
scenic 14.9
rock 14.8
old 13.9
track 13.9
mountains 13.9
ancient 13.8
summer 13.5
wall 12.8
person 12.7
city 12.5
tree 12.5
people 12.3
fortress 12.1
man 12.1
outdoors 11.9
grass 11.9
vacation 11.5
rural 11.5
engineer 11.2
landmark 10.8
history 10.7
hiking 10.6
valley 10.6
sun 10.5
forest 10.4
walking 10.4
sunny 10.3
clouds 10.1
road 9.9
tower 9.9
canyon 9.7
cloud 9.5
natural 9.4
desert 9.3
famous 9.3
countryside 9.1
sand 8.9
country 8.8
traveler 8.7
destination 8.4
field 8.4
rampart 8.2
national 8.2
water 8
ruin 7.8
hills 7.8
heritage 7.7
outside 7.7
culture 7.7
house 7.7
walk 7.6
temple 7.6
cityscape 7.6
south 7.5
active 7.2
holiday 7.2
river 7.1
male 7.1
palace 7.1
spring 7.1
day 7.1
sea 7
autumn 7

Google
created on 2018-03-23

farmworker 73.5
black and white 70.7
track 65.4
monochrome 61.7
rail transport 60.6
soil 59.2
laborer 58
vehicle 56.4
tree 50.8

Microsoft
created on 2018-03-23

sky 100
outdoor 99.9
person 93
group 75.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 30-47
Gender Male, 50.3%
Angry 49.7%
Confused 49.6%
Disgusted 49.6%
Surprised 49.6%
Sad 49.6%
Calm 49.9%
Happy 49.6%

AWS Rekognition

Age 38-57
Gender Female, 53.4%
Confused 45.3%
Surprised 45.5%
Angry 45.4%
Sad 49.9%
Happy 45.4%
Calm 48.4%
Disgusted 45.2%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.6%
Angry 49.6%
Happy 49.5%
Calm 50.3%

AWS Rekognition

Age 26-43
Gender Female, 51.5%
Sad 46.5%
Calm 46.2%
Confused 45.9%
Disgusted 46%
Surprised 45.9%
Happy 46.5%
Angry 48.1%

AWS Rekognition

Age 35-52
Gender Female, 51.5%
Surprised 45.1%
Happy 45.1%
Angry 45.2%
Sad 45.9%
Calm 53.7%
Confused 45%
Disgusted 45%

Feature analysis

Amazon

Person
Person 99.8%
Person 99.8%
Person 99.7%
Person 99.6%
Person 99.6%
Person 99.5%
Person 99.4%
Person 99.2%
Person 98.6%
Person 97.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-11

a photograph of a group of men working in a field -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This black-and-white photograph depicts a group of laborers working in agricultural fields, likely tending rows of crops with hoes or similar tools. The workers appear to be in uniform, suggesting they might be part of a prison labor system. In the background, there is a large, institutional-style brick building—also resembling a prison or similar facility. The surrounding environment includes grassy hills, a dirt road, and some small buildings or structures in the distance. The scene implies hard manual labor under organized supervision.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image is a black and white photograph that shows a group of men working in agricultural fields. The men appear to be using hoes to tend to rows of crops. They are dressed in work clothes, which include long pants, shirts, and some are wearing hats. The setting seems to be a prison or a similar institution, as a large, brick building that resembles a prison or a penitentiary is visible in the background. The landscape is quite barren, with patches of tilled soil and sparse vegetation. The overall atmosphere suggests that this is a historical image likely depicting a prison labor scene from the past.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-29

The image shows a group of workers laboring in a field or construction site, with a large, multi-story building visible in the background. The workers appear to be digging or working the soil, and they are wearing casual clothing and hats. The overall scene suggests a construction or agricultural setting from an earlier time period, likely captured in a black and white photograph.

Created by claude-3-opus-20240229 on 2024-12-29

The black and white image shows a group of men working in a field, likely farming or harvesting crops. They are using manual tools like hoes to work the soil. In the background, there is a large, multi-story brick building with architectural features suggesting it may be an administrative or municipal building of some kind. The men are wearing wide-brimmed hats to shield them from the sun as they work under the open sky.

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This is a historical black and white photograph showing agricultural or field work taking place on the grounds of what appears to be an institutional building. In the background, there's a substantial brick building with architectural features typical of the late 19th or early 20th century. Several workers are shown in the field, using hoes or similar farming tools to work the soil in what appears to be rows for planting. The workers are dressed in typical work clothes of the period - loose shirts, pants, and some wearing hats. The landscape appears to be on a slight hill or incline, with the institutional building positioned at a higher elevation. The image likely dates from the early 1900s based on the architectural style and photographic quality.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a group of African American men working in a field, likely during the early 20th century. The men are dressed in casual clothing, including long-sleeved shirts, pants, and hats, and are engaged in manual labor, using tools such as shovels and rakes to till the soil. In the background, a large brick building with a clock tower can be seen, suggesting that this may be a farm or plantation.

The image conveys a sense of hard work and dedication, as the men are focused on their tasks and appear to be working together as a team. The presence of the brick building in the background adds a sense of permanence and structure to the scene, highlighting the importance of agriculture and manual labor in the community. Overall, the image provides a glimpse into the daily lives of African American workers during this time period, showcasing their resilience and determination in the face of challenging circumstances.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a group of men working in a field, with a large building visible in the background. The men are dressed in casual attire, including hats and long-sleeved shirts, and are engaged in various activities such as digging and raking the soil. The field appears to be a farm or agricultural area, with rows of crops or plants visible in the foreground.

In the background, a large brick building stands out, featuring a prominent tower or clock tower. The building's architecture suggests that it may be an institutional or administrative structure, possibly related to the agricultural activities taking place in the field.

Overall, the image presents a scene of rural labor and agriculture, with a focus on the hard work and dedication of the men involved in cultivating the land. The presence of the large building in the background adds a sense of context and purpose to the scene, highlighting the importance of agriculture in the community.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The black-and-white image depicts a group of men working in a field. They are engaged in agricultural activities, possibly planting or harvesting crops. The men are wearing hats and gloves, and they are holding tools such as rakes and hoes. The field is surrounded by a grassy area with a building in the background. The building has a tower and is situated on a hill, with a few other structures visible in the distance. The image conveys a sense of hard work and dedication to farming.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white photo shows a group of people working on a farm. They are wearing hats and gloves, and some of them are holding hoes. The farm has a dirt road in the middle and is surrounded by grass and plants. On the left side, there is a building with many windows. In the distance, there are two poles and a structure that looks like a small house.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

The image shows a black and white photograph of a group of men working in a field, presumably planting or tending to crops. The men are dressed in simple work clothes, including long-sleeved shirts, pants, and hats. They are using hoes to cultivate the soil between rows of young plants.

In the background, a large brick building with multiple stories and a small tower can be seen. The building appears to be a prison or institution, as the setting and the nature of the work (labor) suggest. A small structure with a rounded roof is visible on a hill further back. The overall impression is one of manual labor and perhaps a sense of confinement or forced work.

Created by gemini-2.0-flash on 2025-05-02

The black and white photograph shows a group of men working in a field. The men, most of whom appear to be African American, are spaced out across the field and are using hoes to till the soil or tend to crops. They are dressed in work clothes, including light-colored shirts and dark pants. Some are wearing hats.

In the background, there is a large brick building with a tower, which could be an institutional structure like a prison or a hospital. The building is set against a grassy hill. There is a cart parked near the building. Further back, a small gazebo-like structure sits atop the hill.

The sky is overcast, providing a soft, diffused light that makes the scene appear somber and perhaps a little desolate. The overall impression is one of hard labor and possibly of a historical setting, given the style of clothing and the nature of the agricultural work being done.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

The black-and-white photograph depicts a group of men working in a field, likely engaged in agricultural labor. The men are dressed in simple, work-appropriate clothing, including long-sleeved shirts, pants, and hats. They are using various farming tools, such as hoes and rakes, to tend to the soil. The field appears to be divided into rows, suggesting systematic planting or cultivation.

In the background, there are several buildings, including a prominent multi-story brick structure with a distinct architectural style. This building has a tower-like feature and several windows, indicating it may be an institutional or administrative building. There are also smaller structures and what appears to be a guard tower on a hill, suggesting the setting might be a prison farm or a similar institution where inmates are engaged in labor.

The scene is set in an open area with a clear sky, and the overall atmosphere suggests a time from the early to mid-20th century. The presence of the guard tower and the organized nature of the work hint at a controlled environment, possibly indicative of a penal or correctional facility.