Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

Date

May 1934-June 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4166

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City Reformatory, New Hampton, New York)

People

Artist: Ben Shahn, American 1898 - 1969

Date

May 1934-June 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4166

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Soil 100
Field 99.8
Person 99
Person 98.9
Person 98.8
Adult 98.8
Male 98.8
Man 98.8
Person 98.7
Agriculture 98.7
Countryside 98.7
Nature 98.7
Outdoors 98.7
Person 98.6
Person 98.5
Person 98.4
Person 98.3
Person 97.6
Person 96.6
Person 95
Garden 91.1
Gardener 91.1
Gardening 91.1
Person 79.1
Rural 79.1
Farm 74.4
Device 67.7
Sword 59.3
Weapon 59.3
Worker 57.8
Hoe 56.9
Tool 56.9
Plant 56.1
Planting 56.1

Clarifai
created on 2018-05-10

people 99.9
group together 99.7
group 99.3
adult 99
man 96.9
many 96.9
several 94.9
child 94.6
war 93.3
woman 93.3
wear 93
military 92.9
five 90.7
four 88.7
three 87.8
home 87.1
soldier 85.3
vehicle 85
street 84.5
administration 82.1

Imagga
created on 2023-10-05

travel 30.3
maze 30
sky 29.5
rampart 27.1
landscape 25.3
stone 22.4
tourism 22.3
rock 20
mountain 19.6
man 18.8
park 18.1
outdoor 17.6
old 16.7
fortress 16.6
summer 16.1
architecture 15.7
outdoors 15.7
vacation 15.6
people 15.1
hill 15
building 14.6
desert 14.4
male 14.2
history 13.4
person 13.4
sand 13.2
ancient 13
track 12.6
hiking 12.5
sun 12.1
wall 12
sunset 11.7
tool 11.4
tourist 11.3
monument 11.2
clouds 11
tree 10.9
active 10.8
boy 10.4
walking 10.4
house 10.3
tower 9.9
scenery 9.9
sport 9.9
hike 9.8
forest 9.6
high 9.5
adventure 9.5
cloud 9.5
natural 9.4
environment 9.1
landmark 9
engineer 9
trekking 8.8
climbing 8.8
canyon 8.7
grass 8.7
water 8.7
men 8.6
walk 8.6
culture 8.6
famous 8.4
field 8.4
silhouette 8.3
historic 8.3
countryside 8.2
castle 8.1
religion 8.1
trees 8
hiker 7.9
couple 7.8
backpack 7.8
beach 7.7
temple 7.3
national 7.3
lifestyle 7.2
knoll 7.2
family 7.1
to 7.1
day 7.1
rural 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 89.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-36
Gender Male, 72.8%
Calm 57.7%
Surprised 14.3%
Confused 9%
Fear 7.4%
Sad 6.5%
Disgusted 4.9%
Angry 3.7%
Happy 2.4%

AWS Rekognition

Age 26-36
Gender Male, 60.5%
Calm 67.2%
Happy 28.7%
Surprised 6.6%
Fear 6%
Sad 2.4%
Angry 0.8%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 19-27
Gender Male, 94.7%
Calm 91.4%
Surprised 7.7%
Fear 6.3%
Sad 2.4%
Disgusted 1.9%
Happy 1.1%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 25-35
Gender Male, 98.1%
Calm 62.9%
Happy 18.5%
Surprised 7.8%
Fear 7%
Sad 3.6%
Confused 3.4%
Angry 3.2%
Disgusted 2.8%

Feature analysis

Amazon

Person
Adult
Male
Man
Sword
Person 99%
Person 98.9%
Person 98.8%
Person 98.7%
Person 98.6%
Person 98.5%
Person 98.4%
Person 98.3%
Person 97.6%
Person 96.6%
Person 95%
Person 79.1%
Adult 98.8%
Male 98.8%
Man 98.8%
Sword 59.3%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-31

a photograph of a group of men standing in a field -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This image is a black-and-white negative photograph depicting a group of people working in a field, likely engaged in agriculture or manual labor with tools such as hoes or rakes. The figures are spaced apart and arranged in rows, focusing on the soil. In the background, there is a large building with architectural features suggesting it might be an institutional structure, such as a school, prison, or factory. The surrounding landscape includes open land with a few smaller buildings and poles visible on the horizon. The negative format inverses the tones, making the sky appear black and the soil and figures lighter in appearance.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image appears as a photographic negative, showing a group of men working in a field. They are using tools like hoes or rakes, and their attire suggests work clothes suitable for manual labor. In the background, there is a large building with distinctive architectural features — it looks like an institutional or industrial facility, possibly a prison or factory, based on its design. The land seems to be sectioned into rows, indicating agricultural activity. The sky is dark due to the negative effect. The overall setting suggests a farming or work scene on the grounds of this facility.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image depicts a group of men engaged in manual labor, specifically digging or shoveling in a field. The men are dressed in casual attire, including shirts, pants, and hats, and are using shovels to dig into the dirt. In the background, there is a large building with a clock tower, which appears to be a school or institution of some kind.

The image has a black-and-white filter applied to it, giving it a vintage or retro look. The overall atmosphere of the image suggests that the men are working hard to complete their task, possibly as part of a larger project or initiative. The presence of the building in the background implies that the men may be students or employees of the institution, and that their work is related to the upkeep or maintenance of the property.

Overall, the image conveys a sense of industriousness and teamwork, as the men work together to achieve their goal. The use of a black-and-white filter adds a touch of nostalgia to the image, suggesting that it may have been taken in the past.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

This image depicts a group of men engaged in agricultural labor, with a large building visible in the background. The men are dressed in casual attire, including hats and long-sleeved shirts, and are equipped with tools such as rakes and hoes. They appear to be working in a field, possibly cultivating crops or tending to the soil.

The building in the background is a large, imposing structure with multiple stories and a prominent clock tower. It may be a farmhouse, barn, or other type of agricultural facility. The overall atmosphere of the image suggests a sense of hard work and dedication, as the men labor in the field under the watchful eye of the building.

The image also features a watermark at the bottom, which reads "President and Fellows of Harvard College (Harvard University Art Museums)" and includes a copyright symbol. This suggests that the image is part of a collection or archive held by Harvard University, and may have been taken by a photographer or artist associated with the institution.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

A black-and-white photo depicts a group of people working in the field, probably during the night. They are holding a rake and seem to be planting something. They are wearing hats and shoes. They are standing on the ground, which is covered with dried leaves. Behind them is a building with several windows. In the distance, there are poles and another building. The image has a watermark on the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white image of a group of people standing on the ground, probably on a farm, and they are probably harvesting crops. They are all wearing hats, and some of them are wearing gloves. Some of them are holding sticks, probably for digging the soil. In the distance, there is a building with many windows and a tower in front of it. There is a watermark in the bottom left corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-31

Here's a description of the image:

The image appears to be an old, inverted black and white photograph. It depicts a group of men working in a field. They are dressed in what looks like work clothes – long pants, shirts, and caps. They are using tools, presumably for farming.

Behind the workers, a large building and a grassy hill are visible in the background. The building has multiple windows and a distinct architectural style, possibly a brick structure with a tower. The sky is dark, and the photograph is quite grainy, typical of older photography. The light is flat, suggesting the photograph was taken on a cloudy day. There's a sense of historical documentation to the image.

Created by gemini-2.0-flash on 2025-05-31

Here is a description of the image:

The image depicts a group of men working in a field. They appear to be in the process of farming or tilling the land, as each of them is holding a long-handled tool, possibly a hoe or rake. The men are dressed in casual work clothes, and some are wearing caps. They are spread out across the field, each focused on their task.

In the background, there is a large building with a tower. The building looks like it could be a school or institution of some kind. The building is situated on a hill, with a grassy area in front of it. There are a few figures visible on the hill, near the building. The sky is dark, and the overall tone of the image is subdued. The image appears to be a black-and-white photograph, and it is possible that it is an older photograph due to the style of clothing and the overall aesthetic.

At the bottom of the image, there is a copyright notice indicating that the image is from the President and Fellows of Harvard College (Harvard University Art Museums). There is also a catalog number.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The black-and-white photograph depicts a group of young men working in a field, likely engaged in agricultural activities. They appear to be using tools such as rakes and hoes to tend to the soil, which is covered with leaves or debris. The men are dressed in casual work attire, including jackets, shirts, and trousers, appropriate for manual labor.

In the background, there is a large building that looks like a significant structure, possibly a school, university, or institutional building, given its architectural style and size. The setting seems to be a rural or semi-rural area with open fields and a few other buildings visible in the distance.

The photograph is credited to the President and Fellows of Harvard College (Harvard University Art Museums), suggesting that it may have historical or educational significance, possibly related to Harvard University or its affiliates. The image has a historical feel, likely taken in the early to mid-20th century, as indicated by the clothing styles and the quality of the photograph.

Text analysis

Amazon

and
College
Art
University
Fellows
(Harvard
of
President and Fellows of Harvard College (Harvard University Art Museums)
Harvard
Museums)
President
P1970.4166.0000

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4166.0000
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4166.0000