Human Generated Data

Title

Untitled (Pennsylvania?)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4281.3

Human Generated Data

Title

Untitled (Pennsylvania?)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4281.3

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Machine 92.2
Spoke 88.7
Road 82.9
Soil 78.9
Gravel 78.8
Head 74.4
Face 68.8
Outdoors 65.9
Clothing 57.8
Coat 57.8
Tarmac 56.4
Worker 56.3
Bicycle 56.3
Transportation 56.3
Vehicle 56.3
Slate 56.1
Hardhat 55.9
Helmet 55.9
Mining 55.7
Archaeology 55.6
Rubble 55.3

Clarifai
created on 2018-05-10

people 99.8
adult 96.7
man 95.1
group together 94.7
woman 93.6
group 93.4
wear 90.7
monochrome 88.6
street 86
child 84.3
one 83.3
vehicle 80.4
military 77.4
two 77.2
recreation 76.1
transportation system 73.8
dark 73.6
many 72.1
outfit 71.1
light 71

Imagga
created on 2023-10-05

man 26.2
rustic 21.4
person 20.1
people 19.5
water 18.7
groom 15.8
sunset 15.3
male 14.2
sky 14
rock 13.9
landscape 13.4
silhouette 13.2
stone 12.9
travel 12.7
love 12.6
beach 11.8
adult 11.8
sand 11.4
couple 11.3
sun 11.3
park 10.7
outdoors 10.6
dark 10
ocean 10
engineer 9.9
outdoor 9.9
attractive 9.8
black 9.6
sitting 9.4
light 9.4
danger 9.1
cemetery 9
bride 8.8
two 8.5
tree 8.5
wedding 8.3
protection 8.2
dirty 8.1
river 8
sea 7.8
destruction 7.8
protective 7.8
structure 7.8
men 7.7
old 7.7
walking 7.6
happy 7.5
industrial 7.3
religion 7.2
romance 7.1
romantic 7.1
portrait 7.1
summer 7.1
happiness 7.1
mask 7
model 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

old 46.3

Color Analysis

Feature analysis

Amazon

Adult
Male
Man
Person
Wheel

Clarifai

Clothing
Man
Human head
Human face
Wheel
Poster
Tree

AWS Rekognition

Adult 99.1%

AWS Rekognition

Adult 99.1%

AWS Rekognition

Male 99.1%

AWS Rekognition

Male 99.1%

AWS Rekognition

Man 99.1%

AWS Rekognition

Man 99.1%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 93.1%

AWS Rekognition

Wheel 92.2%

Clarifai

Clothing 94.4%

Clarifai

Clothing 63.6%

Clarifai

Clothing 45.9%

Clarifai

Man 81%

Clarifai

Human head 42%

Clarifai

Human head 41.9%

Clarifai

Human face 41.2%

Clarifai

Human face 36.3%

Clarifai

Wheel 38.3%

Clarifai

Poster 37.8%

Clarifai

Tree 33.3%

Categories

Imagga
created on 2023-10-05

interior objects 64.5%
paintings art 20.4%
streetview architecture 7.7%
food drinks 2.1%
text visuals 1.9%
nature landscape 1.3%

Captions

Microsoft
created by unknown on 2018-05-10

an old photo of a person 82.5%
a black and white photo of a person 73.8%
old photo of a person 73.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a group of people standing around a pile of gravel

Created by general-english-image-caption-blip-2 on 2025-07-06

a black and white photo of men working on a pile of gravel

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This image is a photographic negative depicting a construction or industrial scene. In the foreground, there is a large pile of gravel or stones. Several workers are positioned throughout the scene, some standing and some operating machinery. The details of their clothing suggest manual labor attire, with hats and work shirts being prominent. On the left side of the image, there is machinery resembling a cement mixer or similar equipment, with visible gears and parts. A shovel stands upright on the right side. The background features vegetation and what appears to be an open rural or outdoor setting. The inversion of light and dark tones, typical of photographic negatives, creates an eerie and surreal visual effect.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image appears to be a photographic negative. It depicts a scene with four men standing around a pile of stones or gravel. One man, dressed in a white shirt and pants, is looking at the pile with his hand on his hip. Another man is wearing a hat and is holding a tool, possibly a shovel. A third man is slightly obscured, standing next to a large piece of machinery with gears, which could be some sort of industrial equipment. The fourth man, also appearing to wear work attire, stands near the machinery. The background shows some vegetation, and the setting seems to be an outdoor worksite, possibly related to construction or roadwork.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph depicting a nighttime scene in a rural or industrial setting. In the foreground, there is a large pile of what looks like rubble or debris. In the background, several figures can be seen, including one person wearing a long white garment and another person wearing a hat. The overall atmosphere of the image is dark and ominous, with a sense of mystery or uncertainty surrounding the scene.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph showing what appears to be a construction or excavation site. Several workers are visible standing on or near what looks like a pile of gravel or aggregate material. There's some machinery or equipment visible in the background, possibly including what looks like a wheel or mechanical component. The workers are dressed in work clothes typical of an earlier era, with one figure wearing what appears to be a hat. The image has a somewhat grainy or textured quality typical of older photography. According to the credit line, this image is from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of a group of men working in a field, with a large piece of machinery in the background.

Foreground:

  • A man stands in the center of the image, facing away from the camera.
  • He is wearing a long-sleeved shirt and pants, and has a hat on his head.
  • To his right, another man is standing, holding a shovel in his hand.
  • He is also wearing a long-sleeved shirt and pants, and has a hat on his head.

Background:

  • In the background, there is a large piece of machinery, possibly a tractor or a plow.
  • The machinery is covered in a tarp or canvas, and has a wheel on the side.
  • There are several other men standing around the machinery, but they are not clearly visible due to the low resolution of the image.

Ground:

  • The ground in the image is covered in dirt and rocks.
  • There are some weeds and bushes scattered throughout the area.

Overall:

  • The image appears to be a historical photograph, possibly from the early 20th century.
  • The men in the image are dressed in clothing that was common during that time period.
  • The machinery in the background suggests that the image may have been taken on a farm or in a rural area.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of three men working in a yard, with one man standing on a pile of gravel. The man on the right is wearing a hat and holding a shovel, while the man in the middle is dressed in a collared shirt and pants. The man on the left is partially obscured by the image's poor quality.

In the background, there appears to be a large piece of machinery or equipment, although its exact nature is unclear due to the image's poor quality. The overall atmosphere of the image suggests that the men are engaged in some kind of outdoor labor or construction work.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph depicting a scene of people working outdoors. In the foreground, there is a large pile of stones or rocks, suggesting a construction or landscaping project. Several individuals are engaged in various activities around this pile. One person, wearing a hat and holding a shovel, is seen actively working on the pile of stones. Another person, standing nearby, is dressed in a white shirt and appears to be observing the work.

In the background, there is a wheeled vehicle, possibly a wheelbarrow or a cart, which is being pushed by a man wearing a hat and a shirt. The scene is set in a rural or outdoor environment, with a sense of activity and teamwork among the workers. The image captures a moment of labor and collaboration in a natural setting.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a construction site. There are three people in the image. One person is wearing a hat and holding a shovel, another is standing next to a machine, and the third is wearing a hat and standing near the machine. The machine appears to be a piece of heavy equipment used for digging or moving earth. There is a pile of gravel or dirt in the foreground, and the background is dark.

Google Gemini

Created by gemini-2.0-flash on 2025-05-27

Certainly! Here's a description of the image:

Overall Impression:

The image appears to be a photograph of a scene with construction workers, a machine (possibly a concrete mixer or related equipment), and a large pile of gravel or similar material. The image has a high contrast and somewhat grainy quality, which could indicate that it's a photograph from an older era or a manipulated image.

Details:

  • Workers: Three figures are visible. Two appear to be wearing hats (one hardhat and one fedora). They seem to be standing near the construction equipment.

  • Equipment: There's a piece of machinery to the left of the frame.

  • Gravel Pile: A prominent feature is a large pile of gravel that takes up much of the foreground.

  • Shovel: A shovel is visible sticking out of the ground.

Interpretation:

The scene likely depicts a construction site or a project involving the use of gravel or similar materials. The men could be workers involved in the mixing or laying of concrete or some other building task. The equipment is possibly being used to prepare or transport materials.

Created by gemini-2.0-flash-lite on 2025-05-27

Here's a description of the image:

Overall Impression:

The image is a black and white negative photograph, giving it a stark and somewhat surreal appearance. The scene appears to depict construction or roadwork, possibly in the early to mid-20th century.

Key Elements:

  • Workers: There are at least three men present. One is standing near a large pile of gravel, another is standing in the middle distance, possibly surveying or supervising the work, and a third is in the foreground, resting on his shovel.
  • Equipment: A large piece of machinery dominates the left side of the frame. It appears to be a mixer or similar device used in construction.
  • Gravel Pile: A massive pile of gravel occupies the lower portion of the image, forming the foreground.
  • Setting: The setting appears to be outdoors, with some indication of foliage or vegetation in the background. The lighting is dramatic, emphasizing the silhouettes and highlights.

Additional Observations:

  • The negative format inverts the colors, so dark areas are light and vice versa.
  • The image has a documentary feel, capturing a moment in time with a focus on work and the people involved.

In short, the image is a moody, negative photograph of construction workers and their machinery, set in an outdoor environment, possibly taken in the early to mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a historical scene of agricultural work, likely from the early to mid-20th century. It shows three men engaged in farming activities. The men are dressed in typical work attire of the period, including hats and long-sleeved shirts. One man is standing on a piece of farm equipment, possibly a tractor or a plow, while the other two are standing on the ground nearby. The equipment has large wheels and appears to be used for tilling or planting. The field in the foreground is freshly tilled, with the soil appearing dark and rich. The background is somewhat blurry, suggesting an open field or rural landscape. The overall tone of the image is sepia or black and white, giving it a vintage feel. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image is a black-and-white photograph depicting three individuals working in an industrial setting, likely a construction or mining site. The central figure, wearing a hard hat and protective gear, appears to be operating or inspecting a piece of machinery, which looks like a large grinding or crushing machine. The machine has a circular component, possibly a wheel or part of the grinding mechanism, and a conveyor belt. Two other individuals stand nearby; one is holding a shovel, suggesting they may be involved in manual labor or cleaning up. The foreground shows a pile of what appears to be processed material, possibly gravel or crushed stones. The scene is set against a dark background, which could indicate that the photograph was taken at night or in a dimly lit area. The overall atmosphere conveys a sense of manual labor and industrial activity.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This is a black-and-white photograph depicting a nighttime scene of three men working outdoors. The image is grainy and has a vintage quality, suggesting it was taken in the early to mid-20th century. The men are illuminated by a strong light source, possibly a searchlight, which creates a stark contrast between the brightly lit figures and the dark background.

The man on the left is partially obscured by a piece of machinery, which appears to be some type of industrial equipment, possibly a stone crusher or a conveyor belt system. The middle man is standing and appears to be operating the machinery, while the man on the right is holding a shovel, seemingly engaged in manual labor, possibly shoveling gravel or stones.

In the foreground, there is a large pile of what looks like gravel or small rocks. The overall scene suggests a construction or mining site, with the workers involved in heavy labor under harsh lighting conditions. The photograph captures a moment of industrial activity, emphasizing the physical effort and the stark environment of the workers' task.

Text analysis

Amazon

Art
and
University
of
(Harvard
College
Fellows
President and Fellows of Harvard College (Harvard University Art Museums)
Museums)
Harvard
President
P1970.4281.0003

Google

@ President and Fellows of Harvard College (Harvard University Art Museums) P1970.4281.0003
@
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4281.0003