Human Generated Data

Title

Untitled (Greenbelt, Maryland)

Date

November 1936

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1838

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Greenbelt, Maryland)

People

Artist: Ben Shahn, American 1898 - 1969

Date

November 1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1838

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Outdoors 99.9
Nature 99.8
Countryside 99.4
Rural 98.1
Farm 95.2
Farm Plow 95.2
Soil 93.4
Armored 77.6
Military 77.6
Transportation 77.6
Vehicle 77.6
Weapon 77.6
Machine 57
Construction 56.4

Clarifai
created on 2018-05-11

vehicle 99.2
machine 99
machinery 99
bulldozer 98
tractor 97.7
transportation system 97.7
industry 97.3
bucket 97.2
power shovel 96.9
scoop 96.6
shovel 96.2
exert 95.6
equipment 95.3
people 93.1
truck 92.9
heavy 92.8
mine 91.7
no person 89.4
loader 89
broken 87.6

Imagga
created on 2023-10-06

power shovel 100
machine 100
steam shovel 91.9
device 66.9
industry 45.3
industrial 40
construction 38.5
equipment 30.3
backhoe 27.9
heavy 27.7
sky 26.8
power 26
machinery 25.6
work 25.1
factory 22.1
dredge 21.7
vehicle 21.3
building 20.6
steel 20.3
crane 19.1
transport 18.3
transportation 17.9
site 17.8
earth 17.4
dirt 17.2
ship 16.9
excavator 16.8
port 16.4
metal 16.1
energy 16
digging 15.8
structure 15.2
business 14.6
bulldozer 14.3
environment 14
tractor 13.7
fuel 13.5
old 13.2
truck 13.1
plant 13
tool 12.9
loader 12.8
hydraulic 12.8
mining 12.8
sea 12.5
engineering 12.4
iron 12.1
water 12
loading 11.8
scoop 11.8
dirty 11.8
architecture 11.7
vessel 11.7
dock 11.7
harbor 11.6
mover 10.9
shovel 10.8
bucket 10.7
cargo 10.7
yellow 10.6
urban 10.5
sand 10.5
development 10.5
outdoors 10.5
ground 10.4
technology 10.4
wheel 10.4
outdoor 9.9
pump 9.8
lift 9.8
pipe 9.7
gas 9.6
boat 9.3
oil 9.3
wreck 9.3
wood 9.2
road 9
pile driver 9
excavation 9
digger 8.9
pipeline 8.9
diesel 8.8
load 8.8
destruction 8.8
shipping 8.7
pollution 8.7
concrete 8.6
trade 8.6
outside 8.6
build 8.5
city 8.3
silhouette 8.3
landscape 8.2
activity 8.1
working 8
dig 7.9
rock 7.8
tire 7.8
track 7.7
house 7.5
ocean 7.5
container 7.5
land 7.4
plow 7.1
wooden 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.9
old 80.4

Color Analysis

Feature analysis

Amazon

Person
Tank

Clarifai

Land vehicle
Window
Person
Wheel
Tree
Plant
Footwear

AWS Rekognition

Person 97%

AWS Rekognition

Person 87.6%

AWS Rekognition

Person 78.8%

AWS Rekognition

Person 77.9%

AWS Rekognition

Tank 77.6%

Clarifai

Land vehicle 77.2%

Clarifai

Land vehicle 33.2%

Clarifai

Window 55.9%

Clarifai

Window 52.8%

Clarifai

Window 47.5%

Clarifai

Window 45.1%

Clarifai

Window 44.4%

Clarifai

Window 38.6%

Clarifai

Window 38.2%

Clarifai

Window 37.3%

Clarifai

Window 34.7%

Clarifai

Person 54.8%

Clarifai

Wheel 46.6%

Clarifai

Wheel 46.4%

Clarifai

Wheel 38.9%

Clarifai

Tree 36.6%

Clarifai

Plant 35.5%

Clarifai

Plant 33.7%

Clarifai

Plant 33.2%

Clarifai

Footwear 34.5%

Categories

Imagga
created on 2023-10-06

cars vehicles 87.6%
beaches seaside 9%
nature landscape 1.5%
streetview architecture 1.1%

Captions

Microsoft
created by unknown on 2018-05-11

a vintage photo of a boat 52.4%
a vintage photo of a truck 52.3%
a vintage photo of a bridge 40.6%

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a black and white photo of a craned crane

Created by general-english-image-caption-blip-2 on 2025-07-05

a black and white photo of a construction machine

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This black-and-white image depicts a vintage tracked excavator at a work site, likely from the early-to-mid 20th century. The excavator has a mechanical arm and scoop mechanism, and a visible operator is seated inside the cab, controlling the machinery. Its design is rudimentary compared to modern construction equipment, with exposed gears, pulleys, and a metal frame. The surrounding environment suggests it is part of a construction or excavation project, possibly in a residential area given the row of houses in the background. The ground shows soil being dug or moved as part of the operation, and wooden scaffolding or similar structures can be seen near the houses.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a construction scene with an excavator in action. The excavator is an older model with a tracked base and a large, extended arm equipped with a digging bucket. It appears to be digging a trench or earth in a construction site. There is a person, likely the operator, visible inside the cabin of the excavator, manipulating the controls to operate the machine. In the background, there are several two-story buildings, possibly residential houses, which appear to be part of a newly developing area. There is also another person visible near the buildings, walking across the construction site. The image is black and white, reflecting an earlier era of construction machinery and techniques.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a large piece of construction equipment, likely a bulldozer or excavator, in the middle of a construction site. The machine appears to be partially disassembled, with various parts and components visible. In the background, there are several buildings or structures that suggest this is an urban or industrial setting. The overall scene conveys a sense of ongoing construction or demolition work taking place.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white historical photograph showing a tracked construction vehicle, likely a bulldozer or early excavator, being used at what appears to be a construction or development site. The machine has a prominent boom or arm extending from it, and there appears to be an operator standing in the cab area. In the background, there are some residential buildings or structures visible. The image appears to be from an earlier era, possibly mid-20th century, based on the style of the equipment and the photographic quality. The ground appears to be dirt or disturbed earth, suggesting this may be part of a construction or land-clearing project.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a large, old-fashioned piece of construction equipment, possibly a steam shovel or dragline, situated in a muddy area. The machine features a large, open cab with a man standing inside, wearing overalls and a hard hat. The machine's arm is extended, and a pulley system is visible.

In the background, several buildings are visible, including what appears to be a row of houses or apartments. The sky above is clear and bright, suggesting a sunny day. The overall atmosphere of the image suggests that it was taken during the construction of a new development or infrastructure project, possibly in the mid-20th century.

The image provides a glimpse into the past, showcasing the machinery and technology used in construction work during that era. It also highlights the importance of manual labor and the role of workers in building our communities.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black-and-white photograph of a man operating a large piece of machinery, likely a trencher or excavator, in a construction site. The machine has a long arm with a bucket on the end, which is digging into the ground. The man is standing inside the machine's cab, wearing overalls and holding onto the controls. In the background, there are several buildings under construction, including what appears to be a row of houses or apartments. The overall atmosphere suggests a busy construction site during the day, with the man working diligently to complete his task.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The black-and-white image shows a person sitting inside a large piece of machinery that seems to be digging the ground. The machinery has a long arm that is digging into the ground, and the person is sitting inside a small cabin. The machinery is surrounded by dirt and mud, and in the distance, there are several buildings. The buildings have a few windows, and some people are standing outside them.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white image shows a person sitting inside a construction vehicle. The vehicle has a long arm with a bucket at the end, which is digging into the ground. The person inside the vehicle is wearing a jacket and pants. The vehicle is on a construction site, with a pile of dirt on the ground. Behind the vehicle, there are houses under construction. There are also people standing near the houses.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

Here is a description of the image:

The image shows a large digging machine in black and white. The machine has a person sitting inside the cab, which is on the left side of the frame. The machine is equipped with large treads similar to those on a tank. A long, metal arm extends from the machine out towards the right side of the image, angled downward into the ground. The machine appears to be digging a trench, as the ground around it is uneven and disturbed.

In the background, there is a building that looks like an apartment complex. Several people can be seen standing around the construction site. Overhead electrical lines are visible in the upper portion of the frame.

Created by gemini-2.0-flash-lite on 2025-06-05

Here is a description of the image:

The image is a black and white photograph featuring a vintage trenching machine, possibly from the early to mid-20th century. The machine, with its tracks, is digging a trench in a dirt or muddy area. An operator is visible inside the machine's cab, sitting at the controls. The machine has a large, articulated boom and digging mechanism extending out from the front. In the background are buildings and construction, which suggest it is a construction site or the initial stages of development. The photo appears to capture an active construction project.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a historical scene of a construction site, featuring a large piece of heavy machinery, likely a power shovel or excavator, actively digging into the ground. The machine is mounted on caterpillar tracks and has a large bucket or scoop attached to a mechanical arm, which is positioned in a trench. The operator, dressed in work clothes, is standing inside the open cab of the machine, controlling the digging operation.

In the background, there are several buildings that appear to be residential structures, possibly under construction or recently completed. The area surrounding the machine and buildings is an open field with some construction materials and equipment visible, suggesting that this is part of a larger construction project. The photograph is in black and white, indicating that it was taken some time ago, likely in the mid-20th century. The overall scene captures a moment in the development of a residential area, highlighting the manual and mechanical labor involved in such projects.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image depicts a vintage construction scene. In the foreground, there is a large piece of heavy machinery, specifically a tracked vehicle, partially submerged in muddy ground. The vehicle appears to have a mobile crane or hoisting mechanism mounted on its back, and it is in the process of lifting or moving a large, complex structure. The structure is composed of metal beams and appears to be part of a larger assembly, possibly a bridge or a similar construction project.

The background shows a construction site with several workers and equipment. There are buildings that look like barracks or dormitory-style structures, suggesting that this is a military or industrial camp. The ground is uneven and covered with dirt and mud, consistent with a construction site. The overall setting appears to be a historical construction project, given the style of the machinery and the black-and-white nature of the photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This is a black-and-white historical photograph showing a construction scene. The main subject is a large, vintage earth-moving machine, likely a trench digger, with a complex structure of metal beams, pulleys, and tracks. The machine is actively digging a trench in the ground. A person is seated in the operator's compartment, controlling the machinery. In the background, there are brick buildings, possibly residential or industrial, and a few people are visible, indicating that this is an active work area. The image captures a moment of industrial activity, likely from the early to mid-20th century, given the style of the machinery and the clothing of the individuals.