Human Generated Data

Title

Man gathering good coal from the slag heaps at Nanty Glo, Pennsylvania

Date

1937

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3110

Human Generated Data

Title

Man gathering good coal from the slag heaps at Nanty Glo, Pennsylvania

People

Artist: Ben Shahn, American 1898 - 1969

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3110

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.6
Human 99.6
Slope 97.2
Soil 94.1
Outdoors 92.3
Rubble 90.1
Gravel 83.1
Dirt Road 83.1
Road 83.1
Coal 82.5
Nature 75.6
Mining 62.6
Worker 59.9
Slate 57.5

Clarifai
created on 2023-10-15

people 99.8
monochrome 98.7
man 98.4
adult 98.3
one 98.1
landscape 97.4
rock 97.3
mountain 97.1
desert 95.4
exert 92.7
beach 92.3
portrait 90.9
two 88.4
hill 88.3
military 87.1
wear 86.8
stone 85.9
volcano 85.2
sky 85.1
travel 84.9

Imagga
created on 2021-12-15

thatch 51.4
grave 40.4
roof 39.2
travel 36.7
mountain 32.7
stone 31.3
protective covering 30.7
sky 30
rock 29.6
desert 29
landscape 27.6
ancient 26
sand 24.8
history 24.2
tourism 23.2
cliff 22.5
rocks 21.7
covering 20.3
clouds 19.5
outdoors 18.7
tourist 18.7
architecture 18.1
hill 17.8
monument 17.8
pyramid 16.8
ascent 16.8
scenic 16.7
landmark 16.3
old 16.1
mountains 15.8
slope 15.5
summer 14.8
peak 14.5
pharaoh 13.9
wall 13.7
construction 13.7
sun 13.7
park 13.2
destination 13.1
vacation 13.1
culture 12.8
archeology 12.8
geology 12.7
great 12.5
stones 12.3
canyon 12
national 11.8
scenery 11.7
environment 11.5
outdoor 11.5
east 11.2
famous 11.2
civilization 10.8
sandstone 10.8
temple 10.7
hiking 10.6
wilderness 10.5
adventure 10.5
geological formation 10.4
rampart 10.4
heat 10.2
holiday 10.1
building 9.8
wonder 9.8
hike 9.8
ruins 9.8
scene 9.5
historical 9.4
dry 9.3
land 9.3
tomb 8.9
climb 8.8
climbing 8.8
natural 8.7
day 8.6
extreme 8.6
brick 8.4
historic 8.3
river 8
tower 8
trekking 7.9
ruin 7.8
plant 7.5
snow 7.3
sea 7.1

Google
created on 2021-12-15

Wood 84
Adaptation 79.3
Bedrock 78.6
Landscape 76.6
Sky 76.5
Slope 75.4
Climbing 74.1
Monochrome 70.8
Monochrome photography 70.3
Art 69.2
Rectangle 66.9
Rock 66.5
Sport climbing 64.1
Stock photography 63.7
Recreation 63.5
Soil 62.5
Outcrop 61.6
History 61.6
Visual arts 59.4
Fault 58.5

Microsoft
created on 2021-12-15

mountain 98.8
outdoor 98.1
text 95.1
hiking 91.6
person 88.8
sky 80.5
man 79.1
clothing 73.3
black and white 50.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 51-69
Gender Male, 94.1%
Calm 84%
Happy 12.3%
Sad 3.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.6%

Categories

Imagga

paintings art 99.9%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-17

a photograph of a man in a hat and overalls is holding a bucket -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image depicts a worker climbing or working on a steep, rocky incline, likely related to mining or quarrying. He is dressed in overalls and a cap, and holds a bucket in one hand while using the other hand to handle or sift through materials on the slope. In the background, there is a wooden industrial structure that might be part of a mining or processing facility, with distant hills or mountains in the landscape. The scene conveys manual labor in a rugged environment.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts a worker climbing up a steep, rocky slope. The worker is wearing rugged clothes and appears to be engaged in manual labor, using both hands to collect material from the hillside. A bucket is positioned under one of his knees, suggesting that he is gathering the material into it. In the background, a building structure is partially visible on the left, indicating an industrial setting, possibly related to mining or quarrying. The slope is covered in loose rocks and debris. The scene has a gritty, historical feel, capturing the essence of hard physical labor in an outdoor, challenging environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows a person, likely a man, climbing up a steep, rocky hillside. He is wearing work clothes, including a shirt and pants, and appears to be exerting effort as he makes his way up the incline. The background shows a mountainous landscape with a building or structure visible in the distance. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white historical photograph showing a coal miner at work on a steep slope of what appears to be a coal slag heap or mine tailings. The worker is wearing typical mining attire of the era - overalls, work clothes, and a flat cap. He's carrying what looks like a bucket or pail and appears to be collecting or sorting through the rocky debris on the incline. In the background, you can see what appears to be part of a mining structure or building. The image likely dates from the early to mid-20th century and provides a glimpse into the difficult and dangerous working conditions faced by coal miners of that period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a man working in a coal mine. The man is dressed in overalls and a cap, and he is leaning forward, using a pickaxe to break up rocks on a steep hillside. He is holding a bucket in his left hand, likely to collect the coal or other minerals he extracts from the ground.

In the background, there is a large wooden structure that appears to be a mine shaft or elevator. The sky above is overcast, suggesting that the photo was taken on a cloudy day. The overall atmosphere of the image conveys a sense of hard work and labor, as the man is engaged in physically demanding tasks to extract resources from the earth.

The image provides a glimpse into the life of a coal miner during a bygone era, highlighting the challenges and dangers associated with this type of work. It also serves as a reminder of the importance of the coal mining industry in providing energy and resources for society.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a man engaged in manual labor on a rocky hillside. The man is attired in a long-sleeved shirt, overalls, and a cap, and is seen climbing up the hill while carrying a bucket in his left hand. His right arm is outstretched, suggesting that he may be using it for balance or to pull himself up.

In the background, a wooden structure resembling a mine shaft or a building associated with mining activities can be observed. The presence of this structure implies that the man's labor is likely related to mining or excavation work.

The overall atmosphere of the image conveys a sense of hard work and physical exertion, as the man navigates the challenging terrain with determination. The monochromatic tone of the photograph adds a sense of nostalgia and timelessness to the scene, evoking a sense of history and tradition in the context of manual labor.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black and white photograph of a man who appears to be a miner. He is wearing a hat, a long-sleeve shirt, and pants. He is holding a bucket in one hand and is climbing up a steep slope, possibly a mine. The man is looking down, and his body is slightly bent forward, as if he is looking for something. The slope is covered with rocks and debris. In the background, there is a building that looks like a mine tower.

Created by amazon.nova-pro-v1:0 on 2025-05-31

The black and white image depicts a man climbing up a steep, rocky slope. He is wearing a hat, a shirt, pants, and shoes. He is holding a bucket in his left hand and a piece of paper in his right hand. He seems to be collecting something from the rocks. Behind him, there is a structure that looks like a wooden house.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

The black-and-white photograph shows a man working on a steep, rocky hill. He is wearing a long-sleeved shirt, overalls with suspenders, a cap, and boots. A metal bucket hangs from his waist. He is crouched slightly and is using a tool, possibly a small pick or chisel, to work on the rocks.

To the left of the frame, there is a tall, wooden structure that appears to be part of a mining operation, with windows and a vertical support system. Beyond the rocky hill and structure, a landscape of rolling hills can be seen in the distance. The sky is overcast. The photograph's composition emphasizes the arduous nature of the work being done and the harshness of the environment.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

The image is a black and white photograph depicting a man working on the side of a large, rocky slope. The scene has a stark, somewhat bleak quality. It appears to be an historical image, likely from the early 20th century.

Details:

  • The Man: A man, dressed in work clothes (likely overalls and a shirt), with a flat cap, is leaning into the slope. He is holding some sort of tool in his hands, possibly a pick or shovel, and seems to be working on the rocks. A metal bucket hangs from his waist.
  • The Slope: The slope dominates the image, with a steep incline covered in rocks and debris.
  • Structure: In the upper left of the image, we see a wooden structure, which looks like a mining structure, possibly a headframe or a building associated with a mine. It has a few windows.
  • Background: In the distance is a mountain range, possibly an indication of location and terrain. The sky appears overcast and dull.
  • Composition: The angle of the photograph emphasizes the steepness of the terrain and the physical labor required. The composition is relatively simple, focusing on the man and the slope.

Overall, the image depicts a scene of hard manual labor, possibly within a mining environment.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a man working in what appears to be a mining or excavation site. He is climbing a steep slope composed of rocky, uneven terrain. The man is dressed in work clothes, including a cap, and is carrying a bucket in one hand. He is using his other hand to help steady himself as he ascends the slope. In the background, there is a structure that resembles a mining building or a shed, suggesting that this is an industrial or mining environment. The overall scene conveys the physical labor and challenging conditions associated with mining or similar manual work.