Human Generated Data

Title

Untitled (Freeze Fork, Scotts Run, West Virginia)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1242

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Freeze Fork, Scotts Run, West Virginia)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.1242

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Face 100
Head 100
Photography 100
Portrait 100
Baseball Cap 100
Cap 100
Clothing 100
Road 96.2
Accessories 82
Sunglasses 82
Coat 57.6
Shirt 57.3
People 56.5
Tarmac 55.3
Sun Hat 55.2
City 55
Street 55
Urban 55

Clarifai
created on 2018-05-11

people 99.7
one 98.7
man 97.8
adult 97.7
portrait 96
wear 96
uniform 93.3
military 92.2
lid 89.8
veil 87.8
soldier 83.3
cap 82.7
leader 79.3
war 77.9
outfit 77.7
mustache 76.5
athlete 76.1
police 74.7
facial hair 73.8
vehicle 72.4

Imagga
created on 2023-10-06

military uniform 91.6
uniform 89.4
clothing 60
man 42.3
helmet 40.4
consumer goods 37.7
male 34.2
covering 33.6
person 33.4
snow 32.7
hat 32
winter 28.9
people 28.4
portrait 25.2
adult 24.6
cold 24.1
job 23
sport 22.4
worker 22.2
goggles 21.6
outdoor 21.4
occupation 21.1
fun 20.2
mountain 19.8
professional 19.4
mountains 18.5
safety 18.4
commodity 17.2
ski 17.2
happy 16.9
active 16.2
handsome 16
smile 15.7
men 15.5
outdoors 14.9
sky 14.7
lifestyle 14.5
one 14.2
vacation 13.9
armor plate 13.8
construction 13.7
extreme 13.4
black 13.2
equipment 13.1
industry 12.8
contractor 12.6
ice 12.5
engineer 12.2
travel 12
industrial 11.8
builder 11.6
collar 11.5
serious 11.4
sun 11.3
mature 11.2
sports 11.1
work 11
season 10.9
smiling 10.9
skier 10.8
activity 10.7
recreation 9.9
skiing 9.9
officer 9.8
foreman 9.8
jacket 9.8
cool 9.8
labor 9.7
child 9.4
face 9.2
protection 9.1
boy 8.9
landscape 8.9
hardhat 8.8
looking 8.8
guy 8.8
backpack 8.8
freeze 8.7
standing 8.7
profession 8.6
hard 8.6
outside 8.6
build 8.5
youth 8.5
slope 8.5
joy 8.4
action 8.3
leisure 8.3
security 8.3
suit 8.1
plate 7.9
police 7.9
day 7.8
high 7.8
repair 7.7
business 7.3
holiday 7.2

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.6
person 99.5
man 98.1
wearing 77.6

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 99.6%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.2%
Confused 0%
Happy 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Hat

Clarifai

Clothing
Human face
Hat
Human nose
Human arm
Human mouth

AWS Rekognition

Person 99.7%

AWS Rekognition

Adult 99.7%

AWS Rekognition

Male 99.7%

AWS Rekognition

Man 99.7%

AWS Rekognition

Hat 58.2%

Clarifai

Clothing 97%

Clarifai

Human face 92.1%

Clarifai

Hat 61.7%

Clarifai

Human nose 48.1%

Clarifai

Human arm 38.2%

Clarifai

Human mouth 33.4%

Categories

Imagga
created on 2023-10-06

paintings art 90.5%
streetview architecture 5.2%
interior objects 1.5%

Captions

Microsoft
created by unknown on 2018-05-11

a man wearing a hat 91.5%
a man wearing a hat and glasses 87.8%
a man wearing a baseball hat 80.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-05

a man wearing a coal miner's hat and holding a flashlight

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man in a hat with a hat on

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image shows a person wearing a dark jacket and a miner's helmet equipped with a mounted lamp, designed for illumination in underground or dark environments. The background includes a road and rocky terrain, suggesting an outdoor location near a mining site or excavation area.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image depicts a person standing on a road. The person is wearing a helmet with a lamp attached to it, typical of mining or construction work. The individual is dressed in what appears to be work overalls. The background shows a rocky or earthen embankment, and the road extends into the distance. The setting suggests an outdoor work environment, possibly near a mining or construction site.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a close-up portrait of a man wearing a hard hat with the word "Locout" written on it. He appears to be an older man with a weathered face and a serious expression. He is wearing a jacket or coat, and the background suggests an outdoor, rural setting. The image has a black and white, documentary-style aesthetic.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from the early-to-mid 20th century showing a coal miner. The subject is wearing typical mining attire including a mining helmet with a lamp attached to it. The miner is wearing what appears to be work clothes and has a weathered, rugged appearance characteristic of someone who works in the mines. The lighting in the photo creates strong shadows and contrast, highlighting the harsh working conditions these miners faced. The image captures the gritty reality of coal mining during this historical period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a man standing in front of a road, wearing a hard hat with a light on it and a dark-colored jacket. The background is a rocky hillside with a road running through it.

  • The man is wearing a hard hat with a light on it, which suggests that he may be a miner or working in a similar environment.
  • He is also wearing a dark-colored jacket, which could be a work uniform or protective clothing.
  • The background of the image shows a rocky hillside with a road running through it. The road appears to be paved and well-maintained, suggesting that it may be a main road or highway.
  • The rocky hillside in the background adds a sense of ruggedness and natural beauty to the image.
  • Overall, the image suggests that the man is working in a rugged and industrial environment, possibly in a mining or construction setting.

The image provides a glimpse into the life of a man working in a rugged and industrial environment, and highlights the importance of safety equipment and protective clothing in such settings.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a man in a hard hat with a light on it, standing on the side of a road.

The man is wearing a collared shirt and a hard hat with a light on the front. The light is attached to the front of the hat and has a small handle on top. The man's face is blurred, but he appears to be looking directly at the camera.

In the background, there is a road that runs along the side of a hill or mountain. The road is paved and has a white line down the center. There are no other people or vehicles visible in the image. The overall atmosphere of the image suggests that the man is working outdoors, possibly in a mining or construction setting.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The image is in black and white. It shows a man standing on the side of the road. He is wearing a hat with a lamp on top, a collared shirt, and a jacket. He is looking straight at the camera. Behind him, there is a road with white lines. There are also some rocks on the side of the road. The road is surrounded by trees.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph of an elderly man standing on the side of a road. He is wearing a rugged hat with a miner's lamp attached to it, suggesting that he might be a miner or someone who works in a similar occupation. The man has a serious expression on his face, and his clothing appears to be worn and weathered, indicating that he has spent a lot of time working outdoors. The road behind him is empty, and there are some rocks and vegetation visible on the side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-29

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white portrait of a man, likely a miner, taken in a somewhat documentary style. It conveys a sense of ruggedness and the hardships of the profession.

Specific Details:

  • The Man: The man is the central focus. He appears to be older, with a weathered face, suggesting experience and likely difficult work. He has a short beard or stubble. The lighting casts shadows across his face, giving it depth and highlighting his features.
  • Attire: He is wearing a miner's helmet with a lamp attached. He is also wearing a work shirt or jacket, likely made of a durable material.
  • Background: In the background, we see what appears to be a road running alongside a rocky hillside. There are some indistinct objects that might be barrels or storage containers.
  • Lighting and Composition: The lighting is harsh, with strong shadows. This, combined with the man's direct gaze at the camera, gives the portrait a sense of directness and intensity.

Overall: The image feels like a historical photograph, capturing a sense of work, and possibly the difficult life of a miner.

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

This black and white photograph features a weathered man, likely a miner, standing in what appears to be a rural or industrial setting. He faces the camera with a serious, perhaps tired, expression. The man is wearing a hard hat with a miner's lamp attached to it, which indicates his profession. He also sports a collared shirt or jacket, and a thin scarf or neckerchief is visible at his neck.

The background is somewhat blurred, but it looks like a road or path running alongside a rocky hillside or cliff face. There's also what seems to be a barrel or container visible in the background. The light in the photo is slightly harsh, creating strong shadows on the man's face and clothing, emphasizing his features and the details of his work attire. Overall, the image conveys a sense of labor, resilience, and perhaps the hardships of a working-class life.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image is a black-and-white photograph of a man who appears to be a miner. He is wearing a hard hat with a headlamp attached to the front, which is typical of mining gear. The man's face is covered in dirt or coal dust, indicating that he has been working in a mine. He is dressed in a work shirt, and his collar is turned up. The background shows a rugged, rocky terrain, suggesting that the photo was taken near a mining site. The overall mood of the image conveys the hardworking and challenging nature of mining work.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph of a man wearing a miner's helmet with a headlamp attached. He is dressed in a rugged, work-appropriate outfit that includes a heavy, buttoned shirt. The man has a weathered appearance, with visible dirt and dust on his face, suggesting he has been working in a dusty or industrial environment. The background shows a rocky, possibly mountainous terrain, and there appears to be a tunnel or mine entrance in the distance. The overall composition and attire of the man suggest he is a miner or someone who works in a similar occupation.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph depicts a man wearing a mining helmet equipped with a headlamp. The man appears to be a miner, as suggested by his attire and the equipment. He is standing outdoors, with a natural background that includes a rocky terrain and some foliage. The man has a serious expression on his face, and his clothing looks worn, likely due to the nature of his work. The overall atmosphere of the image suggests a gritty, hardworking environment.