Human Generated Data

Title

Untitled (U.S. Highway 40, central Ohio)

Date

July 1938-August 1938, printed later

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3346

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (U.S. Highway 40, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Museum Acquisition, P1970.3346

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Worker 98.7
Garden 81.2
Gardener 81.2
Gardening 81.2
Nature 81.2
Outdoors 81.2
Face 78.6
Head 78.6
Bucket 70
Clothing 69.4
Bathing 67.4
Water 66.8
Soil 57.6
Tar 57.1
Washing 55.8
Mining 55.8

Clarifai
created on 2018-05-10

people 100
adult 99.5
man 98.5
one 97.6
two 96.8
group 96.2
woman 92.2
bucket 91.4
war 91.3
group together 91
wear 90.9
military 88.4
portrait 88.2
child 88.1
three 87.8
administration 86.6
four 85.4
soldier 85
home 79.4
furniture 75.2

Imagga
created on 2023-10-07

barrow 23.1
man 22.8
container 21.5
handcart 20.5
people 20.1
person 19.1
bucket 18.4
vessel 16.9
wheeled vehicle 16.2
male 15.6
television 14.2
adult 13.6
outdoors 13.4
sunset 11.7
holding 11.5
businessman 11.5
black 11.4
telecommunication system 11.1
business 10.9
old 10.4
work 10.4
outdoor 9.9
silhouette 9.9
portrait 9.7
summer 9.6
vehicle 9.3
briefcase 9.1
park 9
dirty 9
suit 9
couple 8.7
love 8.7
men 8.6
child 8.4
clothing 8.4
fashion 8.3
working 7.9
autumn 7.9
standing 7.8
sitting 7.7
walking 7.6
guy 7.4
can 7.4
water 7.3
lady 7.3
protection 7.3
danger 7.3
lifestyle 7.2
world 7.1
women 7.1
grass 7.1
shovel 7.1
day 7.1
milk can 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.2
standing 84.3
old 66.2
white 62.6
posing 47.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 29-39
Gender Male, 98.6%
Calm 75.3%
Confused 11.6%
Surprised 6.8%
Sad 6.2%
Fear 6.1%
Angry 1.6%
Happy 1%
Disgusted 1%

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Glove

Clarifai

Clothing
Human face
Tree
Footwear

AWS Rekognition

Adult 99.2%

AWS Rekognition

Male 99.2%

AWS Rekognition

Man 99.2%

AWS Rekognition

Person 99.2%

AWS Rekognition

Glove 69.4%

AWS Rekognition

Glove 58.5%

Clarifai

Clothing 88.3%

Clarifai

Clothing 82.8%

Clarifai

Human face 64.3%

Clarifai

Human face 45.5%

Clarifai

Tree 58.8%

Clarifai

Footwear 36.2%

Clarifai

Footwear 35.6%

Categories

Imagga
created on 2023-10-07

nature landscape 50.7%
streetview architecture 39.5%
paintings art 3.6%
beaches seaside 2.5%
people portraits 2.4%

Captions

Microsoft
created by unknown on 2018-05-10

a vintage photo of a man 89.6%
a black and white photo of a man 84.8%
a man standing next to a boat 71.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a man is standing in front of a building

Created by general-english-image-caption-blip-2 on 2025-07-08

two men are standing next to a large fire

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This black-and-white image depicts two workers engaged in a labor-intensive activity outdoors, possibly related to industrial or construction work. One individual is handling equipment that appears to involve liquid or molten material being poured into a bucket, wearing gloves and protective clothing. The scene includes a large container or vat, as well as a rugged background of dirt, debris, and vegetation, suggesting a worksite environment.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts two workers engaged in an industrial task. The worker in the foreground, wearing a long-sleeve shirt and a cap, is operating a piece of machinery. He is holding a lever or handle attached to a metal container or vat. He is wearing gloves, likely for safety and protection. The setting appears to be an outdoor industrial site, with the ground in the background being uneven and somewhat rugged. The equipment is large and seems to be used for handling some form of material or liquid. The workers are dressed in work clothes suitable for manual labor and appear to be focused on their task.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image depicts two men working in an industrial or construction setting. They appear to be standing next to a large piece of machinery or equipment, with one man holding a tool or object. The background shows a natural, wooded environment, suggesting this is an outdoor work site. The image has a black and white, documentary-style aesthetic, capturing the physical labor and working conditions of these individuals.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a historical black and white photograph showing two workers in industrial or mining settings. They are wearing overalls, long-sleeved shirts, and caps, which was typical workwear of the early 20th century. In the image, they are working with what appears to be some kind of large industrial container or tank, with one worker standing near what looks like a bucket or vessel. The setting appears to be outdoors, with some vegetation visible in the background. The image quality and style suggests this was taken sometime in the early to mid-1900s, and likely documents industrial or mining work conditions of that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts two black men working in a yard, likely in the early 20th century. The man on the left is wearing overalls and a cap, while the man on the right is wearing a long-sleeved shirt and pants. The man on the right is holding a large bucket and appears to be working with some sort of machinery or equipment.

The background of the image shows a yard with trees and bushes, suggesting that the men are working outdoors. The overall atmosphere of the image is one of hard work and labor, as the men are engaged in manual labor tasks. The image may have been taken during a time when black men were disproportionately represented in manual labor jobs, and it could be used to highlight the challenges and hardships faced by these individuals.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts two men engaged in manual labor, likely working with tar or asphalt. The man on the left is wearing a long-sleeved shirt and overalls, while the man on the right is dressed in a baseball-style shirt and pants. Both individuals are covered in dark substance, suggesting they are handling tar or asphalt.

In the foreground, a large container filled with the dark substance is visible, accompanied by a bucket and a tool that appears to be used for applying the substance. The background of the image features trees and bushes, indicating an outdoor setting. The overall atmosphere of the image conveys a sense of hard work and physical labor.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image depicts two men working on a construction site, captured in black and white. They are dressed in overalls and hats, indicating a manual labor environment. One man is pouring a substance from a container into a larger, industrial-sized container, while the other man stands nearby, holding a bucket that appears to be filled with the same substance. The background shows a rugged terrain with some vegetation and a dirt path, suggesting an outdoor setting. The image conveys a sense of hard work and manual labor in a historical context.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The black-and-white image shows two men working in an outdoor area. One of the men is wearing a cap and holding a bucket, while the other man is wearing a hat and a shirt with an apron. The man with the bucket is probably pouring something into a large container, while the other man is standing beside him. Behind them is a pathway with plants and rocks on the side.

Google Gemini

Created by gemini-2.0-flash on 2025-05-27

Here is a description of the image:

The black and white photograph shows two men working with what appears to be asphalt or tar, likely paving a road or surface. In the foreground on the left, a large, dark, rectangular tank or container is present, with thick, dripping substance covering its surface.

A man stands in front of the tank, wearing a long-sleeved shirt, dark trousers, and a cap. He has gloves on and appears to be operating a valve or spout to fill a bucket with the tar-like substance. The bucket is small and dark, and its handle is visible.

Behind him and slightly to the left, another man stands wearing overalls, a long-sleeved shirt, and a cap. He is looking towards the man in front.

The background consists of foliage and possibly a dirt or gravel area, with some scattered debris visible. The ground where the men are working appears to be paved, with the pavement stretching towards the lower right of the image. The entire scene suggests a hot, laborious work environment, and the image captures a moment in time of manual labor, possibly from an earlier era.

Created by gemini-2.0-flash-lite on 2025-05-27

Here is a description of the image:

This is a black and white photograph of two men working with what appears to be hot tar or asphalt. The photo is taken from a slightly low angle. The men are standing near a large, dark container or vat, that is dripping with a black substance. One man, standing closer to the camera, is wearing a long-sleeved shirt, overalls, and gloves. He is holding a bucket of the black substance. The other man is behind him and also wearing overalls. The background is out of focus, but it appears to be an outdoor setting with greenery. The overall tone of the photograph is somber, likely capturing a moment of manual labor.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The black-and-white photograph depicts two men engaged in what appears to be a labor-intensive task. Both men are dressed in work clothes, including long-sleeved shirts, pants, and gloves, suggesting they are involved in manual labor. The man on the left is wearing a cap and appears to be operating a valve or spout from a large, cylindrical container, which could be a tank or a barrel. He is filling a bucket with a dark, viscous substance, likely oil or tar, given its appearance. The man on the right is holding the bucket, presumably to collect the substance.

The setting appears to be outdoors, with a natural backdrop of trees and foliage. The ground is uneven and covered with rocks and debris, indicating a rugged or industrial environment. The overall scene suggests a work environment related to the handling of industrial materials, possibly in a mining, construction, or manufacturing context. The photograph captures a moment of teamwork and the physical demands of their job.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This is a black-and-white photograph depicting two individuals engaged in what appears to be manual labor. They are standing outdoors near a large, possibly industrial or construction-related structure. The person in the foreground is wearing a mask and gloves, holding a piece of machinery or tool, possibly involved in some form of extraction or processing activity. The individual in the background is wearing a cap and a long-sleeved shirt with overalls, also appearing to be involved in labor-intensive work. The surrounding environment includes vegetation and what looks like a gravel or rocky path, suggesting an industrial or rural setting. The photograph captures a moment of labor and appears to be historic, as indicated by the style of clothing and the overall aesthetic of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph depicts two men engaged in a physically demanding industrial task. Both are dressed in work clothes, including overalls and caps, which suggests a labor-intensive occupation. The man on the left is partially obscured by a large, dark structure, possibly a furnace or a similar piece of industrial equipment. He is wearing a hat and appears to be observing or assisting the man on the right. The man on the right is actively using a tool, possibly a hammer or a wrench, to work on a piece of machinery or equipment that is covered in what looks like slag or some other industrial residue. He is also wearing a hat and gloves, which are likely for protection against the harsh working conditions. The ground is covered in debris and broken materials, indicating a rough, industrial environment. The background shows some vegetation, suggesting that this industrial site is located near a natural area. The overall atmosphere of the image conveys the challenging and gritty nature of industrial work.