Human Generated Data

Title

Untitled (picking cotton)

Date

1946, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.323

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (picking cotton)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1946, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.323

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 97.7
Mammal 94.6
Animal 94.6
Transportation 93.7
Vehicle 93.2
Wagon 86.8
Machine 72.9
Carriage 56.1

Clarifai
created on 2023-10-25

people 99.9
wagon 99.8
cart 99.7
vehicle 99.5
cavalry 99.4
transportation system 99
cropland 98.5
two 98.5
adult 98.4
carriage 96.7
driver 95.4
group together 95.3
group 95.2
tractor 95
farm 94.8
plow 94.4
man 92.6
farming 92.3
mammal 91.9
one 90.7

Imagga
created on 2022-01-08

barrow 66.5
thresher 56
handcart 54
machine 49.7
wheeled vehicle 49.4
vehicle 46.1
farm machine 45.4
rural 24.7
landscape 24.5
old 24.4
device 23.7
farm 21.4
tractor 21.1
sky 21
field 20.9
grass 19
tree 17.7
agriculture 15.8
outdoors 15
outdoor 13.8
machinery 13.6
conveyance 13.3
cart 13
bench 12.8
road 12.6
car 12.1
transport 11.9
transportation 11.7
summer 11.6
antique 11.3
snow 11.1
industry 11.1
clouds 11
wagon 10.9
farmer 10.7
farming 10.4
hay 10.2
countryside 10
plow 9.9
horizon 9.9
park 9.9
equipment 9.8
autumn 9.7
country 9.7
black 9.6
dirt 9.5
work 9.4
man 9.4
hill 9.4
land 9.2
house 9.2
wood 9.2
travel 9.2
working 8.8
park bench 8.8
rust 8.7
scene 8.7
heavy 8.6
rusty 8.6
winter 8.5
wheel 8.5
iron 8.4
fall 8.1
copy space 8.1
scenery 8.1
meadow 8.1
mountain 8
trees 8
scenic 7.9
farmland 7.7
tool 7.6
harvest 7.5
environment 7.4
vacation 7.4
peaceful 7.3
industrial 7.3
people 7.3
dirty 7.2
truck 7.1
building 7.1

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

outdoor 99.9
grass 99.9
sky 98.7
tractor 88.2
wheel 84.9
land vehicle 82.9
old 82.6
bovine 71.5
vehicle 69.9
farm 68.9
cart 58.4
black and white 55.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 89.4%
Calm 97.1%
Happy 1.4%
Sad 0.9%
Fear 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Horse
Bird
Wheel

Clarifai

Cart
Wheel
Horse
Person
Tree
Plant

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 59%

AWS Rekognition

Person 58.7%

AWS Rekognition

Horse 94.6%

AWS Rekognition

Horse 78.2%

AWS Rekognition

Horse 62.1%

AWS Rekognition

Bird 91.8%

AWS Rekognition

Wheel 72.9%

AWS Rekognition

Wheel 59.8%

Clarifai

Cart 88.3%

Clarifai

Wheel 81.4%

Clarifai

Wheel 80.3%

Clarifai

Wheel 71.9%

Clarifai

Wheel 54.2%

Clarifai

Horse 74.7%

Clarifai

Horse 35.2%

Clarifai

Person 68.7%

Clarifai

Person 49.3%

Clarifai

Person 44.8%

Clarifai

Person 33.8%

Clarifai

Tree 54.8%

Clarifai

Tree 52.4%

Clarifai

Tree 47.2%

Clarifai

Tree 44.7%

Clarifai

Tree 44.1%

Clarifai

Tree 43.7%

Clarifai

Tree 40.5%

Clarifai

Tree 38.6%

Clarifai

Tree 36.9%

Clarifai

Tree 34%

Clarifai

Plant 33.3%

Categories

Imagga
created on 2022-01-08

paintings art 95.8%
streetview architecture 2.5%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-10

a farmer plows a field with his oxen.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a man is pulling a carton of cotton in a field

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image depicts a rural agricultural scene in which a wooden wagon filled with cotton sits in front of a vast cotton field. The wagon is hitched to two mules and features large, wooden wheels. Several individuals are scattered throughout the field, engaging in the process of cotton harvesting. In the background, trees line the horizon under a clear sky, enhancing the natural setting of the farmland.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image shows a rural agricultural scene featuring a large field of cotton plants. The foreground is dominated by a wooden cart filled with picked cotton. The cart is pulled by two mules and has large wooden wheels. Several individuals are working in the field, gathering cotton. Two of them are in the distance, while another person is seen riding a horse closer to the cart. The background is filled with trees bordering the field under a clear sky.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image depicts a cotton field being harvested. In the foreground, there is a horse-drawn wagon loaded with freshly picked cotton. A person can be seen sitting on the wagon, likely the driver or worker responsible for transporting the cotton. In the background, there are several other people, presumably cotton pickers, working in the field to harvest the cotton crop. The scene appears to be from a time period when manual labor was the primary method for cotton harvesting.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white photograph depicts a horse-drawn wagon in a cotton field. The wagon is loaded with picked cotton and is being pulled by two horses. A man is standing on the wagon, likely overseeing or assisting with the cotton harvesting process. The field stretches out into the distance, with trees visible on the horizon. The image captures a scene of agricultural labor from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical black and white photograph showing cotton harvesting. In the image, there's a horse-drawn wagon filled with harvested cotton. The wagon is positioned at the edge of a vast cotton field that stretches into the distance. Several people can be seen in the field picking cotton. The wagon has wooden sides and large wooden wheels typical of the era. The image appears to be from the American South, likely dating to a period when cotton was a major agricultural crop. The contrast between the white cotton and the dark wagon creates a striking visual in the photograph.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a cotton field with workers harvesting cotton.

  • The image is in black and white, which suggests it was taken in the past, possibly during the early 20th century.
  • In the foreground, there is a wooden wagon pulled by two horses. The wagon is filled with cotton, and a man is sitting on top of it.
  • Behind the wagon, there are several people working in the cotton field. They are all dressed in old-fashioned clothing, and some of them are carrying baskets or bags.
  • In the background, there are trees and other vegetation. The sky is clear and sunny, suggesting a warm day.
  • Overall, the image appears to be a historical photograph of a cotton farm, possibly taken during the time of slavery or shortly after emancipation.

The image provides a glimpse into the past, showing how cotton was harvested and processed in a bygone era. It also highlights the hard work and labor that went into producing this important crop.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image depicts a black-and-white photograph of a cotton field, where several individuals are engaged in harvesting cotton. The scene is set against a backdrop of a vast field of cotton plants, with a few trees visible in the distance.

In the foreground, a horse-drawn cart is prominently featured, filled with freshly picked cotton. A man sits atop the cart, while another person stands beside it, holding a basket of cotton. Two additional individuals are seen working in the field, one of whom is mounted on a horse.

The overall atmosphere of the image suggests a sense of hard work and dedication, as the individuals labor to harvest the cotton crop. The use of horses and manual labor adds a touch of nostalgia to the scene, evoking a sense of a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image depicts a scene from the early 20th century, showing a group of people engaged in the laborious task of picking cotton in a vast cotton field. The image is in black and white, which adds a historical and nostalgic feel. The field is expansive, with rows of cotton plants stretching far into the distance. The cotton plants are tall and full of cotton bolls, ready to be harvested.

In the foreground, there is a mule-drawn cart, which is a common sight in agricultural settings of that era. A young boy is sitting on the cart, holding onto the reins. The cart is filled with freshly picked cotton, which is being collected and transported to a central location for processing. The boy's presence on the cart suggests that he is either helping with the work or is simply enjoying the ride.

In the background, there are several people working in the cotton field. Some are standing, while others are bending over, picking cotton from the plants. A woman wearing a hat and holding a basket is standing next to a horse, which is likely being used for transportation or as a means of rest during breaks. Another person is riding a horse, possibly supervising the workers or overseeing the cotton picking process.

The image captures the hard work and dedication of the people involved in cotton picking, which was a significant part of the agricultural economy in the early 20th century. The use of mules and horses for transportation and labor highlights the reliance on animal power during that time, as modern machinery was not yet widely available.

Overall, the image provides a glimpse into the daily life and work of people in the early 20th century, showcasing the challenges and hardships they faced in their pursuit of a livelihood. The cotton field, the mule-drawn cart, and the people working in the background all contribute to a sense of historical authenticity, making the image a valuable visual record of a bygone era.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black and white image features a man sitting on a wooden cart being pulled by a donkey. The cart is filled with cotton, and a basket is placed on top. There are other people in the background, including a woman with a hat and a man riding a horse. They are in a field of cotton plants. In the distance, there are trees.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

The black-and-white photograph shows a young African American boy sitting atop a wooden cart filled with cotton. He is positioned in the foreground, and a mule stands harnessed to the front of the cart. In the background, several other people, possibly women, are working in a vast cotton field. A person on horseback is visible further in the distance. The scene appears to be taken on a sunny day, with the cotton field stretching to the horizon under a clear sky. The image captures a moment in what seems to be a cotton harvest, likely in the rural South.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Scene: The image captures a scene of cotton harvesting, likely from the early to mid-20th century given its black and white aesthetic and the subject matter. It depicts agricultural labor in a field.

Foreground: The prominent element is a wooden cart, pulled by a dark-colored mule or donkey. A young Black man sits atop the cart, which is partially filled with harvested cotton. The cart has a basket-like structure at the front.

Midground: A vast cotton field stretches into the background. In the field, several other people are present. One person, wearing a wide-brimmed hat, appears to be working in the cotton field. There is also someone riding a horse in the field.

Background: The background consists of a vast field of cotton plants, indicating the scale of the operation. Trees are visible along the horizon, suggesting the edge of the field or a nearby landscape.

Composition and Atmosphere: The image is a black and white photograph. The lighting is bright and appears to be a sunny day. The photograph conveys a sense of labor, the scale of cotton farming, and possibly social or historical context. The image likely portrays a time when cotton farming relied heavily on manual labor.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a scene of cotton harvesting in what appears to be a rural setting. In the foreground, there is a mule-drawn wagon with a man sitting on the wagon, holding the reins. The wagon is partially filled with picked cotton. The mule is harnessed to the wagon and is standing still.

In the background, several people are working in the cotton field, picking cotton by hand and placing it into large sacks. The workers are spread out across the field, which is lush with cotton plants. The sky is clear, and the landscape is flat with a few trees visible in the distance. The overall atmosphere suggests a period setting, possibly from the early to mid-20th century, capturing the labor-intensive process of cotton harvesting.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a rural agricultural setting. In the foreground, there is a wooden cart, which appears to be a hay wagon, loaded with what looks like bales of cotton. The cart is being pulled by two mules. A man is seated in the wagon, appearing to guide the mules.

In the background, there is an expansive field with rows of crops that resemble cotton, indicating that the scene is likely set during the cotton harvest season. To the right, a person is standing in the field, possibly harvesting cotton. Another individual is seated on a horse in the distance, observing the scene. The setting is characterized by open fields, trees in the background, and appears to be a sunny day. The photograph captures a moment of rural life, likely from the early to mid-20th century, based on the style of clothing and the equipment used.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a rural scene of cotton harvesting. In the foreground, there is a wooden wagon with large wheels, pulled by a mule. The wagon is partially filled with cotton. A young boy is seated on the wagon, holding the reins of the mule. In the background, several individuals are seen working in a cotton field, picking cotton. The landscape is flat and expansive, with a line of trees visible in the distance under a clear sky. The overall atmosphere suggests a historical setting, likely in a rural, agricultural community.