Human Generated Data

Title

Untitled (cotton pickers, Pulaski County, Arkansas)

Date

October 1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2544

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (cotton pickers, Pulaski County, Arkansas)

People

Artist: Ben Shahn, American 1898 - 1969

Date

October 1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2544

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Architecture 100
Building 100
Outdoors 100
Shelter 100
Clothing 99.8
Hat 99.8
Countryside 98.7
Hut 98.7
Nature 98.7
Rural 98.7
Photography 94.2
People 94.1
Face 91.9
Head 91.9
Portrait 91.9
Accessories 86.9
Bag 86.9
Housing 68.3
Cap 63.9
Footwear 60.6
Baseball Cap 57.5
Shorts 56.8
House 56.8
Farm 56.6
Shack 56.6
Coat 56.1
Soil 56
Field 56
Grass 55.9
Plant 55.9
Agriculture 55.8
Garden 55.7
Gardener 55.7
Gardening 55.7
Sun Hat 55.1

Clarifai
created on 2018-05-10

people 99.9
adult 99.4
man 98.5
two 97.2
one 96.4
portrait 94.8
wear 94.6
veil 93
group 91.7
vehicle 91.6
woman 91.5
group together 91.2
child 89.4
administration 89.2
transportation system 88.2
lid 87.7
leader 85.9
three 84.7
recreation 84.4
military 81.5

Imagga
created on 2023-10-05

man 24.9
park 23
male 20.2
people 20.1
child 18.8
outdoors 18.2
person 17
old 13.2
happy 13.2
active 12.7
snow 12.7
outdoor 12.2
weapon 12
outside 12
city 11.6
smiling 11.6
winter 11.1
summer 10.9
sky 10.8
life 10.5
adult 10.5
cold 10.3
mountains 10.2
sport 10.1
smile 10
leisure 10
mountain 9.9
travel 9.9
world 9.8
vacation 9.8
hiking 9.6
building 9.6
couple 9.6
grass 9.5
walking 9.5
love 9.5
men 9.4
senior 9.4
bench 9.1
fun 9
activity 9
youth 8.5
garden 8.4
street 8.3
family 8
women 7.9
backpack 7.8
covering 7.6
tourist 7.5
landscape 7.4
back 7.3
freedom 7.3
clothing 7.3
juvenile 7.3
looking 7.2
religion 7.2
portrait 7.1
tree 7.1
architecture 7
together 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.9
person 97
old 48

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 23-33
Gender Male, 98.1%
Calm 96.5%
Surprised 7.6%
Fear 5.9%
Sad 2.2%
Confused 0.6%
Disgusted 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Male, 96.7%
Calm 51.7%
Confused 42.9%
Surprised 6.8%
Fear 6.6%
Sad 2.5%
Angry 0.5%
Disgusted 0.5%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Male, 98.9%
Calm 87.3%
Sad 6.9%
Surprised 6.3%
Fear 6%
Happy 3%
Angry 0.5%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 45-53
Gender Male, 83.6%
Calm 99.4%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Handbag
Shoe

Clarifai

Clothing
Tree
Human face
Man
Plant
Footwear

AWS Rekognition

Adult 99.3%

AWS Rekognition

Adult 99.2%

AWS Rekognition

Adult 98.6%

AWS Rekognition

Adult 97.4%

AWS Rekognition

Male 99.3%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 98.6%

AWS Rekognition

Male 97.4%

AWS Rekognition

Man 99.3%

AWS Rekognition

Man 99.2%

AWS Rekognition

Man 98.6%

AWS Rekognition

Man 97.4%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 97.4%

AWS Rekognition

Handbag 86.9%

AWS Rekognition

Shoe 60.6%

Clarifai

Clothing 92.2%

Clarifai

Clothing 88.2%

Clarifai

Clothing 81.9%

Clarifai

Tree 85%

Clarifai

Tree 84.7%

Clarifai

Tree 80.7%

Clarifai

Tree 51.8%

Clarifai

Tree 40%

Clarifai

Tree 37.8%

Clarifai

Human face 74.8%

Clarifai

Human face 63.9%

Clarifai

Human face 47.9%

Clarifai

Human face 37.8%

Clarifai

Man 60.6%

Clarifai

Plant 53.5%

Clarifai

Plant 39.1%

Clarifai

Footwear 49.2%

Clarifai

Footwear 47.5%

Clarifai

Footwear 41.3%

Categories

Imagga
created on 2023-10-05

paintings art 48.1%
nature landscape 42%
streetview architecture 7.6%
pets animals 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a man and a woman sitting on a bench

Created by general-english-image-caption-blip-2 on 2025-07-07

two men sitting on the ground in front of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image shows a rural setting with dirt roads and fields. There is a simple house or structure with a tin roof in the background surrounded by overgrown grass. In the foreground, two individuals sit on the ground, wearing work attire with caps and long sleeves, indicative of labor in an agricultural or outdoor environment. Another standing figure nearby leans slightly, holding what appears to be a sack or cloth. The atmosphere feels rustic and reminiscent of historical or farm-related imagery.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts three men wearing work clothes and caps, likely suggesting they are laborers or workers. Two of the men are sitting on the grass by the side of a road, while the third man stands next to them, holding a large sack or piece of fabric. In the background, there is a road and some grassy fields, with a few wooden houses or buildings visible. The scene conveys a rural or agricultural setting. The image is in black and white, giving it a historical or vintage feel.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to depict a rural scene from what seems to be a historical time period. It shows two individuals, a man and a woman, standing on a dirt road near a rustic-looking wooden structure in the background. The individuals are wearing clothing that suggests they are from a lower socioeconomic background. The overall atmosphere of the image conveys a sense of hardship and struggle, reflecting the difficult living conditions and challenges faced by people in that time and place.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a black and white historical photograph that appears to be from the mid-20th century. In the foreground, two people are resting on what appears to be grass beside a dirt or unpaved road. They are wearing work clothes - one in overalls and the other in lighter colored clothing with a cap. In the background, there are two other people standing and talking, and further back you can see rural buildings including what appears to be a farmhouse or barn with a metal roof. The scene suggests this may be documenting agricultural or rural life during that time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of four African American men sitting on the grassy roadside of a rural area. The two men in the foreground are seated on the grass, with the man in the front wearing a light-colored shirt and cap, and the man behind him wearing a light-colored shirt and hat with a strap over his shoulder. The two men in the background are standing on the grass, with one wearing a dark-colored shirt and pants and the other wearing a light-colored shirt and pants.

In the background, there is a road running along the side of the grass, with a wooden fence and a barn visible in the distance. The sky above is overcast, and the overall atmosphere of the image suggests a sense of relaxation and leisure. The men appear to be taking a break or enjoying each other's company, and the rural setting adds to the peaceful and serene ambiance of the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

This image is a black-and-white photograph of four African American men in a rural setting. The men are dressed in casual, worn clothing, with two of them wearing caps and one carrying a large bag or sack over his shoulder. They appear to be resting or taking a break, possibly during a journey or while working outdoors.

In the background, there is a dirt road that runs horizontally across the image, with a few buildings visible on the right side. The buildings appear to be small, rustic structures, possibly homes or outbuildings. There is also a field or meadow in the background, with tall grasses and weeds growing.

The overall atmosphere of the image suggests a sense of simplicity and hardship, with the men appearing to be laborers or travelers who are taking a break from their daily activities. The rural setting and the men's clothing suggest that the image was taken in a rural area, possibly in the southern United States, during the early 20th century.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is in black and white. It features four men, two of whom are sitting on the grass beside the road, while the other two are standing. The man in the foreground is wearing a hat and has his mouth open. The man sitting next to him is wearing a cap and is looking forward. Behind them, the two men are standing, one of whom is wearing a hat and holding a jacket.

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image depicts a monochromatic photograph taken on a sunny day. It shows three men standing and sitting on the side of a road. The man in the middle, wearing a hat, is sitting on the grass with his legs crossed. The man on the right, also wearing a hat, is sitting on the ground with his mouth open. The man on the left, wearing a hat and a jacket, is standing on the side of the road. In the background, there is a house, a fence, and some trees.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-24

Here's a description of the image:

The photograph is a black and white snapshot, likely taken outdoors during the day. It depicts four men in a rural setting, possibly in the American South during the mid-20th century.

  • Foreground: Two men are seated on the grassy edge of a paved road. The man closest to the camera appears to be yawning. The man behind him is looking intently towards something. They are both wearing light-colored shirts and caps.
  • Middle Ground: Two other men are standing near the road. One is fully visible and is looking at the ground. The other is in profile with a bag slung over his shoulder. They both wear clothing that looks like workwear or overalls. The men seem to be taking a break or have stopped for some reason.
  • Background: A straight, paved road leads towards a couple of weathered wooden buildings, likely houses, that are set behind a simple fence. There is tall grass and foliage surrounding the structures. The sky appears clear, and the overall mood of the image is one of a quiet, everyday moment. The picture has a documentary feel to it, capturing a slice of life from a specific time and place.

Created by gemini-2.0-flash on 2025-05-24

The black and white photo shows four men next to a road. Two men are standing on the left side of the road, the man closest to the camera is in profile, and a jacket hangs off of one shoulder. In the background another man in uniform stands with his hands on his hips. On the right two men sit in the grass, both wearing caps, and the closest man appears to be yelling, or yawning with his mouth wide open. Behind them a grassy hill meets the road, and a couple of wooden houses are set back behind a wooden fence.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image appears to be a historical black-and-white photograph depicting a rural scene with four individuals. The setting is outdoors, likely in a rural area, with a dirt road and simple wooden houses in the background. The individuals in the image are dressed in work clothes, suggesting they might be farm laborers or sharecroppers.

Here is a detailed description of each person:

  1. Person on the left: This individual is standing with hands on hips, wearing a hat, a jacket, and pants. The stance and attire suggest a casual, possibly supervisory role.

  2. Person in the center-left: This person is standing with a cloth or sack draped over the shoulder, wearing a hat and work clothes. The posture and attire indicate they might be taking a break from work.

  3. Person in the center-right: This individual is seated on the ground, looking directly at the camera. They are wearing a cap and a long-sleeved shirt, with their arms resting on their knees.

  4. Person on the right: This person is also seated on the ground, leaning slightly forward with a cloth or sack in their lap. They are wearing a cap and a light-colored shirt.

The overall scene conveys a sense of hard work and simplicity, typical of rural life in earlier times. The expressions and postures of the individuals suggest a moment of rest or pause in their daily labor. The background includes a wooden fence and some vegetation, further emphasizing the rural setting.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a scene of what appears to be a rural setting. In the foreground, two individuals are seated on the ground; one is wearing a light-colored shirt, and the other is dressed in a darker outfit, possibly with a striped vest. The individual in the dark outfit seems to be in distress or pain, as they are leaning back with their eyes closed and mouth open, suggesting a state of exhaustion or injury. The person in the lighter shirt appears to be attending to them, possibly indicating that they are providing assistance.

In the background, there is a paved road that runs diagonally across the image. On the left side of the road, two individuals are standing and appear to be observing the scene. One of these individuals is wearing a light-colored shirt and pants, while the other is dressed more casually, with a scarf or shawl draped around their shoulders. The background also features a modest wooden house with a thatched roof and some trees and vegetation, giving the impression of a rural or possibly African village. The overall atmosphere of the image is somber and suggests a moment of distress or medical intervention in a remote or rural area.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a rural scene. In the foreground, two individuals are sitting on the grass beside a road. One person appears to be in distress, with their mouth open as if they are shouting or in pain, while the other person is leaning towards them, possibly trying to assist or calm them down. In the background, two more individuals are standing near the road. One of them is wearing a dark outfit and a shawl, and the other is dressed in lighter clothing. There are some buildings, possibly houses or small structures, visible in the distance, surrounded by tall grass and trees. The overall atmosphere of the image suggests a moment of tension or urgency.