Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.970

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (wheat harvest, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.970

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Outdoors 98.7
Nature 98
Face 95.9
Head 95.9
Photography 95.9
Portrait 95.9
Backyard 95.7
Yard 95.7
Garden 95.5
People 92.7
Sun Hat 90
Shorts 81
Machine 80.4
Pants 76.7
Countryside 65.6
Gardening 64.5
Architecture 57.4
Building 57.4
Shelter 57.4
Housing 57.2
Grass 56.9
Plant 56.9
Baseball 56.8
Baseball Glove 56.8
Glove 56.8
Sport 56.8
Gardener 56.7
Dress 56
Rural 55.7
Hut 55.5
Coat 55.4
Bonnet 55.2
Ball 55.2
Football 55.2
Soccer 55.2
Soccer Ball 55.2

Clarifai
created on 2018-05-11

people 100
child 99.5
recreation 98.4
adult 98.3
group together 98.1
group 97.1
several 96
man 95.9
boy 95.8
two 95.3
family 94.6
woman 93.1
offspring 91.3
three 91.2
many 89.8
wear 88.3
four 87.2
sports equipment 86.8
five 84.8
administration 84.6

Imagga
created on 2023-10-06

ball 58.6
soccer ball 51
game equipment 34.4
banjo 27.7
equipment 26.7
musical instrument 25.7
stringed instrument 22.6
people 21.7
child 21.2
man 18.8
person 18.1
outdoors 17.2
male 17.1
happy 16.3
kin 16.1
grass 15.8
family 14.2
field 14.2
happiness 14.1
old 13.9
football 13.4
adult 13
play 12.1
portrait 11.6
holding 11.5
world 11.5
boy 11.3
fun 11.2
sport 11.2
girls 10.9
children 10.9
dirty 10.8
mother 10.4
love 10.3
playing 10
kid 9.7
outside 9.4
face 9.2
joy 9.2
dress 9
father 9
black 9
childhood 9
holiday 8.6
kids 8.5
dark 8.3
competition 8.2
park 8.2
fall 8.1
cheerful 8.1
activity 8.1
game 8
lifestyle 7.9
little 7.9
daughter 7.9
country 7.9
day 7.8
couple 7.8
color 7.8
death 7.7
summer 7.7
outdoor 7.6
one 7.5
vintage 7.4
earth 7.3
aged 7.2
cute 7.2

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 98.6
outdoor 95.5
posing 45.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 40-48
Gender Male, 100%
Sad 44.3%
Confused 24.8%
Surprised 16.3%
Angry 14.5%
Calm 11.8%
Fear 7.9%
Disgusted 4.8%
Happy 1.7%

AWS Rekognition

Age 21-29
Gender Male, 97.8%
Disgusted 56.2%
Surprised 15%
Fear 13%
Angry 7.3%
Sad 5.6%
Calm 2.8%
Confused 1.4%
Happy 1.1%

AWS Rekognition

Age 34-42
Gender Male, 55.8%
Calm 37.1%
Fear 19.7%
Surprised 12.1%
Sad 11.7%
Disgusted 10.8%
Happy 5.2%
Confused 3%
Angry 2.6%

AWS Rekognition

Age 13-21
Gender Male, 71.8%
Sad 51.7%
Calm 20.3%
Surprised 18.8%
Disgusted 16.9%
Confused 9.3%
Angry 7.5%
Fear 6.9%
Happy 1.7%

Microsoft Cognitive Services

Age 74
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Boy
Child
Wheel
Hat

Clarifai

Man
Clothing
Human face
Footwear
Tree
Plant
Human leg
Human arm

AWS Rekognition

Adult 99.2%

AWS Rekognition

Adult 98.7%

AWS Rekognition

Adult 98.6%

AWS Rekognition

Male 99.2%

AWS Rekognition

Male 99%

AWS Rekognition

Male 98.7%

AWS Rekognition

Male 98.6%

AWS Rekognition

Man 99.2%

AWS Rekognition

Man 98.7%

AWS Rekognition

Man 98.6%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 96.3%

AWS Rekognition

Person 87.6%

AWS Rekognition

Person 73.8%

AWS Rekognition

Boy 99%

AWS Rekognition

Child 99%

AWS Rekognition

Wheel 80.4%

AWS Rekognition

Hat 67.1%

AWS Rekognition

Hat 55.7%

Clarifai

Man 87.3%

Clarifai

Man 83.5%

Clarifai

Man 78%

Clarifai

Man 47.5%

Clarifai

Clothing 67.3%

Clarifai

Clothing 50.8%

Clarifai

Clothing 46.5%

Clarifai

Clothing 38.1%

Clarifai

Clothing 33.4%

Clarifai

Human face 61.2%

Clarifai

Human face 61.1%

Clarifai

Human face 53.9%

Clarifai

Human face 50.6%

Clarifai

Footwear 60.6%

Clarifai

Footwear 52.6%

Clarifai

Footwear 52.5%

Clarifai

Footwear 52.1%

Clarifai

Footwear 46.2%

Clarifai

Footwear 43.4%

Clarifai

Footwear 38.5%

Clarifai

Footwear 34.4%

Clarifai

Footwear 33.8%

Clarifai

Tree 45.3%

Clarifai

Tree 42%

Clarifai

Plant 37.3%

Clarifai

Human leg 35.4%

Clarifai

Human leg 35.1%

Clarifai

Human arm 33.7%

Categories

Imagga
created on 2023-10-06

paintings art 98.5%
people portraits 1.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man in overalls and a hat is holding a hat

Created by general-english-image-caption-blip-2 on 2025-07-05

an old black and white photo of men standing outside

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a rural setting with a group of individuals, mostly men, wearing overalls and engaging in casual activities outdoors. Some are holding towels, possibly drying off or cleaning up, suggesting a break or communal activity. One person stands in the center holding a towel, while others appear to converse or relax. Hats are scattered on the ground and hung on a fence post nearby. The background features a wooden building, a wire-fence, and some trees or bushes, contributing to a rustic atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a group of men wearing overalls and work shirts, suggesting they are laborers or farm workers. They are gathered outside near a wooden fence and a building, possibly a barn or a house. Several of the men are holding towels, indicating they might be cleaning up after a day's work or preparing for a meal. One man is seated on the ground, leaning against the fence, and there are several hats scattered around, including a straw hat prominently visible next to him. The setting appears to be rural, with grass and trees in the background contributing to the serene atmosphere.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to depict a rural or agricultural setting, with a group of people gathered outside a wooden building or structure. In the foreground, there is a person wearing overalls and a hat, who seems to be engaged in some kind of work or activity. In the background, there are several other people, some of whom appear to be observing or interacting with the person in the foreground. The overall scene suggests a rural or farming community setting from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a black and white historical photograph, likely from the early-to-mid 20th century. In the center of the image is a man wearing overalls and work clothes, standing in what appears to be a yard or outdoor area. Several straw hats are visible in the scene, including some on the ground. In the background, there are other people gathered near what looks like a building or structure. The setting appears rural or working-class, given the clothing and environment. The image has the grainy, documentary-style quality typical of photographs from this era.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

This black and white photograph depicts a group of men gathered in a yard, with one man standing prominently in the foreground. He is dressed in overalls and holds a towel in his right hand, while his left arm is bent at the elbow. Behind him, several other men are visible, some of whom are also holding towels.

In the bottom-left corner of the image, another man is seated on the ground, wearing a straw hat and leaning against a bush. The background of the photo features a small building or shed, which appears to be constructed from corrugated metal or wood. The overall atmosphere of the image suggests that the men may have been engaged in some form of physical labor or activity, as evidenced by their casual attire and the presence of towels.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image is a black-and-white photograph of a group of men gathered in a yard, likely taken in the early 20th century. The men are dressed in casual attire, with some wearing overalls and others in shirts and pants. They appear to be engaged in conversation, with some holding towels or other items.

In the foreground, a man is kneeling on the ground, possibly working on a task or resting. He is wearing a wide-brimmed hat and a long-sleeved shirt, and has a tool or object in his hand.

The background of the image shows a small building or shed, with a few trees and bushes nearby. The overall atmosphere of the image suggests a relaxed and informal gathering of friends or colleagues, possibly during a break or after a hard day's work.

The image appears to be a candid shot, capturing a moment in time without any apparent pose or staging. The grainy texture of the photograph adds to its nostalgic feel, evoking a sense of nostalgia for a bygone era.

Overall, the image presents a charming and intimate portrayal of everyday life, highlighting the importance of social connections and community in shaping our experiences and memories.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The black-and-white photo shows a group of men in front of a house, possibly in the countryside. The man in the middle is wearing overalls and holding a towel, while the other men are wearing hats and holding towels. They are all looking in the same direction. On the left, a man is sitting on the ground and holding a cigarette. There are hats hanging on the fence, and a plant is on the left.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image shows a black and white photograph of a group of people outside a house. A man in overalls is standing in the center, holding a white cloth. He seems to be trying to dry it. On the left, a person is sitting on the ground, holding a cigarette. Some people are standing behind him. A bucket is placed on the floor near the house. A fence is placed behind the house.

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

Here is a description of the image:

The image is a black and white photograph of a group of men, likely farmworkers, during what appears to be a break from work. The central figure is a man in overalls who is standing and wiping his hands with a towel. He is looking down and appears to be cleaning up. Behind him and to the right are other men, some also wiping their hands with towels. In the background is a simple structure, possibly a shed, with a corrugated metal exterior.

To the left, there is a bush with dense foliage. A man in a straw hat is seen resting on the ground near the bush, and several straw hats are placed on a fence post and the ground. The atmosphere is one of a work break, and the scene suggests a rural setting, likely a farm during the mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-28

Here's a description of the image:

Overall Impression:
The image is a black and white photograph, likely from the mid-20th century, depicting a group of men. The scene suggests a rural setting, possibly during a break from work. The atmosphere feels somewhat casual and weathered.

Foreground:

  • A man stands prominently in the center of the frame. He is wearing overalls and a shirt, typical work attire. He is holding a white towel, possibly wiping his hands or face. His expression is neutral.
  • A man rests on the ground, wearing a straw hat.

Background:

  • A group of men are gathered near a simple building. They appear to be holding towels, and one man is possibly washing his hands in a metal bucket.
  • Hats are hanging on a wooden post with some barbed wire.

Details:

  • The lighting suggests an overcast day.
  • The photograph has some imperfections, like scratches, which contribute to its vintage feel.

Interpretation:
The image might show workers taking a break from manual labor, like farming or construction. The scene reflects a moment of rest and camaraderie amongst them.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The black-and-white photograph depicts a group of men, seemingly farm workers, taking a break outdoors. The setting appears to be a rural area, possibly a farm or a work site, with a wooden structure in the background.

In the foreground, a man wearing overalls and a long-sleeved shirt is standing and holding a towel. He has a hat in his hand and is looking down. Near him, another man is lying on the ground, wearing a hat and long-sleeved shirt, with his arm resting on a small tool, possibly a hammer.

In the background, several other men are standing and leaning against the wooden structure. They are dressed in similar work attire, including overalls and hats. Some of them are holding towels or other items, suggesting they might have just finished working or are taking a rest.

The scene conveys a sense of camaraderie and hard work, typical of laborers in a rural setting. The presence of towels and the relaxed postures of the men indicate they are taking a break from their duties.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image is a black-and-white photograph showing a group of men in what appears to be a rural or farm setting.

  • Foreground: A man in overalls is standing in the center of the image, holding a towel or cloth. He looks somewhat agitated or frustrated. A straw hat lies on the ground to his left, and another straw hat is leaning against a wooden post behind him. The ground is grassy.

  • Background: There are three other men visible, standing near a wooden building. Their postures and gestures suggest they might be engaged in a discussion or argument. One man is holding a towel or cloth, similar to the man in the foreground, while another appears to be holding a piece of clothing.

  • Setting: The scene is outdoors, with a wooden structure that could be a shed or barn in the background. There are bushes and trees to the left, indicating a rural environment.

The overall atmosphere of the image suggests a moment of tension or disagreement among the men.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This black-and-white photograph captures a rural, vintage scene featuring a group of men outdoors near a wooden building. The central figure, standing in the foreground, is wearing overalls and a button-up shirt, holding a white cloth or towel in one hand. He appears engaged in conversation or focused on something off-camera.

In the background, several other men are gathered near the building, some wearing hats and others in overalls. One man is holding a towel, and others seem to be in a relaxed posture, possibly taking a break. To the left, another man is lying on the ground, resting with his arms behind his head, wearing a straw hat.

The setting includes grass, plants, and a wooden fence, indicating a rural or farm-like environment. The overall atmosphere suggests a casual, everyday moment from a bygone era.