Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

Date

August 6, 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.743

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (public auction, A.H. Buchwalter farm, near Hilliards, Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 6, 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.743

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 100
Sun Hat 100
Face 88.2
Head 88.2
Indoors 60
Musical Instrument 56.4
Photography 56.1
Cap 55.2

Clarifai
created on 2018-05-11

people 100
group together 99.6
group 99.4
many 98.9
adult 97.8
man 96.3
several 94
veil 93.9
lid 92.9
woman 90.5
wear 90.5
watercraft 89.8
military 88.8
outfit 88.6
recreation 88
administration 86.1
chair 83.6
vehicle 82.8
uniform 81.8
crowd 79.6

Imagga
created on 2023-10-06

container 23
table 22.9
cup 22.7
restaurant 18.7
drink 15.9
dinner 15.7
food 15.1
vessel 15
coffee 14.9
meal 14.6
setting 14.4
interior 14.1
china 13
man 12.9
business 12.1
plate 12
party 12
wedding 11.9
black 11.5
dining 11.4
lunch 11.4
banquet 11.3
tea 10.9
people 10.6
dish 10.5
hat 10.4
celebration 10.4
event 10.2
beverage 9.9
room 9.9
glass 9.7
breakfast 9.6
decoration 9.5
luxury 9.4
male 9.3
eat 9.2
kitchen 8.9
reception 8.8
cups 8.8
knife 8.6
person 8.1
porcelain 8.1
tableware 8
clothing 8
fork 7.9
napkin 7.8
mortar 7.7
set 7.6
hand 7.6
traditional 7.5
closeup 7.4
office 7.4
ashcan 7.4
wine 7.4
spoon 7.2
cuisine 7.1
percussion instrument 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

person 93.6
several 10.9

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 28-38
Gender Female, 100%
Sad 86.2%
Confused 50.6%
Surprised 6.6%
Fear 6.1%
Calm 4.5%
Happy 2.1%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 48-56
Gender Female, 59.9%
Calm 72.3%
Surprised 15.8%
Confused 11%
Fear 5.9%
Sad 3.6%
Angry 0.6%
Disgusted 0.2%
Happy 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.2%
Calm 93.9%
Fear 7.1%
Surprised 6.5%
Sad 2.4%
Confused 0.6%
Happy 0.4%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 6-16
Gender Male, 99.3%
Calm 97.2%
Surprised 6.3%
Fear 5.9%
Sad 2.5%
Happy 1%
Confused 0.5%
Disgusted 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 42
Gender Female

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Female
Woman
Hat

Clarifai

Man
Human face
Cowboy hat
Sun hat
Human arm

AWS Rekognition

Adult 98%

AWS Rekognition

Adult 97.4%

AWS Rekognition

Adult 97.4%

AWS Rekognition

Adult 97.3%

AWS Rekognition

Adult 91%

AWS Rekognition

Adult 89.1%

AWS Rekognition

Adult 75%

AWS Rekognition

Male 98%

AWS Rekognition

Male 97.4%

AWS Rekognition

Male 97.4%

AWS Rekognition

Male 91%

AWS Rekognition

Male 89.1%

AWS Rekognition

Male 75%

AWS Rekognition

Man 98%

AWS Rekognition

Man 97.4%

AWS Rekognition

Man 97.4%

AWS Rekognition

Man 91%

AWS Rekognition

Man 89.1%

AWS Rekognition

Man 75%

AWS Rekognition

Person 98%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 93.1%

AWS Rekognition

Person 92.3%

AWS Rekognition

Person 91%

AWS Rekognition

Person 90.5%

AWS Rekognition

Person 89.1%

AWS Rekognition

Person 77.9%

AWS Rekognition

Person 75%

AWS Rekognition

Person 73.9%

AWS Rekognition

Female 97.3%

AWS Rekognition

Woman 97.3%

AWS Rekognition

Hat 94.9%

AWS Rekognition

Hat 92.6%

AWS Rekognition

Hat 90.6%

AWS Rekognition

Hat 83.2%

AWS Rekognition

Hat 77.9%

AWS Rekognition

Hat 75.1%

AWS Rekognition

Hat 59.7%

Clarifai

Man 84.2%

Clarifai

Man 77.8%

Clarifai

Man 74.1%

Clarifai

Man 71.6%

Clarifai

Man 69.4%

Clarifai

Man 69.3%

Clarifai

Man 62.2%

Clarifai

Man 57.4%

Clarifai

Man 55.7%

Clarifai

Man 46.8%

Clarifai

Man 46.5%

Clarifai

Man 45.9%

Clarifai

Human face 66.8%

Clarifai

Human face 65.2%

Clarifai

Human face 62.1%

Clarifai

Human face 61.4%

Clarifai

Human face 49.1%

Clarifai

Human face 47.3%

Clarifai

Human face 45.9%

Clarifai

Human face 33.5%

Clarifai

Human face 33.3%

Clarifai

Cowboy hat 56.5%

Clarifai

Cowboy hat 53%

Clarifai

Cowboy hat 52.6%

Clarifai

Cowboy hat 48.9%

Clarifai

Cowboy hat 46.5%

Clarifai

Cowboy hat 46.1%

Clarifai

Cowboy hat 38.4%

Clarifai

Cowboy hat 37.8%

Clarifai

Cowboy hat 36.4%

Clarifai

Sun hat 34.8%

Clarifai

Human arm 33.5%

Categories

Imagga
created on 2023-10-06

paintings art 82%
food drinks 11.1%
people portraits 4.8%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-31

a photograph of a group of people standing around a table

Created by general-english-image-caption-blip-2 on 2025-07-07

a group of men in hats and hats are gathered around a man in a hat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a group of men gathered outdoors around what appears to be an auction or demonstration. The scene includes a variety of hats, such as straw and felt hats, suggesting that it is set in a past era. Some men are observing closely, while one is holding a cigar and interacting with an object, possibly auctioning or demonstrating its function. Another individual is seen taking notes. The location appears to be near a building with wooden siding, adding to the historical atmosphere of the scene.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a group of individuals gathered around a central figure who appears to be demonstrating or discussing something of interest. Most of the individuals are men wearing hats, typical of mid-20th century fashion, with attire that suggests a casual or work environment, possibly an outdoor gathering or event. The setting includes a wooden structure in the background, and the people are focused on the activity in the center. Several people are taking notes, indicating that the event might be of educational or evaluative significance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image appears to depict a group of people gathered around a central object or activity. The individuals are wearing hats, suggesting an outdoor or rural setting. There appears to be a sense of excitement or interest in the central focus of the group. The image has a black and white, historical quality to it, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white historical photograph showing a group of men wearing hats (both straw boaters and fedoras) gathered in a circle, appearing to be observing or examining something. One person appears to be taking notes. The image has the look of being from the early-to-mid 20th century, based on the clothing styles and photographic quality. The men are dressed casually but neatly in what appears to be warm-weather clothing, with some wearing suspenders. The setting looks outdoor with what might be a building's wall visible in the background. The composition suggests this could be some kind of inspection, investigation, or demonstration taking place.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a group of men gathered around a large, dark-colored object, possibly a machine or device, in a black-and-white photograph. The men are dressed in casual attire, including hats and long-sleeved shirts, and some are holding tools or other objects. They appear to be engaged in a discussion or demonstration related to the object, with one man standing at the center of the group, pointing to the object and speaking to the others.

The background of the image shows a wooden wall or building, suggesting that the scene is taking place outdoors, possibly in a rural or industrial setting. Overall, the image conveys a sense of community and collaboration among the men, as they work together to understand and utilize the object in question.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a group of men gathered around a large, dark-colored object. The object appears to be a piece of machinery or equipment, possibly related to agriculture or industry.

Key Features:

  • A group of men, approximately 15-20 individuals, are standing around the object.
  • Most of the men are wearing hats, including fedoras, panama hats, and newsboy caps.
  • Some of the men are holding tools or equipment, such as wrenches or hammers.
  • The object in the center of the image is large and dark-colored, with visible metal components and what appears to be a handle or lever on top.
  • The background of the image shows a wooden wall or fence, suggesting that the scene is taking place outdoors or in a rural setting.

Overall Impression:

The image suggests that the men are gathered to inspect, repair, or operate the machinery or equipment. The presence of tools and the focused attention of the men imply that they are engaged in a task that requires careful attention and expertise. The rural setting and the style of clothing worn by the men suggest that the image may have been taken in the early 20th century, possibly during the 1920s or 1930s.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image shows a group of people gathered around a well, possibly engaged in a community event or activity. The black-and-white photo captures the scene with a sense of nostalgia and simplicity. The people are dressed in hats and long-sleeved shirts, which suggests a rural or outdoor setting. The well appears to be an old-fashioned one, with a large wooden wheel used for drawing water. The man in the center of the image is holding the wheel and appears to be explaining something to the group, while another man stands nearby with a notebook, possibly taking notes or recording information. The overall atmosphere of the image is one of community and shared knowledge, with the people gathered together to learn and participate in a common activity.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of men gathered around a large object. The men are wearing hats and appear to be engaged in some sort of activity. The man in the center of the image is wearing a hat and holding a piece of paper, while the man on the left is wearing a hat and holding a pen. The man on the right is wearing a hat and holding a piece of equipment.

Google Gemini

Created by gemini-2.0-flash on 2025-06-05

Captured in black and white, the image presents a crowd gathered around what appears to be an auction or demonstration of some kind. The majority of the attendees are wearing hats, a mix of fedoras, straw hats, and other styles common in the early to mid-20th century.

In the forefront, the viewers are offered a perspective from behind the crowd, with the focus on the backs of heads and the assortment of hats. The foreground is slightly blurred, which provides depth to the image and directs the eye towards the central activity.

The middle ground features several individuals standing around a dark, box-like object, possibly a piece of machinery or equipment. One man, hat atilt, is holding what might be a handle or lever, suggesting he is operating or demonstrating the object. Another man, holding a notepad, appears to be taking notes, potentially recording details of the demonstration or auction.

The background is somewhat indistinct, with a building or structure featuring horizontal siding visible. The overall composition of the photograph evokes a sense of community and a connection to a historical period, possibly rural America during the Depression era. The image is rich in texture, from the woven hats to the fabric of the clothing, and it captures a moment of collective interest and engagement.

Created by gemini-2.0-flash-lite on 2025-06-05

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph that appears to capture a scene from an era past. A group of men, likely in a rural setting, are gathered around what seems to be a piece of machinery or equipment.

Key Details:

  • The People: The photograph features a group of men, all dressed in clothing that is characteristic of the early to mid-20th century. Many are wearing hats. A few have suspenders, and some are holding clipboards or have items like cigars.
  • The Machinery: At the center of the image, there appears to be a piece of equipment or a large, dark structure. One man is actively working on or interacting with it.
  • The Setting: The backdrop suggests a simple exterior, perhaps against the siding of a building. The setting likely is outdoors.
  • Tone: The image has a documentary feel. The lighting and composition suggest a candid snapshot of a moment in time.

Possible Interpretation:

This image could be depicting a scene related to agricultural work, perhaps a farm auction or a gathering around a piece of farm equipment.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a group of men gathered around a large metal pot or kettle, which appears to be suspended over a heat source, possibly for cooking or boiling something. The men are wearing hats, many of which are wide-brimmed, suggesting a rural or agricultural setting. Some of the men are engaged in conversation, while others seem to be observing or participating in the activity involving the pot. The attire and the setting suggest that this scene might be from an earlier time period, possibly the early to mid-20th century. The men are dressed in work clothes, indicating they might be laborers or farmers. The background includes a wooden structure, which could be a barn or a similar building. The overall atmosphere appears to be one of communal effort or a shared task.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a group of people gathered around a large metal tank or barrel, which appears to be a part of a public demonstration or event. The individuals are dressed in attire that suggests a mid-20th-century setting, with many wearing straw hats and casual clothing. Some are standing, while others are seated, and they seem to be focused on the tank. One person, in particular, is holding a clipboard and appears to be observing or recording information, possibly as part of an inspection or experiment. The setting appears to be outdoors, possibly in a rural or industrial area, given the presence of wooden structures and a simple structure in the background. The overall atmosphere suggests an event of public interest or importance.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white historical photograph depicts a group of people gathered around a well. The well is a large, circular structure with a metal frame and a crank mechanism. The individuals, mostly men, are wearing hats and casual clothing typical of the early to mid-20th century. One man is actively operating the crank, presumably to draw water from the well. The crowd appears to be observing the process, with some individuals taking notes or discussing the activity. The setting suggests a rural or small-town environment, possibly during a demonstration or a community event. The image captures a moment of collective interest and activity centered around the well.