Human Generated Data

Title

Untitled (county fair, central Ohio)

Date

August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.433

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (county fair, central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.433

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Adult 98.7
Male 98.7
Man 98.7
Person 98.7
Person 97.3
Person 94
Person 93.7
Transportation 92.6
Vehicle 92.6
Wagon 92.6
Person 91.1
Person 90
Person 88.7
Person 87.6
Animal 83.8
Horse 83.8
Mammal 83.8
Person 82.9
Person 81.5
Person 81.5
Person 80.9
Person 80.2
Person 76.7
Person 74.1
Person 71.5
Person 69.8
Horse Cart 69.4
Person 68
Person 66.2
Person 65.6
Person 64.1
Person 61.4
Person 60.2
Clothing 60.1
Footwear 60.1
Shoe 60.1
Person 59.1
Person 58
Person 56.4
Andalusian Horse 55.5
Bull 55.5
Person 55.4
Carriage 55.3

Clarifai
created on 2018-05-11

people 100
group together 99.6
many 99.1
man 96.1
adult 94.6
group 94
crowd 93.2
spectator 91.5
administration 85.3
street 83.6
recreation 81.7
cavalry 80.2
military 77.4
leader 76.1
wear 74.4
uniform 73.7
woman 73.1
several 71.2
two 68.9
outfit 68.1

Imagga
created on 2023-10-05

carriage 48.4
horse 47.2
harness 41.6
support 32.1
device 23.6
vaulting horse 23.1
sport 21.1
horse cart 19.7
animal 19.7
sports equipment 19.1
man 16.8
polo mallet 16.6
horses 16.6
cart 16.1
outdoors 14.2
gymnastic apparatus 13.9
people 13.4
mallet 13.3
male 12.8
wagon 12.7
transportation 12.5
urban 12.2
outdoor 12.2
street 11
adult 11
city 10.8
equipment 10.6
person 10.2
competition 10.1
wheeled vehicle 9.9
farm 9.8
stick 9.8
portrait 9.7
vehicle 8.9
destruction 8.8
bench 8.8
building 8.7
grass 8.7
day 8.6
outside 8.6
black 8.4
old 8.4
dark 8.3
danger 8.2
couple 7.8
ranch 7.8
youth 7.7
park 7.4
speed 7.3
seat 7.3
protection 7.3
architecture 7

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.2
road 96.7
people 56.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 14-22
Gender Male, 65.1%
Calm 66.6%
Fear 10.3%
Happy 7.9%
Surprised 7%
Confused 6.2%
Sad 4.3%
Angry 2.5%
Disgusted 1.2%

AWS Rekognition

Age 14-22
Gender Female, 55.3%
Calm 78.9%
Surprised 18.2%
Fear 6.2%
Sad 2.7%
Angry 1.9%
Happy 1.4%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 9-17
Gender Female, 68.1%
Fear 97.2%
Surprised 6.5%
Sad 2.5%
Calm 2.4%
Happy 0.9%
Confused 0.6%
Angry 0.4%
Disgusted 0.3%

AWS Rekognition

Age 9-17
Gender Female, 83.1%
Calm 48.3%
Surprised 22.4%
Fear 19.2%
Confused 9.6%
Sad 3%
Angry 1.4%
Disgusted 1%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 92.3%
Disgusted 59.2%
Confused 13.1%
Sad 12.9%
Fear 10%
Surprised 7%
Calm 1.8%
Happy 1.5%
Angry 0.9%

AWS Rekognition

Age 4-12
Gender Female, 51.3%
Fear 98.1%
Surprised 6.3%
Sad 2.1%
Calm 0%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 31-41
Gender Male, 94.8%
Surprised 25.8%
Happy 21.1%
Disgusted 18.9%
Confused 16%
Calm 13.9%
Fear 7.6%
Angry 3.5%
Sad 3.4%

AWS Rekognition

Age 2-8
Gender Male, 99.9%
Calm 82.6%
Fear 6.9%
Happy 6.8%
Surprised 6.6%
Sad 3.5%
Angry 1.4%
Disgusted 1.3%
Confused 1.1%

AWS Rekognition

Age 7-17
Gender Male, 94.6%
Sad 99.6%
Fear 15.9%
Confused 8.1%
Surprised 6.6%
Happy 3.6%
Calm 3.2%
Angry 1%
Disgusted 0.7%

AWS Rekognition

Age 12-20
Gender Female, 89.3%
Calm 89.5%
Surprised 7.7%
Fear 6.1%
Sad 3%
Angry 2.1%
Disgusted 2%
Confused 0.4%
Happy 0.4%

AWS Rekognition

Age 16-22
Gender Male, 98.4%
Calm 34%
Confused 14%
Happy 13.5%
Disgusted 11.6%
Surprised 10.4%
Sad 8.6%
Fear 7.4%
Angry 6.4%

AWS Rekognition

Age 4-10
Gender Female, 96.2%
Happy 38.1%
Calm 30.1%
Angry 11.8%
Sad 10.3%
Surprised 7.5%
Fear 7%
Disgusted 2.3%
Confused 1%

AWS Rekognition

Age 24-34
Gender Female, 98.8%
Happy 35.6%
Calm 22.1%
Fear 20.5%
Angry 10.8%
Surprised 7.5%
Sad 3.9%
Confused 1.9%
Disgusted 1.8%

AWS Rekognition

Age 14-22
Gender Male, 99.3%
Calm 90.5%
Fear 9.4%
Surprised 6.3%
Sad 2.2%
Angry 0.7%
Happy 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Male, 97.3%
Calm 83.7%
Fear 7.8%
Surprised 6.7%
Angry 4.9%
Sad 2.6%
Confused 1.7%
Happy 1.6%
Disgusted 1.1%

AWS Rekognition

Age 9-17
Gender Female, 64.4%
Happy 42.2%
Sad 24%
Disgusted 15.8%
Calm 13%
Fear 8.1%
Surprised 6.9%
Angry 2.5%
Confused 1.4%

AWS Rekognition

Age 6-16
Gender Female, 93.9%
Happy 40%
Surprised 24.7%
Fear 22%
Calm 7.6%
Angry 4.4%
Disgusted 3.6%
Sad 3.1%
Confused 0.8%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 89%
Sad 6.9%
Surprised 6.4%
Fear 6%
Angry 1%
Confused 0.5%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 14-22
Gender Female, 86.8%
Confused 38.4%
Sad 28.5%
Calm 19.5%
Disgusted 8.2%
Surprised 7.5%
Angry 7.3%
Fear 6.8%
Happy 1.9%

AWS Rekognition

Age 4-12
Gender Female, 91.8%
Fear 95.8%
Surprised 6.7%
Calm 5%
Sad 3.5%
Angry 1%
Confused 0.8%
Happy 0.5%
Disgusted 0.3%

AWS Rekognition

Age 10-18
Gender Male, 87.7%
Happy 49%
Sad 22.9%
Calm 14.2%
Fear 10.3%
Surprised 7.2%
Angry 4.8%
Disgusted 1.6%
Confused 1.3%

AWS Rekognition

Age 16-22
Gender Male, 99%
Calm 51.7%
Sad 22.6%
Angry 18.3%
Fear 7.4%
Surprised 6.6%
Disgusted 3.1%
Happy 2.8%
Confused 1.4%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Fear 97.2%
Surprised 6.3%
Calm 4.5%
Sad 2.2%
Confused 0.3%
Angry 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Female, 82%
Calm 88.1%
Surprised 6.6%
Fear 6%
Sad 4.3%
Angry 2%
Happy 1.6%
Disgusted 1.5%
Confused 0.6%

AWS Rekognition

Age 29-39
Gender Female, 75.4%
Happy 74.2%
Calm 17.1%
Fear 6.5%
Surprised 6.4%
Sad 3.9%
Disgusted 1.8%
Angry 0.4%
Confused 0.2%

Feature analysis

Amazon

Adult
Male
Man
Person
Horse
Shoe
Adult 98.7%
Male 98.7%
Man 98.7%
Person 98.7%
Person 97.3%
Person 94%
Person 93.7%
Person 91.1%
Person 90%
Person 88.7%
Person 87.6%
Person 82.9%
Person 81.5%
Person 81.5%
Person 80.9%
Person 80.2%
Person 76.7%
Person 74.1%
Person 71.5%
Person 69.8%
Person 68%
Person 66.2%
Person 65.6%
Person 64.1%
Person 61.4%
Person 60.2%
Person 59.1%
Person 58%
Person 56.4%
Person 55.4%
Horse 83.8%
Shoe 60.1%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a suit and tie dye dye dye dye dye dye dye dye dye -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts a black-and-white scene at an outdoor event, likely a horse pulling competition. In the foreground, a pair of horses are harnessed to equipment ready to pull a heavy load of stacked cinder blocks. Two men appear to be preparing or guiding the horses for the task. One is standing nearby, while the other seems to be adjusting or steadying the horses.

In the background, a lively crowd is seated on wooden bleachers, watching the event unfold. More spectators are gathered along a fence to the right. The setting is shaded by tall trees, suggesting the event is taking place in a park or rural outdoor environment. Overall, the scene captures a mix of effort and community engagement in rural festivities.

Created by gpt-4o-2024-08-06 on 2025-06-10

This black and white image captures a historical scene at an outdoor event where a crowd of spectators is watching a horse-pulling competition. The setting is likely a fairground or competition space, surrounded by trees, providing a natural backdrop.

In the center of the image, two large draft horses, harnessed together, are being guided by several men. The horses appear to be pulling a sled laden with large concrete blocks or similar heavy materials, which is the focus of the competition. The handlers are holding onto the harness and guiding the horses forward, encouraging them to pull the heavy load.

The left side of the image shows a wooden stand filled with people, who are seated and standing, intently watching the event. The audience is composed of men, women, and children, dressed in the attire typical of a rural or small-town gathering from the mid-20th century. Some individuals are wearing hats, and the overall mood suggests a sense of anticipation and community interest in the event.

This image captures a moment from a bygone era, showcasing a traditional rural activity that highlights the strength of horses and the skill of their handlers, while also illustrating a communal gathering where people came together to enjoy and participate in local events.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to depict a crowded outdoor event or gathering, possibly a parade or festival. In the foreground, there is a horse-drawn carriage or wagon being pulled by a team of horses. The carriage is surrounded by a large crowd of people, many of whom appear to be seated on benches or stands. The background shows a wooded, natural setting with trees and foliage. The overall scene suggests a lively, community-based event taking place in an outdoor, rural or small-town setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white historical photograph showing what appears to be a horse-pulling competition or demonstration. In the image, a horse in harness is being guided by handlers on what looks like a dirt ground or arena. There are wooden bleachers filled with spectators watching the event. In the foreground, there appear to be some blocks or weights, suggesting this might be a demonstration of the horse's pulling strength. The setting appears to be outdoors with trees visible in the background. The style and quality of the photograph suggests it was taken sometime in the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a horse-drawn cart being pulled by a team of horses, with a crowd of people watching from the stands.

Key Features:

  • The horse-drawn cart is being pulled by a team of horses.
  • A crowd of people is watching from the stands.
  • The image appears to be an old photograph, likely taken in the early 20th century.

Context:

  • The image suggests that the event is a horse-drawn cart race or competition.
  • The crowd is seated in the stands, watching the event unfold.
  • The image provides a glimpse into a bygone era, when horse-drawn carts were a common mode of transportation.

Overall:

  • The image captures a moment in time, showcasing a unique event and the people who participated in it.
  • The photograph serves as a historical record, providing insight into the past and the way people lived and entertained themselves.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image is a black-and-white photograph of a horse pulling a load, with a crowd of people watching in the background. The horse is white with dark spots and is wearing a harness. It is pulling a load of what appears to be bricks or blocks on a wooden platform. A man is walking alongside the horse, guiding it.

In the background, there is a crowd of people sitting on bleachers or standing along the side of the road. They are all facing the horse and appear to be watching some kind of event or competition. The atmosphere seems to be one of excitement and anticipation, as if the crowd is waiting for something to happen.

Overall, the image suggests that the horse is participating in some kind of competition or demonstration, possibly a horse show or a test of strength. The crowd's attention and the horse's focused expression suggest that this is an important event, and the horse is being carefully guided and controlled by the man walking alongside it.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph depicting a scene from an outdoor event, likely a fair or a competition. In the foreground, two men are guiding a horse-drawn cart, which is loaded with several bricks. The man on the left is holding the reins of the horse, while the man on the right is guiding the cart. The cart is moving along a dirt path, and there are piles of bricks on the left side of the path.

In the background, there is a large crowd of people gathered around a fenced area, possibly to watch the event. Some of the spectators are sitting on the ground, while others are standing and watching the cart being pulled. The spectators are dressed in a variety of clothing, including hats, shoes, and dresses.

The event appears to be taking place in a natural setting, with trees and greenery visible in the background. The image has a nostalgic and historical feel, suggesting that it may have been taken several decades ago. Overall, the image captures a moment of human effort and teamwork, as the two men work together to guide the cart and its load of bricks.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black-and-white photo depicts a horse-pulling event with a crowd of people watching. The horses are pulling a cart with a man standing in front of it. The man is holding the rope attached to the horses, guiding them. On the left side, there are people sitting on the ground and others standing behind them. Some of them are wearing hats. Behind them are trees and a fence.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression: The image captures a scene from what appears to be a competition or demonstration, likely from the early to mid-20th century, featuring a horse-drawn cart pulling a load. The setting suggests an outdoor event with spectators present.

Key Elements:

  • Horse and Cart: The focal point is a horse, likely a draft breed, harnessed to a cart. The cart is presumably pulling a heavy load, possibly stone blocks.
  • People:
    • A group of people are seated, in rows.
    • Several men are positioned near the horse and cart.
    • The attire of the people suggests an earlier era, possibly the early to mid-20th century.
  • Setting: The event is held outdoors, with a dirt or gravel surface. In the background, there's a structure, possibly a grandstand, filled with spectators. Trees and possibly a fence add to the outdoor ambiance.

Activity: The scene seems to depict a competition, with the horse and cart pulling a heavy load while being observed by a crowd. The men may be participants in the event.

Created by gemini-2.0-flash on 2025-05-04

Captured in grayscale, the image depicts a horse-pulling contest, likely a community event. In the foreground, a man in a simple shirt and pants with a hat guides a harnessed horse. The horse is pulling a load, evidenced by the visible harness.

To the left, a substantial stack of bricks or similar heavy blocks sits on a wooden platform. The shadow cast indicates a day with relatively bright sunshine.

A crowd watches from elevated seating, a tiered structure that appears to be temporary. Many spectators are sitting on the bleachers, observing the event. The audience extends beyond the seating, with people standing behind a wooden fence or barrier.

The background features a grove of trees, adding a natural backdrop to the event. This suggests the contest is held outdoors, possibly in a park or a rural setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a horse-pulling competition, which appears to be taking place at a fair or an outdoor event. In the foreground, a team of two horses is harnessed to a weighted sled or cart. The horses are being guided by a handler who is walking alongside them, likely encouraging them to pull the weight.

The background shows a large crowd of spectators seated on bleachers, watching the event intently. The audience is diverse, with people of various ages, and many appear to be dressed in casual attire suitable for an outdoor event. Some spectators are standing, and there is a sense of excitement and engagement among the crowd.

The setting is outdoors, with trees visible in the background, suggesting a rural or semi-rural location. The ground is dirt, which is typical for such events to provide traction for the horses. The overall atmosphere is lively and communal, indicative of a traditional or agricultural fair.