Human Generated Data

Title

Untitled (central Ohio)

Date

July 1938-August 1938

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.583

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (central Ohio)

People

Artist: Ben Shahn, American 1898 - 1969

Date

July 1938-August 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.583

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Andalusian Horse 97.6
Animal 97.6
Mammal 97.6
People 96.7
Outdoors 95.9
Nature 88.5
Countryside 66.7
Farm 57.1
Ranch 57.1
Rural 57.1
Colt Horse 57.1
Field 57
Plant 57
Tree 57
Grass 55.8

Clarifai
created on 2018-05-11

people 99.8
cavalry 99.5
group together 96.7
adult 96.5
mammal 95.3
group 91.9
man 90.5
seated 90.2
one 89.4
two 88
many 84.3
three 81.7
transportation system 81.4
seat 78.6
child 78.3
wagon 76.4
vehicle 74.8
chair 73.7
war 73.3
military 73.3

Imagga
created on 2023-10-06

swing 100
mechanical device 100
plaything 100
mechanism 100
sky 19.1
outdoors 17.9
outdoor 17.6
play 16.4
grass 15.8
summer 15.4
fun 15
man 14.1
tree 13.8
vacation 13.1
male 12.8
playground 12.8
sport 12.4
park 12.4
recreation 11.7
trees 11.6
people 11.2
field 10.9
game 10.7
travel 10.6
day 10.2
beach 10.1
leisure 10
adult 9.7
sun 9.7
sand 9.6
sea 9.4
resort area 9
active 9
slide 8.8
water 8.7
outside 8.6
old 8.4
ocean 8.3
playing 8.2
landscape 8.2
sunset 8.1
activity 8.1
area 7.9
cloud 7.8
industry 7.7
person 7.7
children 7.3
danger 7.3
exercise 7.3
childhood 7.2
mountain 7.1
kid 7.1

Google
created on 2018-05-11

Microsoft
created on 2018-05-11

outdoor 99.9
tree 99.5
old 65.7
playground 33.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-33
Gender Male, 88.2%
Sad 64.2%
Fear 50.4%
Calm 16.8%
Surprised 9.1%
Disgusted 2.5%
Confused 1.5%
Happy 1.1%
Angry 1.1%

Feature analysis

Amazon

Person
Adult
Male
Man
Horse

Clarifai

Horse
Tree
Clothing
Person
Window
Human face
Plant

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 97.7%

AWS Rekognition

Adult 99.1%

AWS Rekognition

Male 99.1%

AWS Rekognition

Man 99.1%

AWS Rekognition

Horse 96.9%

Clarifai

Horse 96.6%

Clarifai

Tree 86%

Clarifai

Tree 53.7%

Clarifai

Tree 49.6%

Clarifai

Tree 38.4%

Clarifai

Tree 37.8%

Clarifai

Tree 33.4%

Clarifai

Clothing 59.7%

Clarifai

Person 55.5%

Clarifai

Person 53.6%

Clarifai

Window 38.3%

Clarifai

Human face 36.1%

Clarifai

Plant 33.6%

Categories

Imagga
created on 2023-10-06

paintings art 57.9%
streetview architecture 25.9%
nature landscape 8.3%
beaches seaside 4.7%
pets animals 2.8%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-06

a photograph of a man riding a horse in a field

Created by general-english-image-caption-blip-2 on 2025-07-07

a black and white photo of two men on horses

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This black-and-white photograph captures an outdoor scene in a rural setting. In the foreground, a man riding a horse is passing under a simple wooden arch or frame structure, which appears to be part of an activity or training setup. The rider is holding a long pole or lance, suggesting the possibility of a riding or equestrian exercise. Standing next to the horse is a man wearing a hat and suspenders; he seems to be observing or assisting the process. Behind them is a grassy area with several trees, and in the background, a house with a porch can be seen, lending a pastoral atmosphere to the image. On the left edge of the photo, part of a third person's figure is visible but cropped out.

Created by gpt-4o-2024-08-06 on 2025-06-12

The black and white image depicts a scene set outdoors in a grassy area with trees and a house in the background. In the foreground, a man is riding a horse and passing under a wooden arch structure. The horse is moving forward as the man, dressed in casual attire, holds a pole or staff in his hand. To the right of the horse, another man is standing, watching and holding something in his own hands, dressed in slightly more formal attire with a hat. The men appear to be engaged in a rural activity or game, and the atmosphere suggests a leisurely or practice session. On the left margin of the photo, part of another individual or object can be seen, indicating the presence of other people or equipment outside the frame.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a black and white photograph of a man riding a horse through a rural setting. The man is wearing a white shirt and appears to be holding reins to guide the horse. There is a wooden frame structure in the foreground, which appears to be some kind of swing or platform for the horse and rider. In the background, there are trees and what looks like a house or other building. The scene has a rustic, historical feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This appears to be a historical black and white photograph showing several individuals gathered around what looks like a wooden frame structure or apparatus in an outdoor setting. In the background, there's a house with a porch visible. The frame structure appears to be made of white-painted wood with angled supports. There are also horses visible in the image, and the people are dressed in what appears to be late 19th or early 20th century clothing. The setting appears to be a grassy yard or field area.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man riding a horse through an obstacle course, with another man standing nearby.

  • The man on the horse is wearing a light-colored shirt and dark pants. He is holding a long stick or pole in his right hand, which he is using to guide the horse through the course.
  • The horse is dark-colored and appears to be a thoroughbred or quarter horse breed. It is running at a moderate pace, with its head down and ears forward.
  • The obstacle course consists of a series of wooden posts and beams that form a rectangular shape. The posts are spaced about 10 feet apart, and the beams are angled to create a challenging path for the horse to follow.
  • The man standing next to the horse is wearing a light-colored shirt and dark pants. He is watching the horse as it runs through the course, and he appears to be giving instructions or guidance to the rider.
  • In the background, there are trees and a house visible. The trees are tall and leafy, and they provide shade for the obstacle course. The house is a two-story building with a porch and a balcony. It appears to be a residential home, possibly the residence of the man standing next to the horse.

Overall, the image suggests that the man on the horse is participating in some kind of equestrian event or competition, such as a horse show or a rodeo. The obstacle course is designed to test the horse's agility and obedience, as well as the rider's skill and control.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a man riding a horse through an archway, with another man standing to the right. The rider is dressed in a white shirt and dark pants, holding a long stick or pole in his right hand. The horse is dark-colored and appears to be walking through the archway.

To the right of the archway stands another man, wearing a light-colored shirt and dark pants, with a hat on his head. He has his hands clasped together in front of him. In the background, there are trees and a house visible, suggesting a rural or countryside setting.

The overall atmosphere of the image suggests a sense of activity or training, possibly related to horse riding or equestrian sports. The presence of the archway and the rider's use of the stick or pole may indicate that this is a training exercise or obstacle course.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph depicting a scene from the past. In the center, a man is riding a horse, holding a spear or lance in his right hand. He is wearing a hat and appears to be participating in a sport or activity involving horses. Behind him, another man stands, dressed in a hat and a tie, possibly observing or assisting. The horse is positioned between two makeshift obstacles, resembling a structure made of wooden planks. The background features trees and a house in the distance, suggesting a rural or outdoor setting.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white photo shows a man riding a horse and holding a spear. The man is wearing a hat, a shirt, and boots. He is about to hit a target, which is a piece of wood, with a spear. On the right side, there is another man wearing a hat, a shirt, and pants. He is holding a stick. Behind them, there are trees and a house.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

Here is a description of the image:

This black and white photograph features a man on horseback holding a long spear, riding beneath a wooden A-frame structure. The rider, dressed in what appears to be a light-colored shirt, dark pants, and a cap, is positioned centrally in the frame. He is leaning forward, with the spear pointed towards the left.

The horse is dark-colored and appears to be mid-stride, moving from right to left. In the foreground, to the right of the horse and structure, stands another man wearing a hat, suspenders, and a light-colored shirt with rolled-up sleeves. He is looking in the direction of the horse and rider.

The wooden A-frame structure is painted white and consists of two A-shaped frames connected by a horizontal beam at the top. To the left of the frame, only the torso of a man in a suit and tie is visible.

In the background, there's a grassy field with trees scattered around, and a two-story house is partially visible on the right. The house has a porch and several windows. The overall scene appears to be taking place outdoors on a grassy field.

Created by gemini-2.0-flash-lite on 2025-05-07

Here's a description of the image:

Overall Impression: The photograph is a black and white shot of a man on horseback, presumably engaged in a sport or training exercise. There's a structure that looks like a gate.

Specific Elements:

  • The Rider: A man dressed in light clothing is riding a horse. He holds a long stick.
  • The Horse: The horse is dark, and appears to be walking.
  • The Structure: A wooden gate-like structure is set up.
  • Other person: A man is standing on the ground nearby, possibly an assistant.
  • Background: The background shows a grassy field, trees, and a two-story house.

Possible Context: This image may depict a sport or training involving riding, where the rider is aiming for a target. The setting suggests a rural location.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a historical scene involving three individuals and a horse. The setting appears to be outdoors, in a grassy area with trees and a house visible in the background.

In the foreground, there is a wooden structure resembling a frame or gallows. A man is mounted on a horse positioned under this structure. The man on the horse is wearing a white shirt and dark pants, and he is holding a long pole horizontally across his shoulders.

To the right of the horse, another man is standing, dressed in a light-colored shirt, dark pants, and a hat. He appears to be observing or assisting in the scene.

On the left side of the image, partially out of frame, a third individual is visible. This person is wearing dark clothing and a hat, and seems to be looking towards the central scene.

The overall atmosphere of the image suggests a historical reenactment or a staged scene, possibly related to a significant event or practice from the past. The presence of the wooden structure and the manner in which the individuals are positioned and dressed contribute to this impression.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image depicts an outdoor scene where a person is mounted on a horse and appears to be using a pole or long stick to interact with a large wooden structure that looks like a makeshift framework or scaffolding. The structure is supported by four tall wooden posts and is positioned in a grassy area. There is a person standing on the ground to the right side of the structure and another person partially visible on the left side of the image. In the background, there is a house with a porch and trees, suggesting a rural or suburban setting. The overall scene has a vintage feel, indicated by the black-and-white photograph and the style of clothing worn by the individuals.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph depicts a rural scene with a horse and rider practicing jumping through a wooden obstacle. The obstacle appears to be a small frame structure, likely used for horse training exercises. The rider is seated on the horse, holding the reins, and appears focused on navigating the obstacle. On the right side of the image, a man is standing next to the obstacle, possibly observing or assisting with the training. In the background, there is a house with a porch, surrounded by trees and a grassy area. The overall setting suggests a farm or countryside environment.