Human Generated Data

Title

Untitled (Wissahickon Races: photographs of horses, riders and spectators)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12101

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Wissahickon Races: photographs of horses, riders and spectators)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12101

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 97.2
Human 97.2
Person 95.4
Person 95
Collage 94.3
Advertisement 94.3
Person 92.6
Person 86
Poster 84.2
Horse 82.8
Animal 82.8
Mammal 82.8
Horse 79.5
Text 76.3
Person 74
Person 67.1
Person 63.9
Flyer 55.8
Paper 55.8
Brochure 55.8

Clarifai
created on 2023-10-26

people 99.6
adult 98.2
group 96.7
monochrome 96
man 94.8
print 94.2
art 93.6
paper 93.5
illustration 93.3
woman 92
one 90.6
wear 89.6
leader 88.7
many 87.3
painting 84.8
administration 83.2
commerce 82.4
war 81.6
two 80.8
veil 80.4

Imagga
created on 2022-01-22

newspaper 45
sketch 44.7
drawing 44.1
product 35.8
currency 30.5
creation 29.5
money 28.9
representation 28.2
paper 26.7
dollar 25
business 23.7
grunge 21.3
bank 21.2
finance 20.3
cash 20.1
art 19.9
hundred 18.4
bill 18.1
wealth 17.9
dollars 16.4
pattern 16.4
sign 15.8
design 15.8
vintage 15.7
banking 15.6
decorative 15
financial 14.2
loan 13.4
frame 13.4
texture 13.2
daily 12.8
symbol 12.1
savings 12.1
rich 12.1
economy 12
comic book 11.9
book jacket 11.8
franklin 11.8
exchange 11.5
decoration 10.9
us 10.6
closeup 10.1
bills 9.7
close 9.7
finances 9.6
text 9.6
pay 9.6
card 9.5
floral 9.4
jacket 9.2
investment 9.2
global 9.1
backdrop 9.1
old 9.1
retro 9
style 8.9
greenback 8.9
black 8.4
modern 8.4
number 8.4
element 8.3
border 8.1
dirty 8.1
collection 8.1
holiday 7.9
president 7.9
map 7.8
wages 7.8
artistic 7.8
price 7.7
grungy 7.6
antique 7.5
many 7.4
banner 7.3
graphic 7.3
history 7.2
market 7.1

Google
created on 2022-01-22

Art 83.6
Font 75.9
Wood 67.8
Visual arts 67.5
Room 67.2
Painting 64.8
Paper 64.8
Monochrome photography 64.6
Monochrome 64
Pattern 64
Illustration 63.4
History 63.1
Publication 60.6
Paper product 58.1
Collection 56.4
Fiction 50.1

Microsoft
created on 2022-01-22

text 99.6
cartoon 96.1
drawing 90.2
book 89.1
poster 87.3
person 79.6
sketch 75.3
posing 67.7
clothing 53.1
store 51.8
old 44.3
bunch 42.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 45-53
Gender Male, 78.6%
Calm 98.8%
Sad 0.7%
Confused 0.2%
Happy 0.1%
Angry 0%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 29-39
Gender Female, 96.9%
Calm 95.7%
Angry 1.5%
Sad 0.8%
Fear 0.6%
Surprised 0.5%
Disgusted 0.4%
Happy 0.3%
Confused 0.3%

Feature analysis

Amazon

Person
Poster
Horse
Person 97.2%
Person 95.4%
Person 95%
Person 92.6%
Person 86%
Person 74%
Person 67.1%
Person 63.9%
Poster 84.2%
Horse 82.8%
Horse 79.5%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-05

a photograph of a poster of a man in a hat and a woman in a dress -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

This is a collage of photographs organized on a board with handwritten labels and inscriptions. The images appear to document an equestrian or outdoor social event with notable individuals and horses prominently featured. The photographs are black and white, and the details are labeled with names and contextual notes.

Here is a breakdown of what the collage includes:

  1. Top left photo: A man in formal attire wearing a hat, labeled "Andrew Papple (Left)."
  2. Top middle photo: An individual riding a horse, labeled with "Clifford Promfield" and "Francis Brooke."
  3. Top right photo: Another person riding a horse, labeled "Morris Dixons Keeps Cool."
  4. Middle left photo: A group of people conversing, with small handwritten captions mentioning "Mr. & Mrs. Stanley Reeve," "Mrs. Hunter Lucas (Above)," and others.
  5. Middle right photo: A man with white hair and a hat interacts with someone off-camera, noted as "Self Remained."
  6. Bottom left photo: A woman dressed stylishly looks at papers, surrounded by others, with a label identifying individuals like "Frances Thrupp" and "Mrs. Wart Thane, Dr. Sumner Cross."
  7. Bottom middle photo: A horse jumping a fence in an action shot.
  8. Bottom right photo: A person appears to be falling or landing awkwardly following horseback riding, labeled "Too Tough To Stay Down."

The layout suggests a mix of casual and formal moments captured during the event, illustrating participants, interactions, and key highlights involving horses and their riders.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image is a collage of several black and white photographs, likely related to a horse-related event or gathering. It appears to be a negative image, where the colors are inverted, giving an unusual appearance with light backgrounds and dark figures. Here's a breakdown of the visible elements in the collage:

  1. Top Left Image: Features a man in a suit and a hat, standing and possibly chatting or observing something out of frame.

  2. Horizontal Image Beside the Top Left: Shows a person riding a horse, with several onlookers in the background. Text above this photo reads: "The Wi" followed by "LEFT: CLIFFORD PROMOTED BELOW FRANCIS BROOKE".

  3. Top Right Image: A person is on horseback, wearing a coat and hat, looking very formal, possibly during a riding event or presentation.

  4. Middle Left Image: Features a group of people standing closely, engaged in conversation. The text under this photo reads: "ANDREW PATERS (LEFT)".

  5. Middle Right Image: Shows a man seeming to enjoy a drink or possibly food, caption with the text: "RT: MORRIS DIXON'S KEEPS COOL".

  6. Lower Left Image: Features a woman holding a small book or pamphlet, with a hat and a light-colored dress, accompanied by other formally dressed individuals. The text next to this image reads: "MR. ALES & STANLEY REEVE MRS. HUNTER LUCAS (ABOVE)".

  7. Middle Image of Horse: Shows a horse behind a wooden fence, possibly resting or not engaging in active riding. The text reads: "BELOW: SELF REPRIMANED."

  8. Bottom Middle Image: A rider is visible behind a fence, as if preparing to jump or finish a jump. The text to the left of this photo reads: "LEFT: PERCIVAL THOMAS MRS. MARIAN THAW DR. SUMMER CROSS".

  9. Bottom Right Image: Another image involving horses, with a rider in a relaxed or resting posture. The caption reads: "RT--TO TOWN TO STAY DOWN".

The collection of images seems to capture a formal equestrian event, including notable or recognizable individuals, their clothing is indicative of a kind of upper-class style typical for such events.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a collage or collection of black and white photographs. It contains several different scenes and images, including:

  • A man in a suit and hat, likely an older gentleman
  • A person riding a horse, with the text "Clifford Bowfield" and "Francis Broke" below
  • Another person riding a horse, with the text "The Wt" and "Reg. Morris" below
  • Several other images of people, some in formal attire and others in more casual clothing
  • Some text captions identifying individuals, such as "Mr. James J. Stanley Reeve" and "Mrs. Hunter Lucas"
  • A landscape or outdoor scene in one of the smaller images

The overall impression is that this collage captures various scenes and individuals, likely from a historical or archival context, though I cannot identify any of the specific people shown.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage photo collage or contact sheet featuring multiple black and white photographs related to equestrian activities and events. The images show various scenes including people on horseback, spectators at what appears to be a horse show or competition, and candid shots of people in formal attire typical of early-to-mid 20th century (including hats and suits). There are handwritten labels and captions beneath some of the photos. One of the photos shows someone riding a horse over what appears to be a jumping obstacle. The overall layout suggests this might be from a photo album or documentation of a specific equestrian event or gathering. The quality and style of the photographs suggest these were taken sometime in the early-to-mid 1900s.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph collage featuring various scenes of people and horses, with handwritten captions.

The collage consists of nine photographs arranged in three rows of three, each with a caption written in white ink. The top row shows a man in a hat and coat, a horse with a rider, and a man in a hat and coat. The middle row features a man in a hat and coat, a man in a hat and coat holding a horse, and a man in a hat and coat. The bottom row includes a man and woman in hats and coats, a horse, and a man in a hat and coat.

The captions are written in white ink and include names such as "Andrew Porter," "Mrs. J. Stanley Reeve," and "Mrs. Hunter Lucas/Reeve." Some captions also include descriptive phrases like "Left - Clifford Brumfield Below Francis Brooke" and "Below - Self Exposed."

The background of the collage is a light gray color, with a darker gray border around the edges. The overall effect is one of nostalgia and simplicity, with the black-and-white photographs and handwritten captions evoking a sense of a bygone era.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white collage of photographs, featuring various scenes and individuals. The top-left corner showcases a man wearing a hat and coat, while the top-right section displays a horse with the caption "The Wi" and additional text that is difficult to decipher.

The middle-left portion of the image features a group of people, including a woman in a dress and a man in a suit, all wearing hats. In contrast, the middle-right section depicts a man sitting on a horse, accompanied by illegible text.

The bottom-left corner of the image presents a couple, with the woman dressed in a long coat and hat, and the man wearing a suit and hat. The bottom-right section features a person standing in front of a fence, with a horse visible in the background.

Throughout the image, there are several lines of handwritten text, although they are not easily readable due to their small size and faintness. Overall, the image appears to be a collection of photographs from an event or gathering, possibly related to horses or equestrian activities.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image is a black-and-white collage of photographs with handwritten text and annotations. The collage is divided into multiple sections, each containing a photograph with text describing the individuals or events depicted. The photographs are of people, horses, and other subjects, and the text provides context or identification for the images. The handwritten text is in a cursive style and appears to be a combination of names, descriptions, and possibly references to specific events or locations. The overall composition of the collage is a mix of different sizes and orientations of photographs, creating a dynamic and visually interesting arrangement.

Created by amazon.nova-pro-v1:0 on 2025-06-09

The image is a black-and-white collage of several photographs and handwritten text. The collage is arranged in a grid-like pattern with multiple sections, each containing a photograph and some text.

The top left section shows a man wearing a hat and a suit, holding a stick, and standing in front of a crowd. The text above him reads "LEFT- CLIFFORD PROMPTED BELOW FRANCES BROOKE."

The top right section features a man riding a horse, with the text "RT- MORRIS DIXONS KEEPS COOL" below him.

The middle left section shows a group of people standing together, with the text "MRS. MRS. J. STANLEY REEVE MRS. HUNTER LUCAS (ABOVE)" above them.

The middle right section displays a man wearing a hat and a woman holding a cup, with the text "LEFT- FORMERS THOMPSON ARE WATT TRUMP DE SUMMER CROSS" above them.

The bottom left section shows a man wearing a hat and a woman wearing a scarf, with the text "RT- Tee TOHN TO STAY DONAN" above them.

The bottom right section shows a man riding a horse, with the text "The W" above him.

Overall, the collage appears to be a collection of photographs and text related to horse racing or equestrian events. The text provides additional information about the people and events depicted in the photographs.

Google Gemini

Created by gemini-2.0-flash on 2025-05-05

The image is a collage of black and white photographs mounted on a dark background. The photographs feature people and horses, seemingly related to equestrian events or activities. Text annotations accompany some of the photographs, identifying individuals and providing brief descriptions.

Here are some key observations:

  • People: Several individuals are featured, some identified by name (e.g., "MR. EARS, J. STANLEY REEVE," "ANDREW PORTER," "CLIFFORD BROMFIED," "FRANCIS BROOKE"). The people are dressed in attire appropriate for the time period, including hats, suits, and dresses.
  • Horses: Horses are prominent in many of the photographs, either being ridden or standing near fences. The horses and riders seem to be participating in some kind of equestrian event or competition.
  • Text: The handwritten text annotations add context to the photographs. For example, one annotation reads "RT-MORRIS DIXONS KEEPS Cool BELOW:-SELF EXPLAINED." Other annotations identify individuals and provide brief descriptions.
  • Composition: The photographs are arranged in a collage-like manner, with some overlapping. The arrangement doesn't seem to follow a strict grid, suggesting a more informal or artistic approach.

Overall, the image appears to be a collection of photographs documenting an event or activity related to horses and people, possibly a competition or gathering. The annotations provide additional information and context, making it a kind of visual record.

Created by gemini-2.0-flash-lite on 2025-05-05

This is a collage of images, seemingly from an event involving horses and possibly a horse show or equestrian competition. It is a collection of various photographs or photo negatives, possibly from an archive or personal album.
Here are some of the specific details:

  • Layout: The images are arranged on a dark background, possibly a page or mounting board.
  • Subjects: The images depict people in attire that suggests a formal event, including riders in riding gear, spectators, and people in suits and hats. The prominent presence of horses, fences, and outdoor settings further suggests this.
  • Inscriptions: There are handwritten captions or labels beside some of the photographs, identifying people (e.g., "Mr. & Mrs. J. Stanley Reeve," "Andrew Porter," "Clifford Bromfield," "Morris Dixons") and sometimes giving context or commentary (e.g., "Cool," "Self Explained").
  • Technique: It looks like the photos are in negative, the shades have been inverted (white as black and vice versa).
  • Composition: The collage appears to aim at documenting various aspects of the event, from riders and their horses to social interactions among the attendees.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

This image appears to be a collage of photographs from an equestrian event or a horse show. The collage is labeled "The Wi" and includes several annotated photographs of individuals, some on horseback and others in formal attire. Here is a detailed description of the different sections:

  1. Top Left: A man in a suit and hat is labeled "Andrew Faulk."
  2. Top Center: A photograph of a horse jumping over a fence with two riders on it. The annotation reads "Left - Clifford Drumfield, Below - Francis Brooks."
  3. Top Right: A woman in riding attire on a horse, labeled "Mrs. Morris Thorns Keeps Cool."
  4. Middle Left: A group of people, including two women and a man, with the annotation "Mrs. J. Stanley Reeve, Mrs. Hunter Lucas, etc."
  5. Middle Center: A horse jumping over a fence with the annotation "Below - Self Explanatory."
  6. Middle Right: A man in a hat and coat, labeled "Self Explanatory."
  7. Bottom Left: A group of people, including a woman in a hat and coat, with the annotation "Left - Florence Thorn, Above Left - Dudley, Right - J. Dudley, To Stay Down."
  8. Bottom Center: A horse jumping over a fence with the annotation "Right - Top To Stay Down."

The photographs capture various moments from the event, including participants, spectators, and equestrian activities. The annotations provide names and brief descriptions, adding context to the images. The overall theme suggests a formal equestrian gathering, possibly a competition or exhibition.

Text analysis

Amazon

The
The Wi
Wi
STAY
KEEPS
BROOKE
FRANCIS BROOKE
ANDREW
ANDREW PORTER
PORTER
LEFT
HUNTER
FRANCIS
DIXONS KEEPS
MRS.
STANLEY
REEVE
TOUGH
DIXONS
To STAY DOWN
DOWN
WIRT
ARS.
MRS. HUNTER LUCAS(ABive)
To
ARS. WIRT THANP
MR.MMS. 3 STANLEY REEVE
3
BELow
Cool
LEFT:-CLIFFORD
FURNESS
BELOW:-SELF
RT:-To TOUGH
CRISS
RT:-MORRIS
BELOW:-SELF EXPLAINED
LEFT:-CLIFFORD BRUMFILO
THANP
EXPLAINED
EILE
FURNESS THOMPSAN
BRUMFILO
VEEF EILE
LUCAS(ABive)
DK.SUMNER
THOMPSAN
RT:-To
VEEF
MR.MMS.

Google

The W LEFT:- CLIFFORD BROMFIED BROOKE ELOW FRANCIS ANDREW PORTER LEFT RT:- MORRIS DIXONS KEEPS BELOW:-SE EXPIAIND MR.MRS. STAN LE REFVE MRS. HUNTER LUeASARaVE LEFT FURMES Tlaps ARS. WIRT RT:-To To AH To STAY DoWN
The
W
LEFT:-
CLIFFORD
BROMFIED
BROOKE
ELOW
FRANCIS
ANDREW
PORTER
LEFT
RT:-
MORRIS
DIXONS
KEEPS
BELOW:-SE
EXPIAIND
MR.MRS.
STAN
LE
REFVE
MRS.
HUNTER
LUeASARaVE
FURMES
Tlaps
ARS.
WIRT
RT:-To
To
AH
STAY
DoWN