Human Generated Data

Title

Untitled (two men standing next to a girl on a pony)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10490

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men standing next to a girl on a pony)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10490

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.7
Mammal 99.1
Animal 99.1
Clothing 93.1
Apparel 93.1
Female 60.6

Clarifai
created on 2023-10-25

people 99.8
cavalry 98.9
group 98.4
monochrome 98.2
man 97.8
group together 97.7
adult 93.3
many 92.8
woman 91.3
seated 90.3
transportation system 90.2
mammal 90.2
child 88.4
street 85.9
several 85.8
police 85.2
wear 83.1
crowd 80.4
administration 80.1
recreation 79.8

Imagga
created on 2022-01-09

people 25.1
man 24.8
adult 23.7
person 22.2
male 17
women 15.8
city 15.8
men 15.4
urban 14.8
clothing 14.5
black 14
horse 13.8
umbrella 13.6
human 13.5
business 13.4
portrait 11.6
two 11
world 10.9
life 10.8
mask 10.7
couple 10.4
activity 9.8
horses 9.7
active 9.7
crowd 9.6
standing 9.6
walking 9.5
happiness 9.4
lifestyle 9.4
model 9.3
face 9.2
street 9.2
outdoor 9.2
hand 9.1
animal 9.1
attractive 9.1
holding 9.1
nurse 9
group 8.9
suit 8.6
smile 8.5
travel 8.4
leisure 8.3
fashion 8.3
device 8.2
pose 8.1
sexy 8
businessman 7.9
work 7.8
hat 7.5
rain 7.5
photographer 7.5
occupation 7.3
protection 7.3
industrial 7.3
equipment 7.2
transportation 7.2
love 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 99.5
horse 97.3
man 96.7
outdoor 95.6
animal 91
standing 88
text 86.2
clothing 58.4
black and white 53.5
posing 43.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 59.4%
Calm 51.3%
Sad 40%
Surprised 2.7%
Confused 2.2%
Happy 1.4%
Disgusted 0.9%
Fear 0.7%
Angry 0.7%

AWS Rekognition

Age 25-35
Gender Male, 71.4%
Calm 49.8%
Happy 43.9%
Surprised 2.1%
Sad 1.4%
Angry 1.2%
Disgusted 0.7%
Confused 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Horse
Hat

Clarifai

Man
Clothing
Land vehicle
Human face
Horse
Footwear

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.1%

AWS Rekognition

Horse 99.1%

AWS Rekognition

Hat 81%

AWS Rekognition

Hat 69.5%

Clarifai

Man 88.5%

Clarifai

Man 86%

Clarifai

Man 72.1%

Clarifai

Man 69.9%

Clarifai

Man 36.1%

Clarifai

Clothing 68.1%

Clarifai

Land vehicle 67.7%

Clarifai

Human face 62.2%

Clarifai

Human face 49.9%

Clarifai

Human face 43.2%

Clarifai

Human face 40.3%

Clarifai

Human face 35.9%

Clarifai

Horse 56.2%

Clarifai

Footwear 33.2%

Categories

Imagga
created on 2022-01-09

paintings art 88.3%
streetview architecture 7%
people portraits 2.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

photograph of a horse and rider.

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man in a cowboy hat is giving a thumbs up

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image features a person seated on a horse, wearing a hat and western-style clothing, including a button-up shirt and scarf. The horse has a distinctive dark-and-light coat pattern and is equipped with a saddle. There are two individuals standing nearby, one dressed in a western-style outfit, and the other wearing a uniform with buttons and a tie, possibly resembling formal or ceremonial attire. In the background, a covered wagon and other individuals seem to be part of the setting, suggesting a historical or event-themed scene. The image appears to be a photographic negative.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black and white negative photograph. It features a person in western attire seated on a horse in the foreground. The person is wearing a cowboy hat, a long-sleeved shirt, and a scarf around their neck. There are two other individuals standing beside the horse; one of them appears to be wearing a suit and a hat, and they are gesturing towards the person on the horse. In the background, wagons with covered tops are visible, suggesting a setting related to a historical or western theme. There is also another individual situated higher up, partially visible on one of the wagons, wearing white clothing. The ambiance appears to be lively, possibly captured during an event or a show.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to depict a scene from a Western-style show or performance. It shows several people dressed in cowboy attire, including hats and boots, gathered around a horse-drawn wagon or carriage. One person appears to be seated on the horse, while others are standing nearby. The setting suggests an outdoor or rural environment, with a backdrop that appears to be a tent or canvas structure. The overall scene has a vintage or historical feel, conveying the atmosphere of a Western-themed event or entertainment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white historical photograph taken at what looks like a rodeo or western show. Several people in western attire, including cowboy hats, are gathered around a horse. Two men in dark clothing and hats are standing and appear to be in conversation, while another person is mounted on the horse. There's also someone visible in the background, possibly in a wagon or elevated position. The horse appears to be a light-colored breed with distinct markings. The setting suggests this might be backstage or behind-the-scenes at some kind of western performance or show. The image has the grainy quality typical of photographs from an earlier era, possibly mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a man presenting a small horse to another man, while a woman rides the horse. The man on the left is wearing a cowboy hat, dark shirt, and light pants, with a light-colored ribbon tied around his neck. The man on the right is wearing a dark suit and hat, and is holding a small horse in his hands. The woman is wearing a cowboy hat, dark shirt, and light pants, and is sitting on the horse. In the background, there is a sign that reads "Presented by Stock Show" and a man in a white shirt and tie is visible.

The image appears to be a historical photograph, possibly taken in the early 20th century, given the clothing and style of the people in the image. The image may have been taken at a stock show or rodeo event, where the man on the right is presenting the small horse to the man on the left. The woman riding the horse may be a performer or participant in the event. Overall, the image provides a glimpse into a specific moment in time and culture, and highlights the importance of horses in rural communities.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black and white photograph of a man in a cowboy hat and suit, standing beside a horse with a saddle. He is holding out his hand to another man, who is also dressed in a cowboy hat and suit. The man on the horse is wearing a cowboy hat and a shirt with a tie. In the background, there is a wagon with a sign that reads "Stock Show" and another man sitting on it.

The overall atmosphere of the image suggests a scene from a rodeo or a western-themed event, with the men dressed in cowboy attire and the presence of a horse and wagon. The image appears to be a vintage photograph, possibly taken in the early 20th century, given the style of clothing and the black and white tone.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph featuring three men in Western attire. The man on the left is wearing a cowboy hat, a bowtie, and a long-sleeve shirt with a belt. The man in the middle is also wearing a cowboy hat and is holding a gun in his hand. The man on the right is sitting on a horse and is also wearing a cowboy hat. Behind them, there is a wagon with a man sitting inside. The image has a watermark in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white photo shows three men standing in front of a horse. The man in the middle is holding a gun, and the man on the left is holding a rope. The man on the right is standing on the horse and holding the reins. Behind them is a wagon with a man sitting inside. The man in the wagon is holding a piece of paper.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The image appears to be a black and white negative, suggesting it's an older photograph. It captures a scene that seems to be related to a Western or rodeo-themed event. Here's a breakdown:

  • Main Subjects: The central focus is a horse with a saddle, being ridden by a person wearing Western attire (hat, shirt, and pants). Several men in Western hats and clothing stand around the horse. One of the men seems to be handing something to the person on the horse.
  • Background: Behind the horse, there is a covered wagon or similar vehicle, which is a common element in Western settings. A man is visible in the wagon's opening.
  • Setting: The location is likely an outdoor event, potentially a rodeo, exhibition, or historical reenactment.
  • Overall Impression: The photograph evokes a sense of nostalgia for a time when Western themes and traditions were prominent.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The image is a black and white photograph, which appears to be a negative, featuring three people with a horse and a covered wagon in the background. On the left, a man wearing a hat, long-sleeved shirt, and trousers stands with his hands at his sides. He has a tie around his neck that is knotted loosely. Next to him is another man wearing a hat and a suit jacket, trousers, and a tie. This man appears to be handing something to the person sitting on the horse. On the horse is someone wearing a hat, shirt, trousers, and a neck scarf, seemingly dressed as a cowboy. The horse is saddled and bridled. Behind them, there is a covered wagon with a man sitting inside at the front, wearing a suit. A sign is attached to the wagon, which reads "Assembled by" at the top, then a title with the word "STOCK SHOW" in it. The wagon appears to be part of "Mountain Transportation." The overall scene suggests a historical event or a reenactment of the Old West.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black and white photograph featuring four men and a horse. The men are dressed in cowboy attire, including hats, boots, and denim clothing.

  • The man on the left is standing and facing the others, wearing a cowboy hat, a dark shirt, and jeans. He has a scarf around his neck.
  • The man in the center is holding a plaque that reads "Sponsored by the Stock Show" and "Courtesy of Union Transportation." He is also dressed in cowboy attire, including a hat, dark shirt, and jeans.
  • The man on the right is sitting on the horse, wearing a cowboy hat, a dark shirt, and a scarf. He appears to be adjusting or holding the horse's reins.
  • Another man is positioned above the others, possibly standing on a platform or elevated area, wearing a lighter-colored shirt and a cowboy hat.

The horse is saddled and bridled, standing calmly while the men interact. The background appears to be an indoor or tented area, possibly part of a stock show or rodeo event. The overall atmosphere suggests a moment of camaraderie and celebration, likely related to the stock show mentioned on the plaque.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black-and-white photograph depicting a scene that appears to be from a vintage Western or rodeo event. In the foreground, three individuals are present. On the left, a man is standing and smiling, wearing a dark long-sleeve shirt with a white neckerchief, light-colored pants, and a dark hat. In the center, another man is holding a box or container and is also wearing a dark suit with a white shirt, a dark hat, and what seems to be a light-colored neckerchief or scarf. He is interacting with the man on the right, who is wearing a cowboy hat, a light-colored long-sleeve shirt, and a dark vest over light-colored pants. This individual appears to be mounted on a horse, which is wearing a bridle and is standing calmly.

In the background, a covered wagon is partially visible, with a person sitting inside, partially obscured by the wagon's structure. The wagon has large wheels and what appears to be a canvas covering, suggesting it is part of a stage or a decorative setup for the event. The overall atmosphere of the image conveys a sense of historical or nostalgic Americana, likely related to a Western-themed performance or exhibition. The image has a slightly faded or vintage quality, enhancing the historical feel.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white photograph depicts a group of people in a rural or Western setting, likely at a fair or exhibition. In the foreground, there is a horse with a rider, a woman wearing a cowboy hat and jeans. She is holding the reins of the horse and appears to be interacting with a man in a suit who is holding a sign that reads "Stock Show." Another man in a cowboy hat and jeans stands next to them, smiling. In the background, a man is seated in a wagon with large wheels, which is partially covered with a tarp. The overall scene suggests a casual and friendly interaction, possibly during a livestock show or similar event.

Text analysis

Amazon

SHOW
TRANSPORTATION
STERN TRANSPORTATION
STERN
STOCK SHOW
by
STOCK
of
eabled by
eabled
MJ17--YT37--
CCCO

Google

MJI7--YT 3RA°2--AGOX
MJI7--YT
3RA°2--AGOX