Human Generated Data

Title

Untitled (Joe Steinmetz holding rattle snake)

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5470

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Joe Steinmetz holding rattle snake)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5470

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.5
Face 91.2
Outdoors 87.6
Grass 86.6
Plant 86.6
Clothing 85.7
Apparel 85.7
Furniture 82.3
Play 76.8
Musical Instrument 74.5
Leisure Activities 74.5
Nature 70.2
Text 69.7
Female 66.8
Portrait 64.8
Photography 64.8
Photo 64.8
Suit 64
Coat 64
Overcoat 64
Shorts 62.5
Kid 60.8
Child 60.8
Girl 60.5
Bed 58.8
Wood 57.4
Housing 57.4
Building 57.4
Brick 57.1

Clarifai
created on 2023-10-26

people 99.7
fence 98.7
adult 97.2
monochrome 93.5
lid 93.1
child 92.7
woman 92.2
man 89.6
two 89.3
wear 88.1
nostalgia 85.9
group together 85.5
one 83.3
vintage 82.7
vertical 81.1
war 78.6
outdoors 77.7
cavalry 75.7
group 75.4
family 75.3

Imagga
created on 2022-01-23

newspaper 72
product 55.2
creation 43.9
people 19.5
statue 17.8
old 16.7
portrait 15.5
daily 14.5
person 14.5
outdoors 13.4
male 12.8
marble 12.6
sculpture 12.4
art 12.4
face 12.1
sport 11.6
man 11.5
cemetery 10.9
history 10.7
park 10.7
human 10.5
outdoor 9.9
adult 9.7
film 9.7
model 9.3
street 9.2
city 9.1
cricket equipment 9
one 9
stone 8.9
sports equipment 8.9
death 8.7
architecture 8.6
grunge 8.5
negative 8.4
black 8.4
pretty 8.4
sky 8.3
fashion 8.3
dress 8.1
lady 8.1
religion 8.1
memorial 8
women 7.9
equipment 7.9
ancient 7.8
men 7.7
culture 7.7
structure 7.6
happy 7.5
fun 7.5
traditional 7.5
vintage 7.4
symbol 7.4
light 7.3
design 7.3
clothing 7.3
decoration 7.2
lifestyle 7.2
active 7.2
grass 7.1
summer 7.1
day 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

outdoor 98.9
text 97
standing 87.8
statue 71.2
posing 57.9
black and white 55.7

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 40-48
Gender Male, 94.8%
Confused 60.3%
Surprised 10.5%
Fear 9.3%
Sad 7.1%
Disgusted 3.9%
Angry 3.8%
Calm 3.8%
Happy 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Guitar

Clarifai

No features identified

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 96%

AWS Rekognition

Person 87.5%

AWS Rekognition

Person 73.9%

AWS Rekognition

Person 70.1%

AWS Rekognition

Person 54.7%

AWS Rekognition

Guitar 74.5%

Categories

Imagga
created on 2022-01-23

paintings art 99.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a man in a cowboy hat and a cowgirl

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This is a black-and-white inverted (negative) image showing a person standing outdoors in front of a wooden fence with a snake in their hands. Behind the individual, there appears to be a raised platform with several individuals sitting or standing on it, observing the scene. The setting looks rural, featuring grass and wooden structures. The sky is darkened due to the negative effect of the image. The text "STEINMETZ SARASOTA, FLORIDA" appears on the left side.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a black and white negative photograph showing a person holding a large snake. The background includes a wooden fence structure, possibly an enclosure or pen, with several people perched above the fence, observing or posing. The setting appears to be outdoors, indicated by grass underfoot and the presence of a tree on the left side of the image. Text along the edge of the photograph reads "STEINMETZ, SARASOTA, FLORIDA" with a numeric code underneath. The overall tone of the image suggests it was taken in a sunny outdoor environment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image appears to be a black and white photograph of a person standing in front of a wooden structure, possibly a fence or a gate. There are several figures visible in the background, seated or standing on what looks like a raised platform or structure. The person in the foreground is wearing casual clothing, including pants and a jacket, and is facing the camera. The background has a rural or outdoor setting, with some trees or vegetation visible. The overall scene has a somewhat vintage or historical feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph that appears to be from an earlier era. In the image, there's a wooden bleacher or stadium seating structure. Several people can be seen sitting in the upper level of the bleachers, while one person stands at ground level wearing what appears to be casual attire including pants and a jacket. The setting looks to be outdoors, with some foliage or trees visible in the background. The image has the characteristic grainy quality typical of vintage photographs.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of a man in a costume, standing in front of a wooden fence with a group of people on top of it.

  • The man is wearing a costume that includes a feathered headdress, a vest with a large brooch, and a sash around his waist. He is holding a small object in his right hand.
  • Behind the man is a wooden fence made of horizontal slats. On top of the fence are five people, all of whom appear to be women. They are all wearing similar costumes to the man, including feathered headdresses and vests with brooches.
  • The background of the image shows a grassy area with trees in the distance. The sky is dark and cloudy, suggesting that the photo was taken on a stormy day.
  • The overall atmosphere of the image is one of excitement and energy. The man and the women on the fence appear to be enjoying themselves, and the costumes they are wearing suggest that they may be participating in some kind of performance or ceremony.

The image appears to be a vintage photograph, possibly from the early 20th century. It has been scanned and digitized, and the original photo has been marked with handwritten notes and numbers in the margins. The image has also been edited to remove any blemishes or imperfections, giving it a clean and professional appearance.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of a man standing in front of a wooden fence, holding a snake. The man is wearing a dark shirt and pants, and has a belt around his waist. He is holding the snake up in the air with both hands, and it appears to be wrapped around his arms.

Behind the man, there are several people sitting on top of the fence, watching him. They are all wearing light-colored clothing and appear to be interested in what the man is doing.

In the background, there is a tree visible on the left side of the image, and the sky above is dark. The overall atmosphere of the image suggests that the man is performing some kind of demonstration or show with the snake, and the people behind him are spectators.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a black-and-white photograph with a watermark on the left side. The photograph depicts a woman standing in front of a wooden fence. She is holding a snake in both hands, and it appears to be a boa constrictor. The woman is wearing a hat and a belt. Behind her, there is a wooden structure with a few people sitting on it. The image has a vintage look, and it appears to be from the early 20th century.

Created by amazon.nova-pro-v1:0 on 2025-05-27

A black-and-white photo shows a woman standing on the grassy ground in front of a fence. She is holding a snake in her hands. Behind her is a wooden fence with a gate. On top of the gate are five people standing and looking at something. Behind them is a tree, and on the right is a blurry view of a building. There is a watermark on the left that reads "STEINMETZ, SARASOTA, FLORIDA."

Google Gemini

Created by gemini-2.0-flash on 2025-04-30

Here is a description of the image:

The image appears to be a black and white photograph or a scan of a photographic negative. There is a man standing in the foreground. He is holding a snake and wearing what appears to be a uniform or shirt with a cord or lanyard around his neck.

Behind the man, there is a wooden fence or corral gate. On top of the fence, a group of people are watching, possibly observing whatever the man is doing.

The background shows a tree and a dark sky, possibly indicating the time of day or weather conditions.

To the side of the image, there is some text that reads "STEINMETZ, SARASOTA, FLORIDA" along with some numbers that could be a date or reference number.

The image seems to be taken outdoors on a grassy area. There are elements like the wooden fence and the snake that suggest a rural or agricultural setting.

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

The image is a black and white negative photograph. It features a person holding what appears to be a snake or reptile, with a group of people watching from behind a fence.

Foreground:

  • A person in the foreground is the main focus. They are wearing dark pants and a shirt, with a collar. They are holding a snake-like creature.

Midground:

  • A wooden fence or gate is in the midground.

Background:

  • Behind the fence, there is a group of people looking over it.
  • The sky is dark.

Additional Details:

  • The photograph seems to be taken outdoors.
  • The image is a negative, which means that the colors are inverted.
  • There is text "STEINMETZ, SARASOTA, FLORIDA 26125" on the side of the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The black-and-white photograph depicts a scene that appears to be a carnival or fairground attraction. In the foreground, a person is standing and holding a rifle, seemingly participating in a shooting game. The individual is wearing a dark shirt and pants, and their stance suggests they are aiming at targets.

Behind the person, there is a wooden structure with several human-like figures mounted on it. These figures are dressed in various outfits and appear to be targets for the shooting game. The setting includes a wooden fence and some trees, indicating an outdoor environment.

The photograph has a vintage appearance, and the date "2-6-51" is printed on the left side, suggesting it was taken on February 6, 1951. The location mentioned is "Steinmetz, Sarasota, Florida." The image captures a moment of leisure and entertainment from that era.

Qwen

No captions written

Text analysis

Amazon

SARASOTA,
STEINMETZ, SARASOTA, FLORIDA
FLORIDA
STEINMETZ,
e
S
S 2198
2198
9
,
6
A
J
®
F

Google

STEINMETZ, SARASOTA, FLORIDA
STEINMETZ,
SARASOTA,
FLORIDA