Human Generated Data

Title

Untitled (man in pith helmet holding small snake)

Date

1947

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7330

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man in pith helmet holding small snake)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1947

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7330

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.7
Apparel 99.7
Human 99.5
Face 93.3
Boy 89
Outdoors 82.4
Pants 81.9
Portrait 74.1
Photography 74.1
Photo 74.1
Animal 73.3
Coat 71.2
Grass 70.8
Plant 70.8
Vegetation 70.6
Jeans 62.7
Denim 62.7
Smile 61.8
Cap 61.5
Tree 61.1
Nature 60.9
Invertebrate 60.1
Kid 60
Child 60
Furniture 57.7
Glasses 57.5
Accessories 57.5
Accessory 57.5
Jacket 56.8
Finger 55.3

Clarifai
created on 2023-10-26

people 99.7
lid 99.6
monochrome 99.1
man 98
adult 95.8
fedora 94.2
veil 94
nostalgia 93.5
bowler 92.5
portrait 92.5
one 88.3
retro 85.4
cigar 85.3
vertical 85
administration 83.2
vintage 82.2
facial expression 82.1
humor 80.8
wear 78.2
cap 77.3

Imagga
created on 2022-01-15

man 28.2
person 27
male 23.5
sax 21.5
portrait 21.3
model 17.9
people 17.8
seller 16.2
adult 16.2
sexy 16.1
fashion 15.8
human 15.7
hat 15
happy 13.8
lifestyle 13.7
face 13.5
attractive 13.3
black 13.2
men 12.9
musical instrument 12.8
wet 12.5
smile 12.1
banjo 11.2
pretty 11.2
hair 11.1
shower 10.8
hand 10.6
one 10.4
body 10.4
worker 10.3
stringed instrument 10.2
emotion 10.1
water 10
wind instrument 9.9
helmet 9.7
guy 9.5
professional 9.3
glasses 9.3
holding 9.1
lady 8.9
job 8.8
building 8.7
hands 8.7
work 8.6
happiness 8.6
industry 8.5
business 8.5
safety 8.3
care 8.2
alone 8.2
handsome 8
women 7.9
washing 7.8
expression 7.7
newspaper 7.7
health 7.6
skin 7.6
bath 7.6
relaxation 7.5
clean 7.5
slim 7.4
occupation 7.3
playing 7.3
girls 7.3
device 7.3
industrial 7.3
gorgeous 7.2
looking 7.2
posing 7.1
love 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99
outdoor 98.2
hat 95.7
fashion accessory 94.3
black and white 90.9
person 89.9
human face 85.3
clothing 84.9
man 72.9
smile 69.5
cowboy hat 61.6
sun hat 53.9
fedora 51.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 91.5%
Happy 94.8%
Calm 3.1%
Sad 0.5%
Fear 0.4%
Surprised 0.4%
Confused 0.3%
Angry 0.3%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat
Person

Clarifai

Human face
Man
Tree
Hat
Human nose
Human hand
Human mouth
Human eye

AWS Rekognition

Hat 99.7%

AWS Rekognition

Person 99.5%

Clarifai

Human face 96.7%

Clarifai

Man 92%

Clarifai

Tree 82%

Clarifai

Tree 38.5%

Clarifai

Hat 47.2%

Clarifai

Human nose 45.3%

Clarifai

Human hand 43%

Clarifai

Human mouth 37.7%

Clarifai

Human eye 33.8%

Categories

Imagga
created on 2022-01-15

paintings art 100%

Captions

Microsoft
created by unknown on 2022-01-15

a person posing for the camera 92.5%
an old photo of a person 85.4%
a person posing for a photo 84.2%

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

person, a man with a beard and mustache.

Salesforce

Created by general-english-image-caption-blip on 2025-05-21

a photograph of a man in a hat and a hat on a lawn

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image depicts an individual wearing a wide-brimmed hat and a collared short-sleeve shirt, holding a snake with patterned markings. The background appears to be an outdoor setting with grass, trees, and structures, possibly in a yard or garden. The visible text on the side reads, "J.J. Steinmetz, Siesta Key, Sarasota, Fla." The photograph itself is shown in negative format.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image shows a person wearing a dark short-sleeved button-up shirt and a pith helmet. The person is standing outdoors, holding a snake with their hands. The snake has a distinct banded pattern that alternates between light and dark bands. The background appears to be a yard with grass, and some trees or shrubs are visible. On the right edge of the image, there is text that reads "J.J. Steinmetz, Siesta Key, Sarasota, Fla." along with a number "23445" written vertically.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows a man wearing a hat and shirt, standing outdoors in a natural setting with trees and foliage in the background. The man appears to be holding some kind of measuring device or tool in his hands. The image is in black and white, giving it a vintage or historical feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white photograph showing someone wearing a hat and button-up shirt, holding what appears to be a snake or similar reptile. The person is standing outdoors on a lawn with some foliage visible in the background. They are smiling at the camera while displaying the creature they're holding. The image has a vintage quality to it, and there appears to be some text or notation visible on the right edge of the photo.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a man holding a snake.

The man is wearing a pith helmet and a dark-colored shirt with rolled-up sleeves. He is holding a snake in his hands, which appears to be a small species of snake. The snake has a patterned skin and is coiled around the man's fingers. The man is looking at the snake with a smile on his face.

In the background, there are trees and a building that appears to be a house or a structure of some kind. The overall atmosphere of the image suggests that the man is in a natural setting, possibly outdoors, and is interacting with the snake in a friendly manner.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a man holding a snake. The man is wearing a wide-brimmed hat, a dark button-up shirt, and dark pants with a belt. He is standing in a grassy area, possibly a park or backyard, with trees and other vegetation visible in the background. The man is holding the snake in both hands, with its body coiled around his arms. The snake appears to be a venomous species, possibly a coral snake or a cottonmouth.

The overall atmosphere of the image suggests that the man is handling the snake with care and caution, possibly for educational or scientific purposes. The image may have been taken by a wildlife expert or a photographer who specializes in capturing images of reptiles and amphibians.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a man standing in an outdoor setting, possibly a backyard. He is wearing a hat, a polo shirt, and a belt. He is holding a long, thin object, possibly a fishing lure, in his hand. The man is smiling and looking directly at the camera. The background shows a grassy area with a tree and a house. The image has a watermark with the text "J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA." on the right side.

Created by amazon.nova-pro-v1:0 on 2025-06-08

A black-and-white photograph features a man standing on a grassy area. He is wearing a hat, a polo shirt, and a belt. He is holding a snake in his right hand, and he seems to be smiling. Behind him is a blurry view of a house with a tree in front. The photograph has a watermark with the text "J.J. Steinmetz, Siesta Key, Sarasota, FL" on the right side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

Overall:

The image is a black and white negative of a man holding a snake. The scene appears to be outdoors, likely in a yard or natural setting. The man is smiling and appears to be posing for the camera.

The Man:

  • He is wearing a hat with a wide brim and a dark shirt with a collar and pockets.
  • He also appears to be wearing dark pants and a belt.
  • He has an expression on his face that looks like he is enjoying himself.

The Snake:

  • The snake is held in the man's hands, which are cupped to cradle it.
  • The snake appears to be a patterned species, possibly a banded or ringed snake.
  • The snake is relatively thin and does not appear to be particularly large.

Background:

  • Behind the man, there's a glimpse of a house, trees, and greenery.
  • The background is slightly out of focus, suggesting the focus is on the man and the snake.

Other Details:

  • There is text in the top right corner of the image that states J. J. Steinmetz, Siesta Key, Sarasota, Fla. and 23445.
  • The image is a negative, meaning light and dark colors are inverted.

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image appears to be an older photograph in a negative format. It depicts a man standing outside, holding a snake. He is wearing a hat that resembles a pith helmet or a similar safari-style hat. The man has on a short-sleeved shirt with a pocket, and he is wearing a belt. He is smiling at the camera.

In his hands, he holds a snake that has a pattern of alternating bands of black and white or light colors. The snake appears to be docile and is draped in a loop.

The background shows an outdoor setting with greenery, possibly a yard or garden. There's a building visible in the background as well.

There's some text on the right side of the image which seems to include the name "J. J. Steinmetz, Siesta Key, Sarasota, Fla." and a number, possibly a reference or identifier for the photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph of a man standing outdoors. He is wearing a wide-brimmed hat and a long-sleeved shirt with rolled-up sleeves. The man is holding up a chain or necklace in his hands, displaying it to the camera. He appears to be smiling, suggesting that he is proud or pleased with the item he is showing. The background shows a residential area with trees and houses, indicating that the photo was likely taken in a suburban setting. The photograph has a vintage feel, possibly from the mid-20th century. The text on the right side of the image reads "J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA," which likely refers to the photographer and the location where the photo was taken.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph of a man outdoors, holding a snake in his hands. The man is wearing a hat, a short-sleeved shirt, and pants, and appears to be in a grassy area with trees and a fence in the background. The snake he is holding is white with darker markings. The man looks surprised or concerned as he holds the snake. There is text at the bottom of the image that includes a name and location, suggesting it may be a historical photograph or part of a collection. The overall tone of the image is somewhat humorous or dramatic, given the man's expression and the snake in his hands.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph features a man standing outdoors, holding a snake with a distinctive pattern of dark and light rings. He is wearing a short-sleeved button-up shirt, a belt, and a wide-brimmed hat. The man appears to be smiling or speaking, and his expression suggests he is comfortable with the snake. The background includes trees and some buildings, indicating a rural or semi-rural setting. The image has a vintage quality, possibly from the mid-20th century, and there is a caption in the bottom right corner that reads "J.J. Steinmetz, Siesta Key, Sarasota, FLA." The image number "23445" is also visible.

Text analysis

Amazon

SIESTA
KEY,
SARASOTA,
23445.
J.J.
J.J. STEINMETZ, SIESTA KEY, SARASOTA, FLA.
STEINMETZ,
FLA.

Google

J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA:
J.
STEINMETZ,
SIESTA
KEY,
SARASOTA,
FLA: