Human Generated Data

Title

Untitled (men holding tail of shark on dock)

Date

1957

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10413

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men holding tail of shark on dock)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1957

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10413

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.8
Water 96.6
Wood 96.1
Waterfront 95
Pier 92.5
Dock 92.5
Port 92.5
Mammal 88.2
Animal 88.2
Canine 88.2
Pet 88.2
Clothing 85.9
Apparel 85.9
Footwear 74.7
Hardwood 72.1
Building 68.5
Flooring 67.4
Plywood 65.2
Floor 62.9
Boardwalk 62.5
Bridge 62.5
Pants 60.8
Shorts 59.8
Sleeve 59
Housing 59
Back 56

Clarifai
created on 2023-10-26

people 99.6
two 98
one 97.6
adult 97.3
man 96.6
group 94.5
group together 94
three 91.6
woman 90.9
vehicle 88.6
actor 87.8
transportation system 84.7
wear 83.9
recreation 83.6
watercraft 82.9
four 78.7
dig 77.1
monochrome 75.4
child 75.3
indoors 74.4

Imagga
created on 2022-01-09

man 34.9
device 29
male 25.5
laptop 20.2
lifestyle 19.5
people 19
technology 17.8
equipment 17.8
worker 17.8
building 17.4
work 17.3
person 17.1
industry 17.1
business 17
construction 16.2
job 15.9
working 15.9
industrial 14.5
machine 14.3
computer 13.1
adult 12.9
men 12.9
businessman 12.4
professional 11.8
handsome 11.6
engineer 11.3
happy 11.3
office 11.2
outdoors 11.2
steel 10.9
smiling 10.8
labor 10.7
day 10.2
communication 10.1
water 10
full length 9.7
support 9.5
sitting 9.4
happiness 9.4
casual 9.3
safety 9.2
house 9.2
fitness 9
iron 8.4
keyboard 8.4
site 8.4
occupation 8.2
vacation 8.2
active 8.1
builder 8
to 8
leisure activity 7.8
couple 7.8
portrait 7.8
travel 7.7
corporate 7.7
treadmill 7.7
chair 7.7
vacations 7.5
senior 7.5
cheerful 7.3
relaxing 7.3
exercise 7.3
black 7.2
holiday 7.2
sea 7
exercise device 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 90.3
clothing 85.8
standing 83.3
black and white 78.9
ship 52.6
posing 43.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 100%
Sad 57.7%
Calm 34.2%
Confused 5.9%
Surprised 0.6%
Happy 0.5%
Disgusted 0.5%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Happy 64.3%
Surprised 11.6%
Confused 9.8%
Calm 6.3%
Sad 3.9%
Angry 1.9%
Disgusted 1.7%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Dog
Shoe

Clarifai

No features identified

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 66.1%

AWS Rekognition

Dog 88.2%

AWS Rekognition

Shoe 74.7%

AWS Rekognition

Shoe 54.5%

Categories

Imagga
created on 2022-01-09

streetview architecture 98.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man standing on a wooden deck with a fish net

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This black-and-white image shows two individuals standing on a wooden dock or pier next to a large, captured shark lying on the ground. The shark appears to have substantial size, with its fin and body prominently displayed. The individuals are holding or gesturing toward the shark's features, such as its fin. The setting includes wooden beams and a workbench, suggesting a fishing or maritime environment. The negative film strips and markings indicate that the image is a photographic negative.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image is a black-and-white negative depicting two individuals standing on a wooden deck with a large fish laid out on the floor between them. The fish appears to be a shark, featuring a prominent dorsal fin and a streamlined body. The individuals seem to be holding the shark's fin in a display. In the background, part of the deck structure is visible, as well as a table or workbench to the right. The scene suggests it might have been taken at a fishing dock or a similar marine setting. The number "42573" is handwritten on the border of the image, and the words "KODAK - SAFETY - FILM" are visible at the top.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows two people, a man and a woman, standing on a wooden platform or deck. The man is holding a large wooden object, possibly a piece of lumber or a tool. The woman is wearing a cap and appears to be examining something on the deck. In the foreground, there is a large animal, possibly a bear or other large predator, lying on the deck. The overall scene suggests some kind of outdoor work or activity, possibly related to construction or carpentry.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph showing two people standing next to what appears to be a large caught fish lying on a wooden floor. The fish looks like it could be a shark or other large marine predator. The two individuals are dressed in casual work clothes, with one wearing a light-colored jacket and cap. The setting appears to be indoors, with wooden floorboards visible and some structural posts or pillars in the background. The image has a vintage quality to it, suggesting it was taken some time ago.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of two men standing on a dock, holding a large fish. The man on the left has short white hair and is wearing a dark jacket and pants. He is standing with his hands in his pockets, looking at the camera. The man on the right is wearing a white jacket, a plaid shirt, and a black hat. He is holding the fish by the tail, which is lying on the dock in front of him.

The fish appears to be a shark, possibly a great white shark, based on its size and shape. It has a long, pointed snout and a large dorsal fin on its back. The fish is lying on its side, with its mouth open and its gills visible.

In the background, there is a wooden dock with a railing and a few other objects, such as a chair and a table. The sky is bright and overexposed, making it difficult to see any details. The overall atmosphere of the image suggests that the men have just caught the fish and are posing for a photo to commemorate the occasion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of two men standing on a wooden dock, proudly displaying a large shark they have caught. The man on the left wears a dark jacket and pants, while the man on the right sports a white jacket, plaid shirt, and a captain's hat. Between them lies the impressive shark, its body stretching across the dock.

In the background, a wooden table and a few poles are visible, suggesting a rustic fishing setting. The overall atmosphere of the image exudes a sense of accomplishment and camaraderie between the two men, who appear to be celebrating their successful catch.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of two men standing on a wooden deck, holding a large fish. The fish appears to be a swordfish, with a long, pointed nose and a sleek, streamlined body. The men are dressed in casual clothing, with one wearing a hat and the other wearing a jacket. The image has a slightly blurry quality, possibly due to the age of the photograph. In the background, there is a wooden structure with a bench and a faucet.

Created by amazon.nova-pro-v1:0 on 2025-06-08

In a black-and-white photo, two men are standing on a wooden deck, probably posing for a photo. One of them is holding the tail of a big fish that is lying on the deck. The other man is wearing a hat and a jacket, and he is holding the fish's head. Behind them, there is a wooden bench with a book on top, and a person is standing behind them.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here's a description of the image:

This is a black and white negative image showing two men posing with a large fish, likely a tuna or shark, on what appears to be the deck of a boat.

On the left, a man with short, light-colored hair and a jacket is holding a large, slender fish. To his right, another man is wearing a nautical cap, a button-up shirt underneath a light-colored coat. He is standing next to the larger fish on the deck.

The deck is made of wooden planks and there's a long wooden table or bench to the right of the men. A faucet and some sort of vertical support structure are visible behind the table. The fish is lying on the deck, and it appears to be quite large.

The image is a negative, so the colors are inverted. There's also some text visible along the top edge, which is characteristic of old photographic film. A number "42573" is written on the right edge of the image.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Scene:

The image is a black and white photograph, likely from the mid-20th century, depicting two men standing next to a large shark on a wooden deck. The photograph has a vintage feel, with the look of a developed negative.

The Men:

  • Two men are the primary subjects.
  • The man on the left is wearing a jacket and casual pants.
  • The man on the right has a sailor's cap, a double-breasted coat over a plaid shirt, and slacks.
  • The man on the right is holding the dorsal fin of the shark.

The Shark:

  • The shark dominates the foreground.
  • It appears to be a fairly large specimen.
  • It is laying on the wooden deck.
  • There is a small amount of blood around the shark.

Setting:

  • The setting appears to be a boat or dock.
  • The deck is made of wooden planks.
  • There are hints of other structures like benches, beams, and what might be a water spigot, suggesting this is a working or recreational area.

Additional details

  • the image includes the Kodak safety film markings.
  • The image is numbered with the code 42573.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black-and-white photograph showing two men standing on a wooden dock next to a large fish, which appears to be a swordfish, hanging from a hook. The fish is suspended by its bill, and its size is quite impressive, almost as tall as the men standing beside it.

The man on the left is wearing a jacket and pants, and he has a serious expression on his face. The man on the right is wearing a light-colored jacket over a plaid shirt, a cap, and light-colored pants. He is holding the fish by its tail and has a more relaxed demeanor, with a slight smile.

The background includes parts of the dock structure, with wooden planks and support beams visible. The setting appears to be a marina or a fishing port. The photograph seems to be taken during the day, as indicated by the bright lighting and shadows. The image captures a moment of pride and accomplishment, likely after a successful fishing expedition.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black-and-white photograph showing two individuals on a wooden dock, holding a large fish that appears to be a shark. The shark is lying on the dock, with its body partially submerged in water. The person on the left is holding the shark's tail, while the person on the right is holding its head. The person on the right is wearing a light-colored jacket and a headband, while the person on the left is wearing a dark jacket and pants. The background includes wooden structures and what appears to be a body of water. The photograph has a Kodak safety film caption and a number in the corner, suggesting it may be from a historical collection.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white image shows two men standing on a wooden deck, holding a large shark that is lying flat on the deck. The shark appears to be dead, and its body is partially out of the water, with its head and tail touching the deck. The men are dressed in casual clothing, with one wearing a cap. The background includes wooden structures, possibly part of a dock or a boat. The image has a vintage feel, suggesting it may be from an earlier time period. The text "KODAK SAFETY-FILM" and a number "43573" are visible on the image, indicating it was taken with Kodak film.

Text analysis

Amazon

ELSTH
MJ17--YT37A- -A

Google

KODVK--2.LEL
KODVK--2.LEL