Human Generated Data

Title

Untitled (men and women on boat and dock with fish)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8987

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women on boat and dock with fish)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8987

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.8
Transportation 87.1
Vehicle 87.1
Aircraft 87.1
Clothing 77.7
Apparel 77.7
Building 77.1
Waterfront 74.7
Water 74.7
Machine 74.2
Shorts 74.1
Harbor 69.7
Pier 69.7
Dock 69.7
Port 69.7
Military 60.7
Cruiser 57.3
Ship 57.3
Navy 57.3
Biplane 56.3
Sailor Suit 55.8

Clarifai
created on 2023-10-25

people 99.8
vehicle 98.6
group together 98.4
group 97.7
transportation system 96.8
many 95.8
adult 95.5
military 94.9
administration 94.4
man 94
woman 92.4
wear 91.7
war 91.2
several 91
aircraft 90.7
watercraft 89.7
monochrome 89.6
airplane 83.2
three 81.2
leader 77.8

Imagga
created on 2022-01-09

cockpit 39.1
man 24.2
war 21.8
male 21.3
equipment 20.3
vehicle 19.6
military 19.3
uniform 16.6
stage 16.6
industrial 16.3
engine 15.4
work 14.9
weapon 14.6
television camera 14.3
person 14.3
power 14.3
metal 13.7
industry 13.6
mechanical 13.6
factory 13.5
transportation 13.4
machine 13.3
engineer 13.3
steel 13.2
battle 12.7
army 12.7
technology 12.6
protection 11.8
gun 11.8
soldier 11.7
people 11.7
car 11.6
business 11.5
television equipment 11.5
device 11.5
engineering 11.4
platform 11.3
aviator 11.3
adult 11
danger 10.9
tank 10.7
automobile 10.5
transport 10
camouflage 9.8
outdoors 9.7
men 9.4
professional 9.3
training 9.2
occupation 9.2
worker 8.9
warfare 8.9
electronic equipment 8.8
mechanic 8.8
military vehicle 8.6
construction 8.5
wheel 8.5
leisure 8.3
playing 8.2
job 8
manufacturing 7.8
conflict 7.8
color 7.8
clothing 7.8
emergency 7.7
mask 7.7
ship 7.6
safety 7.4
building 7.2
recreation 7.2
history 7.1
game 7.1
to 7.1
working 7.1
sky 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 99.4
person 90.4
ship 85.8
clothing 85.4
black and white 72.7
man 56.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 52.9%
Calm 96.9%
Surprised 1.5%
Confused 0.4%
Sad 0.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Female, 63%
Happy 81%
Sad 8.7%
Calm 2.8%
Surprised 2.1%
Fear 2.1%
Confused 1.6%
Angry 0.9%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helicopter
Airplane

Clarifai

Clothing
Footwear
Vehicle
Human face
Human leg
Human arm
Human head

AWS Rekognition

Person 99.8%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99%

AWS Rekognition

Person 89.9%

AWS Rekognition

Person 86.9%

AWS Rekognition

Person 79.2%

AWS Rekognition

Helicopter 87.1%

AWS Rekognition

Airplane 66.3%

Clarifai

Clothing 93.2%

Clarifai

Clothing 91.1%

Clarifai

Clothing 81.3%

Clarifai

Clothing 78.8%

Clarifai

Clothing 76.3%

Clarifai

Clothing 66.5%

Clarifai

Clothing 34.5%

Clarifai

Footwear 58.7%

Clarifai

Footwear 57.9%

Clarifai

Footwear 56.9%

Clarifai

Footwear 56%

Clarifai

Footwear 54.2%

Clarifai

Footwear 50.5%

Clarifai

Footwear 41.9%

Clarifai

Footwear 35.7%

Clarifai

Footwear 34.3%

Clarifai

Vehicle 57%

Clarifai

Vehicle 35.6%

Clarifai

Human face 51.9%

Clarifai

Human face 51.5%

Clarifai

Human face 40.7%

Clarifai

Human face 39.9%

Clarifai

Human leg 36.5%

Clarifai

Human arm 36%

Clarifai

Human head 34.5%

Categories

Imagga
created on 2022-01-09

streetview architecture 87.2%
beaches seaside 9.9%

Captions

Microsoft
created by unknown on 2022-01-09

a group of people on a boat 39.8%
a group of people standing on a boat 36.9%
a group of people in a boat 36.8%

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

photograph of a group of people in a boat.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing on a dock with a boat

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-23

The response was filtered due to the prompt triggering Azure OpenAI's content management policy. The content filter results follow.

hate: safe
self-harm: safe
sexual: safe
violence: medium

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a bustling scene at what appears to be some kind of outdoor market or fair. There are several people visible, including some who seem to be vendors or shopkeepers, standing behind various stalls or booths. The stalls contain a variety of goods, including what looks like a boat or other large item. The overall atmosphere suggests a lively, crowded environment with people engaged in various activities.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white historical photograph taken aboard what looks like a naval vessel, likely from World War II era given the "HELLCAT" aircraft visible in the background. The image shows several sailors gathered around what appears to be a counter or serving area, possibly in a ship's mess hall or galley. The sailors are wearing casual naval attire typical of the period. The photograph is taken from an elevated angle looking down at the scene. The image has a reference number "42484" visible in the corner, suggesting it's from an official archive or collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a group of people on a dock, with boats in the background.

The group consists of six people, all wearing casual clothing and hats. They are standing on a wooden dock, with some of them holding fishing rods. The person in the center of the image is holding a large fish by the tail, and another person is holding a cup or glass. The background of the image shows several boats docked in the water, with a body of water visible beyond them. The overall atmosphere of the image suggests a relaxed and social gathering, possibly a fishing trip or a casual outing.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a group of people gathered around a boat. The boat is docked at a marina, and the people are standing on the dock or on the boat itself. The boat has a sign that reads "HOT SHOT" in large letters.

In the foreground, there are several people visible. One person is wearing a hat and holding a cup, while another person is sitting on the boat with their legs crossed. There are also several other people standing around the boat, some of whom appear to be engaged in conversation.

In the background, there are several other boats visible, as well as a body of water. The overall atmosphere of the image suggests a relaxed and casual gathering of friends or acquaintances.

It's worth noting that the image has been edited to include a watermark that reads "42484" in the bottom-left corner. This suggests that the image may have been taken from a larger collection or archive, and that it may have been used for research or educational purposes.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The black-and-white image depicts a group of people standing on a wooden dock, possibly at a marina. They are wearing hats, glasses, and sneakers, and seem to be preparing to board a boat. The boat is docked on the side of the dock, with a few other boats behind it. One of the boats has the word "HELCAT" written on its side. The image has a watermark with the text "4-24-84" in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph showing a group of people on a dock with boats. The people are wearing hats and appear to be engaged in some activity. The boat in the foreground has a number "2" on its side and is docked next to a larger boat. The larger boat has the word "HELCAT" written on its side. There are ropes and other equipment visible on the dock.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

Certainly! Here's a description of the image based on the details you provided:

General Description:

The image appears to be a black and white photograph of a group of people on and around several boats docked at a pier. The photograph seems to have been taken in a marina or similar boating area.

Key Elements:

  • Boats: Several boats are visible, with at least one named "HELCAT II."
  • People: A group of people is interacting on one of the boats. One man is holding a fish while another stands on the pier.
  • Setting: The backdrop includes other boats and possibly a shoreline or buildings in the distance.
  • Text: Some text is visible on a sign near the dock including the words "SPORT FISHING" and "CHARTER BOAT." The number "42484" appears to be printed at the bottom of the photo.

Possible Scenario:

The image might capture a scene of a group returning from a fishing trip. They seem to be inspecting the catch of the day.

Created by gemini-2.0-flash-lite on 2025-05-07

Certainly! Here's a description of the image:

Overall Scene:

The image appears to be a negative film photograph, captured in black and white. It depicts a group of people on and around a boat, likely at a marina or harbor. The presence of several boats in the background suggests a recreational or commercial boating environment.

Key Elements and Details:

  • People: There are at least five men visible in the photograph. They are dressed in casual attire, typical of a fishing or leisure setting. Some are wearing hats and sunglasses. One of the men is holding up a fish, indicating that fishing has just occurred.
  • Boats: Multiple boats are docked or moored in the scene. One boat is prominently labeled "HELCAT II". Another boat is in the foreground, on which some of the people are standing.
  • Environment: The background shows a body of water, presumably the ocean, lake, or a river. The presence of docks and other boats contributes to the maritime atmosphere.

Possible Activity and Context:

The scene seems to capture a moment of activity related to fishing or boating. The individuals may have just returned from a fishing trip or are preparing for one. The fish being held could be a recent catch. The photograph gives the impression of a pleasant day out, possibly during the warmer months of the year.

Technical Aspects:

The photograph has a vintage feel due to its black and white format and the use of film, as suggested by the text in the corners.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a group of people on a dock or marina. There are several boats moored around them, with one prominently named "Helcat II" in the background. The people in the image appear to be engaged in various activities, possibly related to fishing or boating.

Here is a detailed breakdown:

  1. Setting: The scene is set at a marina or dock with multiple boats in the background. The water is visible, and the boats are tied to the dock.

  2. People: There are five individuals in the image.

    • One person is standing on the dock, wearing a cap and a dark jacket, holding a bucket.
    • Another person is seated on the edge of the dock, wearing a cap and a jacket, seemingly engaged in conversation or preparing something.
    • A third person is standing on a boat, wearing a plaid shirt and a cap, holding a fishing rod.
    • A fourth person is also on the boat, wearing a cap and a jacket, possibly assisting with the fishing rod or other activities.
    • The fifth person is standing on the dock, wearing a cap and a t-shirt, holding a sign that partially reads "SPORTS SHIN..."
  3. Activities: The individuals seem to be involved in fishing or boating activities. One person is holding a fishing rod, and another is holding a bucket, which might contain bait or caught fish.

  4. Boats: Several boats are visible, with one named "Helcat II" prominently in the background. The boats are of varying sizes and types, suggesting a recreational or fishing marina.

  5. Date: The date "4.24.84" is visible at the bottom of the image, indicating that the photograph was taken on April 24, 1984.

Overall, the image captures a moment of leisure or work at a marina, with people engaged in fishing or boating activities.

Qwen

No captions written

Text analysis

Amazon

TER
42484
SHOT
N
WED
BOAT
TER BOAT YT
HELCAT
II
E
PHONE
HO
OFFS
YT
FAST
HINE
CAR
SHOT and WED
CAR 50
50
FA
KODAK
k
2
SPORT3
roe
k Pranett
-
SAME
Ca
Pranett
not
and
ASSOCIAT

Google

HELCAT SPORT HIN TER BOAT SHOT WED CA 4248 f HOP
HELCAT
SPORT
HIN
TER
BOAT
SHOT
WED
CA
4248
f
HOP