Human Generated Data

Title

Untitled (men riding in small boat, Mantalocking, NJ)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8517

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men riding in small boat, Mantalocking, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8517

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.2
Watercraft 93.3
Vessel 93.3
Vehicle 93.3
Transportation 93.3
Water 88.8
Building 66.4
Waterfront 58.4
Spire 57.1
Architecture 57.1
Tower 57.1
Steeple 57.1
Outdoors 55.4

Clarifai
created on 2023-10-25

people 99.5
water 99
vehicle 98.5
watercraft 98.4
group 98.2
group together 97.8
many 97.5
boat 97.3
transportation system 97.2
rowboat 97.1
monochrome 96.8
man 95.8
recreation 93.2
adult 92.4
river 92.4
harbor 89.7
motorboat 89
travel 88.9
canal 88.3
pier 88

Imagga
created on 2022-01-09

vessel 46.7
boat 46.6
sea 42.4
sailboat 42
water 41.4
ship 37.4
ocean 31.5
sky 31.3
travel 30.3
waterfront 30
sailing vessel 28.3
harbor 27
marina 25.7
architecture 25.1
port 24.1
yacht 23.3
tourism 23.1
city 22.5
boats 21.4
island 21.1
bay 20.9
catamaran 20.7
craft 19.7
river 19.6
landmark 19
cityscape 18.9
coast 18.9
pier 18.8
trimaran 18.4
tourist 18.1
sunset 18
landscape 16.4
beach 16.1
coastline 16
lake 15.7
dock 15.6
vacation 15.6
cloud 15.5
sailing 14.6
tower 14.3
structure 13.8
nautical 13.6
clouds 13.5
summer 13.5
skyline 13.3
sun 13.2
famous 13
building 13
sail 12.6
bridge 12.5
reflection 12.4
urban 12.2
rock 12.2
liner 11.8
fisherman 11.7
buildings 11.3
historic 11
history 10.7
light 10.7
old 10.5
scene 10.4
town 10.2
transport 10.1
holiday 10
leisure 10
mast 9.8
dusk 9.5
passenger ship 9.5
evening 9.3
sand 9.1
shore 9
transportation 9
night 8.9
cruise 8.8
pacific 8.7
sunny 8.6
trip 8.5
historical 8.5
sunrise 8.4
waves 8.4
church 8.3
horizon 8.1
construction 7.7
fishing 7.7
tree 7.7
skyscraper 7.7
panorama 7.6
destination 7.5
silhouette 7.5
calm 7.3
shipping 7.2
mountain 7.1

Microsoft
created on 2022-01-09

text 99.9
ship 97.7
water 97.6
boat 97
watercraft 90.2
lake 87.6
white 86.9
outdoor 86.4
black and white 79.3
old 76.1
black 72
sky 56.5
vintage 39.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 90.6%
Calm 71.5%
Happy 24.4%
Fear 1.4%
Surprised 1.4%
Disgusted 0.6%
Sad 0.4%
Angry 0.3%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 89.4%
Calm 98.8%
Sad 0.5%
Happy 0.2%
Disgusted 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 62%
Calm 36.5%
Sad 16.2%
Surprised 12.2%
Happy 9.7%
Disgusted 9.3%
Angry 8.4%
Fear 5.7%
Confused 2%

AWS Rekognition

Age 23-33
Gender Male, 80.5%
Happy 28.7%
Calm 24.7%
Fear 14.1%
Surprised 10.2%
Angry 9%
Sad 6.5%
Disgusted 5.2%
Confused 1.6%

AWS Rekognition

Age 16-22
Gender Male, 51.8%
Calm 80.7%
Sad 12.6%
Happy 2.2%
Confused 1.4%
Angry 1.3%
Disgusted 0.7%
Surprised 0.6%
Fear 0.6%

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Happy 33%
Calm 24.2%
Sad 21.6%
Angry 8.6%
Fear 8.3%
Disgusted 1.9%
Surprised 1.5%
Confused 0.9%

AWS Rekognition

Age 23-31
Gender Male, 84.8%
Calm 56%
Sad 27.8%
Happy 5.7%
Angry 4.1%
Disgusted 3%
Fear 1.5%
Confused 1.1%
Surprised 0.8%

AWS Rekognition

Age 6-16
Gender Male, 92.7%
Sad 37.6%
Calm 35.3%
Confused 8.8%
Disgusted 6.1%
Angry 4.8%
Happy 3.3%
Surprised 2.6%
Fear 1.4%

AWS Rekognition

Age 18-26
Gender Male, 82.4%
Calm 85.1%
Sad 4.5%
Fear 3.9%
Confused 1.9%
Disgusted 1.6%
Surprised 1.6%
Happy 1.2%
Angry 0.3%

AWS Rekognition

Age 19-27
Gender Male, 98%
Calm 98.2%
Disgusted 0.8%
Angry 0.3%
Sad 0.2%
Fear 0.2%
Surprised 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 26-36
Gender Female, 62.6%
Happy 86.5%
Calm 6.2%
Sad 4.1%
Surprised 0.9%
Disgusted 0.8%
Fear 0.6%
Angry 0.5%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person
Boat

Clarifai

No features identified

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 99%

AWS Rekognition

Person 96%

AWS Rekognition

Person 95%

AWS Rekognition

Person 93.6%

AWS Rekognition

Person 92.1%

AWS Rekognition

Person 92.1%

AWS Rekognition

Person 91.9%

AWS Rekognition

Person 89%

AWS Rekognition

Person 88.1%

AWS Rekognition

Person 86.3%

AWS Rekognition

Person 83.1%

AWS Rekognition

Person 77.9%

AWS Rekognition

Person 72.4%

AWS Rekognition

Person 69.4%

AWS Rekognition

Person 66.5%

AWS Rekognition

Person 64.5%

AWS Rekognition

Person 62.5%

AWS Rekognition

Person 51.1%

AWS Rekognition

Person 50.3%

AWS Rekognition

Person 45.1%

AWS Rekognition

Boat 74.7%

AWS Rekognition

Boat 66.2%

AWS Rekognition

Boat 58.4%

Categories

Imagga
created on 2022-01-09

nature landscape 69.3%
streetview architecture 23.8%
beaches seaside 4.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people are in a boat in the water

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This is an inverted (negative) black-and-white image capturing a waterfront scene. The photo features a group of people gathered near a dock or pier. They are standing and observing several small boats in the water, some of which have sails or are being rowed. One man is prominently visible in the foreground in a small boat, wearing a checkered shirt and sitting while another man is standing in a separate boat nearby, with hands on his hips. The background shows houses along the shoreline and more individuals standing in groups. The image has visible markings indicating it is likely from a photographic archive or organized collection, with numbers and "Kodak Safety Film" along the edges.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image appears to be a photographic negative, which reverses the typical light and dark areas of the scene. In the image, a group of people is gathered along a waterfront, observing a few small boats on the water. Some individuals are in the boats, engaged in activities such as rowing. The background features several houses, indicating a coastal residential area. The scene is bustling, with people on both the shore and in the boats, suggesting a community event or gathering. The presence of masts suggests that the boats may be sailboats, but the sails are not deployed. The overall atmosphere seems lively and communal.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image depicts a nighttime scene at a harbor or marina. There are several small boats and yachts in the water, with people standing or sitting in some of them. In the background, there is a crowd of people gathered on the shore, watching the activity in the water. The buildings in the background suggest this is a coastal town or resort area. The overall scene has a festive or celebratory atmosphere, with the large crowd and the boats in the water.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph showing what appears to be a boating event or gathering at a waterfront. Several small boats are visible in the water, with people aboard them. In the background, there's a crowd of spectators lined up along what looks like a dock or shoreline. Behind them stand several typical New England-style houses with their characteristic architectural features including pitched roofs and porches. The houses appear to be two stories tall and painted in light colors. The scene has a distinctly vintage feel, likely from the mid-20th century, based on the clothing styles visible and the photographic quality. The overall composition suggests this might be some kind of community event or boat demonstration taking place in a coastal town.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a group of people gathered on the shore of a body of water, with several boats in the foreground and background. The scene appears to be a social gathering or event, possibly a regatta or sailing competition.

In the foreground, there are several small sailboats and rowboats, some of which have people standing in them. The boats are arranged in a line, with the largest boat in the center. The people in the boats appear to be engaged in conversation or activity, but it is difficult to discern what they are doing.

In the background, there is a large crowd of people standing on the shore. They are all facing towards the water, and some of them appear to be watching the boats. There are also several buildings visible in the background, including what appears to be a house or a clubhouse.

The overall atmosphere of the image is one of relaxation and leisure. The people in the boats and on the shore seem to be enjoying themselves, and the scene is peaceful and serene. The image may have been taken during a summer vacation or a special event, such as a holiday or a festival.

The image is likely a historical photograph, given its age and the style of clothing worn by the people in the image. It may have been taken in the early 20th century, although the exact date is not certain.

Overall, the image provides a glimpse into a bygone era, when people enjoyed leisure activities such as sailing and socializing in a more relaxed and casual manner.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a nighttime scene featuring several small boats in the water, with people standing on the shore and in the boats. The photograph appears to be a negative, as indicated by the white border and the text "17343" at the top and bottom.

In the foreground, there are several small boats, some of which have people standing in them. The boats are positioned in the water, with their bows facing towards the shore. In the background, there is a group of people standing on the shore, watching the scene unfold. Behind them, there are several houses and buildings, which are visible in the darkness.

The overall atmosphere of the image suggests that it was taken during a social event or gathering, possibly a party or celebration. The presence of people in the boats and on the shore, combined with the nighttime setting, creates a sense of excitement and joy. The image may have been taken in the early 20th century, given the style of the clothing and the architecture of the buildings in the background.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph taken at night. It depicts a large gathering of people around a water body, possibly a lake or a river. In the foreground, there are several boats, some of which are overturned, with people standing on them or near them. The boats are of various sizes and shapes, and some have masts. The water is calm, and there are reflections of the boats and people in it. In the background, there are houses and buildings, and some of them have lights on. The sky is dark, and there are no visible stars or moon.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The black-and-white photo shows a group of people gathered around a body of water. Some of them are standing on the shore, while others are riding on boats. One boat is flipped upside down, while the other is upright. The two people in the upright boat are wearing casual clothing. The people on the shore are watching the boats. In the distance, there are houses and a dark sky.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

This is a black and white photograph, possibly a film negative, depicting a scene at a harbor or waterfront. The central focus is on several small boats in the water. A crowd of people is gathered on a dock or shore in the background, watching the activity on the water. There are also houses or buildings in the background, suggesting a coastal or lakeside community.

In the foreground, two people are in one of the small boats. One person stands and appears to be looking out at the scene, while the other is seated and possibly steering. The other boats are near the dock, and some appear to be overturned.

The photograph has a vintage feel, possibly taken in the mid-20th century. The lighting is somewhat flat, and the contrast is moderate. The image is quite detailed, capturing the texture of the water, the boats, and the clothing of the people.

Created by gemini-2.0-flash-lite on 2025-05-17

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white negative, which means the tones are inverted. It appears to be a vintage photograph, likely from the mid-20th century. The scene captures a harbor or waterfront event with boats and a gathering of people.

Key Elements:

  • Boats: Several small sailboats or dinghies are visible in the water. Some are partially submerged, and others are upright.
  • People: A large crowd of people are gathered on a pier or dock. Others are in the boats, and some appear to be assisting.
  • Buildings: In the background, there are houses. Their style suggests they are likely located in a coastal or harbor town.
  • Environment: The water has a rippled texture, suggesting a gentle breeze or current. The sky is not very visible in the negative, but the lighting suggests it's daytime.

Activity:

The scene seems to be an event related to boating, possibly a race, a boat demonstration, or a social gathering.

Let me know if you would like me to elaborate on any aspect of the image!

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a lively scene at what appears to be a sailing event or regatta. Several small sailboats are on the water, each manned by one or two people. The participants are dressed in casual attire, with some wearing hats, and they are actively engaged in handling their boats.

In the background, a large crowd of spectators is gathered along the waterfront, watching the event. The spectators are dressed in what appears to be early to mid-20th-century clothing, suggesting the photo is from that era. The buildings behind the crowd are residential and have a classic architectural style, adding to the historical feel of the image.

The atmosphere seems festive and communal, with many people enjoying the outdoor activity together. The presence of multiple sailboats and the engaged crowd indicate that this might be a competitive event or a community gathering centered around sailing.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

This black-and-white photograph depicts a nighttime scene on a body of water, likely a harbor or similar setting. In the foreground, a small rowboat with two individuals is visible. The person standing appears to be guiding or assisting the seated individual, who is holding a checkered picnic blanket or similar item.

Several sailboats with masts raised are docked or anchored nearby. Some of these boats are tilted or overturned, suggesting a possible accident or a playful scenario. A crowd of people is gathered on the shore, observing the scene from behind a low barrier. The people on the shore are dressed in mid-20th-century attire, indicating the photograph's historical context.

The background features several two-story houses with porches, adding to the residential feel of the setting. The overall atmosphere suggests a lighthearted or staged event, possibly a playful competition or a community gathering related to water activities. The image includes a number "17343" printed on it, which might be an identifier or catalog number for the photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This black-and-white photograph depicts a lively scene at a waterfront. In the foreground, several small boats are in the water, each with one or two people aboard. One person is standing in a boat, appearing to be in mid-action, possibly during a race or demonstration. Another individual is seated in a boat, holding onto the edge. The background shows a large crowd of spectators gathered along the water's edge, watching the activity. Behind the crowd, there are houses with multiple windows and chimneys, and several sailboats are visible in the water. The overall atmosphere suggests a community event or a race taking place at night or during low light conditions. The image has a vintage feel, likely from the mid-20th century.

Text analysis

Amazon

17343
17343-
0.0

Google

19343- 田 17343· -YT3RA2-NAMT2AE
19343-
17343·
-YT3RA2-NAMT2AE