Human Generated Data

Title

Untitled (couple and child on boat posed with a large lobster)

Date

1949

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10595

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple and child on boat posed with a large lobster)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10595

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.2
Face 95.8
Transportation 88.4
Vehicle 88.3
Female 87
Clothing 83.7
Apparel 83.7
Shelter 82.7
Countryside 82.7
Rural 82.7
Nature 82.7
Outdoors 82.7
Building 82.7
Car 78.8
Automobile 78.8
Aircraft 77.3
Kid 75.7
Child 75.7
Meal 72.8
Food 72.8
Girl 71.6
Plant 67
Dress 66.8
Portrait 65.7
Photography 65.7
Photo 65.7
Woman 64.1
Shorts 63.3
Pool 62.2
Water 62.2
Tire 61.4
Yard 59.7
Logo 57.2
Symbol 57.2
Trademark 57.2
Machine 56.6
Crowd 56.5
Swimming Pool 56
Wheel 55.6

Clarifai
created on 2023-10-26

people 99.8
monochrome 99.1
vehicle 97.7
group together 97.3
adult 97.1
woman 97
man 95.6
transportation system 95.4
street 94.9
two 94.4
music 92.5
group 88.2
wear 87.7
three 86.6
portrait 86.5
watercraft 85.1
child 84.9
retro 82.1
aircraft 81.5
several 78.1

Imagga
created on 2022-01-09

vehicle 65.5
car 63.2
transportation 36.7
motor vehicle 31.1
auto 28.7
bobsled 28
automobile 27.8
seat 24.7
sled 22.4
device 21.4
wheeled vehicle 20.1
transport 20.1
drive 19.9
driver 19.4
man 18.8
support 16.9
conveyance 16.4
adult 16.2
driving 15.5
road 15.3
iron lung 15.3
wheel 15.1
male 14.9
speed 14.6
rumble 14.6
truck 14
people 13.9
happy 13.8
person 12.7
engine 12.5
amphibian 12.3
respirator 12.2
sitting 12
luxury 12
tramway 11.5
model t 11.4
traffic 11.4
travel 11.3
machine 11.2
passenger 11.1
inside 11
smile 10.7
modern 10.5
outdoors 10.4
smiling 10.1
rumble seat 10
motor 9.8
new 9.7
business 9.7
metal 9.6
happiness 9.4
breathing device 9.2
old 9.1
fun 9
accident 8.8
insurance 8.7
model 8.6
power 8.4
fire engine 8
work 7.8
station 7.7
summer 7.7
sky 7.7
casual 7.6
fast 7.5
technology 7.4
cheerful 7.3
danger 7.3
color 7.2
convertible 7
train 7

Microsoft
created on 2022-01-09

text 98.9
black and white 92.1
outdoor 86.5
vehicle 57.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 62.7%
Happy 69%
Calm 25.9%
Sad 1.9%
Angry 1.1%
Disgusted 0.9%
Surprised 0.6%
Fear 0.3%
Confused 0.3%

AWS Rekognition

Age 30-40
Gender Male, 96.4%
Happy 91.5%
Calm 3.1%
Surprised 1.5%
Disgusted 1.3%
Confused 1.1%
Angry 0.7%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Male, 80.5%
Calm 95.1%
Surprised 2.6%
Happy 1.1%
Sad 0.4%
Angry 0.2%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Airplane

Clarifai

Clothing
Human face
Window
Human hair
Vehicle

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 96.3%

AWS Rekognition

Airplane 77.3%

Clarifai

Clothing 89.6%

Clarifai

Clothing 81.7%

Clarifai

Clothing 54.7%

Clarifai

Clothing 37.3%

Clarifai

Human face 86.6%

Clarifai

Human face 79.2%

Clarifai

Human face 77.1%

Clarifai

Window 41.8%

Clarifai

Human hair 36.7%

Clarifai

Vehicle 33.5%

Categories

Imagga
created on 2022-01-09

cars vehicles 99.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

photograph of a couple in a boat.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people in a boat with a life preserver

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image depicts a man holding a large lobster aboard a boat. The boat’s name, "Marann," is displayed on a circular life preserver hanging on the side, along with the location "Miami" written below it. The boat's interior features a shaded canopy and visible structural beams, with additional equipment visible on the deck.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image is a black and white negative featuring three people on a boat. The boat has a roof overhead, and one person is holding a fishing line with a large lobster. There is a life ring attached to the side of the boat with the name "MARANN" printed on it, along with the location "MIAMI". The edges of the photo have holes, typical of a film negative, and are labeled "KODAK SAFETY." The number "26477" is written at the bottom.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph depicting a group of people on what looks like a boat or ship. The central figure appears to be a woman in an elaborate costume or outfit, possibly a performer or entertainer. She is surrounded by two other people, who also seem to be dressed in costumes or theatrical attire. The background includes a sign that says "Marann Miami", suggesting this may be a scene from some kind of entertainment or event taking place in Miami. The overall atmosphere of the image suggests a festive or celebratory occasion.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from a boat named "Marann" from Miami, as indicated by a life preserver visible in the image. Three people are shown on what appears to be the deck of the boat, and they seem to be examining or displaying a large lobster. The image has a casual, recreational feeling to it and appears to be from an earlier era, possibly the 1930s or 1940s based on the style and quality of the photograph. The boat's railing and some structural elements are visible, and the composition suggests this was taken during a leisure outing or fishing trip.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people on a boat, with a life preserver and a bird perched on the side.

The boat is in the foreground, with a large, round life preserver attached to the side. The life preserver has the words "MARANN MIAMI" written on it in white letters. A bird is perched on a pole next to the life preserver, facing the camera.

In the background, there are several people standing on the boat, including a man and two women. They appear to be posing for the photo, with their arms around each other and smiling. The boat has a covered top, and the interior is visible through the open sides. There are also some objects on the boat, such as a rope and a bucket.

The overall atmosphere of the image suggests a fun and carefree moment, possibly during a vacation or a special event. The people in the photo seem to be enjoying themselves, and the bird adds a playful touch to the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black and white photograph of a man and two women posing on a boat. The man, positioned centrally, is holding a lobster up by its tail with his right hand. He wears a dark-colored shirt featuring a tropical print.

To the left of the man stands a young woman with blonde hair, wearing a dark-colored dress. On the right side of the man is another woman, also with blonde hair, dressed in a light-colored swimsuit.

In the foreground, a life preserver is attached to the side of the boat. It features the text "MARANN MIAMI" in white letters. The background of the image shows the interior of the boat, including a mirror and other objects. The overall atmosphere of the image suggests a fun and casual gathering on the water.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photograph shows three people sitting on a boat. The woman is wearing a dress, and the man is wearing a shirt. They are holding a lobster and smiling. The boat has a lifesaver with the words "MARANN MIAMI" on it. The boat has a roof with a metal frame. There is a pole with a rope and a hook attached to it. The image has a watermark with the number "26477" on the bottom right.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photo shows three people on a boat. The boat has a railing, and a lifesaver with the text "MARANN MIAMI" is hanging on it. A lobster is hanging from the railing. A man is holding a fish in his hand. A woman is holding the railing and smiling. Another woman is standing beside them. The photo has a watermark with the number "26477" in the bottom center.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image appears to be a negative of a vintage photograph, likely taken on a boat. The scene depicts a family or group of people on a boat, possibly after catching a lobster. The image is in black and white.

Details:

  • Subjects: Three people are visible. A man in a patterned shirt holds up a large lobster, gesturing or possibly showing it off. A young girl looks up towards the lobster with her eyes wide. A woman is seen smiling and looking at the lobster as well.
  • Setting: They are on a boat. The life preserver that says "Marann Miami" indicates this is likely a boat named "Marann" docked in Miami. The boat's railing is visible, along with other details of the boat's structure.
  • Composition: The photograph is well-composed. The lobster is the clear focal point, with the people interacting with it. The framing places the subjects against a clear, bright backdrop, making them stand out.
  • Additional Details: There is the number "26477" at the bottom of the image.

Atmosphere:

The photograph gives off a cheerful, celebratory vibe. It hints at a fun day out on the water.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The image is a black-and-white photograph featuring three individuals on what appears to be a boat or yacht. In the foreground, there's a man holding a large lobster. He's positioned slightly to the right of center and is smiling at the camera. To his left, a younger girl is standing, also looking at the camera with a smile. To the right of the man, a woman is leaning forward, with a smile directed towards the camera.

In the background, elements of the boat are visible, including a roof structure and other architectural details. A life preserver with the word "MARANN" and "MIAMI" is hanging on the side of the boat. The photograph has a vintage quality, with the image being a negative, as indicated by the inverted tones.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black-and-white photograph taken on a boat, likely in a marina or harbor setting. The boat has a life preserver hanging on its side with the words "MARANN MIAMI" printed on it. Three people are visible in the image, standing on the boat.

The person on the left is a woman with light-colored hair, wearing a sleeveless top and smiling at the camera. The middle person is a man with short hair, wearing a patterned shirt and also smiling. The person on the right is another woman with light-colored hair, wearing a swimsuit and smiling as well. The background shows other boats and structures, suggesting a busy marina environment. The image has a vintage feel, possibly from the mid-20th century, and the number "26477" is visible at the bottom, likely a reference or catalog number.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

This is a black-and-white photograph of three individuals on a boat. The boat's name, "Maraann Miami," is visible on a lifebuoy hanging on the side. The individuals appear to be enjoying themselves, with one person holding a fishing pole, and the others smiling and looking at the camera. The setting seems to be a sunny day, and the boat is equipped with various nautical gear. The photograph has a vintage feel, suggesting it was taken in the past.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This black-and-white image depicts three people on a boat. The boat has a lifebuoy attached to its side, which reads "MARANN MIAMI." One of the individuals is holding a large lobster, showcasing it proudly. The setting appears to be a dock or marina, with other boats and buildings visible in the background. The overall atmosphere suggests a casual, possibly celebratory moment, likely after a successful fishing or lobster-catching trip. The photograph has a vintage feel, possibly from the mid-20th century.

Text analysis

Amazon

MARANN
MIAMI
26477
YT37A2-XAGOX

Google

MIAMI 26477 YT3R XA
MIAMI
26477
YT3R
XA