Human Generated Data

Title

Untitled (lifeguard with whistle in mouth, leaning on lifeboat, Miami Beach)

Date

1948

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5092

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (lifeguard with whistle in mouth, leaning on lifeboat, Miami Beach)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5092

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Human 98.7
Face 94.3
Sea 90.8
Ocean 90.8
Outdoors 90.8
Nature 90.8
Water 90.8
Shorts 90
Female 86.9
Sun Hat 86.4
Woman 75.3
Beach 74.3
Shoreline 74.3
Coast 74.3
Portrait 70.7
Photography 70.7
Photo 70.7
People 63.1
Dress 59.9
Sand 58.1
Finger 57
Cap 55

Clarifai
created on 2023-10-26

people 99.5
monochrome 99.5
vertical 97.5
man 95.9
adult 95
lid 91.8
indoors 89.5
woman 85.2
square 83.5
outdoors 83.2
fun 81
portrait 80.5
young 74.3
profile 73.5
one 73
relaxation 72.8
summer 71.7
water 70.4
paper 70.3
isolated 69.8

Imagga
created on 2022-01-22

bride 28.9
wedding 23.9
negative 23.5
clothing 22.8
portrait 22
people 21.7
dress 21.7
adult 21.5
person 19.2
sculpture 18.7
bust 17.9
film 17.8
hat 16.7
fashion 15.8
love 15.8
human 15.7
man 15.5
attractive 15.4
happiness 14.9
sexy 14.5
married 14.4
photographic paper 13.8
happy 13.8
male 13.5
hand 12.9
gown 12.8
art 12.8
bridal 12.6
marriage 12.3
cheerful 12.2
wed 11.8
veil 11.8
model 11.7
life 11.4
face 11.4
elegance 10.9
plastic art 10.8
one 10.4
style 10.4
eyes 10.3
hair 10.3
smiling 10.1
smile 10
pretty 9.8
posing 9.8
ceremony 9.7
black 9.6
celebration 9.6
flowers 9.6
women 9.5
groom 9.4
bouquet 9.4
lifestyle 9.4
blond 9.2
photographic equipment 9.2
holding 8.3
stylish 8.1
lady 8.1
couple 7.8
hands 7.8
men 7.7
engagement 7.7
relaxation 7.5
joy 7.5
fun 7.5
traditional 7.5
covering 7.4
headdress 7.4
design 7.3
cowboy hat 7.2
body 7.2
cute 7.2
romance 7.1
consumer goods 7.1
day 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

text 99.7
person 96.3
fashion accessory 90.6
black and white 81.7
clothing 70.3
human face 67.9
hat 60.7
posing 42.2

Color Analysis

Feature analysis

Amazon

Hat
Person

Clarifai

Human face
Man
Clothing
Hat
Footwear
Human nose
Human arm
Human hand
Human leg
Human eye
Tree

AWS Rekognition

Hat 99.8%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 90.8%

Clarifai

Human face 95.9%

Clarifai

Human face 68.2%

Clarifai

Human face 34.7%

Clarifai

Man 78.7%

Clarifai

Man 75.6%

Clarifai

Man 68.3%

Clarifai

Clothing 67.1%

Clarifai

Clothing 55.6%

Clarifai

Clothing 55.5%

Clarifai

Clothing 35.1%

Clarifai

Hat 59.1%

Clarifai

Footwear 54.6%

Clarifai

Human nose 43.5%

Clarifai

Human arm 38.8%

Clarifai

Human arm 36.1%

Clarifai

Human hand 34.8%

Clarifai

Human leg 34.8%

Clarifai

Human eye 33.9%

Clarifai

Tree 33.3%

Categories

Imagga
created on 2022-01-22

interior objects 44.9%
paintings art 33.9%
streetview architecture 19.7%

Captions

Microsoft
created by unknown on 2022-01-22

a person holding a sign 58%
a person holding a box 57.1%
a person holding a sign 57%

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

person, a sailor, plays with a christmas tree.

Salesforce

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a woman in a white dress and hat with a white hat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image is a black and white negative featuring a man standing next to a boat labeled "No. 19-46." He appears to be on a beach, with several other people visible in the background, some standing, sitting, or interacting on the sand. The scene suggests a casual or recreational atmosphere near the shore.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black and white negative photograph featuring a beach scene. In the foreground, a man is standing next to a boat marked with the number "19-46." He is shirtless and wearing swim trunks and a hat. In the background, the beach is populated with several other beachgoers, some standing and others sitting or reclining near the shoreline. The overall scene depicts a busy day at the beach, with a focus on leisure and relaxation by the sea.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a person wearing a white protective suit and helmet, standing in front of a piece of equipment or machinery labeled "No. 19-46". The person appears to be in an outdoor setting, with a hazy landscape visible in the background. The image has a black and white, vintage aesthetic, suggesting it may be an older photograph.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-20

The black and white photograph depicts a woman wearing a hat and dress standing in front of a boat labeled "No. 19-46". In the background, there are several other people visible, though their faces are not clearly shown. The woman appears to be standing on a dock or pier, with the water and shoreline visible behind the boat. The image has a vintage or historical feel based on the clothing style and photographic quality.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph that appears to be from a beach or seaside setting. In the foreground, someone is wearing a white hat and light-colored clothing, standing next to what appears to be a boat or vessel marked with the number "19-46". In the background, there are several people visible in swimwear on what looks like a beach. The image has the characteristics of being taken in the 1940s based on the style and photographic quality. The lighting creates strong contrasts, typical of photographs from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man standing on the beach, wearing a hat and holding a boat. The man is shirtless and has his left hand resting on the side of the boat, which has the number "19-46" written on it in white letters.

  • The man is wearing a wide-brimmed hat with a dark band around the crown and a light-colored brim.
  • He is also wearing a pair of white shorts.
  • In the background, there are several people swimming or sunbathing on the beach.
  • The sky is cloudy, and the overall atmosphere suggests a warm and sunny day at the beach.

The image appears to be a vintage photograph, possibly from the early 20th century, given the style of clothing and the quality of the image. It may have been taken by a professional photographer or amateur enthusiast. The image provides a glimpse into the past, capturing a moment in time when people enjoyed spending time at the beach.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This image is a black-and-white photograph of a man standing in front of a boat on a beach. The man is wearing a hat, a light-colored shirt, and pants. He appears to be smoking a cigarette.

The boat behind him has the numbers "NO. 19-46" painted on it. In the background, there are people on the beach, some of whom are wearing swimsuits. The sky is overcast. The overall atmosphere suggests a daytime setting at the beach.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man standing on a beach, possibly in the 1940s. He is wearing a hat and a necklace and is holding a cigarette in his hand. The man is standing in front of a boat with the number "19-46" on it. In the background, there are several people, including a man in a white shirt and a man in a hat, who are standing on the beach. The image has a watermark on the top left corner that reads "25710" and "TIRE 2".

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black and white photo shows a man with a hat and a necklace who is standing on the beach. He is holding a cigarette in his mouth and is looking at something. He is standing next to a boat with the number "19-4G" written on it. In the blurry background, there are people on the beach. Some of them are standing, while others are sitting.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

This black and white negative depicts a lifeguard standing on a beach, blowing a whistle. The lifeguard is wearing a lifeguard hat and has a whistle to his lips. He leans his arm on a boat labeled "NO. 19-46."

In the background, there is a beach with several people. The horizon is slightly obscured by the people and buildings or other structures. The overall image is a negative, causing light areas to appear dark and vice versa.

Created by gemini-2.0-flash-lite on 2025-05-17

Here is a description of the image:

The image appears to be a negative of an old photograph taken on a beach. The central figure is a man wearing a hat and a short white bottom. He is holding something up to his mouth, presumably to either eat it or blow into it. He is leaning on a small boat, on which the number "19-46" is painted. Behind the man, other people, clad in swimsuits, are visible on the beach. The overall composition suggests a casual beach scene, possibly from the mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black and white photograph featuring a person standing on a beach. The individual is wearing a large-brimmed hat with a ribbon around it, a long-sleeved sweater, and what appears to be a skirt or shorts. They are holding a small object, possibly a whistle or a similar item, to their mouth, suggesting they might be a lifeguard or someone in a supervisory role.

In the background, there are several people in swimwear, enjoying the beach. Some are standing, while others are sitting or lying on the sand. The beach seems to be crowded, indicating it might be a popular location. The photograph has a vintage feel, likely taken several decades ago, given the style of clothing and the overall quality of the image. The number "NO. 19-46" is visible on a structure in the foreground, possibly indicating a specific location or identifier related to the beach or the person's role.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-01

This is a black-and-white photograph showing a man wearing a wide-brimmed hat, standing on the edge of a small wooden boat labeled "NO. 19-46." The man is shirtless, wearing white shorts, and appears to be sunbathing or relaxing. His left arm is raised, and he is holding something close to his mouth, possibly a cigarette or a type of whistle. The background features a beach scene with several people in the distance, some of whom are also sunbathing or engaging in activities. The overall atmosphere suggests a leisurely day by the sea.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-01

This is a black-and-white photograph of a man sitting on a boat labeled "NO. 19-46." He is wearing a white hat and appears to be smoking or holding a cigarette to his mouth. The man is shirtless and wearing light-colored shorts. In the background, there are several people, some of whom appear to be in swimsuits, standing or sitting on the beach. The scene suggests a casual, leisurely atmosphere, possibly at a seaside location. The image has a vintage feel, likely from the mid-20th century.

Text analysis

Amazon

23710
NO.
NO. 19-46
19-46
KODAK
TLEE

Google

NO. 19-4G TLEE 23711
NO.
19-4G
TLEE
23711