Human Generated Data

Title

Time and Thought, New York City

Date

1976

People

Artist: Paul Diamond, American 1942 - 2017

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.241

Human Generated Data

Title

Time and Thought, New York City

People

Artist: Paul Diamond, American 1942 - 2017

Date

1976

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.241

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.8
Hair 98.7
Railing 89.8
Metropolis 84.5
Building 84.5
Urban 84.5
City 84.5
Town 84.5
Accessories 65.9
Accessory 65.9
Vehicle 57.9
Transportation 57.9
Watercraft 56.8
Vessel 56.8

Clarifai
created on 2023-10-25

people 99.5
portrait 99
monochrome 98.5
street 97.1
one 96.5
adult 96.5
woman 95.7
music 94.7
art 91.9
man 91.4
two 91.3
girl 90.2
black and white 89.8
vintage 86.6
sea 86.1
reflection 85.9
beach 85.2
retro 85.1
wear 83.8
analogue 82.5

Imagga
created on 2022-01-09

billboard 45.8
signboard 37.1
structure 27
person 22.8
portrait 22.6
black 21.1
adult 20.7
people 20.6
hair 20.6
attractive 18.9
sexy 17.7
lifestyle 17.3
face 16.3
model 16.3
man 16.1
human 15.7
one 15.7
pretty 15.4
body 15.2
posing 15.1
dark 15
male 14.9
lighting 14.7
sensuality 14.5
fashion 14.3
silhouette 14.1
studio 12.9
park 12.8
urban 11.4
happy 11.3
binoculars 11.2
women 11.1
equipment 10.9
relaxation 10.9
gorgeous 10.9
light 10.7
lady 10.5
world 10.4
sitting 10.3
skin 10.2
cute 10
sensual 10
optical instrument 9.9
sky 9.8
apparatus 9.6
smile 9.3
slim 9.2
outdoor 9.2
device 9.2
alone 9.1
sun 8.7
water 8.7
television 8.6
expression 8.5
head 8.4
building 8.4
makeup 8.2
healthy 8.2
brunette 7.8
shower 7.8
instrument 7.5
city 7.5
clothing 7.5
outdoors 7.5
style 7.4
pose 7.2
smiling 7.2
dress 7.2
wet 7.2
modern 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

person 96.3
water 94.1
text 91
black and white 86.7
sky 86.7
ship 82.8
clothing 77.2
woman 70
cloud 64.7
human face 50.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 98%
Calm 42.4%
Sad 30.9%
Confused 9.6%
Surprised 7%
Fear 6.6%
Angry 1.6%
Disgusted 1.4%
Happy 0.5%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses

Clarifai

No features identified

AWS Rekognition

Person 99.8%

AWS Rekognition

Sunglasses 65.9%

Categories

Imagga
created on 2022-01-09

paintings art 97.9%

Captions

Microsoft
created by unknown on 2022-01-09

a woman sitting on a bed 71.4%
a woman sitting in a room 71.3%
a woman posing for a picture 71.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a woman in a swimsuit standing in front of a boat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image depicts a black-and-white scene near a waterfront. A person is standing with arms crossed, positioned in the foreground, wearing a sleeveless top. In the background, a majestic tall ship with multiple sails glides across calm waters. The composition includes a decorative pole and wrought-iron fencing, adding a nautical theme to the scene. A bird is captured mid-flight, adding dynamic movement to the serene atmosphere. Clouds dot the sky above, contributing to the overall visual balance. The photo has an artistic, vintage quality.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image depicts a monochrome photograph showing a person wearing a sleeveless top with crossed arms, standing near a waterfront. In the background, there is a large ship with several sails visible on the water. The scene includes a clear sky with some clouds and a bird flying nearby. A striped bollard and metal railing are present in the foreground, suggesting a dock setting. The photo carries a vintage aesthetic marked by the film border, labeled "PANCHROMATIC" on the right edge.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a black and white photograph of a woman with curly hair standing on a dock or pier, with a tall ship sailing in the background. The woman is wearing a sleeveless top and has a pensive expression on her face as she gazes out at the ship. The image has a vintage, atmospheric quality, with the clouds and water creating a moody, dramatic scene.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white image depicts a woman with curly hair standing on a pier or dock with a large sailing ship visible in the background. The woman has her arms crossed and is looking directly at the camera with a serious expression. Next to her on the dock is an old-fashioned fire hydrant or water pump. The sailing ship has multiple tall masts and appears to be anchored or docked near the pier. The overall scene has a vintage or historical feel, likely from an earlier era based on the woman's clothing style and the presence of the old sailing vessel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph showing a maritime scene. In the foreground, there's a railing and a mooring post or bollard with chains. In the background, there's a magnificent tall ship with multiple masts and full sails visible on the water. The composition includes someone in a sleeveless dark top and sunglasses with distinctive curly hair standing by the railing. The sky has some clouds and there appears to be a bird flying in the distance. The photo has a vintage quality to it and captures a beautiful nautical moment.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a woman standing in front of a body of water, with a ship in the background.

  • The woman has curly hair and is wearing a dark-colored tank top. She is standing with her arms crossed and looking at the camera.
  • Behind her is a metal fence with a sign that reads "Hands Across the Sea." The sign is attached to a post with a chain wrapped around it.
  • In the background, there is a large body of water with a ship sailing on it. The sky is cloudy and overcast.
  • The overall atmosphere of the image suggests that it was taken on a sunny day, possibly during a vacation or a trip to the beach.

The image appears to be a vintage photograph, possibly from the early 20th century. It has a classic and timeless feel to it, with a sense of nostalgia and romance.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a black-and-white photograph of a woman standing in front of a body of water, with a ship in the background. The woman has curly hair and is wearing a sleeveless dress. She is standing with her arms crossed, facing the camera.

In the foreground, there is a fence and a pole with a chain attached to it. The pole has the words "ENDS THE TIES" written on it. The background of the image shows a large body of water, possibly an ocean or a lake, with a ship sailing in the distance. The sky above is cloudy.

The overall atmosphere of the image suggests that it was taken on a sunny day, possibly during the summer months. The woman's pose and expression suggest that she may be feeling confident or relaxed, while the ship in the background adds a sense of adventure and freedom to the scene.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph of a woman standing on a dock. She is wearing a sleeveless dress and has curly hair. She is standing with her arms crossed and looking to the right. Behind her is a chain-link fence. In the distance, there is a sailboat with many sails. The water is calm, and the sky is cloudy. The image has a black border and text on the right side.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black and white photograph features a woman standing near a fence with a boat behind her. The woman is wearing glasses and a sleeveless top. She is folding her arms and looking at the camera. Behind her is a black pole with a chain attached to it. The chain is attached to the fence. In the distance, there is a ship sailing on the sea. The sky is cloudy.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here's a description of the image:

This is a black and white photograph that appears to be taken from a film negative. The subject is a woman with curly hair wearing glasses, captured from the chest up. She has her arms crossed, a neutral expression, and a simple dress with a V-neckline.

Behind her, there's a nautical scene. A tall ship with sails is visible on the water, suggesting a harbor or open sea setting. In the foreground, a railing and a bollard with black and white stripes are partially visible, giving the impression that the photo was taken from a pier or waterfront location. The lighting is fairly even, and the overall tone is somewhat soft due to the film's characteristics. There's also a hint of a plane high up in the background sky.

Created by gemini-2.0-flash-lite on 2025-05-17

Certainly! Here's a description of the image:

Overall Impression

The image is a black and white photograph taken on what appears to be a sunny day. It has a slightly vintage feel, likely due to the black and white medium and the style of the photo. The composition is well-balanced.

Foreground

  • A young woman with curly hair and sunglasses stands in the foreground. She's wearing a simple top and has her arms crossed, giving her a somewhat serious or contemplative expression.
  • There is a nautical element: to the left, there's a bollard or post, part of a barrier, painted with white and black stripes. Chains are attached to the post and extend towards the water.
  • A black metal fence provides an additional element of structure in the foreground.

Background

  • The background features a body of water (possibly a harbor or sea).
  • There are several tall ships with multiple masts, and billowing sails are on the water.
  • The sky is visible, with clouds that provide a sense of depth.

Atmosphere

The image evokes a sense of history, perhaps a moment captured in time, possibly at a seaside event. The black-and-white aesthetic gives it a classic, timeless quality.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph featuring a person standing near a waterfront. The individual has curly hair and is wearing glasses and a sleeveless top. They are standing with their arms crossed and leaning against a railing. In the background, there is a large sailing ship with multiple masts and sails, anchored in the water. To the left of the person, there is a post with a chain attached, and the post has the words "FRIENDS" and "STATES" visible on it. The sky is partly cloudy, and there is a small airplane visible in the sky above the ship. The overall atmosphere of the image is calm and serene, capturing a moment of quiet contemplation by the water.

Qwen

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This is a black-and-white photograph with a vintage, artistic feel. The image is framed with a thick, dark border, which adds to its classic appearance. The scene features a woman with curly hair, wearing a sleeveless top, standing in the foreground with her arms crossed. She appears to be looking directly at the camera with a serious or contemplative expression.

Behind her, there is a black metal railing and a pole with a chain attached, suggesting she is on a dock or pier. In the background, there is a large sailing ship with multiple masts and sails, positioned on a calm body of water. The sky is partly cloudy, and the overall atmosphere of the image is serene and nostalgic. The word "PANCHROMATIC" is visible on the right side of the border, indicating the type of film used for the photograph.

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

This is a black-and-white photograph featuring a person standing in the foreground with their arms crossed. The person has curly hair and is wearing a sleeveless top. In the background, there is a ship with multiple masts sailing on the water. The ship appears to be under sail, and there is a large bird flying above it. The scene is framed by a metal railing and a striped post, suggesting the person is near a dock or pier. The sky is partly cloudy, and the overall composition gives a nautical or maritime vibe. The photograph has a vintage or artistic feel, possibly due to the monochromatic color scheme and the framing border.

Text analysis

Amazon

TES
THE
NDS
PANCHROMATIC
VE
80

Google

PANCHROMATIC
PANCHROMATIC