Human Generated Data

Title

Oyster Bay

Date

1978

People

Artist: Larry White, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1641

Human Generated Data

Title

Oyster Bay

People

Artist: Larry White, American 20th century

Date

1978

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Apeiron Workshops, 2.2002.1641

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 97.2
Van 91.9
Vehicle 91.9
Transportation 91.9
Tire 75.4
Outdoors 72.7
Spoke 71.2
Machine 71.2
Caravan 70.6
Tree 66.2
Plant 66.2
Shorts 60.6
Clothing 60.6
Apparel 60.6
Road 59.7
Wheel 59.4
Coupe 59.1
Car 59.1
Sports Car 59.1
Automobile 59.1
Nature 58.9
Weather 58.4
Ground 56.6
Alloy Wheel 55.3

Clarifai
created on 2023-10-25

car 99.9
vehicle 99.8
monochrome 99.6
people 99.6
street 99
transportation system 97.9
snow 96.9
storm 96.3
truck 96.3
winter 96.1
driver 94.5
vintage 93.7
man 92.6
analogue 92.6
dog 91.9
abandoned 91.8
wagon 90.5
adult 90.4
broken 90.1
child 87.6

Imagga
created on 2022-01-09

car 75.2
truck 55.7
motor vehicle 50.2
road 35.3
vehicle 34.4
transportation 31.4
snow 26.4
wheeled vehicle 26.3
automobile 24.9
drive 23.7
auto 22
travel 19
cars 17.6
driving 17.4
tow truck 17.3
street 16.6
transport 16.4
old 15.3
winter 15.3
sky 15.3
landscape 14.9
pickup 14.6
wheel 14.4
trees 14.2
cold 13.8
highway 13.5
minivan 13.4
city 13.3
vintage 13.2
van 12.6
traffic 12.4
tree 12.3
weather 11.7
tire 11.5
garage 11.2
structure 10.9
passenger van 10.7
light 10.7
trailer 10.4
engine 9.6
line 9.4
mobile home 9.4
outdoors 9.1
wheels 8.8
snowy 8.8
motor 8.7
season 8.6
housing 8.4
ice 8.3
retro 8.2
building 8
passenger car 7.9
rural 7.9
antique 7.8
help 7.5
vacation 7.4
limousine 7.3
countryside 7.3
parking meter 7.3
danger 7.3
sun 7.2
scenery 7.2
machine 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

outdoor 99.8
sky 98.8
road 95.4
land vehicle 94.7
vehicle 93.7
black and white 88.8
text 88.7
car 82
wheel 69.4
street 58.4

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-16
Gender Male, 97.1%
Calm 73.5%
Sad 13.9%
Confused 4.1%
Fear 2.3%
Disgusted 2%
Surprised 1.8%
Happy 1.7%
Angry 0.6%

AWS Rekognition

Age 12-20
Gender Male, 53.8%
Calm 89.8%
Fear 3.4%
Sad 3.1%
Confused 1.5%
Angry 1%
Surprised 0.7%
Happy 0.3%
Disgusted 0.3%

Feature analysis

Amazon

Person
Truck

Clarifai

No features identified

AWS Rekognition

Person 97.2%

AWS Rekognition

Person 90.5%

AWS Rekognition

Person 88.2%

AWS Rekognition

Person 84%

AWS Rekognition

Person 64.4%

AWS Rekognition

Truck 78.9%

Categories

Imagga
created on 2022-01-09

streetview architecture 81%
beaches seaside 12.9%
nature landscape 3.5%
cars vehicles 1.5%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a truck parked in front of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This black-and-white photograph depicts a suburban scene. In the foreground on the left, there is a van partially visible. Behind the van in the driveway, a boat is parked on a trailer, with people gathered near it, possibly working on or inspecting it. The boat dominates the left side of the image, while the right side shows a house with wood siding and a sloped roof surrounded by shrubbery and trees.

In the lawn area in front of the house, a child stands facing away from the camera, holding what appears to be an object in their hand. Nearby, an adult sits on the steps of the house, and another adult and a child interact closer to the right edge. The scene feels like a casual weekend moment in a residential neighborhood. The overall tone of the image suggests everyday suburban life in the past decades.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black-and-white photograph of a suburban neighborhood scene. In the foreground, on the left side, there is a van parked on the street. Behind the van, a boat is visible, propped up in a driveway. People are working around the boat, possibly preparing it for transport or maintenance.

On the right side of the image, there is a house with wooden shingles. In front of the house, on the lawn, two young children are playing. Closer to the house, there are several adults standing and sitting on the steps, possibly observing the children's play or conversing with one another.

The scene is set on a sunny day, as indicated by the shadows and the bright lighting. Trees surround the house and the driveway area, providing a sense of a pleasant, leafy suburban environment. The photograph captures a candid moment of daily life in a residential neighborhood.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a black and white photograph of a rural or suburban scene. In the foreground, there is a large van or truck parked on the grass. Behind the vehicle, there is a wooden house with a slanted roof and a porch. Several people can be seen sitting on the porch. The house is surrounded by trees and other vegetation, creating a lush, natural setting. The overall atmosphere of the image suggests a peaceful, idyllic scene.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This black and white photograph appears to be from the 1970s or early 1980s, showing a suburban residential scene. In the foreground, there's a van with the distinctive styling of that era. Behind it, there's a boat on a trailer in the driveway. The house in the image is a split-level style home with cedar shake siding. There's a lawn in front of the house with some people visible in the yard and on what appears to be a porch or deck area. The setting includes mature trees and landscaping around the property. The overall composition gives a typical slice-of-life view of American suburban living from that time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a suburban scene, featuring a house, a boat, and a yard.

In the foreground, on the left side of the image, there is a white van parked on the street. The van has a large front grill and a headlight visible. To the right of the van, a white boat is being lifted by a crane or a hoist, which is attached to the house. The boat is positioned at an angle, with its bow facing towards the right side of the image.

In the background, there is a two-story house with a shingled exterior. The house has a small porch and a window on the second floor. There are several people standing around the yard, including children playing on the grass. The yard is well-manicured, with trees and bushes surrounding it.

Overall, the image appears to be a snapshot of a typical suburban scene, with a mix of everyday activities and domestic life. The presence of the boat suggests that the family may have a recreational interest, such as boating or fishing.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image depicts a black-and-white photograph of a suburban home with a driveway, featuring a boat and a van. The house is situated on the right side of the image, with a two-story structure and a shingled exterior. A window is visible on the second floor, while the first floor appears to be a garage or carport.

In the foreground, a van is parked in the driveway, facing left. Adjacent to the van, a boat is positioned on a trailer, also facing left. The driveway is paved and features a sidewalk running along its edge.

To the right of the driveway, a well-manicured lawn stretches out, with several individuals standing or sitting on it. The background of the image reveals trees and a clear sky, suggesting a sunny day. Overall, the scene appears to be a casual, everyday moment in a suburban neighborhood.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

A black-and-white photograph shows a house with a boat being loaded onto a truck. The house has a wooden exterior and a sloping roof. The boat is being lifted by a crane or a winch. There are people around the house, some standing on the porch and others near the boat. A few people are standing on the grass lawn in front of the house. There are trees and plants around the house.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white image depicts a family in front of a house. A boat is parked in front of the house, and a van is parked on the left side. Some people are sitting on the lawn, while others are standing in front of the house. A few trees are planted around the house. The shadows of the trees and the van fall on the ground.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image.

The black and white photograph features a daytime outdoor scene. The central foreground is dominated by the side of a light-colored van, parked on a residential street, with the front of the vehicle cropped off at the edge of the frame. Behind the van, a large boat rests on a trailer. People are seen near the boat.

In the background, a two-story house with a shingled exterior sits on a well-maintained lawn. Several figures are standing or sitting on the porch. On the lawn, two young boys are playing.

The scene is bathed in sunlight, casting shadows that add depth to the image. Trees and other foliage provide a backdrop to the house, adding to the suburban setting.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Scene:

The image is a black and white photograph depicting a residential scene, likely from the 1970s or 80s. It has a snapshot quality to it, capturing a moment in time. The scene focuses on a boat being unloaded or loaded in front of a house.

Foreground:

  • A large, vintage-looking van is prominently positioned on the left side of the image. We see the front end, with the headlights and front wheel facing the viewer.
  • A paved driveway is in the foreground, where the van is parked.
  • A curb and grassy area form the front yard of the house.

Midground:

  • A boat is being loaded or unloaded from a trailer. Several people are around the boat, possibly assisting with the process.
  • A house is in the background. It has a two-story design, with shingle siding. A few windows are visible.
  • A group of people stand on the lawn in front of the house.
  • Two boys are playing on the lawn in front of the house.

Background:

  • Trees and foliage partially obscure the upper portion of the house and contribute to the summertime feel of the scene.

Atmosphere:

The image has a nostalgic feel due to the black and white format and the subject matter. It seems like a snapshot of a family activity, possibly related to a weekend or vacation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

This black and white photograph captures a residential scene. In the foreground, a truck is parked on a driveway with a boat on a trailer attached to it. A person is crouching down beside the boat, possibly working on or inspecting it.

To the right of the truck, there is a house with a wooden exterior and a sloped roof. The house has a few windows, and some people are visible in the background near the house, seemingly engaged in conversation or activities.

In the yard, a young child is running across the grass, heading towards the camera. The yard appears to be well-maintained, with some shrubbery and trees providing shade. The overall atmosphere of the image suggests a casual, possibly suburban setting with people going about their daily activities.

Qwen