Human Generated Data

Title

Untitled (moldy umbrella)

Date

1976

People

Artist: Sage Sohier, American born 1954

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1156

Copyright

© Sage Sohier

Human Generated Data

Title

Untitled (moldy umbrella)

People

Artist: Sage Sohier, American born 1954

Date

1976

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1156

Copyright

© Sage Sohier

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 97.9
Human 85.5
Canopy 83.1
Awning 80.1
Chair 61.3
Table 59.2
Dining Table 58.3

Clarifai
created on 2023-10-25

monochrome 98.8
beach 98.4
people 97.9
travel 97.4
boat 97.3
sea 97
chair 96.9
architecture 96
water 95.7
ocean 95.5
no person 95.4
street 95.4
vintage 95.4
city 95.1
umbrella 94.9
house 94.2
vacation 92.9
landscape 92.9
snow 92.3
building 92.1

Imagga
created on 2022-01-09

dishwasher 96.2
white goods 75.4
home appliance 60.1
appliance 43
device 28.3
ventilator 20.9
equipment 19.8
durables 19.5
technology 19.3
3d 15.5
design 15.2
modern 14.7
home 14.3
house 14.2
render 13
office 12.8
finance 12.7
digital 12.1
business 12.1
metal 12.1
computer 12
architecture 11.1
money 11
close 10.8
drawing 9.8
object 9.5
paper 9.4
black 9
currency 9
success 8.8
interior 8.8
building 8.7
three dimensional 8.4
electronic 8.4
map 8.4
dollar 8.3
network 8.3
mousetrap 8.3
window 8.2
trap 7.8
construction 7.7
apartment 7.7
graphics 7.6
effects 7.6
hand 7.6
plan 7.6
style 7.4
security 7.3
global 7.3
open 7.2
bank 7.2
information 7.1
structure 7

Google
created on 2022-01-09

Tent 84.6
Shade 83.8
Black-and-white 81.9
Building 81.7
Tints and shades 77.4
Monochrome photography 74.2
Awning 73.3
Art 72.9
Monochrome 70.2
Font 69.9
Canopy 67.9
Fashion accessory 65.1
Rectangle 64.9
History 62.4
Painting 60.6
Room 59.2
Sky 58.3
Gazebo 57.9
House 57.3
Photographic paper 56.1

Microsoft
created on 2022-01-09

black and white 94.6
text 92.3
monochrome 75.9
playground 74.6
white 60.3
gallery 50.2

Color Analysis

Feature analysis

Amazon

Tent
Person

Clarifai

Umbrella
Tree
House
Furniture
Window

AWS Rekognition

Tent 90.3%

Categories

Imagga
created on 2022-01-09

paintings art 97.6%
cars vehicles 1.2%

Captions

Microsoft
created by unknown on 2022-01-09

a cat sitting on top of a table 58.4%
a cat sitting on a table 56.8%
an old photo of a cat 56.7%

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a house in the village.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a black and white photo of a person sitting in a hammock

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

This is a black-and-white photograph of a backyard or outdoor space on a residential property. The image features a multi-level house with an awning covering the second-floor balcony area. A person is visible leaning over the balcony railing, possibly working or inspecting something.

In the foreground, there is a worn and slightly damaged umbrella shading part of the patio. Beneath this umbrella, there are several outdoor lounge chairs and other furniture scattered around. A hammock is hanging under the structure, tied to the posts supporting the building. A ladder is propped up against the balcony railing, suggesting some maintenance or modification work is in progress.

The overall scene gives a slightly worn or lived-in appearance, evoking a casual, tropical, or suburban vibe. Trees and vegetation are faintly visible in the background, contributing to the calm and rustic atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image is a black and white photograph depicting the exterior of a house with a retro style, likely from the mid-20th century. The architecture features a flat roof and a balcony with horizontal railings, adorned with an awning. A person is seen climbing over the balcony railing, perhaps in the midst of some activity or maintenance.

In the foreground, there is an umbrella stand displaying a large, slightly worn-out umbrella providing shade to patio furniture, which includes multiple lounge chairs. The fabric of one chair is visible, giving an indication of leisure or relaxation typically associated with such settings.

Under the balcony, a hammock is strung between two poles or supports, indicating a place for resting or lounging. There is a ladder to the right of the image, suggesting that some work or repair might be ongoing. The setting suggests a backyard or patio area typical of a suburban home, filled with furniture and elements geared towards leisure and outdoor living. Overall, the photograph captures a moment of domestic tranquility mingled with activity.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows an outdoor seating area with umbrellas and hammocks. There is a wooden structure with a covered porch in the background. The scene appears to be in a tropical or beach-like setting, with palm trees visible. The image is in black and white, giving it a vintage or nostalgic feel.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This black and white photograph shows the exterior of what appears to be a residential building or vacation home with a patio area. The patio features a large fabric canopy or umbrella structure that appears somewhat weathered or damaged. There's a hammock visible hanging under the covered area, and several white outdoor lounge chairs are scattered on the concrete patio surface. A ladder is propped up on one side of the structure, and the building itself has wooden siding and what looks like a deck or balcony area visible on the upper level. The overall composition suggests this might be a beachside or tropical location, given the casual outdoor living setup and architectural style.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image depicts a black-and-white photograph of a house with a patio area, featuring a large umbrella and several chairs.

The house is two stories tall, with a balcony on the second floor. The balcony has a railing and a white awning. The patio area below has a large umbrella with a white canopy that appears to be dirty and worn out. There are several chairs scattered around the patio, including two lounge chairs and a small table. A ladder is also visible in the background.

In the background, there are trees and bushes surrounding the house, suggesting a backyard or garden setting. The overall atmosphere of the image is one of relaxation and leisure, with the patio area and umbrella suggesting a comfortable outdoor space for lounging or entertaining.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

This image is a black-and-white photograph of a house with a patio area, featuring a large umbrella and lounge chairs. The house has a dark exterior and a balcony on the second floor, with a white awning above the patio area. A hammock is visible on the left side of the patio, while a ladder stands on the right side. In the foreground, two lounge chairs are positioned under the umbrella, which appears to be in disrepair. The overall atmosphere of the image suggests a relaxed and casual setting, possibly a vacation home or resort.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of a house with a patio area. The patio features a large umbrella, which is open and appears to be wet, possibly from rain. There are lounge chairs and a hammock under the umbrella. The house has a balcony with railings, and a person is standing on it. There is a ladder leaning against the house, and a lifesaver is hanging on the wall. The image has a white border, and the scene appears to be in a state of disrepair or neglect.

Created by amazon.nova-pro-v1:0 on 2025-06-04

A black-and-white photo of a house with a balcony and a patio area with a hammock, lounge chairs, and a table. The house has a wooden fence and a balcony with a railing. The patio area has a hammock hanging from a tree, lounge chairs, and a table. The house has a balcony with a railing and a ladder. A person is standing on the balcony and looking down.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here's a description of the image:

The image is a black and white photograph featuring a house on stilts with a somewhat rundown appearance. A large, slightly tattered white umbrella dominates the foreground. Underneath the stilts, two hammocks are visible, suggesting a relaxed, leisure-oriented space. A set of white plastic chairs is grouped nearby, indicating a seating area. To the side of the house, a ladder leans against the structure. On the balcony above, a person is bent over, possibly performing maintenance or cleaning. Overall, the image has a slightly faded, nostalgic feel, enhanced by the black and white tones. The composition emphasizes the juxtaposition of leisure elements with signs of wear and upkeep.

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image is a black and white photograph depicting a relaxed, tropical-style outdoor scene. It appears to be a snapshot, possibly from the mid-20th century, capturing a moment of leisure.

Key Elements:

  • House: A two-story house is prominent, featuring a balcony or porch on the upper level. The house seems to be made of wood, with a dark exterior. There's a person (or a partial view of someone) working on the upper porch.
  • Outdoor Structure/Umbrella: A large, ornate umbrella provides shade below the elevated house. The umbrella's fabric shows signs of age or weathering.
  • Hammocks: Two hammocks are suspended beneath the porch, inviting relaxation.
  • Furniture: There are several white, slatted lounge chairs and a small table.
  • Ladder: A ladder is leaning against the upper porch.
  • Surroundings: The scene includes lush foliage, suggesting a tropical or subtropical environment.

Atmosphere:

The image evokes a sense of leisure, possibly a vacation or a relaxing afternoon. The black and white format and the details suggest a vintage photograph, adding to the nostalgic feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a tropical setting, likely a beachside or coastal area. It is a black and white photograph. The focal point is a two-story building with a wooden exterior and a balcony on the upper level. The balcony has a railing and appears to have some awnings or canopies.

In the foreground, there is a large, weathered umbrella providing shade. Underneath the umbrella, there are two hammocks hanging from the supports of the building, suggesting a relaxed, leisurely environment. Near the hammocks, there are a couple of lounge chairs, one of which is folded up. Additionally, there is a ladder leaning against the building, possibly indicating ongoing maintenance or construction work.

The ground appears to be sandy, and there are some tropical plants and trees visible in the background, adding to the beachy ambiance. The overall scene conveys a sense of tranquility and relaxation, typical of a beachside retreat or vacation spot.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black-and-white photograph showing a patio area with a structure that appears to be a gazebo or pavilion. The gazebo is supported by metal poles and has a canopy with an awning. Below the gazebo, there are two hammocks hanging from the structure, suggesting a relaxing outdoor space.

In front of the gazebo, there are several white wooden chairs arranged on a concrete patio. To the right side of the image, a ladder is leaning against the structure, and a person is visible climbing the ladder, possibly adjusting the canopy or the structure itself. The background includes a wooden deck with a railing and some tropical foliage, indicating a warm or tropical environment. The overall atmosphere of the image is serene and leisurely, typical of a vacation or resort setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white photograph captures a scene of a patio or outdoor area adjacent to a two-story house. The image is mounted on a white mat, giving it a framed appearance. Here's a detailed description:

  1. Foreground:

    • There are two white lounge chairs with a matching white table between them, positioned in the lower right corner of the image.
    • A large white canopy tent is set up in the center, providing shade over the area. The canopy appears slightly worn, with some discoloration visible.
  2. Midground:

    • A hammock is suspended between two points near the left side of the image, under the canopy tent.
    • A tree with a gnarled trunk is partially visible near the hammock, adding a natural element to the scene.
    • Two ladders are placed against the house, suggesting some maintenance or repair work is being done.
  3. Background:

    • The house is a two-story structure with a dark exterior. The upper floor has a balcony with a railing.
    • A person is visible on the balcony, leaning over the railing, possibly engaged in the maintenance work.
    • The roof of the house has a scalloped edge, adding a decorative touch.
    • Palm trees are visible in the background, indicating a tropical or subtropical setting.

The overall atmosphere of the image suggests a relaxed, possibly vacation-like setting, with elements of leisure (lounge chairs, hammock) and maintenance (ladders, person on the balcony). The black-and-white format adds a timeless quality to the scene.