Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Harlem Hospital, Manhattan: Harlem Hospital, Manhattan (New York City Almshouse System): Side View and Yard

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.829.2

Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. Harlem Hospital, Manhattan: Harlem Hospital, Manhattan (New York City Almshouse System): Side View and Yard

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.829.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 93.6
Outdoors 89.6
Shelter 80.7
Countryside 80.7
Rural 80.7
Building 80.7
Tree 75.7
Plant 75.7
Ground 58.8
Tower 58.3
Spire 58.3
Architecture 58.3
Steeple 58.3
Banister 57.3
Handrail 57.3
Sketch 56.6
Art 56.6
Drawing 56.6
Road 56.6
Snow 56.5
Soil 55.5

Clarifai
created on 2019-06-07

home 98.3
no person 97.6
architecture 97.3
house 96.6
building 96.2
sepia 94.3
tree 94.2
people 91.9
old 91.2
street 90.6
outdoors 89.5
vintage 88.8
town 86.6
calamity 84
art 83.9
wall 81
ancient 80.1
city 77.8
landscape 76.9
travel 76.4

Imagga
created on 2019-06-07

architecture 40.4
building 33.1
shopping cart 32.3
sketch 28.9
handcart 26
landscape 25.3
old 25.1
sky 24.4
drawing 23.6
city 22.5
snow 21.8
travel 21.1
water tower 20.8
structure 20.1
wheeled vehicle 20
history 19.7
vintage 18.2
antique 17.3
representation 17.3
tower 17.1
winter 17
house 16.7
container 16.4
grunge 16.2
reservoir 15.8
tourism 15.7
ancient 15.6
rural 15
landmark 14.5
paper 13.3
church 13
cold 12.9
trees 12.5
old fashioned 12.4
town 12.1
construction 12
scenery 11.7
tank 11.7
university 11.6
billboard 11.6
tree 11.6
historic 11
clouds 11
space 10.9
weather 10.9
outdoor 10.7
river 10.7
retro 10.7
rustic 10.6
texture 10.4
grain 10.2
wall 10.1
brick 10.1
aged 10
religion 9.9
roof 9.6
stone 9.6
grungy 9.5
historical 9.4
season 9.4
water 9.4
scenic 8.8
sepia 8.8
houses 8.7
signboard 8.7
scene 8.7
frame 8.3
rough 8.2
grass 7.9
vessel 7.8
culture 7.7
medieval 7.7
obsolete 7.7
facade 7.7
buildings 7.6
famous 7.5
exterior 7.4
street 7.4
road 7.2
country 7

Google
created on 2019-06-07

House 92.6
Property 87.5
Home 83.8
Building 81
Residential area 78.1
Architecture 76.3
Tree 74.7
History 67.6
Room 65.7
Landscape 59.3
Estate 58.5
Monochrome 54.4
Historic house 52.3
Suburb 50.5

Microsoft
created on 2019-06-07

outdoor 97.3
house 95.7
tree 86.9
building 71.9
old 57.8
dirt 22.7

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

Tree
House
Window
Fountain

Clarifai

Tree 97.3%

Clarifai

Tree 93.8%

Clarifai

Tree 89.4%

Clarifai

Tree 89%

Clarifai

Tree 53.7%

Clarifai

Tree 47.4%

Clarifai

Tree 43.4%

Clarifai

Tree 42.2%

Clarifai

Tree 39.7%

Clarifai

Tree 39.7%

Clarifai

House 88.7%

Clarifai

House 64%

Clarifai

House 59.1%

Clarifai

House 57.8%

Clarifai

House 41%

Clarifai

Window 52.8%

Clarifai

Window 52%

Clarifai

Window 48.5%

Clarifai

Window 48.2%

Clarifai

Window 43.7%

Clarifai

Window 43.2%

Clarifai

Window 42.8%

Clarifai

Fountain 38.5%

Categories

Imagga
created on 2019-06-07

streetview architecture 45.2%
beaches seaside 29.1%
interior objects 16.7%
paintings art 7.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large building with a large building in the background

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a house with a fountain in front of it

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This is a black-and-white photograph depicting a residential house surrounded by a backyard garden. The house has a Victorian architectural style, featuring a Mansard roof and visible chimneys, along with two floors and attic-level dormer windows.

The yard is neatly organized with a fountain in the center of the grassy area, flanked by several trees and benches. A path cuts through the lawn, leading to a gazebo with a pointed roof, which stands just in front of the house’s entryway. To the right side of the yard are laundry lines with clothes hanging to dry, bordered by trees and other structures, possibly outbuildings.

The background shows additional urban structures, suggesting the house is situated within a larger town or city. Power lines run horizontally across the image. The atmosphere evokes a sense of modest elegance and turn-of-the-20th-century life.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a sepia-toned photograph of a residential property, likely from the late 19th or early 20th century. It features a two-story house with a mansard roof and chimney stacks. The facade includes windows with shutters and a small balcony above the entrance. In front of the house is a garden area with a large lawn, a water fountain, and several trees lining either side. There is a small, ornate gazebo centered on the path leading from the foreground to the house. To the right of the gazebo are clothes drying on a line, supported by poles. The garden is bordered by a low fence, and there seems to be urban buildings in the background, implying a city setting. There are also benches in the garden, offering a place to sit and enjoy the surroundings. The overall atmosphere of the image gives a sense of a tranquil, historical residential scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows an old, ornate two-story building with a decorative roof and balconies. The building is surrounded by trees and a well-manicured lawn with a fountain in the foreground. The scene appears to be from an earlier time period, as evidenced by the sepia-toned photograph. There are no people visible in the image.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a vintage black and white photograph showing a stately Victorian-era house with ornate architectural details, including a mansard roof and decorative cornices. In the foreground is a well-maintained yard featuring a fountain or bird bath and what appears to be a decorative gazebo or garden structure with a pointed roof. There are trees scattered throughout the yard providing shade, and laundry can be seen hanging on lines in the background. The image has the number "321" written in the top right corner and appears to be from the late 19th or early 20th century, given the architectural style and photographic quality.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of a large house with a garden and fountain in front.

  • The house is three stories tall, with a balcony on the second floor and a porch on the first floor.
  • There are several windows on the front of the house, and a chimney on the roof.
  • The garden is well-manicured, with a fountain in the center and several trees and bushes around it.
  • A path leads from the street to the front door of the house.
  • In the background, there are other buildings and trees visible.
  • The sky is overcast, and the overall atmosphere of the image is one of serenity and tranquility.

The image appears to be an old photograph, possibly from the early 20th century, given the style of the house and the clothing worn by the people in the image.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of a large house with a yard. The house has two stories and a basement, with a porch on the first floor and a balcony on the second floor. There are several windows on both floors, and a chimney on the roof.

In front of the house, there is a small gazebo with a pointed roof and a fence surrounding it. To the left of the gazebo, there is a fountain with three tiers. The yard is surrounded by trees and bushes, and there is a dirt path leading up to the house.

In the background, there are other houses and buildings visible, as well as power lines and telephone wires. The sky is overcast, and the overall atmosphere of the image is one of nostalgia and tranquility.

The image appears to be an old photograph, possibly from the early 20th century, and it may have been taken for historical or architectural purposes. It provides a glimpse into the past and shows how people lived and built their homes during that time period.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image is an old black-and-white photograph of a house. The house has a gabled roof and several windows, and it is surrounded by trees. There is a fountain in the center of the yard, with a bench nearby. The yard is surrounded by a fence, and there is a gazebo with a roof in the yard. There are clothes hanging on a clothesline, and there is a building with a staircase in the background.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black-and-white photograph of a house with a garden. The house is a three-story building with a chimney on top and many windows. There are trees and plants around the house, and a fountain in the middle of the garden. There is a gazebo with a roof in front of the house. There is a pathway leading to the house, and a few clothes are hanging on the clothesline.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here is a description of the image:

The sepia-toned photograph presents a stately house viewed from a slight elevation, with the focus on its elegant exterior and the garden landscape in front. The building is three stories tall, featuring a columned porch on the second story and dormers on the top floor. It has a symmetrical design and a classic, perhaps colonial, architectural style.

The garden is divided into two distinct sections. To the left, there is a grassy area populated with trees and benches, suggesting a park-like setting. A tiered fountain stands prominently within this area, adding to the aesthetic appeal. To the right, the garden transitions to a more open, sandy ground. A decorative gazebo marks the transition between the two areas, with a path leading directly through it.

Behind the house, other buildings are visible, adding context to the surrounding environment. Utility lines are strung across the top portion of the frame, a common detail in urban landscapes. The overall composition suggests a sense of tranquility and refined taste, evoking a sense of nostalgia.

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

The image appears to be a vintage photograph, likely taken in the late 19th or early 20th century. It captures a stately, three-story house with a classic architectural style, set within a well-manicured garden.

Here's a breakdown of the scene:

  • The House: The house is the focal point, painted in a light color and featuring a prominent porch, multiple windows, and dormers on the roof.

  • The Garden: The foreground is filled with a lawn, and a fountain with a tiered design sits in the center of the garden. There are also trees, benches, and a decorative gazebo.

  • Pathways: A path of gravel or dirt leads from the front of the house towards the gazebo.

  • Background: Behind the house, other buildings can be seen. There seems to be a section for laundry with clotheslines strung up.

  • Atmosphere: The sepia tone and the subject matter evoke a sense of the past, likely depicting a wealthy residence and garden from a bygone era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts an old photograph of a large, two-story house with a distinct architectural style that appears to be Victorian. The house has ornate detailing, including decorative trim around the windows and along the roofline, as well as a prominent central gable. The house features a balcony on the second floor, accessible through a set of double doors.

In front of the house, there is a well-maintained garden with various trees and shrubs. A notable feature in the garden is a small, ornate gazebo with a conical roof, situated near the center of the image. Adjacent to the gazebo, there is a circular fountain or birdbath. The pathway leading up to the house is made of gravel or small stones, and there is a small wheelbarrow positioned on the lawn to the left of the pathway.

To the right of the house, there are additional structures, including what appears to be a shed or small outbuilding with a slanted roof. There are also clotheslines with laundry hanging out to dry, indicating domestic activities. The background shows more buildings, suggesting that this house is located in a residential area with other nearby homes.

Overall, the image captures a serene and picturesque scene of a historic home and its surrounding garden, reflecting a bygone era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image depicts an old, sepia-toned photograph of a two-story, Victorian-style house with a large front porch supported by columns. The house has a prominent tower with a pitched roof and a small balcony. In the foreground, there is a paved walkway leading up to the house, flanked by a grassy area. To the left of the house, there is a three-tiered fountain, and to the right, there is a gazebo-like structure. In the background, there are other buildings and some trees, with clotheslines visible, suggesting a residential setting. The photograph appears to have been taken in an outdoor environment during the daytime, and the overall scene has a nostalgic, historical feel.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a sepia-toned historical photograph of a large, two-story house with a prominent porch and balcony, characteristic of Victorian architecture. The house has a sloping roof with multiple chimneys and decorative trim. In the foreground, there is a well-maintained lawn with a fountain at the center, surrounded by a paved pathway. A gazebo-like structure with a conical roof is located near the pathway, and a few benches are scattered around the yard. A clothesline with laundry is visible to the right side of the image, indicating a domestic setting. Trees and additional buildings can be seen in the background, suggesting a residential area. The photograph appears to be from the late 19th or early 20th century.

Text analysis

Amazon

331

Google

3a1
3a1