Human Generated Data

Title

Charity, Public: United States. New York. Canandaigua. Ontario County Almshouse: Almshouses of Ontario County, N.Y.: Rear View of Main Buildings from Barn

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.954.1

Human Generated Data

Title

Charity, Public: United States. New York. Canandaigua. Ontario County Almshouse: Almshouses of Ontario County, N.Y.: Rear View of Main Buildings from Barn

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.954.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 99.8
Outdoors 99.6
Storm 99
Blizzard 99
Winter 99
Snow 99
Weather 74
Landscape 69.9
Building 64.7
Scenery 60.1
Office Building 59
Neighborhood 57.4
Urban 57.4

Clarifai
created on 2019-06-07

architecture 98.4
building 97.5
house 97
old 95.8
no person 94.7
travel 94.1
street 91.1
city 90.9
vintage 90.1
town 89.3
art 89.2
winter 88.8
outdoors 87.8
castle 87.1
home 86.7
ancient 86.3
wall 86.3
urban 82.9
sky 81
tourism 80.8

Imagga
created on 2019-06-07

monastery 72.6
residence 66.9
building 63
palace 60.8
architecture 60.6
religious residence 54.6
house 53.4
city 37.5
tower 33.2
old 32.8
ancient 32.1
travel 31.8
landmark 31.7
history 31.4
historic 27.6
tourism 27.3
castle 26.9
sky 26.2
town 26
dwelling 25.5
church 23.2
fortress 22.8
historical 22.6
culture 19.7
wall 18.2
medieval 17.3
religion 17.1
monument 16.9
buildings 16.1
stone 16.1
cathedral 15.5
prison 15.2
famous 14.9
facade 14.8
tourist 14.7
structure 13.9
construction 13.7
landscape 13.4
vintage 13.3
exterior 12.9
antique 12.1
brick 11.9
balcony 11.9
square 11.8
architectural 11.6
correctional institution 11.5
old fashioned 11.4
window 11.1
museum 10.9
fort 10.8
river 10.7
heritage 10.6
cityscape 10.4
sunny 10.4
snow 10.2
scenery 9.9
urban 9.6
fortification 9.6
grunge 9.4
destination 9.4
grain 9.2
temple 9.1
mosque 9.1
aged 9.1
outdoors 9
water 8.7
saint 8.7
paper 8.6
penal institution 8.6
statue 8.6
capital 8.6
clouds 8.5
religious 8.5
roof 8.4
ornate 8.3
retro 8.2
style 8.2
plaza 8.2
scenic 7.9
arch 7.8
houses 7.8
place 7.5
street 7.4
rough 7.3
day 7.1

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

sky 93.3
building 91.9
house 74

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

Tree
House
Poster
Window

Clarifai

Tree 86.4%

Clarifai

Tree 61.9%

Clarifai

House 71.8%

Clarifai

House 61.3%

Clarifai

House 41.9%

Clarifai

Poster 68.6%

Clarifai

Window 53.1%

Clarifai

Window 49.1%

Clarifai

Window 48.6%

Clarifai

Window 47.4%

Clarifai

Window 46.7%

Clarifai

Window 46.4%

Clarifai

Window 45.9%

Clarifai

Window 45.3%

Clarifai

Window 45.3%

Clarifai

Window 43.8%

Clarifai

Window 43.4%

Clarifai

Window 42.8%

Clarifai

Window 42.5%

Clarifai

Window 41.8%

Clarifai

Window 41.4%

Clarifai

Window 41.2%

Clarifai

Window 39.7%

Clarifai

Window 39.3%

Clarifai

Window 38.8%

Clarifai

Window 38.2%

Clarifai

Window 38.1%

Clarifai

Window 37.9%

Clarifai

Window 37.1%

Clarifai

Window 36.8%

Clarifai

Window 34.7%

Clarifai

Window 34.7%

Clarifai

Window 34.4%

Clarifai

Window 33%

Categories

Imagga
created on 2019-06-07

streetview architecture 45.5%
interior objects 40.4%
paintings art 6.9%
beaches seaside 3.7%
sunrises sunsets 1.7%
nature landscape 1.3%

Captions

Microsoft
created by unknown on 2019-06-07

a large white building 80.8%
a close up of an old building 80.7%
a large building 80.6%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a clock tower in a large building with a clock tower

Created by general-english-image-caption-blip-2 on 2025-07-08

a large building with a clock tower in the front

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This sepia-toned photograph depicts a large building complex, possibly from the late 19th or early 20th century. The structure on the right is a multi-story building with a mansard roof featuring dormer windows, classic of Second Empire architectural style. It has numerous rectangular windows with shutters evenly spaced along its façade. The left portion of the image shows a lower, adjoining building with a simple angular roof and a smaller cupola.

In the foreground, there is a tall pole topped with a birdhouse or dovecote, crafted to resemble a miniature house, standing prominently in the courtyard area. The surroundings include a dirt or gravel pathway, grassy patches, a section enclosed by a wooden or wire fence, and leafless trees—indicating either winter or early spring. Overall, the image portrays a serene, spacious scene, likely of an institutional or residential building.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts an old photograph of a large building complex with a distinct architectural style. The main structure appears to be a multi-story building with a mansard roof, characterized by dormer windows protruding from the steeply pitched part of the roof. The facade of the building has several evenly spaced windows with dark shutters.

In front of the main building, there is a tall pole with a birdhouse perched atop it, which stands prominently in the center of the image. To the left, there is another section of the building with a simpler design; it is one story tall, with a sloping roof and lesser detail in the windows and structure.

The surrounding area consists of a spacious yard and some trees, and a fence runs along the property, with the ground appearing worn or sparsely vegetated. In the foreground, there seems to be a small pathway or driveway leading up to the building.

The overall appearance of the photograph gives it a historical feel, with signs of discoloration or fading typical of older photographs. The image captures a quiet, static moment in the life of this building complex, likely dating back to the late 19th or early 20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a historical photograph of a large, multi-story building with a distinctive architectural style. The building has a prominent tower-like structure on top, and there are several smaller structures or wings attached to the main building. The photograph seems to have been taken from a distance, capturing the overall structure and surrounding landscape, which includes some trees and a fence or barrier in the foreground. The image has a sepia tone, indicating it is an older photograph, likely from the late 19th or early 20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white historical photograph of what appears to be a large colonial-style building complex. The main structure is a multi-story white building with black shutters and a mansard roof typical of Second Empire architecture. There's a distinctive tall birdhouse or dovecote mounted on a pole in the center of the image. The complex includes several connected buildings with various roof lines and architectural features. In the foreground, there appears to be a fenced yard or courtyard area, and there are some outbuildings or extensions with covered porches. The image has the number "386" written in the top right corner, suggesting it may be part of a historical documentation or archive. The photograph has the sepia toning and slight fading characteristic of late 19th or early 20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of a large, multi-story building with a birdhouse on top of a tall pole in the foreground. The building has a mix of architectural styles, including colonial and Victorian elements, and features multiple chimneys and windows. In the background, there are several other buildings, trees, and a dirt road or path leading up to the main building.

The overall atmosphere of the image suggests that it was taken in the late 19th or early 20th century, possibly in a rural or suburban area. The presence of the birdhouse and the surrounding landscape adds a sense of tranquility and natural beauty to the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a large, multi-story building with a prominent water tower. The building appears to be an old hotel or inn, with a central section and two wings on either side. The central section has a gable roof and a covered porch on the first floor, while the wings have flat roofs and multiple windows. The water tower stands tall in front of the building, with a small house-like structure at the top.

In the foreground, there is a dirt road or driveway leading up to the building, with a few trees and bushes scattered around. The sky above is overcast, giving the image a somber and nostalgic feel. Overall, the photograph captures a sense of history and nostalgia, evoking a bygone era when such buildings were common in rural areas.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

This black-and-white photograph features a large building with multiple windows and a chimney. The building has a distinct architectural style, possibly Victorian or Gothic. It is surrounded by a fence, and there is a tree in the foreground, adding to the scene's composition. In the center of the image, there is a birdhouse perched on a pole, which adds a charming touch to the photograph. The photograph has a slightly blurry effect, giving it an old-fashioned look.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The black-and-white image shows the front of a building with a birdhouse on top of a pole in the middle. The building has several windows, and some of them have shutters. The building is surrounded by a fence. There are two trees on the right side of the building. On the left side, there is a tower-like structure. The image has a watermark with the number "386" in the upper right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here's a description of the image:

The image is a vintage black and white photograph, likely from the early to mid-20th century. It depicts a multi-building complex, possibly a school or boarding house, with some light spots in the bottom of the image.

The main building is a three-story structure with a symmetrical facade. It has a gabled roof with dormer windows. On the side is a covered porch area with pillars. Windows are evenly spaced across the facade, and there are chimneys visible on the roof.

A large birdhouse, standing atop a tall pole, is prominently featured in front of the main building.

To the left of the main building is a smaller, connected building with a lower roofline. A portion of another building is visible on the left.

A dirt path runs along the right side of the main building, and a simple wire fence separates the building from the path. A large, bare tree stands near the edge of the building.

The sky is overcast and light, and the overall tone of the image is somewhat muted. The number "386" is written in ink in the upper right corner of the image.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

Overall Impression:
The image is a vintage, sepia-toned photograph depicting a large, multi-story building. It appears to be a hotel, inn, or similar type of establishment. The photograph is well-composed, capturing the building from a slightly low angle, giving a sense of scale.

Key Features:

  • Architecture: The building features several architectural styles, likely from the late 19th or early 20th century. It has a symmetrical facade with evenly spaced windows, dormer windows in the roof, and a porch.
  • Birdhouse: One unique feature is a large, elaborate birdhouse mounted high on a pole in front of the building. This adds a charming touch.
  • Grounds: The building is set on a grassy lawn with a fence and a path in the foreground.
  • Setting: The surroundings suggest a rural or semi-rural setting. A tall tree stands to the right of the building.
  • Weather: The sky is overcast, and there is a slight softness to the image, possibly from the camera lens.
  • Label: There is handwritten "386" in the top right corner of the image, likely an identifier.

Atmosphere: The image conveys a sense of nostalgia, of a bygone era. It evokes a feeling of calm and quiet, possibly in a resort or retreat.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts an old, multi-story building complex, likely from the late 19th or early 20th century. The architecture features a mix of styles, with the main building having a mansard roof and dormer windows, which are characteristic of Second Empire architecture. The building has multiple chimneys and a tall, ornate structure that appears to be a bell tower or a lookout post.

To the left of the main building, there is a smaller, connected structure with a gabled roof and a covered porch or walkway. The buildings are surrounded by a courtyard area with a dirt or gravel ground, and there are a few bare trees, indicating that the photo might have been taken in late autumn or winter.

The overall scene suggests a historical setting, possibly a school, hospital, or institutional building. The number "386" is written in the top right corner, which might be an identifier for the photograph. The image has a sepia tone, typical of old photographs, adding to its historical feel.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This image is a historical photograph, likely from the late 19th or early 20th century, judging by its sepia tone and style. It depicts a large, multi-story building that appears to be a hotel, boarding house, or similar establishment, based on its architectural features and the presence of a porch area with what looks like guest rooms or living spaces.

The building has a classic Victorian-era design, with ornate decorative elements around the windows and a series of chimneys along its roofline. There is a tall, square tower on the left side of the building, which might have been used for a bell or other purposes.

In front of the building, there is a paved area and a grassy section with some sparse, leafless trees, suggesting the photo was taken in the winter. There are also some simple wooden structures or railings visible in the foreground, possibly part of a fence or gate.

In the background, there is a large water tower, which was common in larger buildings of that era to provide water to the building. There is also a number "386" in the upper right corner of the photograph, which could be a catalog or identification number for the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a vintage black-and-white photograph of a large, multi-story building with a Victorian architectural style. The building features a prominent central section with a gabled roof and multiple windows, some of which have shutters. There are several chimneys on the roof, indicating fireplaces inside. The building has a covered porch area with columns, and there is a smaller structure attached to the left side. In the foreground, there is a dirt yard with a few wooden benches and a small tree. A tall pole with a decorative top stands near the center of the yard. The number "386" is handwritten in the upper right corner of the photograph. The overall scene suggests a historical setting, possibly a hotel or a large residence.

Text analysis

Amazon

386

Google

386 ecccrCEsoCCock CEEESEEEEEED
386
ecccrCEsoCCock
CEEESEEEEEED