Human Generated Data

Title

Charity, Public: United States. New York. New York City. Almshouse, Blackwell's Island: The Almshouse, Blackwell's Island (New York City Almshouse System): General Store-House

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1059.2

Human Generated Data

Title

Charity, Public: United States. New York. New York City. Almshouse, Blackwell's Island: The Almshouse, Blackwell's Island (New York City Almshouse System): General Store-House

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1059.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 99.8
Outdoors 99.5
Building 98.4
Shelter 97.5
Countryside 97.5
Rural 97.5
Housing 90.8
Human 90.8
Hut 90.7
Shack 87.1
House 72.3
People 55.9
Architecture 55.6

Clarifai
created on 2019-06-07

no person 98.1
people 96.4
vintage 96.4
home 96.1
print 95.6
building 94
old 93.5
house 90.9
sepia 90.4
winter 89.2
calamity 89.1
monochrome 88.5
military 87.7
architecture 87.6
antique 87.2
vehicle 87.2
barn 86.4
art 86
landscape 86
abandoned 85.2

Imagga
created on 2019-06-07

building 58
barn 55.9
structure 43.3
farm building 40.4
sky 34.4
old 30.7
architecture 30.5
wall 28.2
snow 27.5
landscape 24.6
rural 22.1
roof 21.4
house 21.1
hut 20.2
travel 19
countryside 18.3
fortress 18.3
history 17.9
scenery 17.2
landmark 16.3
clouds 16.1
scenic 15.8
tourism 15.7
historic 15.6
ancient 15.6
field 15.1
country 14.9
construction 14.6
winter 14.5
shelter 13.8
religion 13.5
rustic 13.4
vintage 13.2
church 13
grass 12.7
farm 12.5
culture 12
tower 11.8
weather 11.8
city 11.7
scene 11.3
famous 11.2
trees 10.7
tree 10.2
stone 10.1
window 10.1
agriculture 9.7
antique 9.5
outside 9.4
grunge 9.4
exterior 9.2
brick 9.2
mountain 9
obsolete 8.6
historical 8.5
outdoor 8.4
town 8.4
wood 8.3
traditional 8.3
mill 7.9
cold 7.8
heritage 7.7
summer 7.7
temple 7.7
hill 7.5
environment 7.4
retro 7.4
antenna 7.3
thatch 7.3
coast 7.2
home 7.2
river 7.1
wooden 7

Google
created on 2019-06-07

Photograph 94.8
Snapshot 82.5
House 68.3
Tints and shades 64.5
Building 63.1
Home 57
Art 50.2

Microsoft
created on 2019-06-07

building 99.2
outdoor 94.9
sky 86.7
house 75.5
old 74.2

Color Analysis

Feature analysis

Amazon

Person

Clarifai

House
Tree

AWS Rekognition

Person 90.8%

AWS Rekognition

Person 73.8%

Clarifai

House 85.1%

Clarifai

House 46.1%

Clarifai

House 40.3%

Clarifai

Tree 37.2%

Categories

Imagga
created on 2019-06-07

nature landscape 67.3%
streetview architecture 21.7%
paintings art 6.4%
beaches seaside 3.1%

Captions

Microsoft
created by unknown on 2019-06-07

an old photo of a building 82.6%
a large white building 77%
a close up of an old building 76.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a building with a cross on the side of it

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a building with a flag on top

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This is a historical photograph of a modest one-story stone building, likely a store or warehouse in a frontier setting. The structure has a pitched roof with several small chimneys along its ridgeline. The building features arched doorways and windows, contributing to its sturdy appearance. A sign reading "STORE" appears on the facade's gable end. Outside the building, barrels, crates, and other goods are stacked, suggesting commercial activity. Two men are visible near the entrance, and a tall flagpole without a flag stands nearby. The surroundings are sparse, with an open dirt ground and minimal infrastructure, including a crooked telegraph pole in the background. The number "341" is handwritten in the upper right corner of the image.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a historical black-and-white photograph of a stone building identified by a sign as the "Stone Commissary." The building is constructed with what appears to be large blocks of stone and features an arched entrance. Several barrels and crates are stacked near the entrance, indicating the storage or shipment of goods, which aligns with the function of a commissary. Two individuals are visible near the entrance, possibly workers or patrons. There is a tall flagpole on the right side of the building, but no flag is present. The setting appears to be dusty, and there are wheel marks on the ground, suggesting the presence of carts or carriages. A utility pole can be seen in the background. The image is marked with the number "341" in the upper right corner.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows an old industrial or commercial building with a stone or brick exterior. The building has a tall, narrow chimney or tower on the roof. There are several barrels or crates visible outside the building, suggesting it may have been used for storage or distribution. The overall scene appears to be from an earlier time period, likely in the late 19th or early 20th century based on the architectural style and the black and white photographic medium.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a historical black and white photograph of a warehouse or storage building. The structure has a stone or brick exterior with arched doorways across the front. There are several barrels and crates stacked near the entrance. The building has a peaked roof with multiple chimneys or vents, and there's a utility pole with a cross-arm visible on the roof. A tall flagpole or mast extends from one end of the building. The image appears to be from the late 1800s or early 1900s based on its style and composition. The number "341" is visible in the top right corner of the photograph, suggesting this may be part of a documentary or archival series.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a sepia-toned photograph of a large stone building with a gable roof, featuring a central arched doorway and a tall flagpole rising from the roof. The building's façade is constructed from rough-hewn stones, with a row of windows along the right side. A sign above the doorway reads "STONE QUARRY" in bold letters.

In the foreground, a man stands in the doorway, while a stack of wooden barrels is visible to the left. The background of the image shows a clear sky, with a handwritten number "341" in the top-right corner. The overall atmosphere of the image suggests a rural or industrial setting, possibly from the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a sepia-toned photograph of a building, likely taken in the late 19th or early 20th century. The building is constructed from stone and features a gabled roof with multiple chimneys. A sign above the entrance reads "STONE RIDGE R.R." in black letters on a white background.

In front of the building, several barrels are stacked, and a man stands to the left, wearing a hat and coat. To the right of the building, a horse-drawn carriage is visible, although partially obscured by the edge of the image. The sky above is overcast, and the overall atmosphere suggests a rural or small-town setting.

The image appears to be a historical photograph, possibly documenting a railroad station or depot in Stone Ridge, New York. The presence of the railroad sign and the horse-drawn carriage suggests that the image was taken during a time when railroads were a primary mode of transportation.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image is a black-and-white photograph of a building with a slate roof. The building has multiple windows and a door in the middle. There are several barrels and barrels stacked in front of the building. Two people are standing in front of the building, and one of them is wearing a hat. There is a pole with a flag on top of the building. The image has a watermark with the number "341" in the upper right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black and white photograph of a building. The building is made of stone and has a flat roof. There are two large arched doorways on the front of the building. A sign above the doorway on the right reads "State House, 1867." There are several barrels and other items outside the building. Two people are standing in front of the building. There is a tall pole in front of the building.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here is a description of the image:

The image is a black and white photograph of a long, one-story stone building. The building has a pitched roof, and there are several barrels stacked near the entrance, and two men are standing in front of them. The building appears to be a storage or warehouse facility.

A tall flagpole rises from the roof of the building. A telephone pole is also visible in the background behind the building.

The overall scene is somewhat deserted and has a vintage feel, suggesting the photo was taken a long time ago. Handwritten number “341” is in the upper right part of the image.

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

The image is a vintage black and white photograph depicting a stone building, likely a warehouse or storehouse, with a simple, symmetrical design. The building's facade has arched openings. A flag pole is in front of the structure. A telephone pole stands on the roof. Several barrels are stacked in front of some of the arched openings. A few people can be seen standing near the building. The name "STORE HOUSE, 1867" is written on the building. The photograph seems to be from an older era, possibly the late 19th or early 20th century, given the style of the building, the grainy texture of the photograph, and the clothing worn by the individuals. The image has a simple, documentary feel, suggesting it might be a record of a place or business from a bygone time. The number "341" has been handwritten in the top right corner.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts an old, industrial-style building that appears to be a warehouse or storage facility. The structure is made of stone or brick, with a sloped roof and several chimneys or vents protruding from it. There are multiple arched openings along the front of the building, some of which are filled with stacked barrels or crates.

Two individuals are standing near the barrels, possibly engaged in some form of work or conversation. The building has a sign above one of the doors that reads "B.C. & E.," which might indicate the name of the company or the building's purpose. A tall pole or antenna is visible behind the building, suggesting it might have been used for communication or signaling purposes.

The ground in front of the building is unpaved and appears to be dirt or gravel. The overall scene suggests a historical setting, possibly from the late 19th or early 20th century, given the style of the building and the attire of the individuals. The number "341" is written in the upper right corner of the image, which might be a reference or catalog number.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This image depicts a large, industrial-looking building with a flat roof and a sign that reads "STORE HOUSE, 1867." The structure appears to be made of stone or brick and has several stone arches and a central arched window. There is a flagpole on the right side of the building, though no flag is raised. The building is surrounded by what looks like a paved area with some barrels or barrels-like objects scattered around. Two individuals are visible in the foreground, seemingly engaged in some activity near the barrels. The sky is overcast, and there are utility poles in the background, suggesting a setting from the late 19th or early 20th century. The number "341" is handwritten in the top right corner of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white historical photograph depicts a large stone building with a triangular roof, featuring several chimneys and a tall flagpole at its edge. The building has multiple arched doorways, and some are open, revealing stacks of barrels and boxes inside. A person stands near one of the open doorways, holding a box, while another person is partially visible near the entrance. The building is labeled "STORE HOUSE 1857" above the central archway, indicating its purpose and date of construction. The ground in front of the building appears to be dirt or gravel, and there are additional barrels and objects scattered around the area. The overall scene suggests a historical industrial or storage facility.

Text analysis

Google

341 S7O U
341
S7O
U