Human Generated Data

Title

Charity, Public: United States. New York. Mexico. Oswego County Almshouse: Almshouses of Oswego County, N.Y.: Rear View of Main Building

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1039.1

Human Generated Data

Title

Charity, Public: United States. New York. Mexico. Oswego County Almshouse: Almshouses of Oswego County, N.Y.: Rear View of Main Building

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1039.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 97.8
Building 97.8
Outdoors 94.8
Factory 89.7
Human 84
Snow 77.7
Architecture 65.9
Weather 62
Column 58.5
Pillar 58.5
Spire 56.3
Steeple 56.3
Tower 56.3

Clarifai
created on 2019-06-07

no person 97.7
people 97.1
vehicle 94.7
group 94.2
print 93.3
building 91.6
winter 90.8
architecture 90.3
home 87.8
art 87.6
outdoors 86.8
travel 85
many 84.9
military 84.3
war 83
adult 82.2
city 81.9
transportation system 80.4
town 80.3
lithograph 77.8

Imagga
created on 2019-06-07

obelisk 100
column 100
structure 100
architecture 45.5
tower 41.4
building 37.7
city 33.3
travel 33.1
tourism 29.7
sky 29
landmark 26.2
monument 26.2
history 22.4
river 22.3
urban 20.1
cityscape 19.9
old 18.1
construction 18
church 17.6
town 15.8
famous 14.9
water 14.7
historic 14.7
snow 14.3
skyline 14.3
industrial 13.6
landscape 13.4
capital 12.4
buildings 12.3
culture 12
religion 11.7
tourist 11
clouds 11
stone 11
minaret 10.6
cathedral 10.6
bridge 10.4
exterior 10.1
ship 9.8
scene 9.5
historical 9.4
temple 8.9
metal 8.9
chimney 8.8
factory 8.7
downtown 8.7
attraction 8.6
sea 8.6
industry 8.5
winter 8.5
tree 8.5
power 8.4
place 8.4
symbol 8.1
day 7.9
ancient 7.8
cloud 7.8
statue 7.7
pollution 7.7
house 7.6
energy 7.6
center 7.6
brick 7.5
traditional 7.5
square 7.2
night 7.1
scenic 7

Google
created on 2019-06-07

Building 65.5
Obelisk 65.1
Monument 64
Paper product 60.9
History 60.4
Stock photography 59.4
Chimney 53.7
Vehicle 51.9
Tower 50.5

Microsoft
created on 2019-06-07

outdoor 90.1
old 86.3
sky 57.6
vintage 35.6

Color Analysis

Feature analysis

Amazon

Person

Clarifai

Building
Tower
Tree
House
Window

AWS Rekognition

Person 84%

AWS Rekognition

Person 77.6%

Clarifai

Building 74.4%

Clarifai

Building 35.4%

Clarifai

Tower 65.6%

Clarifai

Tower 37.6%

Clarifai

Tree 52.3%

Clarifai

Tree 51.7%

Clarifai

Tree 50.3%

Clarifai

Tree 48.1%

Clarifai

Tree 39.9%

Clarifai

Tree 39.9%

Clarifai

Tree 36.2%

Clarifai

House 49.7%

Clarifai

House 43.1%

Clarifai

House 39%

Clarifai

House 38%

Clarifai

House 34.7%

Clarifai

Window 44.9%

Clarifai

Window 44.4%

Clarifai

Window 41.4%

Clarifai

Window 40.9%

Clarifai

Window 34.6%

Clarifai

Window 34.6%

Clarifai

Window 34.2%

Clarifai

Window 33.4%

Clarifai

Window 33.2%

Categories

Imagga
created on 2019-06-07

streetview architecture 49.4%
paintings art 48.5%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a black and white photo of a factory with a chimney chimney

Created by general-english-image-caption-blip-2 on 2025-07-07

an old photo of a building with chimneys

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts a snow-covered scene of a large brick building with multiple windows and a pitched roof structure adorned with a cupola. To the left of the building, there is a tall brick smokestack. Surrounding the building are fences, smaller structures, and snow-covered rails or logs, indicating a wintry, industrial or institutional setting. The foreground has heaps of snow and scattered rocks. The numeral "371" is handwritten in the upper right corner. The overall atmosphere conveys a cold and stark environment with minimal activity.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a sepia-toned photograph of a large brick building surrounded by snow. The building has multiple stories and features several windows. There is a prominent tall brick chimney near the center of the image. To the right, the building has a pitched roof topped with a cupola, which adds to its architectural detail. The foreground shows a snow-covered area with a low stone wall or fence separating it from the terrain closer to the building. Snow is visible on the rooftops and on the ground, indicating a winter scene. The number "371" is written near the top right corner of the image. The overall appearance of the structure suggests it might be an institutional or industrial building from an earlier era.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a historical industrial or manufacturing site in a snowy winter setting. The central feature is a tall, brick chimney or smokestack that dominates the scene. Surrounding the chimney are several multi-story brick buildings with distinctive architectural features like dormers and chimneys, suggesting this was likely a factory or mill complex. The ground is covered in snow, and there are some smaller outbuildings or structures visible as well. The overall scene conveys a sense of the industrial history and character of this location.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white historical photograph showing what appears to be an industrial or institutional building in winter. The building is made of brick and features a tall smokestack chimney. The architecture appears to be from the late 19th or early 20th century, with a distinctive cupola or bell tower on top of the main structure. The building is surrounded by snow, and there are some smaller outbuildings or sheds visible along the side. The number "371" is visible in the top right corner of the photograph, suggesting this might be part of a documentary or archival series. The style and construction of the building suggests it could be a factory, school, or other public institution from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of an old factory or mill, possibly from the late 19th or early 20th century. The building is made of brick and has a tall chimney on the left side. There are several windows on the front of the building, and a smaller building with a peaked roof is attached to the right side. A large pile of rocks or gravel is visible in the foreground, and a fence runs along the bottom of the image. In the background, there are trees and other buildings visible, although they are not clearly defined.

The overall atmosphere of the image suggests that it was taken during the winter months, as there is snow covering the ground and the roofs of the buildings. The image appears to be a historical photograph, possibly taken for documentation or archival purposes. It provides a glimpse into the past and offers insight into the architecture and construction of industrial buildings during that time period.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of a large building with a tall chimney, surrounded by smaller structures and a fence. The main building has a steeply pitched roof and multiple chimneys, while the smaller structures appear to be outbuildings or sheds. A wooden fence runs along the front of the property, and a pile of rocks or gravel is visible in the foreground.

In the background, there are trees and other buildings visible, suggesting that the scene is set in a rural or suburban area. The overall atmosphere of the image is one of quietness and stillness, with no signs of activity or movement. The sepia tone gives the image a nostalgic and historic feel, suggesting that it may have been taken many years ago.

Overall, the image presents a serene and peaceful scene, with a focus on the architecture and landscape of the property. It appears to be a historical photograph, possibly taken for documentary or archival purposes.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image appears to be a black-and-white photograph of a building with a chimney, taken in the winter. The building is surrounded by snow, and there is a wooden fence in front of it. The building has a tower with a steeple on top, and there are several windows on the side of the building. There are also several trees in the distance. The number "371" is written in the top right corner of the image.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black-and-white photograph of a building with a tall chimney, possibly a factory or an industrial facility. The structure is surrounded by snow, indicating that the photograph was taken during the winter season. The building has a rectangular shape with multiple windows and a tower-like structure on the right side. There is a small shed with a slanted roof in front of the building.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

The photo is a vintage sepia shot, capturing an imposing institutional building dusted with snow. A tall, brick chimney rises starkly against the overcast sky, a testament to the building's age and purpose. The building itself is constructed from red brick, with rows of evenly spaced windows hinting at its function as an asylum or school. A decorative cupola with a dark roof crowns the structure, adding a touch of architectural grandeur.

In the foreground, a low wall or embankment is covered in what appears to be loose rocks or debris, blanketed by a fresh layer of snow. A wooden fence runs parallel to the building, and a small shed or structure with a snow-covered roof peeks out from behind it. In the distance, a flat, open space dotted with trees stretches towards the horizon, suggesting a rural setting.

The overall atmosphere of the photo is somber and quiet, evoking a sense of isolation and history. The snow adds a layer of tranquility while also emphasizing the starkness of the architecture. In the top right corner is written "371".

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

The image is a black and white photograph of a large brick building complex in a snowy landscape. A tall brick chimney dominates the center of the frame, rising above the rooftops of the buildings. To the right, the main building structure is visible, featuring multiple rows of windows and a distinctive cupola with a steeple. The rooftops are covered in snow, with icicles hanging from the edges.

In the foreground, the ground is heavily snow-covered, with a small wooden fence or railing running along the bottom. Beyond the fence, there's a low-lying embankment. The photograph seems to be taken during winter, as evidenced by the snow and the overall cold atmosphere. In the distance, a few other buildings are visible, suggesting a broader institutional or industrial complex. The photo is old with the number "371" written in the top right corner.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a historical industrial building covered in snow. The building is constructed of brick and has a tall chimney, suggesting it might have been a factory or a power plant. The architectural style includes multiple windows and a roof with dormers, indicating it could be from the late 19th or early 20th century. There is a smaller structure with a snow-covered roof in the foreground, which appears to be a shed or an outbuilding. The landscape is blanketed in snow, indicating a winter scene. The photograph has a vintage feel, likely due to its sepia tone and the style of the buildings. The number "371" is handwritten in the top right corner of the image.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This image appears to be a historical photograph of a large, multi-story brick building, likely an institutional or industrial structure. The building has several chimneys and small outbuildings with snow-covered roofs, indicating a cold winter setting. A tall smokestack is prominently featured on the left side of the building. The foreground shows a cleared area with some rocks, and the background reveals a snowy landscape with a few trees and a distant building, suggesting a rural or semi-rural environment. The photograph has a black-and-white tone and is marked with the number "371" in the upper right corner, possibly as an identifier or catalog number.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This is a black and white historical photograph of a large, multi-story building in a winter setting. The building is made of brick and features a prominent clock tower on the right side. The roof and the surrounding ground are covered in snow. In the foreground, there is a fenced area with some small structures and a pile of gravel or rubble. A tall smokestack rises prominently in the center of the image, indicating that the building may have been used for industrial or institutional purposes. The overall scene suggests a cold, possibly abandoned or inactive facility. The number "371" is written in the top right corner of the image.

Text analysis

Amazon

37

Google

371
371