Human Generated Data

Title

Charity, Public: United States. New York. Oswego. City Almshouse: Almshouses of Oswego City, N.Y.: Residence Building

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1077.1

Human Generated Data

Title

Charity, Public: United States. New York. Oswego. City Almshouse: Almshouses of Oswego City, N.Y.: Residence Building

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1077.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 99
Outdoors 97.6
Drawing 85
Art 85
Snow 83.9
Building 83
Winter 76.7
Office Building 76.5
Sketch 68.6
Housing 65.9
Postal Office 64.8
Storm 57.2

Clarifai
created on 2019-06-07

no person 98.4
architecture 97.5
home 96.6
house 96.3
building 95.5
vintage 93.8
monochrome 92.4
people 92.2
street 92.2
old 90.9
art 90.1
outdoors 90.1
tree 89.8
sepia 88.2
print 87.8
administration 84.9
government 84.6
sky 82
war 79.8
town 79.7

Imagga
created on 2019-06-07

building 66.4
architecture 46.7
sketch 45.4
structure 39.5
drawing 33.8
water tower 33.2
house 31.6
city 29.1
sky 27.8
representation 27.5
reservoir 25.7
school 25.3
church 23.1
old 23
exterior 19.4
travel 19
tank 19
religion 17.9
tourism 15.7
historic 15.6
university 15.5
construction 15.4
history 15.2
trees 15.1
landscape 14.9
dome 14.7
town 13.9
tree 13.9
residence 13.6
facade 13.1
palace 12.8
home 12.8
vessel 12.6
monastery 12.6
landmark 11.7
tower 11.7
center 11.7
urban 11.4
brick 11.3
culture 11.1
park 10.7
ancient 10.4
cross 10.4
famous 10.2
window 10.1
wall 10
snow 9.9
cathedral 9.8
rural 9.7
roof 9.7
england 8.6
glass 8.6
estate 8.6
historical 8.5
outdoor 8.4
garden 8.4
street 8.3
temple 8.1
scenery 8.1
grass 7.9
country 7.9
cold 7.8
cloud 7.8
residential 7.7
winter 7.7
real 7.6
capital 7.6
barn 7.6
hill 7.5
new 7.3
tourist 7.3
castle 7.1
summer 7.1
scenic 7

Google
created on 2019-06-07

House 89.8
Building 76.4
Architecture 76.3
Home 74
Tree 68.7
Room 65.7
Sketch 60.3
Paper product 57.7
Drawing 57.6
Illustration 54.5
History 54.1

Microsoft
created on 2019-06-07

outdoor 90.7
house 89.9
drawing 79.7
sky 78.2
tree 72.1
building 69.8
old 41.8

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

Tree
House
Window

Clarifai

Tree 97.3%

Clarifai

Tree 92.7%

Clarifai

Tree 87.8%

Clarifai

Tree 75.7%

Clarifai

Tree 72.1%

Clarifai

Tree 54.5%

Clarifai

House 83.8%

Clarifai

Window 48.2%

Clarifai

Window 43.4%

Clarifai

Window 42.2%

Clarifai

Window 38.4%

Clarifai

Window 35.2%

Clarifai

Window 35.1%

Categories

Imagga
created on 2019-06-07

paintings art 55.1%
streetview architecture 22.1%
nature landscape 9.8%
interior objects 8.3%
beaches seaside 2.1%

Captions

Microsoft
created by unknown on 2019-06-07

a house with trees in the background 85.2%
a house covered in snow 62.1%
a close up of an old building 62%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large brick building with a large brick building

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a large brick building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This sepia-toned historical photograph depicts a large, three-story brick building with two chimneys on its roof and a windmill visible behind it. The building features tall, rectangular windows and multiple entrances with prominent wooden stairs leading to porches. Its architecture is symmetrical, with a balanced arrangement of windows and doors.

The surrounding area is landscaped with sparse, leafless trees suggesting it could be late autumn or winter. A dirt path winds across the lawn, leading to the front of the building. The setting appears rural, with open land extending into the background. The number "361" is handwritten on the top portion of the image.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a large, three-story brick building with a grand porch and multiple windows. The building has two prominent chimneys on the roof and a windmill structure positioned behind it, visible above the roof. The surrounding area is mostly open land, with a few leafless trees visible in the foreground, indicating the photo was taken in either late fall or winter. A dirt path leads to the building's entrance, and the number "361" is written at the top center of the image, likely indicating either a catalog or archival number. The overall tone of the image is sepia, suggesting it is an old photograph from the late 19th or early 20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph of a large, multi-story brick building with a distinctive architectural style. The building has a prominent central entrance with a set of stairs leading up to it. There are several chimneys and a windmill-like structure on the roof. The building is surrounded by a grassy area with some bare trees in the foreground. The image has a vintage, historical feel to it, and the building appears to be an important structure, possibly an institutional or governmental building from an earlier time period.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-20

The image shows an old black and white photograph of a large brick building, likely from the late 19th or early 20th century based on the architectural style. The building has multiple stories and a flat roof. There are several windows on each floor, and a set of stairs leading up to the main entrance. The building is surrounded by bare trees, suggesting the photograph was taken in late fall or winter. The number "361" is written in the top left corner of the photograph, possibly indicating an address or catalog number.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a historic black and white photograph of a large three-story brick building, likely from the late 1800s or early 1900s. The building has an Italianate architectural style with symmetrical windows, a hipped roof, and prominent chimneys. There's a windmill visible on the roof. The building features two covered porches with stairs leading up to them, and the windows appear to be tall and evenly spaced with what look like stone sills and lintels. The building is set on a slight hill with a dirt path leading up to it, and there are bare trees visible in the foreground and to the right side of the image. The number "361" appears in the top right corner of the photograph. The overall composition suggests this might have been an institutional building, perhaps a school, hospital, or administrative building from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a sepia-toned photograph of a large, two-story brick building with a windmill on its roof. The building features a covered porch on the front and a staircase leading up to it. There are several windows on both floors, and a chimney rises from the roof. In the foreground, there are several trees, including one bare tree in the center and another to the right. A dirt path leads up to the front door of the building.

The sky above is overcast, and the overall atmosphere suggests a rural or countryside setting. The image appears to be an old photograph, possibly from the late 19th or early 20th century, given the style of the building and the quality of the image.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a sepia-toned photograph of a large, three-story brick building with a flat roof and a windmill on top. The building has a symmetrical facade with a central staircase leading to the front door. There are several windows on each floor, and a covered porch on the right side of the building. The building is surrounded by trees and grass, and there is a dirt path leading up to the front door.

In the background, there is a hazy sky, and the overall atmosphere suggests a rural or countryside setting. The image appears to be an old photograph, possibly from the late 19th or early 20th century, given the style of the building and the sepia tone of the image.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image shows an old black-and-white photo of a house with a chimney and a windmill on top. The house has two floors and a porch with stairs leading to the entrance. It is surrounded by trees and grass, with a pathway leading to the front door. The house has many windows and a brick wall. The photo has a watermark with the number "361" in the top right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black-and-white photograph of a large house with a windmill on the roof. The house is surrounded by trees and grass, and there is a pathway leading up to the front door. The house has many windows and a porch with a staircase. The windmill is on the roof, and there is a chimney on the left side of the house. The image has a watermark with the number "361" in the top right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

This is a sepia toned photograph of a two story brick building. On top of the building is a small windmill between two chimneys. On the second story of the building, there is a porch with pillars and steps that lead down to the front lawn. There is a sidewalk made of dirt that leads to the stairs of the porch and around the side of the building. There is grass on either side of the sidewalk. On both sides of the building are bare trees without leaves, indicating it might be during winter. The photograph also has the number "361" written in the top center of the image. The sky is slightly overcast.

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

The image is a sepia-toned photograph of a large brick building. The building is two stories tall with a flat roof and several windows. A small porch with a covered overhang extends from the front of the building. There is a small wind turbine on top of the building, which suggests this is a relatively old photo. The building appears to be set on a slightly raised foundation.

In the foreground is a grassy area with a winding dirt road leading up to the building. Bare trees are scattered throughout the scene, suggesting it is either late fall or early spring. The overall composition is balanced, with the building centered and the natural elements providing a frame. The number "361" is written at the top-right corner.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts an old, large, three-story brick building with a symmetrical facade. The structure appears to be a historical building, possibly a school, hospital, or institutional facility, given its size and architectural style.

Key features of the building include:

  1. Architecture: The building is constructed from brick and has a rectangular shape. It features a central entrance with a set of stairs leading up to it. There are two additional staircases on either side of the central entrance, suggesting multiple entry points.

  2. Windows: The building has numerous windows, evenly spaced across its facade. The windows on the ground floor are larger, while those on the upper floors are smaller and uniformly sized.

  3. Porches: There are covered porches or balconies on the second floor, supported by columns, providing sheltered outdoor spaces.

  4. Roof: The roof is flat with a small structure on top, possibly a cupola or a ventilation system. There is also a windmill-like structure on one of the chimneys, which might have been used for ventilation or other purposes.

  5. Surroundings: The building is situated in a sparsely vegetated area with a few leafless trees, indicating that the photo might have been taken in late autumn or winter. The ground around the building is mostly bare, with some patches of grass.

  6. Pathways: There are pathways leading up to the building, suggesting it was designed to be accessible and possibly served a public function.

The overall appearance of the building and its surroundings suggest it is from an earlier era, likely the late 19th or early 20th century. The number "361" is written in the top right corner, which might be a catalog or reference number.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black and white photograph of a two-story, brick building with a symmetrical design. The building features a porch on the second floor with columns and a railing, and there is a staircase leading up to the porch from the ground level. The first floor has a simpler facade with several windows. On the roof, there is a windmill positioned between two chimneys. The building is surrounded by a grassy area with a few bare trees, indicating it might be taken during a season when leaves are not in full bloom, such as late fall or winter. The sky is overcast, and the overall atmosphere of the image is calm and serene. The number "361" is visible in the upper right corner of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a sepia-toned historical photograph of a large two-story brick building, likely from the late 19th or early 20th century. The building features a symmetrical design with a central entrance flanked by two wings. The central entrance has a staircase leading up to a porch with columns. The roof is flat with two chimney stacks visible. There is a windmill in the background to the left of the building. The surrounding area is open with a few bare trees, suggesting it might be taken during the winter or early spring season. The image has a number "361" written in the top right corner. The overall scene appears calm and serene.

Text analysis

Amazon

361

Google

361
361