Human Generated Data

Title

Charity, Public: United States. New York. Dewittville. Chautauqua County Almshouse: Almshouses of Chatauqua [sic] County, N.Y.: Building now demolished; Hospital

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.973.2

Human Generated Data

Title

Charity, Public: United States. New York. Dewittville. Chautauqua County Almshouse: Almshouses of Chatauqua [sic] County, N.Y.: Building now demolished; Hospital

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.973.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 99.2
Countryside 98.8
Building 98.8
Outdoors 98.8
Shelter 98.8
Rural 98.8
Housing 95.1
Drawing 85.9
Art 85.9
House 80.8
Sketch 73.3
Neighborhood 73.1
Urban 73.1
Hut 66.5
Office Building 64.4
Road 61.3
Tower 60.1
Architecture 60.1
Steeple 60.1
Spire 60.1
Shack 59.8
Yard 59.4

Clarifai
created on 2019-06-07

home 99.4
house 99.1
no person 98.6
architecture 97.3
building 96.9
people 94.5
family 91.7
street 90.2
town 86
door 83.4
mansion 82.8
vintage 82.1
bungalow 82
farmhouse 81.9
old 79.6
window 78.1
group 76.8
adult 75.5
disrepair 75.2
outdoors 72.9

Imagga
created on 2019-06-07

building 70.3
wall 51.6
warehouse 47.7
house 44
architecture 43.6
structure 41.1
school 37.6
old 30
roof 26
home 24
sky 22.5
brick 19.8
stone 19.4
residential 19.2
history 18.8
window 18.6
door 18.1
residence 16.9
rural 16.8
garage 15.2
church 14.8
exterior 14.8
tree 14.7
farm 14.3
landscape 14.2
windows 13.5
estate 13.3
ancient 13
construction 12.9
property 12.6
country 12.3
historic 11.9
houses 11.7
trees 11.6
barn 11.6
medieval 11.5
real 11.4
prison 11.4
new 11.4
tile 11.2
countryside 11
wood 10.9
grass 10.3
town 10.2
facade 10.2
porch 9.9
travel 9.9
buildings 9.5
street 9.2
scenery 9
housing 8.8
village 8.8
built 8.7
architectural 8.7
castle 8.5
historical 8.5
tower 8.2
homes 7.9
abandoned 7.8
yard 7.8
gate 7.8
st 7.8
heritage 7.7
culture 7.7
dwelling 7.7
palace 7.7
clouds 7.6
correctional institution 7.6
field 7.6
tourism 7.4
religion 7.2
public house 7.1
modern 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

building 99.9
outdoor 98.4
window 95
sky 93.8
house 88.3
old 76.8
town 35.2
stone 32.9

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

House
Window
Tree

Clarifai

House 94.5%

Clarifai

House 94.2%

Clarifai

House 62.9%

Clarifai

House 54.4%

Clarifai

House 44.6%

Clarifai

House 33.9%

Clarifai

Window 64.6%

Clarifai

Window 62.7%

Clarifai

Window 62.1%

Clarifai

Window 62.1%

Clarifai

Window 61.9%

Clarifai

Window 60.2%

Clarifai

Window 58.5%

Clarifai

Window 57.8%

Clarifai

Window 57.6%

Clarifai

Window 57.6%

Clarifai

Window 57.2%

Clarifai

Window 56.9%

Clarifai

Window 55.7%

Clarifai

Window 54%

Clarifai

Window 53.9%

Clarifai

Window 53.3%

Clarifai

Window 52.2%

Clarifai

Window 52.1%

Clarifai

Window 52%

Clarifai

Window 51.6%

Clarifai

Window 51.2%

Clarifai

Window 50.2%

Clarifai

Window 49.8%

Clarifai

Window 49.2%

Clarifai

Window 49%

Clarifai

Window 48%

Clarifai

Window 48%

Clarifai

Window 45.1%

Clarifai

Window 45%

Clarifai

Window 44.4%

Clarifai

Window 44.1%

Clarifai

Window 43.6%

Clarifai

Window 43.5%

Clarifai

Window 43.4%

Clarifai

Window 43.4%

Clarifai

Window 41.4%

Clarifai

Window 41.1%

Clarifai

Window 41.1%

Clarifai

Window 38.4%

Clarifai

Window 38.4%

Clarifai

Window 37.9%

Clarifai

Window 37.9%

Clarifai

Window 37.2%

Clarifai

Window 36.8%

Clarifai

Tree 52%

Clarifai

Tree 38.2%

Categories

Imagga
created on 2019-06-07

streetview architecture 100%

Captions

Microsoft
created by unknown on 2019-06-07

an old barn in front of a house 95.9%
an old barn in front of a building 95.8%
an old brick building 94%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large brick building with a staircase leading up to a building

Created by general-english-image-caption-blip-2 on 2025-07-05

an old photo of a large building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a historic brick building with an early architectural style, likely from the late 19th or early 20th century. The structure has multiple levels and distinctly large windows with vertical panes, allowing ample sunlight. On the left side, there is an entrance with a small balcony supported by columns and a staircase leading to the ground. The facade on the right features more windows and a smaller entrance with stairs.

The building appears to serve an institutional purpose, such as a school, hospital, or an administrative structure. Surrounding the building is an open patch of grass or lawn, which gives it a spacious, isolated appearance. A sheet or fabric item is hung outside, perhaps for drying or shading purposes. The background features a clear sky and minimal vegetation, with a bare tree branch reaching into the frame in the top-right corner. On the image's top right, the number "37" is handwritten, presumably as a reference or catalog number.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a sepia-toned photograph of a large, historical brick building. The building appears to be from the 19th or early 20th century, based on the architectural style. It consists of multiple stories and features tall windows, a pitched roof, and chimneys, indicative of its old construction. The right part of the building has a gabled roof and an adjacent structure with similar architectural elements. There is a small set of stairs leading to an entrance on the side of the building. A porch with columns is visible on the left side, accompanied by stairs leading down to the ground. In the foreground, there is a dirt or gravel path and a patch of grass. There are bare tree branches visible in the upper right corner, suggesting a late fall or winter setting. The number "37" is handwritten in the top right corner of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a large, multi-story brick building with a distinctive architectural style. The building has a prominent gabled roof and several chimneys, as well as rows of symmetrically arranged windows. There appear to be other smaller brick buildings or structures adjacent to the main building. The image has a sepia-toned, historical quality, suggesting this is an older photograph of the building.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white historical photograph of a large brick building, likely from the early 1900s. The building appears to be an institutional structure, possibly a school, hospital, or dormitory. It's a multi-story brick building with distinctive architectural features including:

  • Multiple levels with numerous windows
  • A complex roofline with dormers
  • External staircases
  • White trim and decorative elements
  • Curved architectural details along the roofline
  • Multiple entrances at different levels

The photograph shows the building from an angle, capturing both its front and side facades. There appears to be some laundry hanging outside on a line. The ground in front of the building is bare, possibly a yard or courtyard area. The image has the number "37" written in the upper right corner, suggesting it might be part of a series of documentary photographs.

The architectural style is typical of institutional buildings from the late Victorian or early Edwardian era, with its substantial brick construction and ornate details.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a large, multi-story brick building with a gable roof and a central staircase leading to a covered porch. The building features multiple windows on each floor, with some of them having bars on the outside. A chimney is visible on the right side of the roof, and a smaller building is situated to the left.

The building appears to be old, with a worn and weathered appearance. The sky above is overcast, suggesting that the photo was taken on a cloudy day. In the top-right corner of the image, the number "37" is handwritten in black ink, possibly indicating the building's identification number or a reference for the photographer.

Overall, the image presents a detailed view of the building's architecture and surroundings, providing insight into its history and context.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a black-and-white photograph of a large brick building with a gable roof, featuring multiple windows and chimneys. The building appears to be an old school or institutional structure, possibly from the late 19th or early 20th century.

The building's facade is constructed from red bricks, with white trim around the windows and doors. A small porch with stairs leads to the entrance on the left side of the building. The roof features several chimneys, indicating that the building was heated by fireplaces or wood-burning stoves.

In the foreground, a dirt road or path runs in front of the building, while a bare tree branch is visible in the top-right corner of the image. The sky above is overcast, suggesting that the photograph was taken on a cloudy day.

Overall, the image provides a glimpse into the past, showcasing a historic building that may have served as a school, hospital, or other institutional facility.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

An old black-and-white photo shows a large building with a brick exterior. The building has a gabled roof and a tower on the left side. It has many windows, some of which have bars. There is a staircase on the left side of the building. On the right side, there is a smaller building with a chimney and a small porch. There is a tree branch on the right side of the photo.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black-and-white photograph of two buildings. The building on the left has a tower, a balcony, and stairs. The building on the right has a chimney and a small house in front of it. Both buildings have many windows. There is a grassy area in front of the buildings. A tree is on the right side of the image. There is a number 37 in the top right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

This is a grayscale photograph of two brick buildings next to each other. The building on the left is larger and more ornate. It has a curved roofline with a small tower in the center. The building has a porch with a staircase leading up to it. There are many windows on the side of the building, arranged in rows. The building on the right is smaller and simpler. It has a gabled roof and fewer windows. There is a small porch with a staircase leading up to it. A line of laundry hangs on the lawn between the two buildings. The yard appears to be primarily grass and dirt. In the upper right corner of the photograph is the number "37" written in white. The sky is overcast, and the overall tone of the photograph is somber.

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

The image is a sepia-toned photograph of a large, brick building. The building is rectangular in shape, with multiple stories and numerous windows. There is a smaller building attached to the left side. There is a balcony on the left. To the right is a smaller, similarly styled building. In front of the buildings is a grassy area and a dirt road. The sky is overcast.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts an old photograph of a large brick building complex, likely from the late 19th or early 20th century. The building has multiple sections with distinct architectural features.

  1. Main Building:

    • The central structure is a three-story brick building with a gabled roof.
    • The windows are tall and narrow, with some having bars, suggesting it might have been used for institutional purposes such as a school, hospital, or prison.
    • There is a small tower or cupola on the roof, possibly for ventilation or as a lookout point.
  2. Adjacent Buildings:

    • To the left of the main building, there is another structure with a curved roof and a balcony. This building has a more ornate appearance with detailed woodwork and a staircase leading up to the balcony.
    • To the right, there is a smaller, two-story brick building with a similar architectural style, featuring tall, narrow windows and a gabled roof.
  3. Surroundings:

    • The area around the buildings appears to be open and grassy, with a few trees visible in the background.
    • There is a clothesline with laundry hanging out to dry, indicating that the building was inhabited at the time the photo was taken.

The overall scene suggests a historical institutional setting, possibly a school, hospital, or other community facility. The architecture and details hint at a functional and utilitarian design typical of institutional buildings from that era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image depicts a multi-story brick building with a symmetrical architectural design. It appears to be a historical structure, possibly from the late 19th or early 20th century, given the style of the windows and the overall design. The building has a symmetrical facade with evenly spaced windows on both the first and second floors. The second floor features a smaller, triangular section with additional windows, suggesting a dormer window or attic space.

The building is accompanied by a smaller structure to the right, which also has a brick facade and a smaller roof. There is a small white building with a pitched roof adjacent to the main building. In the foreground, there is an open area with some dirt and scattered objects, possibly including a piece of equipment or a small structure.

The photograph is in black and white, and there is a number "37" in the upper right corner, which might indicate this is part of a series or catalog. The overall condition of the building and the surrounding area appears to be in a state of disrepair, with some missing or broken elements, such as the roof of the small white building.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph depicts a large, historic brick building with multiple sections and architectural features. The main structure has a triangular gable roof with a small cupola or lantern at the top. The building has several tall, rectangular windows arranged symmetrically. On the left side, there is a section with a curved roof and a balcony supported by columns. Stairs lead up to the balcony area. The building appears to be well-maintained, with a lawn in front and some laundry hanging on a line to the right. The image has a vintage feel, suggesting it was taken in the late 19th or early 20th century. The number "37" is written in the top right corner of the photograph.

Text analysis

Amazon

37
E

Google

37 II
37
II