Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. City Hospital, Blackwell's Island: City Hospital, Blackwell's Island (New York City Almshouse System): Front

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.763.1

Human Generated Data

Title

Charity, Hospitals: United States. New York. New York City. City Hospital, Blackwell's Island: City Hospital, Blackwell's Island (New York City Almshouse System): Front

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.763.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Mansion 96.6
Housing 96.6
Building 96.6
House 96.6
Architecture 96.4
Palace 91.7
College 87.3
Dome 81.9
Parliament 76.4

Clarifai
created on 2019-06-07

no person 99.1
architecture 97
building 96.5
old 95.5
vintage 92.9
city 92.3
travel 92.1
street 91.6
home 91.6
people 91.4
outdoors 91.3
war 91.1
sepia 89.9
military 89.7
art 89.1
town 88.7
castle 88.1
retro 87.5
house 87.1
administration 86.9

Imagga
created on 2019-06-07

palace 92.3
building 65.2
residence 62.7
house 50.8
architecture 41.1
city 36.6
structure 34.5
dwelling 31.5
sky 25.9
travel 25.4
landscape 24.6
landmark 24.4
old 22.3
tourism 22.3
tower 20.6
town 20.4
historic 20.2
history 19.7
prison 19.2
wall 17.4
famous 16.8
castle 15.4
housing 15
ancient 14.7
construction 14.6
fence 14.2
church 13.9
monument 13.1
correctional institution 13
stone 12.8
urban 12.3
culture 12
capital 11.4
historical 11.3
hill 11.3
grass 11.1
dome 10.8
river 10.7
university 10.6
fortress 10.5
summer 10.3
exterior 10.2
cathedral 10.1
tree 10
religion 9.9
brick 9.9
penal institution 9.8
england 9.5
snow 9.4
picket fence 9.3
center 9
barrier 9
rural 8.8
fortification 8.6
panorama 8.6
skyline 8.6
institution 8.5
outdoor 8.4
traditional 8.3
street 8.3
outdoors 8.2
vacation 8.2
tourist 8.2
scenery 8.1
country 7.9
antique 7.8
scene 7.8
panoramic 7.7
area 7.6
place 7.5
national 7.3
road 7.2
trees 7.1
monastery 7.1

Google
created on 2019-06-07

Architecture 72.6
Building 72
History 64.5
House 63.1
City 59.6
Visual arts 59.3
Facade 52.6
Art 50.2

Microsoft
created on 2019-06-07

outdoor 95.1
building 94.4
sky 88.5
old 56.1

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

Building

Clarifai

Building 85.6%

Clarifai

Building 36.6%

Clarifai

Building 36.5%

Categories

Imagga
created on 2019-06-07

cars vehicles 66.4%
nature landscape 14.7%
streetview architecture 10%
beaches seaside 6%
sunrises sunsets 1.9%

Captions

Microsoft
created by unknown on 2019-06-07

a large white building 78.4%
a close up of an old building 78.3%
a large building 78.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large building with a large building in the background

Created by general-english-image-caption-blip-2 on 2025-07-05

an old photo of a large building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts a large, grand building featuring symmetrical architecture and likely historical significance. It appears to be constructed predominantly of brick or stone, with multiple stories. The central section is characterized by a dome-like structure on top, while the wings on either side extend outward and are topped with smaller towers or domes. Windows are evenly distributed across the facade, suggesting a formal or institutional style, and a staircase leads up to the main entrance beneath the central dome. In front of the building lies an open grassy field. The photograph has a vintage, sepia tone, indicating it may date back to the late 19th or early 20th century. The number "272" is handwritten in the upper right corner.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a large, historic building with a grand architectural design, reminiscent of European palaces or large institutional structures from the late 19th or early 20th century. The building is made of brick or stone and features a central section with a prominent dome. The long, symmetrical facade is characterized by multiple windows organized in rows. There are three main sections; the central section with the dome is flanked by two wings, each having a slightly elevated tower or turret at the ends. The style is formal and imposing, with a series of windows spanning at least four stories, topped by dormer windows on the roof level. A staircase leads up to the entrance in the central building section, and the entire structure is set on grounds that appear to be a large open grassy area, suggesting a setting away from urban clutter. The number "272" is written at the top right corner of the image, likely indicating an archival or cataloging reference. The photograph is in sepia tones, indicating it is an old photograph, likely from the early 20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph of a large, ornate building with multiple stories and a domed roof. The building has a grand, stately appearance, with numerous windows and architectural details. It is situated in an open area, with a grassy field or lawn in the foreground. The image has an antique, historical feel, suggesting it was likely taken some time in the past.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-20

The image shows a large, historic stone building complex. It appears to be a palace, castle or grand estate with multiple wings and floors. The architecture features many windows, domed roofs, and ornate details. In front of the building is a large open courtyard or lawn area. The image is an old black and white photograph, giving it an antique and historic feel. The building seems impressive in scale and design, likely serving as an important landmark or residence at one time.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a historic black and white photograph of what appears to be a large institutional building, likely from the late 19th or early 20th century. The building has a grand architectural style with a prominent central dome and symmetrical wings extending on either side. It's constructed of stone or brick and features mansard roofs with dormer windows, typical of Second Empire architectural style. The building has multiple stories with uniform rows of windows and a central entrance accessed by a double staircase. There's a large open lawn or field in the foreground. The building has several cupolas or ventilation towers along the roofline. The number "272" is visible in the top right corner of the photograph, suggesting this might be part of a documentary or archival collection. The overall impression is of a substantial public building, possibly a government facility, hospital, or educational institution from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a large, multi-story building with a grassy lawn in front of it. The building is made of brick and has a domed roof. There are several windows on each floor, and a staircase leads up to the entrance. The building appears to be old, as evidenced by the faded color of the photo and the presence of a handwritten number in the top-right corner.

  • The building is large and imposing, with multiple stories and a domed roof.
  • The building is made of brick, which gives it a rustic and historic appearance.
  • The building has a large grassy lawn in front of it, which suggests that it may have been used for recreational purposes.
  • The building appears to be old, as evidenced by the faded color of the photo and the presence of a handwritten number in the top-right corner.
  • The building has a staircase leading up to the entrance, which suggests that it may have been used for official or ceremonial purposes.
  • The building has several windows on each floor, which suggests that it may have been used for residential or commercial purposes.

Overall, the image suggests that the building is a historic and important structure, possibly used for official or ceremonial purposes.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a large, imposing building with a symmetrical facade, featuring a central entrance and two wings on either side. The structure is constructed from brick or stone and has multiple stories, with numerous windows and chimneys visible. A dome-shaped roof adorns the central section, while the wings have flat roofs. In the foreground, a grassy area stretches out, with a dirt path leading up to the entrance. The sky above appears overcast, and the overall atmosphere suggests an old photograph, possibly taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image depicts an old photograph of a large, imposing building. The building appears to be an academic institution, possibly a university or college, given its architectural style and the presence of a large, open field in front of it. The building is constructed with stone and has a symmetrical design with multiple floors. It features a central dome with a smaller dome on top, flanked by two smaller towers. The windows are arranged in a grid pattern, and there are several smaller domes and towers on the sides of the building. The photograph has a sepia tone, indicating its age.

Created by amazon.nova-pro-v1:0 on 2025-06-13

The image is a black-and-white photograph of a large building with a wide, open field in front of it. The building has a symmetrical design with multiple windows, some of which have arched tops. There are several domes on the roof, and the central dome appears to be larger than the others. The building has a grand staircase leading up to the entrance, and there are several smaller buildings or structures on the sides. The field in front of the building is covered with grass and appears to be well-maintained. The sky is clear and blue, and there are no clouds visible. The image has a vintage look, suggesting that it was taken in the past.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

The sepia photograph shows a large, imposing building, most likely of historical significance, set against a plain sky and a simple grassy foreground.

The building itself is a multi-storied structure, constructed from what appears to be stone or brick. It has a symmetrical design, with a central section that features a grand entrance approached by steps. The windows are evenly spaced, and the roofline is adorned with domes and small towers, adding to the building's grand appearance.

The ground in front of the building is a field of grass that extends to the bottom of the frame. The grass is short and appears to be well-maintained. The simplicity of the foreground and sky emphasizes the monumental scale and presence of the building.

The overall impression is one of age and history. The sepia tone gives the image a vintage feel, suggesting that it was taken long ago. The architectural style and scale of the building further imply that it may be a landmark of historical or cultural importance.

Created by gemini-2.0-flash-lite on 2025-06-13

Here is a description of the image:

This is a vintage photograph of a large, imposing building. The building is constructed of stone and features multiple stories, with a central section topped by an ornate dome. The architecture is classical, with symmetrical facades and regular rows of windows. The building appears to be set on a grassy field, and the image suggests an old-fashioned, perhaps institutional, setting. There is writing in the upper right corner "272".

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a large, historic building with a grand architectural design. The structure appears to be made of stone or brick, featuring multiple stories and numerous windows. The central portion of the building is particularly prominent, with a dome-like structure on top and a staircase leading up to the entrance. This section is flanked by symmetrical wings on either side, each with multiple chimneys and small towers.

The building's facade is adorned with detailed masonry and classical architectural elements, such as columns and arches. The overall style suggests it could be a government building, a university, or a significant public institution. The photograph appears to be quite old, possibly from the late 19th or early 20th century, given the sepia tone and the architectural style.

In the foreground, there is a large open space, likely a courtyard or lawn, which is mostly barren, indicating that the photo might have been taken during a season with less vegetation or before landscaping was completed. The sky is clear, providing a stark contrast to the darker tones of the building. The number "272" is handwritten in the upper right corner of the image, which might be a catalog or reference number.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image depicts a large, historic building with a symmetrical architectural design. The structure is multi-storied, constructed primarily of stone, and features numerous windows. A prominent central dome with a smaller dome to its left is a focal point, suggesting a possible institutional or governmental function. The building is flanked by two wings with similar architectural details, including smaller domes on their roofs. The foreground consists of a grassy area, and the photograph has a vintage quality, indicating it is likely from an earlier time period. The number "272" is handwritten in the upper right corner, possibly indicating a catalog or file number.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a black-and-white photograph of a large, imposing building that appears to be an institutional structure such as a hospital, educational facility, or government building. The building features a symmetrical design with a central section that is slightly elevated and has a dome-like structure on the roof. The facade is made of stone and has numerous windows arranged in a regular pattern. There are two prominent wings extending from the central section, each with its own tower. The building has a formal entrance with steps leading up to it. The foreground shows a large, open grassy area in front of the building. The image has a vintage appearance, suggesting it was taken in the late 19th or early 20th century.

Text analysis

Amazon

772