Human Generated Data

Title

Charity, Children: United States. New York. New York City. Randall's Island, Children's Hospital and Schools: Children's Hospital and Schools, Randall's Island, New York: Infants' Hospital.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.643.1

Human Generated Data

Title

Charity, Children: United States. New York. New York City. Randall's Island, Children's Hospital and Schools: Children's Hospital and Schools, Randall's Island, New York: Infants' Hospital.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.643.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Building 99.5
Urban 99.5
City 99.5
Downtown 99.5
Town 99.5
Mansion 99.4
Housing 99.4
House 99.4
Architecture 99.2
Palace 98.7
Person 88.7
Human 88.7
Castle 71.9
Dome 67.3
Office Building 65.3
Fort 57.6
Parliament 56.3
Plaza 56.2
Town Square 56.2
Villa 55.3

Clarifai
created on 2019-06-07

administration 99.1
architecture 98.9
building 98
government 97.6
no person 97.2
castle 96.2
art 95.7
people 94.7
old 93.5
sepia 93
city 92.9
travel 92.7
outdoors 91.9
home 89.8
vintage 89.6
square 88.6
print 88.5
street 88.3
monument 86.5
town 85.3

Imagga
created on 2019-06-07

palace 100
residence 100
building 90.8
house 83
architecture 61.2
dwelling 48.1
city 44.2
travel 35.3
structure 32.9
landmark 30.8
tourism 28.9
historic 27.6
old 27.2
university 27
history 25.1
housing 25.1
sky 21.2
famous 20.5
town 19.5
church 18.5
tourist 18.2
capital 18.1
facade 17.7
street 16.6
dome 16.6
tower 16.1
monument 15.9
ancient 15.6
culture 15.4
exterior 14.8
square 14.5
england 14.3
buildings 14.2
river 13.4
night 13.4
urban 13.1
construction 12.9
cityscape 12.3
historical 12.3
cathedral 11.8
scenic 11.4
landscape 11.2
government 10.7
houses 10.7
attraction 10.5
place 10.3
hall 10.2
saint 9.6
architectural 9.6
castle 9.3
flag 9.2
summer 9
religion 9
style 8.9
parliament 8.9
royal 8.7
heritage 8.7
water 8.7
day 8.7
sunny 8.6
brick 8.5
destination 8.4
traditional 8.3
vintage 8.3
park 8.3
national 8.2
college 7.8
st 7.8
center 7.7
united 7.6
window 7.3
home 7.2
holiday 7.2

Google
created on 2019-06-07

Building 90.7
Architecture 84.4
Palace 79.4
Facade 73.2
Château 72.4
House 71.7
History 68.8
Stately home 63.3
Estate 63
Black-and-white 56.4
Almshouse 54.9
City 51.3
Historic house 51.3
Mansion 50.7

Microsoft
created on 2019-06-07

outdoor 97.7
sky 88.8
building 85.4
house 55.7
government building 37.9

Color Analysis

Feature analysis

Amazon

Person
Person 88.7%

Categories

Captions

Microsoft
created by unknown on 2019-06-07

a large white building 92.3%
a large white building in a city 92.2%
a large white building in the background 91.3%

Clarifai
created by general-english-image-caption-blip on 2025-06-13

a photograph of a large building with a clock tower in the middle of it -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This is a sepia-toned photograph of a large, historical building, likely from the late 19th or early 20th century. The architecture suggests it may have been institutional, such as a school, government building, or hospital. The structure is made of brick and features distinct decorative elements from that era, including arched windows, mansard roofing, and dormer windows. The left portion of the building is longer and lower, with an extended section that includes large glass windows or conservatory-like features. The right portion is taller and more prominent, with ornate detailing, large arched entryways, and a tower-like element at the center. In front of the building is an open and barren landscape with a few young trees planted sparsely across it. Overhead, there are power or telephone lines visible. The image has a soft, timeless quality due to its sepia tone and aged appearance.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts an old, large building, likely a historical structure, with detailed architectural elements. The building appears to be made of brick and has a prominent facade with arched windows. The central structure seems to have a tower-like feature with a pointed roof. It has three stories and a mansard-style roof, common in architecture from the late 19th century. The windows are tall and rounded, with decorative headers. In front of the building, there is an open area that might be part of a park or garden, with several small, leafless trees spaced across the lawn. The image is sepia-toned, suggesting it is a vintage photograph, potentially from the late 19th or early 20th century. The photograph captures the grandeur and symmetry of the building, which may have served as an institutional or official establishment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a large, ornate building with a domed roof and arched windows. The building appears to be constructed of brick or stone and has a grand, architectural style typical of late 19th century or early 20th century buildings. The image is in black and white, suggesting it is an older photograph. There are no people visible in the image, only the impressive structure itself.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historic black and white photograph of what appears to be a Victorian-era institutional building, possibly a school, hospital, or government building. The architecture features Second Empire style elements, characterized by a mansard roof with dormer windows and elaborate window treatments. The building has two main sections - a longer wing with uniform arched windows and a taller corner section with more ornate detailing and a decorative cupola or bell tower on top. The ground floor features a series of large storefront-style windows. The building is photographed from across what looks like an empty lot or courtyard, and there are a few young trees planted along the front. The image has the sepia tones and slight fading typical of late 19th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a large, multi-story building with a mix of architectural styles, featuring a central section with a mansard roof and two side wings with gabled roofs. The building is constructed from brick and has numerous windows, including arched and rectangular shapes. A large grassy area in front of the building suggests it may be a school or other educational institution. The image appears to be an old photograph, likely taken in the late 19th or early 20th century, given the style of the building and the quality of the image.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a sepia-toned photograph of a large, multi-story building with a mix of architectural styles. The building features a central section with a mansard roof and a tower, while the left side has a flat roof. The facade is adorned with numerous windows, including arched and rectangular shapes. In the foreground, a grassy area stretches out, dotted with bare trees. The overall atmosphere of the image suggests that it was taken during the winter season, likely in the late 19th or early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image is a vintage photograph of a large building with a classic architectural design. The building has multiple floors and a symmetrical facade, with a central section that is slightly taller than the side sections. The building has many arched windows and doors, giving it a grand and imposing appearance. The image has a sepia tone, giving it an old-fashioned look. The building is situated in an open area with a few trees and a clear sky.

Created by amazon.nova-pro-v1:0 on 2025-06-13

The image is a black-and-white photograph of an old building with many windows. The building has a flat roof with a dome-shaped structure on top. There are several windows on the dome, and a small tower-like structure is on top of it. The building has a symmetrical design, with a large entrance in the middle. The entrance has a staircase leading to the top floor. The building is surrounded by trees.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here's a description of the image:

The image depicts a large, imposing brick building in a sepia tone, suggesting it is an older photograph. The building is several stories tall and features a combination of arched and rectangular windows. The first floor of the left section of the building appears to have an enclosed porch or sunroom with many windows. The right section of the building is taller and features a prominent tower or cupola on top.

A grassy lawn stretches out in front of the building, and a few bare trees are visible in the foreground. The overall scene has a stark, institutional feel. The sky is a uniform light color, indicating a slightly overcast or hazy day. "D 143" is written in the upper right corner.

Created by gemini-2.0-flash-lite on 2025-06-13

The image shows a sepia-toned, vintage photograph of a large, multi-story brick building. The building has a complex architectural design, featuring various window shapes and a prominent tower with a cupola. The building appears to be a school or institutional structure, possibly dating back to the late 19th or early 20th century. The photograph is taken from a ground-level perspective, with a grassy field or lawn in the foreground. The sky is overcast or hazy. The overall impression is one of historical significance and formality. There's a faint "D 143" written at the top right corner of the image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a large, historical building with a distinct architectural style. The structure appears to be constructed in the late 19th or early 20th century, characterized by its ornate and grand design.

Key features of the building include:

  1. Facade: The front of the building is symmetrical with a central tower-like structure that rises higher than the rest of the building. This central section has a steeply pitched roof with dormer windows and a small spire or cupola at the top.

  2. Windows: The building has numerous large windows, many of which are arched at the top. The windows are evenly spaced and contribute to the symmetrical appearance of the building.

  3. Entrance: The main entrance is centrally located and features a large arched doorway. There are steps leading up to the entrance, which is framed by columns and decorative stonework.

  4. Materials: The building appears to be constructed from brick or stone, giving it a solid and imposing look.

  5. Roof: The roof is complex, with multiple gables and dormers. The central tower-like structure adds to the building's grandeur.

  6. Surroundings: The area around the building is relatively open, with a few small trees and a clear, paved pathway leading up to the entrance. The ground appears to be covered in snow, suggesting the photo was taken in winter.

Overall, the building exudes a sense of historical significance and architectural elegance, likely serving an important public or institutional function.

Text analysis

Google

D 143
D
143