Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Side view of Administration Building

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2374.1

Human Generated Data

Title

Races, Indians: United States. New York. Iroquois. Thomas Asylum for Orphan and Destitute Indian Children: State Thomas Asylum for Orphan and Destitute Indian Children, Iroquois, N.Y.: Side view of Administration Building

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2374.1

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Building 96.9
Factory 89.2
Housing 80.8
Urban 72
Art 61.2
Drawing 61.2
Office Building 59.1
Brewery 58.9
House 57.1
Mansion 55.7

Clarifai
created on 2019-06-04

home 99.5
no person 99.2
architecture 99
building 98.1
street 97.3
house 97.3
outdoors 92.9
administration 92.5
city 92.2
government 91.1
town 90.8
people 90.8
monochrome 89.9
old 89.5
tree 88.2
mansion 85.8
travel 85.3
vintage 85.1
vehicle 81.6
group 81.5

Imagga
created on 2019-06-04

palace 69.4
building 68.3
house 56.6
architecture 52.7
residence 38.8
old 31.4
university 30
castle 27.6
structure 26.9
town 24.2
historic 23.9
ancient 22.5
city 22.5
tower 22.4
history 22.4
sky 21.9
facade 20.7
dwelling 19.9
travel 19.1
landmark 19
tourism 18.2
school 18.1
historical 17
famous 15.9
wall 15.6
construction 15.4
stone 15.2
home 15.2
college 14.9
church 14.8
window 14.7
monastery 14.5
roof 13.5
exterior 12.9
landscape 12.7
brick 12.6
buildings 12.3
public house 12.3
monument 12.2
street 12
tourist 11.8
houses 11.6
residential 11.5
square 10.9
river 10.7
architectural 10.6
office 10.3
housing 9.7
windows 9.6
medieval 9.6
religious residence 9.3
century 8.8
heritage 8.7
village 8.7
england 8.6
culture 8.6
cityscape 8.5
clouds 8.5
vintage 8.3
aged 8.2
balcony 8.2
religion 8.1
trees 8
grass 7.9
urban 7.9
museum 7.8
royal 7.7
summer 7.7
tree 7.7
capital 7.6
place 7.5
fortress 7.4
cathedral 7.1

Google
created on 2019-06-04

Building 88.7
House 88.7
Architecture 81.7
Estate 81
Mansion 79.2
Home 76.1
Historic house 69.9
History 66.1
Palace 57
Facade 56.5
Manor house 54.1
Château 53.2
Almshouse 52.1

Microsoft
created on 2019-06-04

outdoor 99.2
house 96.1
building 94.2
sky 87.2
old 86.2
white 74.5
town 38.3
vintage 25.1

Color Analysis

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a large building with a large building in the background -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image shows an elegant, historic building in a classical architectural style. The structure is large, primarily composed of red brick with white accents, such as corner detailing and ornamentation under the windows. It has a symmetrical design, featuring a central section with a triangular pediment above the main entrance. Flanking the central area are two wings that are slightly recessed.

The building has a mansard-style roof with dormer windows, chimneys, and decorative elements near the roofline. There is a large porch or portico with columns, adding to the grandeur of the design. Surrounding the building is an expansive lawn, and mature trees are visible, providing a serene, park-like setting. The overall atmosphere suggests that this could be a museum, historic home, or institutional building from the late 19th or early 20th century.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image shows a large, formal building, likely a mansion or institutional building, with early 20th-century architectural design elements. It is a multi-story structure made of brick, with prominent white stone detailing around the windows and corners. The building features several chimneys, dormer windows on the roof, and has a central entrance with columns. The facade is symmetrical, with an ornate central gable featuring decorative elements like stone carvings or trim. Surrounding the building is a well-maintained grassy area, and trees are visible on the right side, suggesting it is situated in a spacious property or park-like setting. The style and design hint at a historic building, possibly used for institutional purposes or as a private estate from the early 1900s.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows a large, ornate, multi-story building with a grand, symmetrical facade. The building appears to be constructed of stone or brick and features intricate architectural details such as columns, arched windows, and decorative rooflines. The building is situated on a grassy lawn with some trees visible in the background. The overall style and grandeur of the structure suggest it may be a historic mansion, government building, or other significant public or private institution.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph of a grand historic mansion or estate house. The building appears to be from the late 19th or early 20th century, featuring Georgian or Colonial Revival architectural style. It's a large, symmetrical brick structure with prominent architectural details including:

  • Multiple dormer windows along the roof
  • Tall brick chimneys
  • Decorative quoins (corner stonework)
  • Classical columns at the entrance porticos
  • Ornate window treatments
  • Multiple stories with numerous windows
  • Detailed cornices and trim work

The mansion sits on a manicured lawn, and there appears to be another building visible in the background to the right. The photograph has a number "898" written in the top right corner, suggesting it may be from an architectural archive or historical collection. The image quality and style is consistent with early photography techniques, likely from the early 1900s.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image depicts a large, multi-story house with a symmetrical facade and a central front door. The house is constructed from brick and features a mix of rectangular and triangular windows, as well as several chimneys. A covered porch is situated on the left side of the house, while a smaller structure with a porch is visible on the right side. The house is set amidst a well-manicured lawn, with trees visible in the background.

The image appears to be an old photograph, likely taken in the early 20th century, given its sepia tone and the style of the architecture. The overall atmosphere of the image suggests a sense of grandeur and elegance, with the large house and manicured lawn evoking a feeling of luxury and refinement.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

This image is a black-and-white photograph of a large, multi-story house with a symmetrical facade and a central front door. The house features a flat roof with chimneys and dormer windows, as well as a covered porch on the left side. The exterior is constructed from brick and wood, with a lawn in front of the house.

In the background, trees are visible on either side of the house, and a smaller building or structure can be seen to the right. The sky above is overcast, suggesting that the photo was taken on a cloudy day. Overall, the image presents a stately and elegant residence, likely from an earlier era given the architectural style and the black-and-white format of the photograph.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a black-and-white photograph of a large, historical building. The building is a three-story structure with a symmetrical design, featuring a central entrance framed by two columns and a porch with decorative elements. The facade is made of brick, with stone detailing around the windows and the entrance. The roof is gabled with chimneys on either side. The building has a classic architectural style, possibly from the late 19th or early 20th century.

The photograph captures the building from the front, showing a wide lawn in front of it. There are trees in the background, and the image has a slightly faded, vintage look, suggesting it is an old photograph. The number "898" is faintly visible in the top right corner of the image, possibly indicating the year the photograph was taken.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The black-and-white photo shows the front of a large house with a lawn in front. The house has a porch with pillars and a staircase. The house has many windows and chimneys. The house has a large entrance with a balcony and a clock on top. There are plants and trees in front of the house. There are other houses in the distance. The photo has a number 898 on the top right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-04-30

The black and white image shows a large, multi-story building in a classical style. The building is made of brick and has symmetrical architecture, featuring rows of windows, a central entrance with columns, and a decorative facade. The roofline includes dormers and chimneys, contributing to the building's grandeur.

A well-manicured lawn stretches out in front of the building, adding to the sense of elegance and formality. To the sides, trees provide a natural frame for the architectural structure, while a colonnaded walkway can be seen extending from the side of the building. The sky is overcast, giving the scene a muted, timeless quality.

Created by gemini-2.0-flash-lite on 2025-04-30

Here's a description of the image:

Overall Impression: The image is a vintage black and white photograph featuring a grand, stately brick building. It appears to be an older photograph due to the sepia tone and the style of the architecture.

Building:

  • Style: The building's architecture suggests a classical or colonial revival style, with symmetrical facades, prominent windows, and a detailed cornice. It's a large, two-story structure with a complex roofline.
  • Materials: The building's main material is brick, which is visible throughout the facades. The window frames are likely wood.
  • Features: There are multiple windows, chimneys, and ornate details around the entrances and above the windows. A portico with columns is visible on the left side of the building, and there is a small balcony centered above the front entrance.

Setting:

  • Grounds: The building is set in a well-manicured lawn. There's a clear path leading up to the front entrance, and the open space gives the building a sense of grandeur.
  • Surroundings: Some trees surround the building, providing a bit of shade and framing the scene. Another building is partially visible in the background.

Other Details:

  • There are a couple of trees on the right side of the picture.
  • On the top right of the picture, there is the number "898".

Overall, the image evokes a sense of history and elegance. It likely depicts a significant building from a bygone era, possibly a mansion, a historical building, or a civic structure.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a large, stately mansion with classical architectural features. The building is multi-storied with a symmetrical design, featuring a central section flanked by two wings. The façade is adorned with decorative elements such as pilasters, cornices, and ornate carvings.

Key features of the mansion include:

  1. Central Entrance: The main entrance is grand, with a portico supported by columns, leading to a set of double doors.
  2. Windows: The windows are tall and narrow, evenly spaced across the façade, and framed with decorative moldings.
  3. Roofline: The roof is flat with a balustrade running along the edge. There are also several chimneys and dormer windows protruding from the roof.
  4. Balconies and Terraces: There are balconies and terraces, particularly over the main entrance, adding to the grandeur of the structure.
  5. Materials: The building appears to be constructed from stone or brick, giving it a solid and enduring appearance.
  6. Surroundings: The mansion is set within a well-maintained garden or lawn, with trees and other greenery visible in the background, suggesting a spacious and possibly secluded estate.

The overall impression is one of elegance and opulence, typical of historic mansions or estates designed to showcase wealth and status.

Text analysis

Amazon

898