Human Generated Data

Title

Defectives, Insane: United States. New Hampshire. Concord. State Hospital: New Hampshire State Charitable and Correctional Institutions.: Twitchell Building.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3040.1

Human Generated Data

Title

Defectives, Insane: United States. New Hampshire. Concord. State Hospital: New Hampshire State Charitable and Correctional Institutions.: Twitchell Building.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3040.1

Machine Generated Data

Tags

Amazon
created on 2022-07-02

Grass 94.5
Plant 94.5
Housing 91.7
Building 91.7
Tree 81.6
House 76.4
Human 71.1
Outdoors 71.1
Urban 69.7
Villa 69.5
Home Decor 59.2
Spire 59
Architecture 59
Tower 59
Steeple 59
Road 57.7
Walkway 56.4
Path 56.4
Mansion 55.8
Campus 55.3

Clarifai
created on 2025-01-10

home 99.6
architecture 99.2
house 99
street 98.9
no person 97.4
building 96.8
tree 93.9
family 92.8
mansion 91.8
outdoors 91.5
driveway 90.3
window 88.9
sky 86.5
people 85.5
suburb 85.3
monochrome 85.1
lawn 84.3
museum 84.2
light 84.2
sepia 82.4

Imagga
created on 2022-07-02

school 100
building 100
structure 92.1
house 65.8
architecture 54.6
home 51.2
estate 36.2
residence 34.9
residential 32.7
property 32
real 29.5
new 29.2
garage 27.5
brick 24.6
construction 23.2
sky 22.6
real estate 22.5
exterior 22.2
dwelling 20
suburban 19.8
realty 19.8
roof 19.1
windows 18.3
lawn 18
suburbs 17.8
neighborhood 17.8
landscaping 17.8
modern 17.6
street 16.6
housing 16.4
grass 15.9
driveway 15.8
window 15.8
door 15.4
porch 14.8
mortgage 14.7
yard 14.6
expensive 14.4
family 14.3
trees 13.4
old 13.3
houses 12.6
historic 12
investment 12
landscape 11.9
two story 11.9
wall 11.6
garden 11.2
stone 11.1
facade 11
mansion 10.8
tree 10.8
travel 10.6
living 10.5
bungalow 10.4
luxury 10.3
wood 10
suburbia 9.9
wooden 9.7
summer 9
history 9
siding 8.9
upscale 8.9
rural 8.8
sunny 8.6
dream 8.5
contemporary 8.5
town 8.4
park 8.3
homestead 7.9
suburb 7.9
own 7.9
urban 7.9
landscaped 7.9
homes 7.9
flowers 7.8
household 7.8
built 7.7
culture 7.7
city 7.5
outdoors 7.5
single 7.4
palace 7.4
fence 7.3
landmark 7.2
wealth 7.2
center 7.1

Google
created on 2022-07-02

Sky 95.4
Building 95.4
Photograph 94.2
Tree 89.4
House 83.6
Rectangle 80.4
Window 80
Door 80
Plant 79.1
Landscape 77.5
Tints and shades 77.4
Facade 75.2
Cottage 74.7
Monochrome 71
Monochrome photography 69.2
Siding 67.1
Plantation 66.4
Room 66.4
History 66.4
Paper product 66.2

Microsoft
created on 2022-07-02

tree 100
outdoor 99.9
sky 99.1
house 93.5
old 74
building 69.9
text 63.6
window 60
town 51.6
residential 37.1

Color Analysis

Feature analysis

Amazon

Person

Clarifai

Tree
House
Window

AWS Rekognition

Person 71.1%

AWS Rekognition

Person 69.5%

Clarifai

Tree 97.3%

Clarifai

Tree 89.5%

Clarifai

Tree 77.2%

Clarifai

Tree 35.7%

Clarifai

House 93.3%

Clarifai

House 59.8%

Clarifai

Window 51.6%

Clarifai

Window 50.7%

Clarifai

Window 50.1%

Clarifai

Window 49.9%

Clarifai

Window 49.8%

Clarifai

Window 47.9%

Clarifai

Window 46.2%

Clarifai

Window 45.8%

Clarifai

Window 45.8%

Clarifai

Window 43.9%

Clarifai

Window 43.9%

Clarifai

Window 43.5%

Clarifai

Window 41.2%

Clarifai

Window 40.5%

Clarifai

Window 40.4%

Clarifai

Window 39.7%

Clarifai

Window 38.6%

Clarifai

Window 38.4%

Clarifai

Window 36.9%

Clarifai

Window 36.6%

Clarifai

Window 35%

Categories

Imagga
created on 2022-07-02

streetview architecture 85.4%
nature landscape 13.9%

Captions

Microsoft
created by unknown on 2022-07-02

an old photo of a house 96%
a house on the side of a road 95.9%
a house on the side of the road 95.8%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large house with a driveway and a driveway

Created by general-english-image-caption-blip-2 on 2025-07-05

an old black and white photo of a large house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a large, stately building that appears to be of Georgian architectural style. The structure is symmetrical, with a pitched roof featuring several dormer windows on the second level. The main entrance has a prominent portico supported by white columns, giving the building a formal and elegant look. The facade is made of brick, punctuated by several rectangular windows arranged evenly, further emphasizing symmetry.

The building is surrounded by a serene lawn area with a path leading to the entrance, and it is set against a backdrop of mature trees on both sides. The surrounding landscape appears well-maintained, with trimmed grass and ornamental plants near the walkway. The lighting suggests the photo was taken during daylight hours, and the image is in black-and-white, likely taken in the early 20th century.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a historic building with a symmetrical design, likely of classical or colonial architecture style. It is a large brick building with two stories, featuring a prominent entrance with four white columns supporting a pediment above the front door. The building has multiple evenly spaced windows on both floors, and dormer windows are visible on the roof, suggesting it may have an attic space. The walkway leading to the entrance is bordered by neatly maintained lawns and flowering plants, adding to the formal appearance of the structure. The building is surrounded by mature trees, with one particularly large tree visible on the right side of the image. In the background on the left side, partially obscured by trees, there appears to be another building or structure, possibly part of the same complex. The image is rendered in sepia tones, giving it a vintage or historical feel.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a large, stately building with a grand, columned entrance and a curved driveway leading up to it. The building appears to be constructed of brick and has a distinctive architectural style with arched windows and a central pediment. The building is surrounded by lush, mature trees, creating a picturesque, pastoral setting. The overall impression is of a historic, well-preserved structure set in a tranquil, natural environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph of a stately brick building, likely from the early to mid-20th century. It appears to be an institutional or academic building with Georgian colonial architectural style. The building features symmetrical windows, white trim, and a prominent entrance with classical columns forming a portico. There's a decorative pediment above the entrance and a widow's walk or balustrade on the roof. The building is approached by a curved walkway through a manicured lawn, and mature trees frame the scene. The composition suggests this might be part of a college campus, private school, or government building. The photograph has the formal, documentary quality typical of architectural photography from this era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a large, two-story brick house with a symmetrical facade and a central front door. The house features a gable roof with a dormer on the second floor, and a covered porch with columns on the front. A path leads up to the front door, and there are trees on either side of the house. The sky is overcast.

The image appears to be a vintage photograph, possibly from the early 20th century. The sepia tone and the style of the house suggest that it may have been taken during this time period. The image provides a glimpse into the architectural style and design of homes during this era, as well as the landscaping and outdoor features that were common at the time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a large, two-story brick house with a gable roof and a central front porch. The house features a symmetrical facade, with evenly spaced windows on both floors. A decorative pediment adorns the front of the house, adding to its architectural charm.

In the foreground, a well-manicured lawn stretches out, punctuated by trees and bushes that add a touch of natural beauty to the scene. A winding path leads up to the front door, inviting visitors to enter the stately home.

The overall atmosphere of the image exudes a sense of elegance and refinement, suggesting that the house may have been built during a bygone era when grandeur and sophistication were highly valued. The sepia tone of the photograph adds a nostalgic quality to the image, evoking feelings of nostalgia and wonder.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

An old image of a building with many windows and a walkway leading to the entrance is surrounded by trees. The building has a balcony on the second floor and a porch with columns in front. There is a grassy area with plants and flowers on the right side of the building. The sky is clear and bright, and the image has a vintage filter.

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black and white photograph of a building. It is a large, two-story building with a gray roof. The building is surrounded by trees, and there is a pathway leading up to the front entrance. The pathway is surrounded by grass and plants. The building has many windows, and there is a porch with columns at the front entrance. The image has a vintage filter, giving it a nostalgic feel.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here's a description of the image:

The image is a sepia-toned photograph of a large, stately building. The building is three stories tall with a prominent entryway featuring a covered porch supported by classical columns. Above the porch, there is a triangular pediment with a semi-circular window. The windows on the front of the building are rectangular and evenly spaced.

The building is surrounded by a well-manicured lawn, and a paved walkway leads to the entrance. A flowerbed runs along the edge of the lawn parallel to the walkway. Large trees flank the building on both sides, adding to the overall sense of grandeur. The sky is light and appears somewhat overcast.

In the background, to the left of the main building, parts of another structure are visible, suggesting that the scene might be on a campus or estate. The image has a timeless quality, likely taken sometime in the mid-20th century or earlier.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

The image shows a stately, three-story brick building in a classic, colonial style. The building has a symmetrical design with rows of windows. A prominent portico with tall white columns marks the entrance. The roofline is accented with a decorative railing and dormer windows.

The building is situated on a large, grassy lawn. A winding path leads up to the entrance. Mature trees surround the building, providing shade and adding to the overall serene atmosphere. The photograph appears to be an older one, as indicated by the sepia tone. The overall composition suggests a prestigious institution or a grand residence.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a large, stately brick building that appears to be a historic mansion or institutional building. The structure is symmetrical with a central entrance flanked by evenly spaced windows on both floors. The entrance features a portico with four columns supporting a triangular pediment, adding a classical architectural touch. The roof is hipped with dormer windows and a small cupola on top.

The building is surrounded by well-maintained grounds with a paved pathway leading up to the entrance. There are landscaped flower beds on either side of the pathway and mature trees providing a backdrop, enhancing the picturesque setting. The overall atmosphere suggests a serene and elegant environment, likely indicative of a historic estate or a significant public building. The photograph appears to be in black and white, giving it a vintage feel.

Qwen

No captions written