Human Generated Data

Title

Defectives, Epileptics: United States. Massachusetts. Palmer. State Hospital for Epileptics: Farm Group #1 and 2 1906.

Date

1906

People

Artist: Woodhead Studio, American active 1900s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3474

Human Generated Data

Title

Defectives, Epileptics: United States. Massachusetts. Palmer. State Hospital for Epileptics: Farm Group #1 and 2 1906.

People

Artist: Woodhead Studio, American active 1900s

Date

1906

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3474

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Nature 97.3
Building 96.5
Outdoors 95.8
Home Decor 95
Housing 93.7
Countryside 93.7
Rural 93.7
Shelter 93.7
Art 91.2
House 87.9
Cottage 87.9
Urban 73.5
Plant 67.4
Architecture 65.3
Tower 65.3
Suburb 61.8
Grass 61.4
Tree 60.2
Land 56.9
Villa 55.2

Clarifai
created on 2019-06-05

house 99
home 98.8
no person 97.8
farmhouse 94.4
landscape 94.1
storm 93.9
building 92.6
tree 92.5
people 92.5
architecture 90.9
barn 90
calamity 89.5
window 89.3
vintage 88.5
street 87
outdoors 85.9
farm 85.6
wood 82.7
family 82.5
light 82.1

Imagga
created on 2019-06-05

barn 100
farm building 99.4
building 89
structure 71.1
sky 32.3
house 31.8
landscape 28.3
rural 26.5
field 25.1
old 23
grass 23
fence 22.5
farm 21.4
trees 20.5
architecture 18
country 17.6
tree 17
clouds 16.1
home 15.2
wood 15
wooden 15
countryside 14.6
agriculture 14.1
picket fence 13.8
barrier 13.4
roof 12.9
summer 12.2
hut 11.8
houses 11.6
farming 11.4
new 11.4
outdoors 11.2
mountains 11.1
window 11.1
grain 11.1
scenery 10.8
construction 10.3
exterior 10.2
travel 9.9
scenic 9.7
forest 9.6
cloud 9.5
season 9.4
shelter 9.3
vintage 9.1
meadow 9
obstruction 8.9
garage 8.7
scene 8.7
residential 8.6
winter 8.5
buildings 8.5
outdoor 8.4
peaceful 8.3
wall 7.9
land 7.9
cabin 7.9
cottage 7.9
day 7.9
abandoned 7.8
antique 7.8
cold 7.8
windows 7.7
rustic 7.7
door 7.6
estate 7.6
real 7.6
snow 7.5
horizon 7.2
autumn 7
shed 7

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

grass 98.5
tree 90.6
house 86.9
sky 85
painting 80.2
building 52.3

Color Analysis

Feature analysis

Amazon

Painting

Clarifai

Tree
House
Picture frame
Window

AWS Rekognition

Painting 91.2%

Clarifai

Tree 97%

Clarifai

Tree 55%

Clarifai

Tree 40.4%

Clarifai

House 96.9%

Clarifai

House 80.4%

Clarifai

Picture frame 95.4%

Clarifai

Window 48%

Clarifai

Window 47.3%

Clarifai

Window 45.3%

Clarifai

Window 42.4%

Clarifai

Window 42.3%

Clarifai

Window 39.4%

Clarifai

Window 38.4%

Clarifai

Window 37%

Clarifai

Window 35%

Clarifai

Window 34.4%

Clarifai

Window 33.2%

Categories

Imagga
created on 2019-06-05

paintings art 93.7%
streetview architecture 5.5%

Captions

Microsoft
created by unknown on 2019-06-05

a sign in front of a house 77.7%
an old photo of a house 76.1%
a house with a grass field 76%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-29

a photograph of a large house with a large house in the background

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a large house on a hill

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image depicts an early 20th-century photograph of a rural property featuring two buildings. The primary structure, in the foreground, is a large, two-story stone house with a steep, hipped roof and Tudor-style architectural elements, including the prominent decorative wooden beams in the gable area of the roof. A small cupola or rooftop ornament is situated near the peak of the roof. The house has large windows, and a covered porch is visible on the ground level.

The second structure, in the background to the right, is a smaller building with a similar roof style and stone construction, likely serving as an accompanying house or utility building. The foreground shows a grassy, uneven landscape, and a barren tree is positioned on the right side of the image. A utility pole stands toward the left, adding a sense of location and infrastructure. The entire scene is framed in a dark border, common in vintage photograph presentations. The overall atmosphere captures a serene, rustic setting.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a black and white photograph of a large, two-story house situated on a slightly elevated, grassy hill. The house features a steep, gabled roof and a dormer with a small spire on top. The architecture appears to be a mix of styles, with timbering detail visible on the second floor near the roofline. The building has multiple windows and a prominent front porch.

Adjacent to the main house, in the background on the right, is a smaller building also featuring a gabled roof, suggesting it might be an auxiliary structure like a guesthouse or carriage house. The landscape around the house is open, with a bare tree on the right side of the image. There's also a utility pole visible on the left side of the image, indicating the presence of modern amenities like electricity.

The overall setting has a serene rural feel, with no other buildings or people visible in the immediate vicinity. The photograph is bordered by a dark mat with a signature in the bottom right corner, indicating it might be a professional photograph taken by a specific photographer.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows a large, two-story wooden building with a distinctive roof and architectural features, surrounded by smaller structures and trees on a grassy hillside. The image appears to be a historical photograph, with a sepia-toned color palette. The building and surrounding landscape suggest a rural or small-town setting from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a historical black and white photograph showing a large house or institution situated on a hillside. The building appears to be in an Arts and Crafts or early 20th century architectural style, with multiple levels following the slope of the hill. It has a cross mounted on top, suggesting it may be a church, school, or religious institution. The structure features several wings and porches, with what looks like stucco or light-colored siding. Bare trees frame the scene, indicating it was taken during late fall or winter. The photograph has a dark border or frame around it, which was common in early photography presentation styles.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a sepia-toned photograph of a large house and a smaller building on a hill, surrounded by grass and trees.

  • The large house has two stories and a steeply pitched roof. It has a covered porch on the front and a chimney on the right side. There are several windows on the front and back of the house.
  • The smaller building is to the right of the large house and has a flat roof. It appears to be a garage or outbuilding.
  • In the foreground, there is a grassy hill with rocks and trees scattered throughout. A telephone pole is visible on the left side of the image.
  • The sky is overcast and hazy, giving the image a vintage feel.

Overall, the image suggests that the large house is the main residence, while the smaller building may be used for storage or other purposes. The surrounding landscape adds to the sense of tranquility and seclusion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image depicts a sepia-toned photograph of a large house situated on a hill, with a smaller structure in the background. The main house features a gable roof and a covered porch, while the smaller building appears to be a separate dwelling or outbuilding. A tree stands to the right of the image, and a utility pole is visible on the left side. The photograph is presented in a black frame, which adds a sense of nostalgia and timelessness to the scene. Overall, the image captures a serene and peaceful atmosphere, evoking a sense of simplicity and tranquility.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph of a house on a hill, with a tree in the foreground. The house has a gabled roof and a porch, with a chimney on the side. There is a small house in the background, with a chimney on the side. The house is surrounded by a grassy field, with a pole in the distance. The image has a vintage look, with a sepia tone and a black border.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The image is a vintage black-and-white photograph of two houses. The houses are situated on a hill, with one larger house in the center and a smaller house on the right side. The larger house has a tower-like structure on top, and both houses have chimneys. The hill is covered with grass, and there are some trees on the right side. The sky is clear, and the image has a vintage filter.

Google Gemini

Created by gemini-2.0-flash on 2025-06-02

The sepia-toned photograph depicts a scene from the early 20th century, capturing a large, two-story building with a smaller, single-story structure situated on a grassy hill. The main building boasts a prominent, multi-pitched roof topped with a small cupola, and is adorned with numerous windows. A covered porch extends from the side of the building, adding architectural interest.

To the right of the main building, the smaller structure appears simple, yet complementary to the overall composition. A tall, bare tree stands prominently to the right of the smaller building, its branches stark against the pale sky, suggesting it is either late fall or winter.

The setting is a gentle hill covered in short grass. The photograph is framed with a dark border, giving it a vintage appearance, adding to the feeling of viewing a moment captured long ago. A utility pole is visible on the far left, offering a glimpse into the infrastructure of the time.

Created by gemini-2.0-flash-lite on 2025-06-02

Here is a description of the image:

The image is a vintage black and white photograph. It depicts two buildings situated on a grassy hill. The larger building is a two-story structure with a gabled roof and several windows on both floors. It appears to be made of stone or a similar material. A smaller, one-story building is located to the right. A tree with bare branches stands near the right edge of the image. The foreground is a grassy slope. The photo is set within a dark gray mat, with the photographer's mark on the bottom right corner. The image has a sepia tone, suggesting it may be an old print.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a vintage sepia-toned photograph depicting a large, two-story house situated on a sloping hill. The house has a distinct architectural style, featuring a steeply pitched roof, multiple gables, and a prominent turret-like structure on one corner. The exterior walls appear to be made of stone or brick, and the house has a covered porch supported by columns on the front side.

Adjacent to the main house, there is a smaller structure, possibly a carriage house or a guest house, which also has a gabled roof. The surrounding landscape is hilly and sparsely vegetated, with a few leafless trees and patches of grass. A utility pole with wires can be seen on the left side of the image, indicating the presence of electrical infrastructure.

The photograph is framed with a dark border, and there is a signature or studio mark in the bottom right corner, though it is not entirely legible. The overall scene suggests a rural or semi-rural setting, likely from the late 19th or early 20th century.

Qwen

No captions written

Text analysis

Amazon

lathele