Human Generated Data

Title

Defectives, Insane: United States. Massachusetts. Waverly. McLean Hospital: McLean Hospital: Lodge

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3036.1

Human Generated Data

Title

Defectives, Insane: United States. Massachusetts. Waverly. McLean Hospital: McLean Hospital: Lodge

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3036.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Building 97
Housing 95.8
Countryside 95.2
Outdoors 95.2
Rural 95.2
Nature 95.2
Shelter 95.2
Cottage 94.1
House 94.1
Urban 91.2
Neighborhood 83.3
Plant 82.9
Tree 82.9
Suburb 65
Road 57.3
Hut 56.8
Roof 55.4

Clarifai
created on 2019-06-05

home 99.9
no person 99.5
house 96.6
people 93.4
farmhouse 92.3
building 90.9
family 90.2
architecture 90.2
tree 88.7
street 87.1
calamity 82.4
government 81.4
wood 80.1
vehicle 78.8
driveway 75.4
military 74.8
porch 73.1
bungalow 71.9
administration 71.5
war 69.8

Imagga
created on 2019-06-05

house 60.8
building 53.6
architecture 51.2
home 50.4
garage 34.6
structure 34.6
estate 32.4
residential 28.8
residence 27.1
brick 25.1
dwelling 24.9
real 24.7
bungalow 22.6
roof 22.5
tree 22.4
property 22.3
sky 21.9
new 21.1
trees 19.6
school 19
construction 18.9
grass 18.2
lawn 18
landscape 17.9
modern 17.6
exterior 17.6
neighborhood 16.8
yard 16.6
door 16.2
housing 16
landscaping 15.8
luxury 15.5
window 15.4
windows 15.4
old 15.4
country 15
driveway 14.8
suburban 14.8
expensive 14.4
wood 14.2
tile 13.4
fence 13.2
snow 12.9
real estate 12.7
family 12.5
rural 12.4
wooden 12.3
historic 11.9
single 11.5
summer 11
porch 10.9
realty 10.9
landscaped 10.8
houses 10.7
urban 10.5
contemporary 10.4
wall 10.3
stone 10.3
winter 10.2
investment 10.1
mortgage 9.8
garden 9.5
hut 9.4
suburb 8.9
mansion 8.8
architectural 8.7
rustic 8.7
picket fence 8.6
living 8.6
travel 8.5
university 8.4
church 8.3
traditional 8.3
city 8.3
village 8.2
two story 7.9
homestead 7.9
masonry 7.9
cottage 7.9
center 7.7
historical 7.5
town 7.4
facade 7.4
vacation 7.4
wealth 7.2

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

tree 100
outdoor 100
house 99
residential 82.6
sky 80.4
window 79.6
street 77.1
town 74.4
old 73.1
building 60.3
black and white 56.4
historic 54.4

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

Tree
Window
House

Clarifai

Tree 97.7%

Clarifai

Tree 93.8%

Clarifai

Tree 87.7%

Clarifai

Tree 73%

Clarifai

Tree 68.9%

Clarifai

Tree 64.2%

Clarifai

Tree 59%

Clarifai

Tree 52.7%

Clarifai

Tree 51.1%

Clarifai

Tree 50.9%

Clarifai

Tree 46%

Clarifai

Tree 45.5%

Clarifai

Tree 41.6%

Clarifai

Tree 40.3%

Clarifai

Tree 38.8%

Clarifai

Tree 38%

Clarifai

Window 68.3%

Clarifai

Window 64.7%

Clarifai

Window 64%

Clarifai

Window 62.4%

Clarifai

Window 61.5%

Clarifai

Window 50.1%

Clarifai

Window 44.4%

Clarifai

Window 41.6%

Clarifai

Window 40.3%

Clarifai

Window 39.6%

Clarifai

Window 38.2%

Clarifai

Window 38.1%

Clarifai

Window 34.4%

Clarifai

Window 34.2%

Clarifai

Window 33.5%

Clarifai

House 34.8%

Clarifai

House 34%

Categories

Imagga
created on 2019-06-05

streetview architecture 98.9%
nature landscape 1.1%

Captions

Microsoft
created by unknown on 2019-06-05

an old house on a street 97.4%
an old brick house 95.7%
a house that has a sign on the side of a road 95.1%

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

an old black and white photo of a house

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a house with a gated entrance and a gated in front of it

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This image depicts a charming brick house in a natural, tree-lined setting. The house is designed in a classic style, with a steep roof and white-framed windows featuring shutters. A small porch with columns marks the entrance. In front of the house is a gated driveway flanked by two brick pillars, and there is a low stone wall skirting one side of the driveway. Surrounding the house, trees are prominent, suggesting a tranquil and private atmosphere. The photograph appears to be in black and white, lending a nostalgic, vintage feel to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a historic brick house situated in a picturesque, wooded setting. The house is two stories with a gabled roof, featuring dormer windows and brick chimneys. The architecture is traditional, with a symmetrical façade and large multi-pane windows adorned with shutters. A notable feature is the small porch with columns at the front entrance.

In front of the house is a wrought iron gate flanked by two brick posts, marking the entrance to the property from a dirt road. The road curves slightly upward from the entrance toward the house, which is surrounded by mature trees and shrubs giving the setting a natural and secluded feel. There are stone walls lining the road and driveway, adding to the rustic charm of the landscape. The overall scene is reminiscent of a stately countryside home from the early 20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows a large, two-story brick and stone house with a wraparound porch and gabled roof. The house is surrounded by trees and set back from a gravel road. There is a stone wall or fence in the foreground. The image has a vintage, black and white appearance, suggesting it is an older photograph. The architectural style and setting give the impression of a historic, country home or estate.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white historical photograph of a brick house, likely from the late 19th or early 20th century. The house appears to be a Colonial or Federal style home with a prominent brick exterior, shuttered windows, and a small covered entry porch with columns. There's a distinctive brick and iron gate entrance with brick pillars at the property line, and a stone retaining wall runs along what appears to be a dirt or gravel road. The house is set among mature trees, giving it a stately, established appearance. The architecture includes details like a dormer window on the second floor and multiple chimneys. The overall composition suggests this was likely a well-to-do family's home during that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image depicts a large brick house with a chimney and a tree in front of it. The house is two stories tall, with a gable roof and a chimney on the right side. There are several windows on the front of the house, including a bay window on the first floor. A stone wall runs along the front of the property, with a gate in the center. The gate is made of metal and has a pointed top. To the left of the gate, there is a stone pillar with a flat top. In front of the house, there is a large tree with branches that stretch out over the driveway. The driveway is made of dirt and leads up to the front door of the house. The background of the image shows a grassy field with trees in the distance. The sky is overcast, and the overall atmosphere of the image is one of serenity and tranquility.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image depicts a historic black-and-white photograph of a house, showcasing its architectural features and surroundings. The house is constructed from brick and features a gable roof with a chimney on the right side. A small porch with a gate adorns the front of the house, accompanied by a stone wall that runs along the front and right sides of the property. The house is surrounded by trees and bushes, with a dirt road leading up to it.

In the background, additional trees and a hill are visible, suggesting that the house is situated in a rural or natural setting. The overall atmosphere of the image is one of serenity and tranquility, with the old-fashioned architecture and peaceful surroundings evoking a sense of nostalgia and charm.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

The image is a black-and-white photograph of a house. The house is constructed with bricks and has a two-story design. It has a chimney on the right side and a small porch on the front. The roof is covered with shingles. There are two windows on the left side of the porch and two windows on the right side of the house. There is a tree in front of the house. The house is surrounded by a stone wall.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The image is a black-and-white photograph of a house with a driveway leading up to it. The house has a brick exterior, a chimney, and a gabled roof. It features several windows, including one with shutters. There is a small porch with a roof supported by columns. The house is surrounded by trees and bushes, and there is a stone wall along the driveway. The driveway is made of gravel and leads to the entrance of the house.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-24

Here's a description of the image:

The image is a black and white photograph of a brick house with a gabled roof. The house appears to be a stately, older home, possibly from the early to mid-20th century.

Here are some key features:

  • Architecture: The house has a classic, somewhat formal design with brickwork, multi-pane windows, and likely a chimney. It has a distinctive gabled roof with dormers.
  • Setting: The house sits behind a stone wall and a gated entrance, suggesting a private property or a well-landscaped area. A large, bare tree is in the foreground and adds a sense of age to the home. Lush foliage frames the house and its surroundings.
  • Overall Impression: The photograph conveys a sense of quiet elegance and the passage of time. The scene is likely in the fall or winter, as the tree is bare. The photograph looks to be a historic record of the house.

Created by gemini-2.0-flash on 2025-05-24

The black-and-white image captures an elegant brick house situated on a well-manicured property. The house, with its classic architecture, features a gable roof, a prominent brick chimney, and shuttered windows that add depth to its facade. A sunroom-like structure extends from the side of the house, providing an inviting, sheltered space.

A tall, leafy tree stands prominently in front of the house, its branches creating an intricate network of lines against the sky. The tree's position adds a touch of natural beauty to the scene, framing the house and softening its lines.

In front of the house, a stone wall runs along the property line, adding a rustic, timeless quality to the landscape. The stone wall appears to have an opening with two brick pillars and a gate, hinting at the entrance to the property. The dirt road that leads up to the house adds a sense of history and charm.

The background is filled with lush greenery, suggesting a tranquil, wooded environment. The overall composition of the image conveys a sense of serenity, suggesting that the house is a peaceful retreat nestled in a beautiful natural setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a vintage photograph of a two-story brick house with a gabled roof, set in a serene, wooded environment. The house has a symmetrical design with a central entrance featuring a small portico supported by columns. The windows are evenly spaced with shutters on the lower level.

In front of the house, there is a low stone wall that runs along the edge of the property, and a gated entrance with brick pillars on either side. The gate is made of wrought iron and is currently open. The driveway leading up to the house is paved and appears to be well-maintained.

The surrounding landscape includes mature trees and dense foliage, suggesting a peaceful, rural setting. The overall scene conveys a sense of tranquility and timeless elegance. The photograph has a slightly faded quality, indicating it might be quite old.

Qwen

Text analysis

Amazon

79

Google

79
79