Human Generated Data

Title

Housing, Industrial: United States. New York. Mineville: Industrial Housing. Semi-Detached Dwellings of Frame Construction: Witherbee, Sherman & Company, Mineville, N.Y.: III

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1963.3

Human Generated Data

Title

Housing, Industrial: United States. New York. Mineville: Industrial Housing. Semi-Detached Dwellings of Frame Construction: Witherbee, Sherman & Company, Mineville, N.Y.: III

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1963.3

Machine Generated Data

Tags

Amazon
created on 2019-06-04

Housing 95.8
Building 95.8
Outdoors 88.6
Nature 88.6
Shelter 88.6
Countryside 88.6
Rural 88.6
Tree 86.8
Plant 86.8
House 83.9
Machine 81.1
Urban 80.1
Home Decor 74.1
Cottage 68.6
Furniture 67
Bench 66.6
Vegetation 58.7
Villa 56.8
Porch 55

Clarifai
created on 2019-06-04

home 99.5
no person 99.2
house 97
building 95.5
people 95.1
architecture 94.4
group 91.6
street 89.7
family 89.2
outdoors 84.9
group together 81.2
government 80.4
war 79.2
calamity 76.7
tree 76.2
town 76.1
administration 75.6
horizontal plane 75.5
vehicle 75.1
offense 74.8

Imagga
created on 2019-06-04

house 72.1
building 64.1
home 58.4
architecture 53.8
structure 41.1
estate 41
residence 36.8
bungalow 34.1
real 33.3
brick 33.2
school 33
property 33
residential 32.7
garage 26.6
dwelling 25.9
roof 25.1
windows 25
landscaping 24.7
construction 24
center 23.5
new 22.8
lawn 21.8
sky 21.2
window 20.7
door 20
modern 19.7
yard 19.5
tile 19
neighborhood 18.8
landscape 18.7
suburban 17.8
grass 15.9
realty 15.8
exterior 15.7
housing 15.6
expensive 15.4
old 14.7
houses 14.6
trees 14.3
luxury 13.8
family 13.4
living 13.3
suburbs 12.9
investment 12.9
driveway 12.9
porch 12.9
stone 12.8
real estate 12.7
mortgage 12.7
wood 12.6
single 12.4
tree 12
street 12
public house 11.6
country 11.5
garden 11.4
historic 11
upscale 10.9
architectural 10.6
rural 10.6
village 10.4
two story 9.9
landscaped 9.9
homes 9.9
contemporary 9.4
fence 9.3
travel 9.2
style 8.9
facade 8.7
nice 8.3
wealth 8.1
suburbia 7.9
wooden 7.9
mansion 7.9
dutch 7.8
summer 7.7
two 7.7
buildings 7.6
history 7.2
urban 7

Google
created on 2019-06-04

House 96.7
Home 94.8
Property 92.6
Building 89.5
Residential area 87.3
Architecture 78.7
Neighbourhood 77.6
History 73.3
Real estate 65.2
Roof 58.6
Cottage 55.2
Car 54.8
Vehicle 54.4
Suburb 52.5

Microsoft
created on 2019-06-04

tree 99.9
outdoor 99.7
house 97.5
window 94.4
black and white 84.4
building 80.7
sky 80.5
porch 77.9
old 59.4
town 44.5
residential 29.7

Color Analysis

Feature analysis

Amazon

Wheel

Clarifai

Tree
House
Window
Porch
Car
Wheel
Stairs

AWS Rekognition

Wheel 81.1%

AWS Rekognition

Wheel 78.4%

Clarifai

Tree 97.8%

Clarifai

Tree 93.9%

Clarifai

Tree 93.5%

Clarifai

Tree 35.2%

Clarifai

House 97.3%

Clarifai

House 41%

Clarifai

Window 86.2%

Clarifai

Window 81.5%

Clarifai

Window 79.2%

Clarifai

Window 72.7%

Clarifai

Window 71.9%

Clarifai

Window 60.4%

Clarifai

Window 58.1%

Clarifai

Window 55%

Clarifai

Window 54.6%

Clarifai

Window 54.5%

Clarifai

Window 52.8%

Clarifai

Window 49%

Clarifai

Window 48.8%

Clarifai

Window 48.6%

Clarifai

Window 48.3%

Clarifai

Window 45.1%

Clarifai

Window 43.2%

Clarifai

Window 43.1%

Clarifai

Window 42.5%

Clarifai

Window 42.2%

Clarifai

Window 41%

Clarifai

Window 37.6%

Clarifai

Window 37.2%

Clarifai

Window 35.6%

Clarifai

Window 34.1%

Clarifai

Window 33.3%

Clarifai

Porch 69.8%

Clarifai

Porch 34.2%

Clarifai

Car 68.6%

Clarifai

Wheel 64.6%

Clarifai

Wheel 61.1%

Clarifai

Wheel 50%

Clarifai

Stairs 36.6%

Categories

Imagga
created on 2019-06-04

streetview architecture 99.9%

Captions

Microsoft
created by unknown on 2019-06-04

a bench in front of a house 86%
an old photo of a house 85.9%
a house with trees in the background 85.8%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a horse drawn carriage in front of a house

Created by general-english-image-caption-blip-2 on 2025-07-06

an old black and white photo of a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This black-and-white photograph depicts a two-story house with a shingled exterior and a pitched roof. The building features multiple windows, including dormer-style windows on the second floor. A small covered porch with steps leads up to the main entrance, and there is additional covered outdoor space on the right side. The house is set on a slightly elevated foundation, with visible stonework at the base.

Surrounding the house are trees and other foliage, giving a rural or suburban feel to the area. On the right side of the image, there is an antique car, suggesting the photo dates back to the early 20th century. A utility pole is visible in the background, which adds to the impression of a sparsely developed area. The overall aesthetic captures a historic, tranquil setting.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a black-and-white photograph of a two-story house with a rustic appearance. The house has wooden shingle siding and a hipped roof with a dormer featuring three small windows. The front of the house shows a covered porch with steps leading up to it, and there are several windows on both floors. The structure appears to be built on a slightly elevated foundation, indicated by the visible concrete or stone base.

In the foreground, a vintage automobile is parked on an unpaved road or driveway to the right of the house; the car appears to be an early model, possibly from the 1920s given its style. Surrounding the property are a few trees, and there is a utility pole visible, suggesting the location is in a semi-rural or suburban area. The overall scene suggests an early 20th-century setting, characterized by its tranquil and historical ambiance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image shows a large, two-story wooden building with a slanted roof and multiple windows. The building appears to be surrounded by trees and has a porch with a railing. In the foreground, there is an old-fashioned car parked on the dirt road in front of the building. The overall scene has a vintage, historical feel to it.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-13

The black and white image shows an old two-story house with a shingled roof. The house has multiple windows and a front porch with stairs leading up to it. There are two vintage cars parked in front of the house. The house is surrounded by trees, giving it a rural or small town feel. The image has an aged, historical quality to it based on the style of the house and cars.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white photograph of what appears to be an early 20th century American house. It's a two-story craftsman-style home with cedar shake siding and multiple windows with white trim. The house features a covered porch with white railings and steps leading up to the entrance. There's an old automobile, likely from the 1920s or early 1930s, parked in front of the house. The property appears to have some trees around it, and utility poles can be seen in the background. The ground appears unpaved, suggesting this may be from a time before widespread residential street paving. The architectural style and photographic quality suggest this image was taken sometime in the 1920s or 1930s.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image depicts a large, two-story house with a shingled exterior and a covered porch on the front. The house has a gable roof and multiple windows on both floors. A staircase leads up to the front door, which is situated on the left side of the house. The house appears to be made of wood and has a rustic, old-fashioned look.

In the foreground, there is a vintage car parked on the street in front of the house. The car is facing towards the right side of the image and has a license plate that reads "A96539". The car is an older model, likely from the early 20th century.

The background of the image shows a dirt road or driveway leading up to the house, as well as some trees and power lines. The sky above is overcast, suggesting that the photo was taken on a cloudy day.

Overall, the image presents a charming and nostalgic scene of a classic American home, complete with a vintage car and a rural setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

This image is a black and white photograph of a two-story house with a car parked in front. The house has a shingled exterior, a gabled roof, and a covered porch on the right side. There are several windows on both floors, and a staircase leads up to the front door. A vintage car is parked in front of the house, facing to the right. The background of the image shows trees and a telephone pole, suggesting that the house is located in a rural or suburban area. The overall atmosphere of the image is one of nostalgia and simplicity, evoking a sense of a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of a large house with a sloped roof, surrounded by trees. The house has a porch with white railings and steps leading up to the entrance. There is a vintage car parked on the road in front of the house, and a pole with a streetlight and wires is visible on the right side of the image. The sky is clear and bright, and the overall tone of the image is nostalgic and reminiscent of a bygone era.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of a house with a car parked in front. The house has many windows and a porch with a railing. The house is surrounded by trees. The car is parked on the side of the road, and there is a pole with a street light on the right side. The road is made of dirt. The house is on a hill.

Google Gemini

Created by gemini-2.0-flash on 2025-05-01

The image is a vintage black and white photograph of a two-story house with a steeply pitched roof and dormer windows. The house is covered in shingles and has a prominent front porch. A vintage car is parked in front of the house, adding to the nostalgic feel of the image. Mature trees surround the house, partially obscuring it from view. A utility pole is visible in the background, suggesting that the house is located in a developed area. The overall composition of the image gives a sense of history and charm.

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

The image shows a large, two-story house in a vintage photograph. The house appears to be covered in shingle siding, giving it a textured look. It features multiple windows, including some in dormers on the roof. A porch with stairs and a small covered entrance is visible. Tall trees surround the house. A vintage car is parked in front of the house, on what appears to be a dirt road. A utility pole with a street light stands in the background. The image has a classic black-and-white aesthetic that indicates it was taken a long time ago.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a vintage black-and-white photograph of a two-story wooden house. The house has a rustic appearance, characterized by its shingle siding and a hipped roof. The front of the house features a covered porch with a set of stairs leading up to it. The porch has a railing and appears to have a small overhang supported by columns.

The house has multiple windows on both the first and second floors, indicating several rooms inside. The surrounding area is somewhat rural, with trees and unpaved ground visible around the house. To the right of the house, there is an old-fashioned car parked on a dirt driveway, which helps to date the photograph to the early 20th century.

In the background, there are utility poles and wires, suggesting that the area had access to electricity. The overall setting gives the impression of a quiet, possibly suburban or rural location from a bygone era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image depicts a two-story residential building with a shingled exterior, likely from the early to mid-20th century. The architecture features a gabled roof with a smaller gabled extension on the second floor. The building has a porch with a set of stairs leading up to the entrance, and the porch is supported by wooden columns. The windows are uniformly spaced and rectangular, with some featuring wooden shutters. A vintage car is parked in front, suggesting the photograph's era. The scene is set in a suburban or rural area with visible trees and a dirt road or unpaved street. The overall style and elements of the image point to a historical setting, with the car and the architectural design providing clues to the time period.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This is a black and white photograph of a two-story house with a steeply pitched roof and multiple dormer windows. The house has a shingled exterior and a front porch with a staircase leading up to it. There are several trees and bushes around the house, and a vintage car is parked on the street in front of the house. The sky appears to be clear, and there is a utility pole with power lines in the background. The overall style of the photograph suggests it is from an earlier time period, possibly the early 20th century.