Human Generated Data

Title

Charity, Aged: United States. New York. New York City. Home for Aged and Infirm, Richmond Division, Staten Island: Home for Aged and Infirm, Borough of Richmond Division, Staten Island (New York City Almshouse System): Superintendant's Quarters: Old Quarters (100 Years Old); Present Quarters.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.610.1

Human Generated Data

Title

Charity, Aged: United States. New York. New York City. Home for Aged and Infirm, Richmond Division, Staten Island: Home for Aged and Infirm, Borough of Richmond Division, Staten Island (New York City Almshouse System): Superintendant's Quarters: Old Quarters (100 Years Old); Present Quarters.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.610.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Nature 99.8
Outdoors 99.3
Snow 95.6
Winter 94.6
Blizzard 94.6
Storm 94.6
Building 84.5
Countryside 67.1
Shelter 57.3
Rural 57.3

Clarifai
created on 2019-06-07

people 99.5
adult 96.9
no person 96.8
winter 96.4
home 96.3
vehicle 96.1
building 94
group 93.9
group together 92
snow 91.6
administration 91.3
war 90.6
military 90.6
wear 90
house 90
street 89.3
architecture 89
calamity 88.2
man 87.6
many 86.8

Imagga
created on 2019-06-07

snow 53.1
building 43.9
sketch 35.4
structure 34.4
barn 31.5
architecture 31.5
old 30.7
winter 29.8
drawing 29.1
city 26.6
sky 24.9
farm building 23.8
weather 22.3
wall 21.6
history 21.5
representation 21.3
cold 20.7
landscape 19.4
house 19.3
vintage 19
tower 17.9
ancient 17.3
graffito 17.2
grunge 17
town 16.7
antique 16.5
church 15.7
travel 15.5
landmark 15.4
scene 14.7
tourism 14
construction 13.7
religion 13.5
facade 13.4
season 13.3
texture 13.2
retro 13.1
decoration 12.9
exterior 12.9
historic 12.8
billboard 12.6
aged 11.8
frame 11.7
scenic 11.4
urban 11.4
historical 11.3
paper 11
frost 10.6
obsolete 10.5
grungy 10.4
signboard 10.2
ice 10.2
window 10.1
rough 10
tree 10
scenery 9.9
rural 9.7
warehouse 9.2
art 9.1
outdoors 9
trees 8.9
rustic 8.6
brick 8.6
aging 8.6
old fashioned 8.6
weathered 8.6
culture 8.6
space 8.5
famous 8.4
grain 8.3
pattern 8.2
fortress 8.2
forest 7.8
snowy 7.8
freeze 7.8
torn 7.7
village 7.7
wood 7.5
monument 7.5
brown 7.4
street 7.4
monastery 7.3
dirty 7.2
black 7.2

Google
created on 2019-06-07

House 73.1
Building 69.2
Home 68.2
Almshouse 67.6
Room 65.7
Architecture 65.5
Paper product 57.7
History 54.1
Workhouse 50.7
Illustration 50.4
Art 50.2

Microsoft
created on 2019-06-07

snow 97.5
outdoor 96.5
house 96.2
tree 85.1
sky 71.6
heritage 55.8
building 55

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

House
Tree
Window

Clarifai

House 90.6%

Clarifai

House 74%

Clarifai

House 72.1%

Clarifai

House 62.9%

Clarifai

House 50.6%

Clarifai

House 48.5%

Clarifai

House 35.3%

Clarifai

Tree 82.4%

Clarifai

Tree 80%

Clarifai

Tree 72.8%

Clarifai

Tree 70.4%

Clarifai

Tree 59.9%

Clarifai

Window 49.1%

Clarifai

Window 46.3%

Clarifai

Window 42.5%

Clarifai

Window 40.5%

Clarifai

Window 40.3%

Clarifai

Window 37.6%

Clarifai

Window 35.8%

Clarifai

Window 34.7%

Clarifai

Window 34.4%

Categories

Imagga
created on 2019-06-07

paintings art 68%
streetview architecture 18.7%
nature landscape 9.6%
interior objects 1.3%
pets animals 1%

Captions

Microsoft
created by unknown on 2019-06-07

a house covered in snow 70.4%
a large white building 66.6%
a person standing in front of a building 60.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a black and white photo of a house in the snow

Created by general-english-image-caption-blip-2 on 2025-07-05

an old photo of a house in the snow

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This is a historical photograph showing a snowy landscape with buildings and structures. In the foreground, there is a house with siding, featuring multiple windows and a chimney. The house is elevated with stairs leading to the entrance, and barrels are visible near the structure. In the surrounding area, there are a few other buildings and houses, including one with distinctive pointed architecture, likely representing a turret or gable. The area is fenced, and trees with bare branches are evident, suggesting a winter season. In the front of the image, there is a tripod-like object or surveying equipment placed in the snow. The photo has the number "292" written on it, possibly as an archival reference.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a vintage, snow-covered scene featuring a two-story building on the left-hand side. The building is constructed of wood and has a chimney, with several windows visible on both levels. The roof is covered in snow, indicating winter conditions.

Next to the building is a smaller outbuilding or shed, and two large barrels can be seen leaning against it. In the foreground, there is a device mounted on a tripod, possibly an early scientific or meteorological instrument, placed in the snow.

In the background, more residential houses are visible beyond a wooden fence. These houses are also two stories tall and have various architectural styles, with bare trees surrounding them. A tall flagpole stands to the right of the main building, extending upwards towards the sky. The entire scene has a quiet, wintery atmosphere. The number "292" is written at the top right of the image, suggesting it could be part of a series or collection.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph of an old, multi-story building with a chimney and several windows. The building is surrounded by bare trees and what looks like a snowy landscape. There are some smaller structures visible in the background, and a set of stairs leading up to the main building. The overall scene has a historic, wintry feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a historical black and white photograph of a large white building, likely from the early 1900s based on the architectural style. The building is two stories tall with multiple windows and appears to be painted white or made of light-colored material. There's a chimney visible on the roof. In the foreground, there appears to be snow on the ground, and there are what look like barrels or containers near the base of the building. There's also a wooden fence or railing visible in the middle ground. Bare trees can be seen in the background, suggesting this photo was taken during winter. The number "292" appears to be written at the top right corner of the photograph.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a large white house with a chimney, taken in the snow. The house has two stories and several windows on the front side. There are stairs leading up to the front door, which is located on the right side of the house. To the left of the house is a smaller building with a sloping roof. In the foreground, there is a tripod with a bucket hanging from it.

In the background, there are several trees and another house or building. The sky is overcast, and the overall atmosphere suggests a cold winter day. The image appears to be an old photograph, possibly from the early 20th century, given the style of clothing and the lack of modern technology visible in the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of a two-story house with a chimney, situated in a snowy landscape. The house features a gable roof and a small porch on the right side, accompanied by a staircase leading up to it. A fence runs along the front of the property, while trees are visible in the background.

In the foreground, a tripod is positioned in front of the house, with a small object attached to it. The sky above appears overcast, and the overall atmosphere suggests a cold winter day. The image has a vintage quality, with a sepia tone that gives it an aged appearance.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image shows a black-and-white photograph of a building with a chimney and a flagpole in front of it. The building has a few windows and a door, and there are some barrels and a tripod with a lamp in front of it. The building is surrounded by snow, and there are trees and other buildings in the background. The image has a watermark with the number "292" in the upper right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-13

The black-and-white photo shows a house with a chimney and a staircase in front. On the left side, there is a shed, and in front of it, there are three barrels. In front of the house, there is a tripod, and on the right side, there is a pole. Behind the house, there is a fence and a house, and behind it, there are several trees. The number "292" is written on the right side.

Google Gemini

Created by gemini-2.0-flash on 2025-06-12

The image is a monochrome snapshot of a historical scene, likely taken in the winter. The main subject is a large two-story building, appearing to be constructed with clapboard siding. It has a prominent chimney and a straightforward, functional design. There's a smaller, single-story structure attached to the main building on the left side, with snow blanketing its roof.

In the foreground, a snow-covered yard stretches out, partially obscuring a tripod-like object. Two wooden barrels are nestled close to the main building's wall.

Beyond the building, a picket fence runs across the frame, behind which are other buildings of varying styles and sizes. A tall, slender flagpole stands upright, piercing the winter sky. The trees in the background are bare, indicative of the winter season.

In the upper right corner of the image, there's a handwritten number "292", presumably a catalog or identification number. The overall tone of the image is quiet and somewhat stark, typical of historical photographs.

Created by gemini-2.0-flash-lite on 2025-06-12

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage black and white photograph, likely from the early to mid-20th century. It depicts a snow-covered scene with a prominent, well-built house as the main subject. The atmosphere feels cold and quiet.

Key Elements:

  • House: The house is the focal point. It appears to be a substantial, two-story building with a simple design, likely made of clapboard or similar siding. It has a pitched roof covered in snow. The front entrance is accessed via a small flight of stairs.
  • Winter Landscape: The ground is completely covered in a thick layer of snow, adding to the coldness of the scene. The snow-covered surroundings emphasize the season.
  • Other Structures and Objects: Additional structures in the background hint at other buildings. There are wooden barrels and a small shed near the main house.
  • Composition: The house is slightly off-center, with a tall pole rising behind it. This creates a sense of depth and balances the image.
  • Number 292: There is a handwritten number "292" at the top right corner.

Atmosphere:

The photograph evokes a sense of nostalgia, perhaps documenting a rural or small-town winter scene from a past era. The heavy snow adds to the sense of isolation and stillness.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a snowy scene featuring a two-story building with a simple, rustic design. The building has a steeply pitched roof with a chimney and is constructed with what appears to be stone or brick walls. There are several windows on both floors, and a door is visible on the ground floor.

In the foreground, there is a tripod with a camera mounted on it, suggesting that the photo was taken by someone capturing the scene. Next to the tripod is a small barrel or bucket. The ground is covered in snow, indicating that the photo was taken during winter.

In the background, there are other buildings, including a house with a gabled roof and a fence running along the perimeter. Bare trees are also visible, further emphasizing the winter setting. The overall atmosphere of the image is quiet and serene, typical of a rural or small-town setting during the colder months. The number "292" is handwritten in the upper right corner of the image, possibly indicating a catalog or reference number.

Qwen

No captions written

Text analysis

Amazon

19