Human Generated Data

Title

Defectives, Epileptics: United States. New York. Sonyea. Craig Colony: Craig Colony, Sonyea, N.Y.: Hospital and Laboratory

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1371.2

Human Generated Data

Title

Defectives, Epileptics: United States. New York. Sonyea. Craig Colony: Craig Colony, Sonyea, N.Y.: Hospital and Laboratory

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1371.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Nature 99.6
Outdoors 98.8
Snow 92.3
Neighborhood 86.5
Urban 86.5
Building 86.5
Shelter 84.7
Countryside 84.7
Rural 84.7
Home Decor 82.8
Winter 81
Storm 70.8
Housing 65.4
Ice 64.7
Tree 63
Plant 63
Tower 61.5
Steeple 61.5
Spire 61.5
Architecture 61.5
Landscape 58.9
Blizzard 58.7
Weather 58
Yard 55.9

Clarifai
created on 2019-06-06

house 98.7
home 97.2
print 97.2
no person 96.3
storm 95.4
vintage 94.8
building 94.7
winter 94
farmhouse 92.5
street 91.7
calamity 91
architecture 90.6
old 90.1
weather 89.9
road 89.3
people 88.6
outdoors 87.8
landscape 87.7
tree 86.8
beach 86.3

Imagga
created on 2019-06-06

barn 68.6
building 66.2
snow 55
farm building 51.3
structure 49.5
weather 33.8
sky 31.5
landscape 30.5
architecture 27.4
old 26.5
house 23.7
clouds 22.8
trees 19.6
water tower 18.4
travel 16.2
rural 15.9
winter 15.3
field 15.1
scenic 14.9
reservoir 14.7
history 14.3
grass 14.2
city 14.2
country 14.1
tree 13.9
scenery 13.5
wood 13.4
vintage 13.3
wooden 13.2
cold 12.9
tourism 12.4
outdoor 12.2
antique 12.1
church 12
exterior 12
countryside 11.9
season 11.7
summer 11.6
roof 11.4
hut 11.2
construction 11.1
grunge 11.1
sea 11
tank 10.9
rustic 10.6
forest 10.5
ancient 10.4
sand 9.9
religion 9.9
farm 9.8
new 9.7
outdoors 9.7
fog 9.7
cloud 9.5
beach 9.4
culture 9.4
water 9.4
mountain 9.3
town 9.3
school 9.3
window 9.2
tower 9
retro 9
home 8.8
scene 8.7
england 8.6
texture 8.3
historic 8.3
peaceful 8.2
vacation 8.2
vessel 8.2
landmark 8.1
coast 8.1
sunny 7.8
fence 7.7
industry 7.7
old fashioned 7.6
buildings 7.6
historical 7.5
mountains 7.4
grain 7.4
light 7.4
sun 7.3
sunset 7.2
brick 7.2
holiday 7.2
river 7.1

Google
created on 2019-06-06

House 88.1
Home 82.3
Building 71.5
Paper product 71.3
History 66.1

Microsoft
created on 2019-06-06

outdoor 99.5
sky 89.7
old 86
house 83.8
building 73.8
tree 72
historic 69.3
heritage 57.2
vintage 40.3
town 34.3
sign 29.2

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

House
Tree
Window
Poster

Clarifai

House 94.7%

Clarifai

House 92.9%

Clarifai

Tree 91.1%

Clarifai

Tree 88.2%

Clarifai

Tree 79.8%

Clarifai

Tree 78.6%

Clarifai

Tree 76.2%

Clarifai

Tree 50.5%

Clarifai

Tree 47.1%

Clarifai

Tree 35.7%

Clarifai

Tree 34.7%

Clarifai

Window 49%

Clarifai

Window 48.5%

Clarifai

Window 42.1%

Clarifai

Window 37.1%

Clarifai

Window 36.5%

Clarifai

Window 36.4%

Clarifai

Window 35.2%

Clarifai

Window 35.1%

Clarifai

Window 34.7%

Clarifai

Window 34.4%

Clarifai

Window 33.9%

Clarifai

Window 33.3%

Clarifai

Poster 33.8%

Categories

Imagga
created on 2019-06-06

beaches seaside 75.2%
nature landscape 18.5%
sunrises sunsets 2.8%
streetview architecture 1.4%

Captions

Microsoft
created by unknown on 2019-06-06

a vintage photo of a house 92%
a vintage photo of a town 91.9%
a vintage photo of an old town 90.3%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a black and white photo of a hospital building

Created by general-english-image-caption-blip-2 on 2025-07-05

an old photo of a hospital and a large house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This black-and-white photograph showcases two buildings situated on a grassy plot of land. On the right is a large three-story structure, likely made of brick, with a steeply pitched roof and a distinctive central tower topped with a spire. The facade features a prominent rounded bay with an upper balcony supported by columns. Ivy is visible climbing up parts of the exterior walls, adding a touch of greenery. The building has several windows and exudes a stately, institutional appearance.

On the left is a smaller, rectangular building with a flat, mansard-style roof. It appears simpler in design compared to the larger building and could be an auxiliary structure. A visible wooden or paved path connects the two buildings, winding through the grass lawn. Trees dot the landscape, enhancing the rural or suburban atmosphere. Below the image, the handwritten text "HOSPITAL and LABORATORY" identifies the purpose of the buildings.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a sepia-toned photograph depicting two prominent buildings situated on a spacious, grassy landscape. The larger building on the right is a substantial multi-story brick structure with a pitched roof and a distinctive turret feature at its front entrance, giving it a somewhat grand and institutional appearance. It has several windows, and some areas of the building's exterior walls are partially covered in ivy. The smaller building on the left is a simpler, rectangular brick structure with a flat or slightly hipped roof and features a large entrance in the center. In the foreground, there is a dirt road or path that leads up to the buildings, bordered by a curved sidewalk and surrounded by a well-maintained lawn and a few small trees. The handwritten caption at the bottom of the photograph reads "HOSPITAL and LABORATORY," which suggests that these buildings served medical or scientific purposes. The style of the architecture and the overall appearance of the photograph suggest that it was taken in the late 19th or early 20th century.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a large, multi-story building with a distinctive architectural style, surrounded by trees and a grassy area. The building appears to be a hospital or medical facility, as indicated by the text "Hospital and Laboratory" below the image. The image has an antique, sepia-toned quality, suggesting it is an old photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph of a hospital and laboratory building. The image shows a large, two-story brick structure with Victorian-era architectural features, including a turret or bay window and detailed trim work. The building appears to have multiple wings or sections. There's a curved driveway or path leading up to the building, and the grounds are landscaped with a manicured lawn and some trees visible at the edges of the frame. The photograph appears to be from the late 19th or early 20th century, given the architectural style and photographic quality. The caption below the image reads "HOSPITAL AND LABORATORY."

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a sepia-toned photograph of a hospital and laboratory, with the title "HOSPITAL AND LABORATORY" written in small letters at the bottom.

Scene Description:

  • The photograph is taken from a distance, showing a large building with a prominent entrance and a smaller building to its left.
  • The main building features a central tower with a pointed roof and a covered porch on the front.
  • The smaller building has a flat roof and appears to be a single-story structure.
  • A dirt road leads up to the main building, and a sidewalk runs along the front of it.
  • A tree stands in front of the main building, and another tree is visible to the right.
  • The background of the image shows a clear sky, with trees visible in the distance.

Overall Impression:

  • The photograph appears to be an old image, likely taken in the early 20th century.
  • The sepia tone gives the image a nostalgic feel, evoking a sense of history and tradition.
  • The image suggests that the hospital and laboratory were once a prominent institution, possibly serving as a center for medical research or treatment.

Possible Context:

  • The image may have been taken during a time when medical care was more rudimentary than it is today.
  • The presence of a laboratory suggests that the hospital may have been involved in scientific research or experimentation.
  • The image may be part of a larger collection of photographs documenting the history of medicine or healthcare.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a vintage black-and-white photograph of a hospital and laboratory, with the title "HOSPITAL AND LABORATORY" inscribed at the bottom. The scene is set against a serene backdrop of trees and a clear sky.

In the foreground, a dirt road leads to the hospital building, which features a prominent chimney and a covered entrance. A smaller structure, possibly an outbuilding or annex, is situated to the left of the main hospital. The surrounding landscape is characterized by lush grass and trees, creating a peaceful atmosphere.

The overall tone of the image suggests that it may have been taken during the early 20th century, given the architectural style and the presence of a dirt road. The photograph appears to be an archival or historical record, capturing a moment in time when the hospital and laboratory were operational.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image shows a black-and-white photograph of a hospital and laboratory building, with a large lawn in front and a winding driveway leading up to the entrance. The building has a classic architectural style, with a prominent tower and a large porch with columns. There is a smaller building in the background, which appears to be a residence or administrative building. The image has a watermark in the top right corner that reads "759".

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a photograph of a building that is possibly a hospital or laboratory. The building is made of bricks, with a few windows and a chimney on the roof. The building is surrounded by a grassy field, with a few trees planted around it. A pathway runs through the grassy field, leading to the building. The photograph is in black and white, and it has a vintage look.

Google Gemini

Created by gemini-2.0-flash on 2025-05-27

Here is a description of the image:

This is a monochrome photograph of a hospital and laboratory. In the distance on the left is a brick building with a flat roof and a set of steps leading up to the entrance. To the right and further back, is a larger building, also brick, with a gabled roof and a turret-like structure in the center. Vines are growing up the side of the building. A dirt road curves from the bottom left of the image to the right, leading to the main building. There are trees and grass on either side of the road. The sky is overcast and a bit blurry.

The words "HOSPITAL AND LABORATORY" are printed at the bottom of the image. In the upper right corner, there is a handwritten number "759". The image is framed by a gray border.

Created by gemini-2.0-flash-lite on 2025-05-27

Here's a description of the image:

Overall Impression: The image is a vintage photograph, likely from the early 20th century. It depicts two brick buildings on a large property, with a grassy area and a curved dirt road leading towards the main structure.

Buildings:

  • Main Building: This is a larger, multi-story building with a complex roofline. It has multiple windows, including a curved bay window feature. Ivy climbs the exterior walls. A small tower or turret is visible on the roof.
  • Secondary Building: A smaller, one-story brick building sits to the left of the main structure. It has a flat roof and appears more utilitarian in design.

Landscape and Surroundings:

  • Road: A winding dirt road leads towards the main building. It is flanked by grassy areas.
  • Vegetation: Mature trees are visible around the buildings, contributing to the scene's age.
  • Sky: The sky is plain and slightly overcast.

Overall: The image shows what seems to be a "Hospital and Laboratory" as it is written below the photograph. The setting suggests a medical or research facility from the early 20th century. The overall atmosphere is calm and historical.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a historical photograph of a hospital and laboratory. The scene shows two large brick buildings set in a landscaped area with a curved driveway leading up to them.

The building on the right appears to be the main structure, possibly the hospital, with a more elaborate architectural design. It features multiple stories, a prominent porch with columns, and a turret-like structure on the roof. The building is partially covered in ivy, adding to its aged and stately appearance.

The building on the left, likely the laboratory, is simpler in design but still substantial. It has a gabled roof and large windows, suggesting it is designed for functionality.

The area around the buildings is well-maintained, with grassy lawns, a few trees, and a paved pathway or road connecting the two structures. The photograph has a vintage quality, indicated by the sepia tone and the style of the buildings, suggesting it was taken in the late 19th or early 20th century. The caption at the bottom of the image reads "HOSPITAL AND LABORATORY," confirming the purpose of the buildings.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

This is a historical black-and-white photograph depicting a large two-story brick building with a prominent turret and gabled roof structures, labeled as a "Hospital and Laboratory." The building has a grand appearance with multiple windows and a well-maintained lawn in front, bordered by a paved and unpaved road leading up to it. A smaller, one-story building is situated to the left, also made of brick, with a simpler design. The immediate surroundings are landscaped with trees, suggesting a peaceful and well-planned campus setting. The photograph has a vintage quality, indicating it likely dates back to the early-to-mid 20th century. The image is framed with a scan mark and a handwritten number "759" in the top right corner, along with the label "HOSPITAL AND LABORATORY" at the bottom.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This black-and-white photograph depicts a two-story hospital and laboratory building, labeled as such in the caption at the bottom of the image. The building has a traditional architectural style with multiple windows, a prominent bay window, and a tower with a pointed roof. The structure is surrounded by a grassy yard with a few trees and a curved dirt path leading to the entrance. To the left of the main building is a smaller structure with a similar architectural style. The image has a vintage appearance, suggesting it was taken in the early 20th century. There is a handwritten number "759" in the top right corner of the image.

Text analysis

Amazon

LABORATORY
HOSPITAL
59
HOSPITAL AND LABORATORY
AND

Google

$1.59 HOSPITAL AND LABORATORY
$1.59
HOSPITAL
AND
LABORATORY