Human Generated Data

Title

Defectives, Epileptics: United States. New York. Sonyea. Craig Colony: Craig Colony, Sonyea, N.Y.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1372

Human Generated Data

Title

Defectives, Epileptics: United States. New York. Sonyea. Craig Colony: Craig Colony, Sonyea, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1372

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Text 91.7
Nature 91.7
Advertisement 91.2
Outdoors 90.4
Poster 89.5
Vehicle 86.4
Aircraft 86.4
Transportation 86.4
Building 85.6
Architecture 72.4
Tower 72.4
Paper 70.3
Brochure 70.3
Flyer 70.3
Plant 62.9
Vegetation 62.9
Housing 60.9
Countryside 56.4
Page 55

Clarifai
created on 2019-06-05

empty 98.7
picture frame 98
blank 97.7
art 96.9
wall 96.7
old 96.1
retro 95.3
museum 95.1
landscape 94.6
vintage 94.3
nature 94
album 92.8
painting 92.3
no person 91.6
water 91.3
dirty 91
sky 90.7
antique 90.2
paper 89
house 87.6

Imagga
created on 2019-06-05

billboard 100
signboard 83.7
structure 66.5
web site 28.3
grunge 28.1
frame 21.8
old 21.6
vintage 21.5
sky 21.2
texture 20.9
border 19.9
grungy 18
landscape 17.9
design 17.5
pattern 17.1
paint 16.3
paper 15.7
antique 15.6
retro 15.6
space 15.5
rough 15.5
blank 15.4
art 14.3
dirty 13.6
damaged 13.4
graphic 13.1
envelope 13
aged 12.7
text 12.2
trees 11.6
edge 11.6
wallpaper 11.5
travel 11.3
scene 11.3
empty 11.2
winter 11.1
black 10.8
snow 10.5
weathered 10.5
cold 10.3
horizon 9.9
fog 9.7
color 9.5
silhouette 9.1
element 9.1
vacation 9
decoration 9
outdoors 9
material 8.9
digital 8.9
drawing 8.9
container 8.9
artistic 8.7
sea 8.6
wall 8.4
environment 8.2
sun 8.1
holiday 7.9
forest 7.8
frames 7.8
noise 7.8
season 7.8
ancient 7.8
messy 7.7
rust 7.7
tree 7.7
parchment 7.7
outdoor 7.7
worn 7.6
poster 7.6
decorative 7.5
grain 7.4
coast 7.2
summer 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

scene 96.3
gallery 94.8
house 86.9
room 83.5
sky 71.8
drawing 71.3
tree 64.1

Color Analysis

Feature analysis

Amazon

Helicopter

Clarifai

Tree
House
Picture frame
Window

AWS Rekognition

Helicopter 86.4%

Clarifai

Tree 94.7%

Clarifai

Tree 86.1%

Clarifai

Tree 82.5%

Clarifai

Tree 69.8%

Clarifai

Tree 66.5%

Clarifai

Tree 63.6%

Clarifai

Tree 59.2%

Clarifai

Tree 53.9%

Clarifai

Tree 51.5%

Clarifai

Tree 37.3%

Clarifai

House 84.8%

Clarifai

House 75.3%

Clarifai

House 73.9%

Clarifai

House 65.6%

Clarifai

House 51.7%

Clarifai

House 43.6%

Clarifai

House 34.3%

Clarifai

House 33.6%

Clarifai

Picture frame 66.6%

Clarifai

Picture frame 38.5%

Clarifai

Window 58.1%

Clarifai

Window 57.2%

Clarifai

Window 54.5%

Clarifai

Window 51.2%

Clarifai

Window 48.5%

Clarifai

Window 48.3%

Clarifai

Window 48.2%

Clarifai

Window 42.4%

Clarifai

Window 42.2%

Clarifai

Window 41.4%

Clarifai

Window 35.4%

Clarifai

Window 34.4%

Categories

Imagga
created on 2019-06-05

text visuals 67.8%
paintings art 18.3%
nature landscape 4.6%
beaches seaside 4%
streetview architecture 1.9%
food drinks 1%

Captions

Microsoft
created by unknown on 2019-06-05

a close up of a sign 75.3%
a sign on the screen 44.1%
a close up of a screen 44%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of two photographs of a building with a large building in the background

Created by general-english-image-caption-blip-2 on 2025-07-06

two old photographs of buildings and a house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This image consists of a gray background with two black-and-white photographs mounted side by side. The photographs are labeled at the bottom and depict two separate buildings associated with Craig Colony in Sonyea, New York.

  1. Left Photograph: Titled "Men's Infirmary," it shows a large, rectangular building with architectural detailing typical of early 20th-century institutional structures. The infirmary is surrounded by grass and trees, creating a serene environment. Paths are visible leading to the building, and the overall scene appears open and peaceful.

  2. Right Photograph: Titled "Women's Infirmary," it depicts a slightly different structure — a larger building that seems to have multiple sections and additional architectural features, including chimneys. The foreground shows some dirt or unpaved ground, and ivy is growing on parts of the building. The surroundings appear to be less landscaped than the men's infirmary.

Above the photographs is the title "Craig Colony, Sonyea, N.Y.," indicating the location as an institution in New York. Craig Colony was historically known for treating individuals with epilepsy in a residential setting during the late 19th and early 20th centuries.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a photograph that appears to be an old archival document featuring two separate photos side by side, each depicting a different building. The document is labeled at the top with "Craig Colony, Sonyea, N.Y."

  • The photograph on the left is labeled "MEN'S INFIRMARY." It shows a view of the men's infirmary building, which appears to be a multi-story brick structure with a pitched roof. The surrounding area is grassy, with a few trees in front of the building and a path leading towards it.

  • The photograph on the right is labeled "WOMEN'S INFIRMARY." This building is also a multi-story brick structure, similar in architectural style to the men's infirmary. There is a dirt path or road leading to the building, and some vegetation is visible around it.

Both images likely date from the historical period of the Craig Colony, which was known for being one of the first epilepsy treatment facilities in the United States. The overall layout of the document is simple, with the two photos placed on a plain background and descriptive labels beneath each image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows two black and white photographs depicting buildings and landscapes in Craig Colony, Sonyea, N.Y. The left photograph shows a rural scene with several buildings and trees, while the right photograph shows a larger building, likely a public or institutional structure. The images provide a historical view of the architecture and landscape of this location.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The image shows two black and white photographs of buildings in Craig Colony, Sonyea, N.Y. The photograph on the left is labeled "Lend Infirmary" and depicts several multi-story brick buildings surrounded by trees and open grassy areas. The photograph on the right is labeled "Nurses Infirmary" and shows a large brick building with architectural details like arched windows and a peaked roof section.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical photograph showing two images of Craig Colony in Sonyea, N.Y. The images appear to be from an institutional or medical facility, with the left photo labeled "MEN'S INFIRMARY" and the right photo labeled "WOMEN'S INFIRMARY." Both buildings are substantial brick or stone structures typical of early 20th century institutional architecture. The men's infirmary appears to be set back on a grassy area with several buildings visible, while the women's infirmary shows a closer view of the building along what appears to be a dirt road or path. The buildings have a formal, symmetrical design common to medical facilities of that era. The photos are mounted on a single page and appear to be part of a documentary or archival collection.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image presents a vintage photograph of two buildings, accompanied by text that provides context about the location and purpose of the structures.

Image Description:

  • The photograph is divided into two sections, each featuring a distinct building.
  • The left section shows a large, two-story building with a tree in front of it, while the right section depicts a smaller, one-story building.
  • Both buildings appear to be constructed from stone or brick, with a light-colored exterior.
  • The background of the photograph is a light gray color, which helps to highlight the details of the buildings.

Text Accompanying the Photograph:

  • At the top of the image, the text "Craig Colony, Sonyea, N.Y." is written in small letters.
  • Below the photograph, the text "MENS INFIRMARY" and "WOMENS INFIRMARY" is written in small letters, indicating the purpose of the buildings.

Overall Impression:

  • The image suggests that the buildings are part of a larger complex, possibly a hospital or medical facility.
  • The use of stone or brick construction and the presence of trees in the background suggest a rural or natural setting.
  • The overall atmosphere of the image is one of serenity and tranquility, with the buildings and surroundings appearing peaceful and calm.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image presents a collection of two black-and-white photographs, each depicting a distinct scene within the Craig Colony in Sonyea, New York.

Photograph 1: Men's Infirmary

  • The photograph on the left showcases a serene landscape featuring a grassy field and a few trees.
  • In the background, several buildings are visible, including what appears to be the men's infirmary.
  • The photograph is accompanied by the caption "MEN'S INFIRMARY" at the bottom.

Photograph 2: Women's Infirmary

  • The photograph on the right presents a similar scene, with a grassy field and trees in the foreground.
  • In the background, a building is visible, which is identified as the women's infirmary.
  • The photograph is captioned "WOMEN'S INFIRMARY" at the bottom.

Additional Information

  • The photographs are presented on a light gray background, with a darker gray border surrounding them.
  • The title "Craig Colony, Sonyea, N.Y." is displayed at the top of the image, providing context for the photographs.
  • The overall atmosphere of the image is one of tranquility and simplicity, with a focus on the natural surroundings and the buildings within the Craig Colony.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph that appears to be an old postcard. It shows two separate images of a hospital or medical facility, one on the left and one on the right. The image on the left is labeled "MEN'S INFARARY," while the image on the right is labeled "WOMEN'S INFARARY." The image in the center has a label that reads "Craig Colony, Sonyea, N.Y." The photographs show the exterior of the buildings, with trees and grass in the foreground.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a composite of two black-and-white photographs of the Craig Colony for Epileptics, located in Sonyea, New York. The left photograph shows the Men's Infirmary, a large building with a flat roof and multiple windows. The building is surrounded by a grassy field and trees, with a pathway leading up to the entrance. The right photograph shows the Women's Infirmary, which is a smaller building with a sloping roof and fewer windows. The Women's Infirmary is also surrounded by trees and grass, with a dirt road leading up to the entrance.

Google Gemini

Created by gemini-2.0-flash on 2025-06-16

The image shows a grey page from a photo album with two black and white photographs glued to the page. The upper center of the page has a caption that reads "Craig Colony, Sonyea, N.Y." On the right side of the page are some hand written letters and numbers. On the left is a photo of "MEN'S INFIRMARY" and on the right is a photo of "WOMEN'S INFIRMARY". The buildings are a few stories tall and constructed with brick or stone. Each building has a paved pathway leading to it. The front of the buildings are surrounded by a large grassy field. The images appear to be taken outdoors in daylight.

Created by gemini-2.0-flash-lite on 2025-06-03

Here is a description of the image:

The image is a vintage photograph of the Craig Colony in Sonyea, New York. It is a black and white shot, likely taken in the early 20th century. The photograph is mounted on a larger grey cardboard sheet.

The image is divided into two distinct sections, likely illustrating the facilities offered at the colony:

  • Left: This section shows the "Mens Infirmary." It features a long, low building with several windows. A path leads up to the entrance of the building. The scene is set in a grassy field.
  • Right: This section features the "Womens Infirmary." The building appears to be brick or stone.

The image is of good clarity for its age, allowing viewers to discern details of the architecture and the overall setting.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image is a historical photograph showcasing two buildings from the Craig Colony in Sonyea, New York. The photograph is split into two sections:

  1. Left Section:

    • The building is labeled "MEN'S INFIRMARY."
    • It appears to be a large, multi-story structure with a symmetrical design.
    • The building has a central section with a gabled roof and two wings extending from either side.
    • There are trees and shrubs around the building, and a pathway leading up to the entrance.
    • The surrounding area is grassy and open, suggesting a rural or semi-rural setting.
  2. Right Section:

    • The building is labeled "WOMEN'S INFIRMARY."
    • This structure is also substantial but appears to be more compact than the men's infirmary.
    • It has a central section with a gabled roof and a wing extending to the right.
    • The building has a more rustic appearance, with stone or brick construction.
    • There are trees and shrubs around the building, and a dirt pathway leading up to the entrance.
    • The surrounding area is also grassy and open.

The photograph is dated "2/24/12" and has the number "727" in the top right corner of the left section and "728" in the top right corner of the right section. The overall setting suggests a peaceful, institutional environment, likely from the early 20th century.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-06

The image is a black-and-white photograph showing two separate views of what appears to be the Craig Colony in Sonyea, New York. The photographs are labeled "Men's Infirmary" and "Women's Infirmary," suggesting that the photos depict the facilities for men and women, respectively, within the colony.

  • The left photograph, labeled "Men's Infirmary," shows a large, rectangular building with a flat roof, surrounded by a grassy area and several trees. The building has a symmetrical design with multiple stories and windows.

  • The right photograph, labeled "Women's Infirmary," shows a similar style of building, also with a flat roof and multiple stories, but it appears to be slightly smaller and situated on a slightly elevated terrain. The area around this building is less grassy and more barren, with a dirt path leading to the building.

Both images are part of a larger collection, as indicated by the number "787" in the upper right corner of the left photo, and the reference "Willard Asylum 5/1916" in the upper right corner of the document, suggesting that the photographs were taken in May 1916 and are associated with the Willard Asylum, which was a facility for the mentally ill in New York State.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-06

This image is a composite of two black-and-white photographs, likely taken in the early 20th century. The title "Craig Colony, Sonyea, N.Y." is written at the top, indicating that the photographs depict buildings from a facility in Sonyea, New York.

The photograph on the left is labeled "MENS INFIRMARY" and shows a two-story building with a central section that is slightly taller than the wings on either side. The building is set in a grassy area with a few trees and a paved path leading up to it. The number "787" is written in the upper right corner of this photograph.

The photograph on the right is labeled "WOMENS INFIRMARY" and features a different two-story building with a similar architectural style. This building also has a central section that is slightly taller and wings on either side. It is situated in a dirt area with some vegetation and trees in the background. The number "971" is written in the upper right corner of this photograph.

Text analysis

Amazon

Colony,
Craig
WOMEN
MN NIRMARY WOMEN
NIRMARY
MN
Sonyea.
Craig Colony, Sonyea. N. Y. Y.
NRMARY
N. Y.
0673.516
Y.

Google

Craig Colony, Sonyea, N. Y. 727 MEND NIRMARY WOMENS INTIAMARY
Craig
Colony,
Sonyea,
N.
Y.
727
MEND
NIRMARY
WOMENS
INTIAMARY