Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: I. Elementary and High School. Complete course only 9 years. II. Technical School for Boys. 9 years course. III. Technical School for Girls. 9 years course.

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.662.1

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: I. Elementary and High School. Complete course only 9 years. II. Technical School for Boys. 9 years course. III. Technical School for Girls. 9 years course.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.662.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Grass 98.5
Plant 98.5
Field 72.9
Symbol 68.3
Lawn 65.7
Flag 57.4
Building 57.2

Clarifai
created on 2019-06-07

barn 99.2
home 98.5
no person 98.4
farm 98.3
landscape 98.1
building 97.2
house 97.1
people 95
agriculture 94.8
cropland 93.7
prairie 93.3
light 93.2
farmhouse 91.9
cavalry 87.2
storm 86.5
vehicle 86.3
tree 86.1
fence 85.4
field 85.1
sunset 84

Imagga
created on 2019-06-07

pier 71.4
support 53.5
device 40.9
sky 37.4
landscape 35.8
fence 35.4
picket fence 25.7
grass 23
structure 22.6
barrier 20.5
building 20.1
architecture 20.1
summer 17.4
house 16.1
wall 15.5
travel 15.5
farm 15.2
field 15.1
tourism 14.9
old 14
clouds 13.5
obstruction 13.1
turbine 13
cloud 12.9
bridge 12.9
countryside 12.8
water 12.7
road 12.7
sea 12.5
trees 12.5
country 12.3
beach 12.3
ocean 12.1
rural 11.5
scenic 11.4
hill 11.3
vacation 10.7
sand 10.6
sun 10.6
historic 10.1
tree 10
city 10
park 9.9
coast 9.9
environment 9.9
mountain 9.8
worm fence 9.7
ancient 9.5
town 9.3
peaceful 9.2
scenery 9
sunset 9
history 9
stone 8.5
mountains 8.3
outdoors 8.2
national 8.2
horizon 8.1
agriculture 7.9
rock 7.8
rail fence 7.8
sunny 7.8
barn 7.7
panorama 7.6
relax 7.6
fortress 7.5
desert 7.5
calm 7.3
tourist 7.3
home 7.2
river 7.1
spring 7.1

Google
created on 2019-06-07

House 83.8
Sky 82.2
Building 72.5
Grass 68.8
Home 68.2
Architecture 65.5
History 60.4
Cloud 59.5

Microsoft
created on 2019-06-07

outdoor 99.8
sky 98.3
grass 96.9
field 94.8
house 87
building 70.3
old 59.2

Color Analysis

Feature analysis

Amazon

No features identified

Clarifai

House
Plant
Tree
Flag
Window

Clarifai

House 88.2%

Clarifai

House 84.1%

Clarifai

House 83.6%

Clarifai

House 82.5%

Clarifai

House 71.2%

Clarifai

House 69.3%

Clarifai

House 67.4%

Clarifai

House 62.4%

Clarifai

House 54.8%

Clarifai

House 44.1%

Clarifai

House 33.4%

Clarifai

Plant 57.8%

Clarifai

Tree 54.8%

Clarifai

Tree 54.7%

Clarifai

Tree 47.2%

Clarifai

Flag 47.9%

Clarifai

Window 47.4%

Clarifai

Window 44.3%

Clarifai

Window 40.7%

Clarifai

Window 40.5%

Clarifai

Window 38.7%

Clarifai

Window 36%

Clarifai

Window 34%

Categories

Imagga
created on 2019-06-07

nature landscape 59%
streetview architecture 16.7%
beaches seaside 12.1%
paintings art 5.4%
sunrises sunsets 4.2%

Captions

Microsoft
created by unknown on 2019-06-07

a vintage photo of a house 89.5%
a vintage photo of a large house 89.4%
an old barn in a field 89.3%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large building with a flag on it

Created by general-english-image-caption-blip-2 on 2025-07-05

an old photo of a school building with a flag flying in the background

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This sepia-toned historical photograph depicts a campus-like setting consisting of three primary buildings arranged in a row, with expansive open grass in the foreground. The architecture is minimalistic, featuring rectangular structures with peaked roofs and symmetrically arranged windows. The central building is slightly taller and more prominent, flanked by two shorter, lateral buildings connected by covered walkways. On the left side of the image, there is a tall flagpole with the American flag waving in the wind. The background shows some trees and open landscape under a featureless, overcast sky. The image evokes a sense of early 20th-century institutional or educational architecture.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a sepia-toned photograph of a building complex consisting of three main structures arranged in a broad U-shape. The central building has two stories and features large, rectangular windows. The two flanking buildings on either side appear to be single-story with hipped roofs, and they are connected to the central building by covered walkways or colonnades. The complex is set amidst a large, open grassy area, providing a sense of symmetry and spaciousness. In the foreground, slightly to the left, there is a tall flagpole flying a flag that appears to be the American flag. The background shows a line of trees or shrubbery, suggesting a rural or semi-rural setting. The architecture reflects an early 20th-century institutional style, perhaps indicative of a school, hospital, or similar establishment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a large, multi-story building with a central tower and several wings or annexes. The building appears to be surrounded by a grassy field or lawn, with some trees visible in the background. An American flag is flying atop the central tower. The overall style of the building suggests it may be an educational or institutional structure, such as a school or government facility, from an earlier era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a historic black and white photograph of what appears to be a school building complex from the early 20th century. The architecture features a symmetrical design with a two-story central building flanked by single-story wings on either side. The buildings are painted in a light color, likely white, and feature multiple windows and covered walkways or corridors connecting the sections. There's a tall flagpole in the foreground with an American flag flying at the top. The buildings sit on a large, open grass field or lawn. The style is typical of American school architecture from that era, with its Colonial Revival influences evident in the design. The photograph has a sepia tone quality characteristic of early photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a sepia-toned photograph of a large school building with a flagpole in the foreground.

The school building is a long, rectangular structure with multiple wings and a central section. The building has a pitched roof and a chimney rising from the center section. There are several windows on each side of the building, and a covered walkway runs along the front of the building.

In the foreground, there is a large grassy field with a flagpole standing tall in the center. The flag is not visible, but the pole is adorned with a weather vane at the top.

The background of the image shows a clear sky with no clouds, and a line of trees in the distance. The overall atmosphere of the image suggests a sense of patriotism and tradition, as evidenced by the presence of the flagpole and the school building.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a sepia-toned photograph of a school building, with an American flag flying in front. The school is a single-story structure with a gable roof and a central entrance. It appears to be a rural or suburban school, surrounded by a grassy field and trees in the background. The overall atmosphere suggests a peaceful and serene setting, possibly during the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image is a black-and-white photograph of a building complex, possibly a military academy, surrounded by a vast open field. The building complex consists of three buildings with gabled roofs, each with multiple windows and a central entrance. A flagpole stands in the foreground, with a flag waving gently in the breeze. The sky is overcast, and the overall scene has a slightly hazy, vintage feel. The image conveys a sense of tranquility and simplicity, with the focus on the architectural features of the buildings and the surrounding landscape.

Created by amazon.nova-pro-v1:0 on 2025-06-13

The image is a black and white photograph of a large building, with a flagpole in the foreground. The building has a symmetrical design, with a central section that is slightly taller than the wings on either side. The roof is sloped, and there are many windows. The building appears to be made of concrete or brick, and it has a flat roof. The flagpole is tall and has a flag at the top.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here is a description of the image:

The image shows a large, likely historic, building complex in a sepia tone. The complex consists of three main buildings: a central, two-story structure with a gabled roof and multiple windows, and two one-story wings on either side, also with gabled roofs. All three buildings are connected by covered walkways.

In front of the buildings, there is a large expanse of grass. To the left of the buildings, a tall flagpole is visible, with an American flag fluttering in the wind. The sky is a muted white, and there is a hint of trees in the background, behind the buildings. The overall atmosphere of the image is calm and somewhat nostalgic.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

The image is an aged, sepia-toned photograph of a large building complex. The primary focus is on the architecture, which consists of interconnected, low-rise buildings with white exteriors and dark, pitched roofs. A central, slightly larger building is flanked by two smaller wings.

In the foreground, a vast expanse of grass or lawn stretches out towards the buildings. A tall flagpole stands near the left, with an American flag waving in the wind. The sky is overcast and appears to be devoid of color. The overall impression is one of a historical photograph, possibly of an institution or government facility.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a historical photograph of a building complex that appears to be an institutional or educational facility, possibly a school or a military installation. The architecture features a series of connected buildings with a uniform design, characterized by large windows and covered porches or verandas.

In the foreground, there is a flagpole with a flag flying, which seems to be the American flag, indicating the location is likely in the United States. The buildings are single-story structures with hipped roofs, and they are arranged in a linear fashion, connected by the covered walkways. The landscape around the buildings is open and grassy, suggesting a rural or semi-rural setting. The sky is clear, and the overall scene gives an impression of order and structure, typical of institutional settings from earlier periods.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

The image depicts a sepia-toned photograph of a large, symmetrical building complex set in an open grassy area. The architecture is classical, featuring a central pavilion with a prominent front entrance flanked by two identical wings on either side. Each wing has a series of windows and columns, contributing to the uniform design. The central section has a slightly raised roof, and the wings have flat rooftops. A flagpole with a flag is positioned to the left of the central pavilion. The surrounding area is open and grassy, with some trees visible in the background and overcast skies, giving the photo a vintage and serene atmosphere. The overall impression is of a historical or institutional building, possibly a school, government building, or public facility.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This sepia-toned photograph captures a large, symmetrical building with a central section flanked by two wings, each featuring a covered porch supported by columns. The building has a uniform architectural style, with multiple windows and a pitched roof. In front of the building, there is a large, open grassy area. On the left side of the image, there is a tall flagpole with an American flag flying. The background shows a line of trees, indicating a rural or campus-like setting. The overall scene suggests a peaceful and organized environment, possibly a school, hospital, or institutional building. The photograph appears to be historical, given the sepia tone and the style of the architecture.