Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Children's campus

Date

c. 1900

People

Artist: Wolfson, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.661.2

Human Generated Data

Title

Charity, Children: United States. New York. Pleasantville. Hebrew Sheltering Guardian Society: Hebrew Sheltering Guardian Society Orphan Asylum, Pleasantville, New York: Children's campus

People

Artist: Wolfson, American

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.661.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Field 85.6
Building 82.5
Art 79.2
Team Sport 67.1
Sport 67.1
Sports 67.1
Team 67.1
Plant 61.6
Grass 61.6
Metropolis 61
Town 61
City 61
Urban 61
Campus 55.6

Clarifai
created on 2019-06-07

pollution 99.6
smoke 99.4
environment 98.8
calamity 98.5
water 97.2
smog 97.1
city 97.1
waste 96.8
fog 96.8
no person 96.7
landscape 96.4
grinder 96.3
building 96.3
air pollution 96.3
condensation 96
weather 95.5
river 95.4
energy 95.3
storm 95.2
tree 95.2

Imagga
created on 2019-06-07

fortress 49.2
ship 38.3
travel 29.6
sky 28.3
water 27.4
landscape 26.8
architecture 26.6
oil tanker 25.4
tourism 24.8
city 24.2
vessel 23.5
building 22.7
submarine 22.2
sea 21.9
cargo ship 21.8
river 20.8
landmark 19.9
submersible 17
tower 16.1
clouds 16.1
history 15.2
structure 15.2
coast 14.4
shipping 14
famous 14
old 14
mountain 13.4
cityscape 13.3
hill 13.1
scene 13
warship 13
bridge 12.9
cooling tower 12.5
tree 12.3
urban 12.3
outdoor 12.3
culture 12
ocean 11.8
scenery 11.7
summer 11.6
panorama 11.5
buildings 11.4
ancient 11.3
cloud 11.2
outdoors 10.5
boat 10.4
grass 10.3
industry 10.3
town 10.2
historic 10.1
tourist 10
trees 9.8
harbor 9.6
day 9.4
historical 9.4
church 9.3
cooling system 9.2
island 9.2
road 9.1
vacation 9
sunset 9
military vehicle 8.8
channel 8.8
light 8.7
fog 8.7
center 8.6
construction 8.6
skyline 8.6
dome 8.4
craft 8.4
shore 8.3
transport 8.2
beach 8.2
sunlight 8
night 8
rural 7.9
scenic 7.9
factory 7.7
port 7.7
outside 7.7
downtown 7.7
bay 7.6
lake 7.3
industrial 7.3
sun 7.3
transportation 7.2
mechanism 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

painting 97.8
sky 93.6
outdoor 90.1
cloud 88.8
building 72.9
house 71.4
nature 70.2
day 13.1

Color Analysis

Feature analysis

Amazon

Painting

Clarifai

Tree
House
Window

AWS Rekognition

Painting 79.2%

Clarifai

Tree 95.5%

Clarifai

Tree 94.2%

Clarifai

Tree 91.9%

Clarifai

Tree 87.1%

Clarifai

Tree 79.8%

Clarifai

Tree 60.5%

Clarifai

Tree 60.3%

Clarifai

Tree 52.9%

Clarifai

Tree 49.6%

Clarifai

Tree 49.3%

Clarifai

Tree 41.5%

Clarifai

Tree 39.9%

Clarifai

Tree 36.1%

Clarifai

House 86.1%

Clarifai

House 84.2%

Clarifai

House 81.3%

Clarifai

House 56.6%

Clarifai

House 55%

Clarifai

House 52.6%

Clarifai

Window 51.4%

Clarifai

Window 49.6%

Clarifai

Window 45.4%

Clarifai

Window 43.1%

Clarifai

Window 42.4%

Clarifai

Window 41.2%

Clarifai

Window 38.1%

Clarifai

Window 36.1%

Clarifai

Window 34.1%

Categories

Imagga
created on 2019-06-07

nature landscape 59.1%
beaches seaside 15.7%
food drinks 10.9%
streetview architecture 8.4%
interior objects 2.1%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large grassy field with a church in the background

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a large building with a lawn

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a large, serene campus-like setting with three prominent buildings surrounded by greenery. The buildings have light-colored exteriors, likely cream or beige, with hipped roofs. The structure on the left features multiple large windows and a chimney, giving the impression of either an institutional or educational building. The middle building, smaller in size, connects to the larger one via a walkway or porch area. The building on the right is a similar style to the one on the left but has a more residential feel with covered entryways.

A manicured lawn spans the foreground, scattered with young trees planted symmetrically, suggesting intentional landscaping. A light-colored pathway runs through the lawn, connecting the buildings. A crowd of people, dressed predominantly in white, is gathered in front of the left and middle buildings, perhaps for an event or gathering. The background features rolling hills and open fields, enhancing the tranquil and rural ambiance of the setting.

The image appears to have been colorized, with soft pastel tones for the grass, buildings, and sky, giving it a vintage aesthetic. A faint stamp or watermark is visible in the lower-right corner, indicating its source.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a large, open green lawn with several trees sparsely planted across it, suggesting a park or institution setting. In the background, there are three large, two-story buildings with white exterior walls and dark roofs. The buildings appear to be institutional, possibly part of a hospital or school complex.

On the left side, a long line of people dressed in white clothing is seen stretching along part of the lawn, walking towards or standing near the buildings. They might be participants in an event or ceremony. There are walkways leading from the lawn to the buildings, with a few more individuals visible walking along them.

Beyond the buildings, there is a glimpse of a forest or field, indicating a rural or suburban setting with open landscapes. The sky is pale blue and seems clear, suggesting a pleasant daytime scene.

The image is colored in such a way that it appears to be either a painted photograph or an early color photograph, giving it an aged appearance. There is also a mark in the bottom right corner indicating “Koledon Studio St. Louis,” possibly the studio or photographer responsible for the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a historical photograph of a campus or school grounds. It shows several large, multi-story buildings with architectural features typical of late 19th or early 20th century construction. The buildings are surrounded by a grassy lawn or field, with trees and other landscaping elements visible. There are people gathered on the lawn, suggesting this may have been a formal event or gathering taking place on the campus. The overall scene conveys a sense of an established, well-developed educational institution from a bygone era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a historical photograph of what looks like a school or institutional campus. The image shows three large white buildings with colonial/craftsman architectural style, typical of the early 20th century. The buildings are arranged around a large central lawn or quad area. There's a smokestack or chimney visible between the buildings on the left. The buildings feature multiple windows and covered porches or entrances. There appears to be a crowd of people in white clothing gathered near the building on the left. The grounds include some young trees and curved pathways. The overall scene has a sepia or faded quality typical of early photography. The landscape in the background suggests this facility was built on elevated or hilly terrain.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a vintage photograph of a large grassy field surrounded by several buildings, likely a school or university campus.

In the foreground, the grassy field dominates the scene, with a few trees scattered throughout. The field is well-manicured and appears to be a central gathering area for the buildings surrounding it.

The buildings are arranged in a semi-circle around the field, with a path leading from the center of the field to the main building on the right. The buildings are all two-story structures with pitched roofs and large windows. They appear to be made of stone or brick and have a classic, timeless design.

In the background, there are rolling hills and trees visible, suggesting that the campus is located in a rural or suburban area.

Overall, the image suggests a peaceful and serene atmosphere, with the grassy field and surrounding buildings creating a sense of community and tranquility.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a vintage photograph of a large, open grassy area with several buildings in the background. The photograph is faded and has a sepia tone, giving it an aged appearance.

In the foreground, there is a large, open grassy area that takes up most of the image. The grass is well-manicured and appears to be freshly cut. There are a few trees scattered throughout the area, but they are not densely packed.

Behind the grassy area, there are several buildings that appear to be part of a larger complex. The buildings are all white with dark roofs and have a similar architectural style. They are arranged in a row, with some of them being slightly larger than others.

To the left of the image, there is a large building with a chimney rising from its roof. This building appears to be the largest of the group and may have been used as a main building or administrative center.

In the center of the image, there is a smaller building with a covered porch. This building appears to be a residence or dormitory, given its size and design.

To the right of the image, there is another large building with a similar design to the one on the left. This building also has a chimney rising from its roof and may have been used for a similar purpose.

Overall, the image suggests that the buildings were part of a larger complex, possibly a school, hospital, or other institutional setting. The well-manicured grass and trees suggest that the area was well-maintained and cared for.

It's worth noting that the image is quite old, likely dating back to the early 20th century. The faded colors and sepia tone give it a nostalgic feel, and the buildings and landscape appear to be from a bygone era.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-13

The image is a black-and-white photograph of an outdoor area. In the foreground, there is a large, open grassy field with a few trees scattered around. The field appears to be well-maintained and has a walkway running through it. In the middle of the field, there are several people standing in a row, possibly waiting for something or participating in an event. In the background, there are several buildings, including a large, white building with many windows and a chimney. There are also some smaller buildings and a tree-lined area.

Created by amazon.nova-pro-v1:0 on 2025-06-13

The image is a vintage photograph of a large open field with several buildings on the sides. The buildings are painted white and have a classic architectural style. The field is covered with grass, and there are a few trees scattered around. In the distance, there are more buildings and trees, and the sky is clear and blue. The image has a nostalgic feel, and it looks like it was taken in the early 20th century.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here is a description of the image:

The image appears to be an old, possibly hand-tinted photograph of a large campus or institution. In the foreground, there is a large expanse of green lawn. Scattered across the lawn are a few small trees.

In the background, there are three large, light-colored buildings. The buildings are all similar in style, with many windows and large roofs. There is a group of people lined up along the front of the buildings, which could be students or staff. Between the first and second buildings, there is a tall smokestack.

There is a small road that snakes through the center of the image that connects the three buildings. The image is washed with soft, muted colors, giving it an antique feel. The sky is a pale blue, and the overall mood is one of serenity and academia.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

Overall Impression:

The image depicts a large complex of buildings, likely a school or institution, set on a spacious, well-manicured green lawn. The scene is bathed in soft, natural light, creating a sense of calm and order. It appears to be an older photograph, possibly a hand-colored one, giving it a vintage aesthetic.

Key Elements:

  • Buildings: There are at least three main buildings visible, all sharing a similar architectural style, with light-colored walls and dark roofs. The buildings have numerous windows and appear to be two stories in height. The buildings have columns and covered verandas in the front.
  • Lawn/Grounds: A vast expanse of green lawn dominates the foreground. A few trees are scattered across the lawn.
  • People: There are small groups of people near the buildings, suggesting activity, such as students or staff.
  • Pathways: Paved pathways lead toward the buildings, connecting them and providing access.
  • Sky: The sky is light blue, possibly suggesting a sunny day.
  • Background: In the distance, the landscape features a hilly area with trees, and a visible chimney, suggesting there may be another building.

Overall Atmosphere:

The image evokes a sense of a tranquil and orderly environment. It portrays a place of learning or possibly care, given the size and layout. The photo looks like it was taken in the early part of the 20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-14

The image depicts a historical photograph of a large, open, grassy field flanked by two substantial buildings. The buildings appear to be institutional in nature, possibly part of a school, college, or hospital complex. The architectural style of the buildings is somewhat classical, with multiple stories, large windows, and gabled roofs.

In the foreground, there are several rows of people, likely students or staff, standing in formation. They are dressed in uniform attire, suggesting a formal gathering or event. The people are arranged in neat lines, facing towards the buildings, which indicates a ceremonial or organized assembly.

The landscape includes a few young trees and a pathway leading towards the buildings. The sky is clear, and the overall atmosphere of the image is calm and orderly. The photograph has a sepia tone, indicating it is quite old, possibly from the early 20th century. The image captures a moment of institutional life, highlighting the architecture and the organized nature of the gathering.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image depicts a large, open grassy area with several buildings in the background. The architecture of the buildings suggests a school or institutional setting, possibly from the early 20th century, given the style and the photograph's coloration. On the left side, there is a long, rectangular building with numerous windows, and a smaller structure with a red roof is attached to it. On the right side, there is a larger building with a symmetrical design, featuring a central entrance flanked by two wings. The buildings are surrounded by trees, and the area appears to be well-maintained. In the foreground, there are a few individuals, possibly students or staff, standing or walking near the buildings. The sky is clear, indicating a sunny day. The overall atmosphere of the image is serene and orderly, typical of a school or campus setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This image is a vintage photograph of a large, well-maintained institutional complex, likely a school, hospital, or other public facility. The buildings are light-colored, possibly white or cream, with numerous windows and symmetrical designs. The architecture suggests an early 20th-century style.

In the foreground, there is a wide, open grassy area with a few trees scattered around. A group of people, dressed in white, are gathered near the left side of the image, possibly students or staff. There is also a paved path or driveway leading up to the buildings.

The background features a hill with trees, indicating that the complex is situated in a rural or suburban area. The sky is clear and bright, suggesting a sunny day. The overall atmosphere of the image is calm and orderly.