Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. New York City. Randall's Island, House of Refuge: New York City Home of Refuge, Randall's Island (State Society for the Reformation of Juvenile Delinquents): N.W. Corner of Main Buildings

Date

c. 1900

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1258.2

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. New York City. Randall's Island, House of Refuge: New York City Home of Refuge, Randall's Island (State Society for the Reformation of Juvenile Delinquents): N.W. Corner of Main Buildings

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1258.2

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Human 95.2
Steeple 89.6
Tower 89.6
Spire 89.6
Architecture 89.6
Building 89.6
Tree 87
Plant 87
Tarmac 83.9
Asphalt 83.9
Road 73.5
Urban 71.2
Fir 64.6
Abies 64.6
Campus 59.4
Town 57.8
City 57.8
Tire 57.3
Grass 57
Nature 56.5
Weather 56.5
Flare 56
Light 56
Machine 55.5
Spoke 55.5

Clarifai
created on 2019-06-07

tree 97.9
architecture 97.2
travel 96.5
landscape 95.9
no person 95.7
building 94.8
park 92.4
light 92.4
old 92.4
sky 92
nature 90.9
outdoors 90.5
city 90.4
church 90.3
street 90
religion 88.1
house 87.9
people 87.4
monochrome 86.4
fall 86.4

Imagga
created on 2019-06-07

dome 57.5
building 48.4
architecture 44.8
church 42.6
religion 38.6
roof 35.5
history 32.2
sky 30.4
travel 30.3
tourism 28.1
radio telescope 27
old 26.5
fortress 26
temple 25.8
landmark 23.5
historic 23
tower 22.7
cathedral 22.5
culture 22.3
structure 22.1
ancient 21.7
protective covering 21.6
astronomical telescope 21.6
city 20.8
cross 18.9
landscape 18.6
orthodox 16.7
telescope 16.1
hill 15.9
religious 15
famous 14.9
stone 14.8
tree 14.5
covering 14.3
historical 14.1
barn 14.1
monument 14
construction 13.7
monastery 12.4
house 12.3
summer 12.2
exterior 12
wall 11.9
trees 11.6
faith 11.5
cemetery 11.2
orthodoxy 10.9
magnifier 10.7
farm building 10.6
god 10.5
university 10.3
castle 10.2
outdoor 10
sunset 9.9
heritage 9.7
buildings 9.5
day 9.4
water 9.4
tourist 9.2
river 8.9
palace 8.9
scenic 8.8
grass 8.7
rock 8.7
saint 8.7
town 8.4
traditional 8.3
night 8
prayer 7.7
medieval 7.7
snow 7.7
sun 7.5
island 7.3
mountain 7.2
coast 7.2
spring 7.1
brick 7

Google
created on 2019-06-07

Microsoft
created on 2019-06-07

outdoor 98.8
tree 98.4
sky 96.3
building 61.2
black and white 59.6

Color Analysis

Feature analysis

Amazon

Person

Clarifai

Tree

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 93.1%

AWS Rekognition

Person 64.6%

AWS Rekognition

Person 47.4%

Clarifai

Tree 95%

Clarifai

Tree 94.9%

Clarifai

Tree 92.5%

Clarifai

Tree 90.9%

Clarifai

Tree 88.7%

Clarifai

Tree 86.5%

Clarifai

Tree 75.8%

Clarifai

Tree 73.2%

Clarifai

Tree 69.1%

Clarifai

Tree 68.4%

Clarifai

Tree 53.8%

Clarifai

Tree 50.3%

Clarifai

Tree 46.3%

Clarifai

Tree 42.1%

Clarifai

Tree 41.5%

Clarifai

Tree 41.4%

Clarifai

Tree 41.1%

Clarifai

Tree 37.3%

Clarifai

Tree 36.2%

Categories

Imagga
created on 2019-06-07

nature landscape 94.8%
streetview architecture 4.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-06-13

a photograph of a large building with a clock tower in the middle of it

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a large building with a large clock tower

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This image depicts a historical building, characterized by large stone walls and prominent domed structures, likely indicative of 19th-century architecture. The building is surrounded by trees and greenery, contributing to a serene atmosphere. A pathway leads across an open grassy area in the foreground toward the building. The trees partially obscure the view of the structure but allow glimpses of its detailed design and multiple domes. A few individuals are visible on the pathway and adjacent to the building, adding movement and scale to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a large, historic building with a prominent dome on top. The architecture suggests that it could be a university or older institutional building. It is surrounded by a well-maintained lawn and several mature trees. A pathway leads up to the building, with a few people seen walking near it, giving a sense of scale and activity. The image appears to be black and white and has a timeless, classic feel to it. The building's facade is mostly obscured by trees, but the dome and part of the building are clearly visible against the sky.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows a large, domed building surrounded by trees and greenery. The building appears to be an older, ornate structure with multiple levels and architectural details. In the foreground, there is a grassy area with a dirt path running through it. A few people can be seen walking along the path. The overall scene has a historical, academic feel to it, suggesting this may be a university or other educational institution.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-20

The black and white photograph shows an exterior view of a large, stately building with domed roofs. The building appears to be an institutional or government structure, possibly a university or courthouse. It is surrounded by mature trees and there is a path or road leading up to the entrance, with a few people walking on it. The overall scene has a tranquil, park-like atmosphere on what seems to be a clear day based on the bright lighting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white historical photograph showing what appears to be a large institutional building, likely from the late 19th or early 20th century. The building features distinctive domed cupolas or towers on its roof and is surrounded by mature trees on a spacious lawn or grounds. The architectural style appears to be Victorian or Second Empire, with the characteristic domed features being quite prominent. The foreground shows an open grassy area with what looks like a path or walkway. There are some small figures visible in the distance on the grounds. The overall composition suggests this might be an educational institution, hospital, or other public building of significance from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a large building with a dome, surrounded by trees and a grassy field.

The building is made of stone and has a large dome on top. It appears to be a multi-story structure with many windows. There are several trees in front of the building, and a grassy field stretches out in front of them. A dirt path runs through the field, leading up to the building.

In the background, there is a clear sky. The overall atmosphere of the image suggests a peaceful and serene setting, possibly a park or a campus. The presence of the building and the trees suggests that it may be a historic or educational institution.

The image is likely from the early 20th century, based on the style of the building and the clothing of the people in the image. The image is in black and white, which was a common format for photographs during this time period. The image has a sepia tone, which gives it a warm and nostalgic feel.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

This image is a black-and-white photograph of a large building with a dome on top, surrounded by trees and grass. The building appears to be made of stone or brick and has a classical architectural style. In the foreground, there are several trees and a grassy area, with a dirt path leading up to the building. The sky above is overcast, giving the image a somber tone.

In the background, there are several people standing around the building, but they are too far away to make out any details. The overall atmosphere of the image suggests that it may have been taken in the late 19th or early 20th century, possibly at a university or other educational institution.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-14

The image is a black-and-white photograph of a historical building. The building is large, with a dome-shaped roof and several windows. It is surrounded by trees and grass, and there is a pathway leading to the entrance. The photograph appears to be from the early 1900s, based on the style of the building and the clothing of the people in the image. The people in the image are walking on the pathway, and some are standing near the building. The image has a watermark in the top right corner with the number "690".

Created by amazon.nova-pro-v1:0 on 2025-06-14

The image is a black-and-white photograph of a building with a lawn in front of it. The building has a dome-shaped roof and a tower-like structure on the left side. A few trees are in front of the building, and a pathway is in the middle of the lawn. Some people are standing near the trees on the right side. A watermark with the text "690" is on the top right corner.

Google Gemini

Created by gemini-2.0-flash on 2025-06-13

Here is a description of the image:

This is a black and white photograph of a large building taken from a distance. The building appears to be an older structure, possibly a university or institution, featuring a dome-like structure on top of at least one of its sections. The building is mostly obscured by tall trees in the foreground.

In front of the building is a large, grassy field. A pathway cuts through the grass to the right side of the frame. Along this path, there are several people, giving the impression that it is a well-used route.

To the left, there's a wall-like structure. The sky is overcast and fills a significant portion of the upper part of the image.

Created by gemini-2.0-flash-lite on 2025-06-13

Here's a description of the image:

Overall Impression: The photograph is a vintage black-and-white shot featuring a large building, likely a historical institution. It's taken from a low angle across a grassy area, giving prominence to the building's architecture.

Building:

  • The focal point is a large, multi-story building with a prominent central section topped by a dome. The dome has a decorative finial.
  • The architecture seems to be of a classical style.
  • The facade appears to be constructed of brick or stone.
  • Windows can be seen across the face of the building.

Foreground:

  • A large, grassy lawn occupies much of the foreground.
  • A pathway or dirt road leads from the front right side of the image.
  • Several trees are scattered across the foreground.

Background:

  • The sky is overcast and light.
  • A brick wall can be seen to the left of the image.

Additional Details:

  • The photograph is likely an older print, possibly dating from the late 19th or early 20th century, given the style and quality.
  • A number "690" is written in the top right.

Overall, the image conveys a sense of grandeur and history, with the large building dominating the scene.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-13

The image depicts a large, historic building with a distinct architectural style. The structure features two prominent domed towers on either end, suggesting it may be of institutional or governmental significance. The building is constructed from stone or brick, giving it a solid and imposing appearance.

In the foreground, there is a wide, open grassy area with a pathway leading up to the building. Several mature trees are scattered around the lawn, providing some shade and adding to the serene atmosphere. A few people can be seen walking or standing near the building, indicating that the area is accessible and possibly in use.

The photograph appears to be old, as indicated by its sepia tone and the style of clothing worn by the people in the image. This suggests that the photo was taken in the late 19th or early 20th century. The overall scene conveys a sense of history and grandeur.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black-and-white photograph depicting a large, stately building with a prominent cupola on its roof. The building appears to be made of brick and has a symmetrical design with multiple windows and a central section that stands out. The structure is surrounded by a well-maintained lawn with scattered trees providing shade. There are a few people visible in the lower right corner, suggesting some activity or maintenance work being performed on the grounds. The sky is clear, and the overall atmosphere of the image is serene and orderly, typical of a historic or institutional setting. The number "690" is written in the top right corner of the photograph, possibly indicating a catalog or inventory number.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph of a large, historic building with two prominent domes. The building appears to be made of stone and is surrounded by a well-maintained lawn with several trees. The architecture suggests a classical or institutional style, possibly a government building, a university, or a museum. In the foreground, there are a few people engaged in various activities, such as walking and possibly working on the grounds. The image has a vintage feel, likely from the late 19th or early 20th century, given the style of clothing and the overall appearance of the photograph. The number "670" is handwritten in the top right corner of the image.

Text analysis

Amazon

690

Google

690
690