Human Generated Data

Title

Social Settlements: United States. Ohio. Cleveland. "Hiram House": Hiram House, Cleveland, Ohio.: Gymnasium and Auditorium: Main Building. Two of the Cottages.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3205.1

Human Generated Data

Title

Social Settlements: United States. Ohio. Cleveland. "Hiram House": Hiram House, Cleveland, Ohio.: Gymnasium and Auditorium: Main Building. Two of the Cottages.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3205.1

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 97.1
Envelope 96.6
Mail 96.6
Postcard 96.6
Building 91.5
Urban 87.2
Town 81.5
City 81.5
Road 80.7
Advertisement 77.8
Outdoors 75.8
Tower 71.3
Steeple 71.3
Architecture 71.3
Spire 71.3
Street 70.4
Metropolis 67.8
Nature 66.5
Transportation 62.3
Vehicle 61.4
Apartment Building 59.8
High Rise 59.8
Text 55.6

Clarifai
created on 2019-06-06

print 99.3
people 98.5
no person 97.4
lithograph 94.8
home 94.4
group 92.8
military 92.7
architecture 92.7
building 91.9
administration 91.3
outdoors 90.9
house 90.6
vehicle 90.3
war 90.1
street 89
government 88.9
art 88.1
old 86.6
town 85.6
travel 85.4

Imagga
created on 2019-06-06

building 54
architecture 53.5
university 52.8
city 42.4
structure 32.8
town 27.9
travel 27.5
landmark 25.3
tower 24.2
tourism 23.9
house 23.9
old 23.7
sky 21.8
historic 21.1
capital 19.9
history 18.8
billboard 18.6
palace 18
urban 17.5
signboard 16.1
facade 15.1
monument 15
culture 14.5
famous 14
castle 13.9
ancient 13.8
buildings 13.2
river 12.7
historical 12.2
landscape 11.9
tourist 11.9
residence 11.5
facility 11.4
scenic 11.4
cityscape 11.4
center 11.2
construction 11.1
exterior 11.1
roof 11
gymnasium 10.8
vacation 10.6
office 10.6
england 10.5
street 10.1
destination 9.4
church 9.3
vintage 9.1
night 8.9
antique 8.8
athletic facility 8.8
holiday 8.6
skyline 8.6
school 8.2
square 8.2
cathedral 8.1
flag 7.9
summer 7.7
college 7.7
windows 7.7
old fashioned 7.6
window 7.5
dome 7.4
new 7.3
clock 7.2
sunset 7.2
grass 7.1
paper 7.1
wall 7

Google
created on 2019-06-06

Town 82.3
History 77.6
Building 76.7
Paper product 75.4
House 75.3
Architecture 72.6
Illustration 68.1
Home 63.7
Almshouse 62.7
Residential area 53.4
City 51.3

Microsoft
created on 2019-06-06

old 89.4
house 64.9
vintage 42.2

Color Analysis

Feature analysis

Amazon

Person
Poster

Clarifai

Building
Poster
House
Wheel
Window
Person

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 91.3%

AWS Rekognition

Person 85.6%

AWS Rekognition

Person 85.6%

AWS Rekognition

Person 82.7%

AWS Rekognition

Person 81.1%

AWS Rekognition

Person 77.1%

AWS Rekognition

Person 74.8%

AWS Rekognition

Person 71%

AWS Rekognition

Person 67.7%

AWS Rekognition

Person 67.3%

AWS Rekognition

Person 65.1%

AWS Rekognition

Person 62.7%

AWS Rekognition

Person 62.6%

AWS Rekognition

Poster 77.8%

Clarifai

Building 72.2%

Clarifai

Poster 63.8%

Clarifai

House 62.5%

Clarifai

House 59.2%

Clarifai

House 52.5%

Clarifai

House 42.4%

Clarifai

House 36.8%

Clarifai

Wheel 47.8%

Clarifai

Window 41.3%

Clarifai

Window 41.2%

Clarifai

Window 39.1%

Clarifai

Window 38.5%

Clarifai

Window 38.2%

Clarifai

Window 38%

Clarifai

Window 36.5%

Clarifai

Window 35.2%

Clarifai

Window 35%

Clarifai

Window 34.6%

Clarifai

Window 33.9%

Clarifai

Window 33.7%

Clarifai

Window 33.6%

Clarifai

Window 33.5%

Clarifai

Window 33.3%

Clarifai

Window 33.3%

Clarifai

Person 35.4%

Clarifai

Person 33.7%

Categories

Imagga
created on 2019-06-06

streetview architecture 99.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing in front of a building

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a building with people walking by

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

This historical photograph depicts a street scene featuring several buildings and a crowd of people, with handwritten labels providing context. On the left is a large brick structure labeled "Main Building," adorned with a prominent porch and decorative gables at the roofline. People are gathered near the entrance and on the street, possibly for an event or meeting.

Adjacent to the main building are two smaller structures labeled "Two of the Cottages." These appear to be wooden houses with residential-style architecture. Further to the right is a taller structure labeled "Gymnasium and Auditorium," which resembles a barn or hall and includes a tower-like feature.

The street in front of the buildings has tram tracks, and a horse-drawn carriage can be seen, indicating this image is from a pre-automobile era (likely late 19th or early 20th century). The scene suggests an institution or community setting.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image is a sepia-toned photograph depicting a historical street scene with several large buildings. On the left side of the image is a multi-story brick building with a prominent pitched roof and decorative gables. This building has a porch or balcony where several people are gathered. In front of the building, there is a group of people on the sidewalk and street, possibly students or residents, given the context of the surroundings.

To the right of the main building are two smaller wooden structures referred to as "cottages" in the caption. Further back, there is a larger building that resembles a gymnasium or auditorium, as noted in the caption. A tall utility pole with multiple wires is visible in the foreground, and the street has what appears to be tram tracks. The setting conveys a sense of early 20th-century or late 19th-century architecture and community life. The caption beneath the photograph reads: "Main Building Two of the Cottages. Gymnasium and Auditorium."

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a historical photograph depicting a building complex in what seems to be an urban setting. The main building, labeled "Main Building Gymnasium and Auditorium", is a large, multi-story structure with an ornate architectural style. There are several smaller buildings, labeled "Two of the Cottages", adjacent to the main building. The scene shows people gathered outside the buildings, suggesting this may have been some kind of public or institutional facility. The image has a sepia tone, indicating it is an older photograph, likely from the late 19th or early 20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a historical black and white photograph showing what appears to be a school or institutional complex. The main building is a three-story Victorian-style brick structure with arched windows, dormers on the roof, and a covered entrance porch. There are trolley or rail tracks visible in the street in front of the building. To the right of the main building are what the caption identifies as "Two of the Cottages" and a "Gymnasium and Auditorium." There's a utility pole with multiple crossbars carrying electrical or telephone lines. A crowd of people can be seen gathered outside the main building, and there appears to be some horse-drawn transportation visible at the edge of the frame. The image has a sepia tone typical of early 20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a sepia-toned photograph of a street scene, with a large brick building on the left and several smaller buildings to the right. The main building has multiple stories and a gable roof, with a chimney on the left side. There are several windows on the front of the building, and a balcony on the second floor.

In the foreground, there is a group of people standing on the sidewalk in front of the main building, and a few children playing in the street. A horse-drawn carriage is visible in the bottom-left corner of the image.

The background of the image shows a clear sky, with power lines running across the top of the photo. The overall atmosphere of the image suggests a quiet, rural town in the early 20th century.

The image is captioned "Main Building Gymnasium and Auditorium" at the bottom, and "Two of the Cottages" to the right of the main building. The image appears to be a historical photograph, possibly taken for archival or commemorative purposes.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a sepia-toned photograph of a large building, with a caption at the bottom that reads "Main Building Two of the Cottages Gymnasium and Auditorium." The building appears to be a multi-story structure with a gable roof and a chimney on the left side. There are several windows on each floor, and a covered porch or balcony on the second floor.

In front of the building, there is a street with a horse-drawn carriage and several people walking along the sidewalk. To the right of the main building, there are two smaller cottages, one of which has a tower or steeple. The background of the image shows a clear sky, suggesting that it was taken on a sunny day.

Overall, the image appears to be a historic photograph of a school or educational institution, possibly from the late 19th or early 20th century. The caption suggests that the building was used for various purposes, including as a gymnasium and auditorium, and that it was part of a larger campus or complex.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a vintage photograph of a school campus, featuring several buildings and people. The main building, which is a large, multi-story structure, is located on the left side of the image. It has a prominent chimney and several arched windows. In front of the main building, there is a group of people standing on the porch, with some individuals walking on the sidewalk.

To the right of the main building, there is a tall pole with electrical wires. The image also shows a smaller building with a tower, which is labeled as "Two of the Cottages."

The image has a sepia tone and a vintage filter, giving it an old-fashioned look. The photograph is labeled with the words "Main Building, Two of the Cottages, Gymnasium, and Auditorium," indicating the different structures on the campus.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black and white photograph of a street scene, showing a building with a tall chimney on the left side of the image. The building has multiple windows and a balcony with people standing on it. On the right side of the image, there is another building with a tower and a spire. There are also people walking on the sidewalk and a horse-drawn carriage on the street.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-09

Here's a description of the image:

The image is an old sepia-toned photograph, likely from the late 19th or early 20th century. It depicts a scene of what seems to be an educational institution, possibly a school or college. Here's a breakdown:

  • Buildings: The main focus is a large, imposing brick building with multiple stories. It has a veranda or balcony on one side and a prominent chimney. Further down the street, there are a few smaller wooden buildings, possibly cottages, and a church-like structure with a steeple.
  • People: A large group of people are gathered in front of the main building, many of whom are likely students, along with others, perhaps faculty or visitors. Some people are also walking along the street.
  • Environment: The scene includes a street with what appears to be train tracks running along it. Telephone poles with multiple crossbars stand along the side of the road, suggesting an urban environment. The overall impression is one of a well-established institution in a growing community.
  • Labels: There is a caption at the bottom that reads: "Main Building. Two of the Cottages. Gymnasium and Auditorium." These labels help further confirm the image's context.
  • Overall impression: This is a historical photograph, likely capturing a moment in the life of a school or educational facility, providing a glimpse into the architecture and social life of the era.

Created by gemini-2.0-flash on 2025-05-09

The photograph shows a streetscape with several buildings, captured in a sepia-toned, vintage style. The text below identifies the buildings as "Main Building," "Two of the Cottages," and "Gymnasium and Auditorium."

On the left is a substantial brick building with multiple stories, identified as the "Main Building." It has a prominent chimney and architectural details, including arched windows on the upper floors and a balcony with railings. A group of people is gathered near the entrance, some appearing to stand on the steps or veranda. A horse-drawn carriage is partially visible on the lower left corner.

To the right of the "Main Building" are two smaller buildings, labeled as "Two of the Cottages." These appear to be residential-style buildings with gabled roofs and windows. Further down the street, the "Gymnasium and Auditorium" is visible, which is a larger structure with a steeple.

A utility pole with multiple horizontal supports stands in front of the "Main Building." Power lines stretch across the image, adding to the old-fashioned aesthetic. Train tracks run along the street, creating a sense of urban activity. The photograph appears to be from the late 19th or early 20th century, capturing a moment in time of a historical institution.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a historical scene featuring several buildings and a group of people gathered outside. The photograph appears to be from the late 19th or early 20th century, as indicated by the architectural style and the attire of the people.

  1. Main Building: The most prominent structure is a large, multi-story brick building with several windows and a gabled roof. The building has a mix of rectangular and arched windows, and the entrance is adorned with a small balcony supported by columns. The building's facade suggests it is an institutional or educational structure.

  2. Cottages: To the right of the main building, there are two smaller buildings labeled as "cottages." These structures are also made of brick and have simpler architectural designs compared to the main building.

  3. Gymnasium and Auditorium: The label at the bottom of the image indicates that the main building houses a gymnasium and an auditorium, suggesting it is a multi-purpose facility.

  4. People: A group of people, mostly dressed in formal attire typical of the era, is gathered outside the main building. Some individuals are standing on the balcony, while others are on the street below. The gathering could be for an event or ceremony.

  5. Street and Surroundings: The street in front of the buildings is unpaved and has tram tracks running through it. There is a telephone or telegraph pole with multiple wires, indicating the presence of early electrical or communication infrastructure.

  6. Vehicles: A horse-drawn carriage is visible on the left side of the image, further emphasizing the historical context of the photograph.

The overall scene suggests a formal gathering or event at an educational or institutional facility, capturing a moment in time from a bygone era.

Qwen

No captions written

Text analysis

Amazon

the
of
and
Audtorium
ymnosum and Audtorium
ymnosum
Building
Moin Building Tno of the CoHages.
Moin
CoHages.
Tno
SJ,

Google

Two of the Cottages Main Building mnasium and Auditorium. Gymne
Two
of
the
Cottages
Main
Building
mnasium
and
Auditorium.
Gymne