Human Generated Data

Title

Housing, Improved: United States. New York. New York City. "Phipps House" Nos. 1 and 2: Improved Housing: New York City: "Phipps House, #1," New York City. Located at 331 E. 31 St. Architect: Grosvenor Atterbury; Manager: City & Suburban Homes Co. Rents: $1.35 per room per week.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1918.2

Human Generated Data

Title

Housing, Improved: United States. New York. New York City. "Phipps House" Nos. 1 and 2: Improved Housing: New York City: "Phipps House, #1," New York City. Located at 331 E. 31 St. Architect: Grosvenor Atterbury; Manager: City & Suburban Homes Co. Rents: $1.35 per room per week.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.1918.2

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 98.8
Building 88.1
Urban 86.3
Home Decor 85.6
City 85.6
Town 85.6
Architecture 81.2
Office Building 73.8
High Rise 71.7
Window 67.6
Downtown 65.8
Outdoors 63.9
People 60.5
Apartment Building 60
Pedestrian 59.5
Transportation 56.4
Vehicle 56.4
Tower 55.7
Road 55.6
Neighborhood 55.4
Spire 55.3
Steeple 55.3
Street 55.2

Clarifai
created on 2019-06-06

building 97.6
architecture 97.6
house 97.4
street 95.7
wall 95.4
old 95.2
urban 94.2
city 93.7
art 93
window 92.8
family 92.5
no person 90
expression 88.8
vintage 88
ancient 86.9
outdoors 85.4
stone 85.3
travel 85
town 84.6
apartment 84.3

Imagga
created on 2019-06-06

obelisk 78.3
structure 73.5
column 69.1
architecture 47.5
building 41
city 33.3
old 32.8
ancient 30.3
arch 28.6
historic 28.5
stone 28.1
tower 27.8
tourism 27.3
history 26.9
brick 26.8
travel 25.4
church 23.2
wall 20.8
town 19.5
house 19.1
construction 18.9
landmark 18.1
historical 17.9
sky 17.9
exterior 17.5
religion 17.1
pedestal 16.8
medieval 16.3
monument 15.9
window 15.7
tourist 15.4
building material 15.4
urban 14.9
street 14.8
castle 14.6
culture 14.6
palace 14.5
memorial 13.7
fortress 13.6
buildings 13.3
famous 13.1
support 13
triumphal arch 12.9
cathedral 12
vintage 11.6
architectural 11.6
facade 11.2
art 11.1
rampart 10.6
windows 10.6
balcony 10.4
roof 9.9
heritage 9.7
sculpture 9.7
supporting structure 9.6
home 8.8
antique 8.7
village 8.7
cityscape 8.5
temple 8.4
place 8.4
retro 8.2
statue 8
marble 7.9
grave 7.9
sightseeing 7.8
gate 7.8
grunge 7.7
center 7.7
england 7.6
frame 7.5
detail 7.3
square 7.3
university 7.1

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

building 87.3
window 82.7
house 75.4
old 74.1
street 72.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Happy 49.6%
Calm 49.6%
Sad 49.7%
Surprised 49.6%
Angry 50%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.2%
Angry 49.6%
Happy 49.7%
Calm 49.9%
Confused 49.5%
Sad 49.7%
Disgusted 49.5%
Surprised 49.5%

Feature analysis

Amazon

Person

Clarifai

Window
Building
Footwear
Clothing

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 89.7%

Clarifai

Window 94.3%

Clarifai

Window 92.4%

Clarifai

Window 91.6%

Clarifai

Window 91.6%

Clarifai

Window 91.5%

Clarifai

Window 85.6%

Clarifai

Window 85.1%

Clarifai

Window 83.5%

Clarifai

Window 77.2%

Clarifai

Window 77%

Clarifai

Window 76.9%

Clarifai

Window 74.7%

Clarifai

Window 74.3%

Clarifai

Window 71.7%

Clarifai

Window 69.5%

Clarifai

Window 69.3%

Clarifai

Window 68.7%

Clarifai

Window 60.6%

Clarifai

Window 59.5%

Clarifai

Window 59%

Clarifai

Window 51.6%

Clarifai

Window 48.9%

Clarifai

Window 46.4%

Clarifai

Window 38.4%

Clarifai

Window 35.6%

Clarifai

Window 35.1%

Clarifai

Building 60.8%

Clarifai

Building 51.5%

Clarifai

Building 35.5%

Clarifai

Footwear 38.1%

Clarifai

Clothing 34.4%

Categories

Imagga
created on 2019-06-06

streetview architecture 98%
interior objects 1.6%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-28

a photograph of a couple of people sitting on a bench in front of a building

Created by general-english-image-caption-blip-2 on 2025-07-06

an old photo of a building with a man on a bike

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This image depicts a street view of an urban environment featuring a prominent brick building with an arched passageway connecting its structure. The architecture shows decorative brickwork along the edges and stone-like base detailing near the ground level. Windows on the building are visible, some with curtains or shades drawn.

In the lower right corner, a group of individuals is sitting near a corner ledge or bench. Two young boys, dressed in period clothing, are seated, one wearing a hat, while another boy is standing nearby. The setting carries a historical feel, likely from the early 20th century or late 19th century, as indicated by the clothing and the design of the building. The photo has a sepia tone, further enhancing its vintage quality. There also appears to be a blurry figure in motion on the sidewalk, perhaps a pedestrian passing by.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a sepia-toned photograph depicting an urban street scene, likely from the early 20th century. The focus is on a segment of a building with a large archway, which appears to be part of a residential structure. The architecture is characterized by brickwork with some decorative elements around the windows and a strong, sturdy masonry base. There is a group of three boys sitting and standing near the archway on the sidewalk. They are dressed in early 20th-century clothing, with one boy sitting on a low stone wall and the others standing nearby. The scene conveys a glimpse of everyday life in a city from that era, with the motion blur of a passerby suggesting movement and activity on the street.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to be a black and white photograph of a city street scene from an earlier time period. The buildings lining the street have an ornate, historic architectural style with intricate brick patterns and decorative elements. There are several people visible on the street, including a couple sitting on a bench or ledge. The overall scene conveys a sense of the past, with the vintage style of the buildings and the presence of the people in period clothing. The image captures a glimpse of urban life from a bygone era.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-15

The black and white photograph depicts a street corner scene with a multi-story brick apartment building. The building has many windows and architectural details like cornices and pilasters. On the sidewalk in front of the building, a group of people are gathered, appearing to be having a conversation. One person is sitting on the steps while the others stand nearby. The image provides an interesting glimpse into urban life and architecture from an earlier time period, likely the early 20th century based on the clothing styles and building design.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white vintage photograph showing the exterior of what appears to be an apartment building or residential structure. The building features brick construction on the upper levels with decorative quoining (corner stonework), and a stone or concrete base level. There are multiple windows arranged in a regular pattern on the façade. The building has some architectural details including ornamental elements near the windows and base. At street level, there are steps leading to the entrance, and some people can be seen sitting on these steps. The image has the grainy, slightly faded quality typical of early 20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a sepia-toned photograph of a large building with a group of people sitting on the steps in front of it.

The building is made of brick and stone, with multiple windows and balconies. The building appears to be several stories tall, with a flat roof. There are several signs on the building, but they are not legible.

In front of the building, there is a group of people sitting on the steps. There are four people visible in the photo, all of whom appear to be men. They are dressed in casual clothing, and one of them is wearing a hat. The people are sitting on the steps, facing the camera, and appear to be engaged in conversation.

The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly during the 1920s or 1930s. The style of the building and the clothing worn by the people in the photo are consistent with this time period.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image is a sepia-toned photograph of a street scene, featuring a large brick building with multiple windows and balconies. The building appears to be an apartment complex or residential structure, with several people sitting on the sidewalk in front of it. The overall atmosphere of the image suggests a quiet, everyday moment in an urban setting.

Key Features:

  • Building: The building is the central focus of the image, with its brick facade and numerous windows and balconies.
  • People: Several individuals are seated on the sidewalk in front of the building, adding a sense of human presence to the scene.
  • Street: The street in front of the building is visible, with a few people walking or standing on it.
  • Atmosphere: The overall atmosphere of the image is one of quietness and everyday life, with no signs of activity or excitement.

Color Palette:

  • Sepia: The dominant color of the image is sepia, which gives it a warm, nostalgic feel.
  • Shades of Gray: The image also features various shades of gray, which add depth and contrast to the scene.

Mood:

  • Quiet: The image exudes a sense of quietness and stillness, with no signs of activity or excitement.
  • Everyday: The scene depicted in the image is an everyday moment, with people going about their daily lives.

Style:

  • Photographic: The image is a photograph, with a realistic and detailed representation of the scene.
  • Sepia-Toned: The use of sepia tone gives the image a distinctive look and feel, evoking a sense of nostalgia and history.

Subject Matter:

  • Urban Landscape: The image depicts an urban landscape, with a focus on the building and the people in front of it.
  • Everyday Life: The scene depicted in the image is an everyday moment, with people going about their daily lives.

Emotional Response:

  • Nostalgia: The image may evoke feelings of nostalgia in viewers, particularly those who have lived in urban environments.
  • Appreciation: The image may also inspire appreciation for the beauty of everyday moments and the importance of human connection.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

A black-and-white photograph shows two buildings, one on the left and one on the right. Both buildings have brick walls and windows. There is a balcony on the second floor of the building on the right. There are people sitting on the sidewalk in front of the buildings. One of them is a man wearing a hat and holding a bag. There is a person walking in the middle of the two buildings.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The image is a black-and-white photograph of a street corner with two buildings on either side. The building on the left has a name board, and the building on the right has a name board and a lamp hanging from the wall. The street corner has a few people standing and sitting on the pavement. The image has a vintage filter, giving it an old-fashioned look.

Google Gemini

Created by gemini-2.0-flash on 2025-05-31

The sepia-toned image captures an exterior view of two towering brick buildings, linked by a large archway above street level. The buildings, adorned with windows and subtle detailing, rise into the frame. A sign, presumably indicating an address, is visible on the corner of one of the buildings.

At the base of the building on the right, a group of people are seated on a low wall. The group consists of three younger people sitting next to each other, and an older individual, likely a teen or young adult. A blurred figure, possibly a pedestrian, walks across the street in front of the buildings. The street is visible as a flat surface stretching across the bottom of the image.

Created by gemini-2.0-flash-lite on 2025-05-31

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph, seemingly taken during the early to mid-20th century. It captures a city street scene with distinct architectural features.

Composition and Key Elements:

  • Archway: The central focus of the photograph is a large archway, formed by two adjacent brick buildings. The arch creates a dramatic sense of depth and leads the eye into the background.
  • Buildings: The buildings on either side of the arch appear to be multi-story, constructed of brick with decorative stone details. They have multiple windows and likely represent apartment buildings or similar residential structures.
  • Signage: You can see signs with street addresses or names. It is likely the location of the building is being identified by this sign.
  • People: Several people are present in the image. Three people are on the ground.
  • Setting: The setting appears to be a street in a city. There's a sidewalk, and possibly a street, and the overall mood is one of a snapshot of urban life.
  • Color and Tone: The photograph's monochrome nature gives it a classic, historical feel. The tonal range, the shadows, and highlights provide texture.

Overall:

The photograph's aesthetic and composition suggest it was taken with a keen interest in capturing the beauty of city architecture and the daily life within it. It gives us a glimpse of the past, offering a visual record of a moment in time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-06

The image depicts a vintage photograph of a city street scene, likely from the early to mid-20th century. The photograph is in sepia tones, giving it an aged, nostalgic appearance.

In the foreground, there are two children standing on the sidewalk in front of a building. One child is sitting on a small tricycle, while the other is standing beside them. Both children are dressed in casual clothing typical of the era.

The building behind the children is a multi-story brick structure with several windows. The architectural style features decorative elements, such as ornate carvings and moldings around the windows and corners. There is a set of stairs leading up to an entrance, and a small fence is visible in front of the building.

The street in front of the building is relatively empty, with no visible vehicles or other pedestrians. The overall scene conveys a quiet, residential atmosphere. The photograph captures a moment of everyday life from a bygone era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-12

The image depicts a photograph of a building corner with a narrow pedestrian walkway between two multi-story brick structures. The architecture suggests a vintage style, possibly from the early to mid-20th century. The building on the left displays the address "6035 East Whittemore Street," and the building on the right has a similar sign that reads "6030 East Whittemore Street." The walkway is bordered by low walls and has a few people sitting on one of the walls. The buildings have a series of windows, some of which have curtains, and there are balconies visible on the upper floors. The photograph has a sepia tone, giving it a nostalgic and historical feel.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-12

This image is a sepia-toned photograph depicting an urban scene from what appears to be an older time period. The focal point is a large brick building with "331-351 East 121st Street" engraved on its facade. The building has multiple windows and a decorative architectural style typical of early 20th-century architecture.

In the foreground, a group of children is sitting on a low wall or steps near the entrance of the building. They seem to be dressed in period clothing, possibly from the early 1900s. The scene captures a sense of everyday life in a bustling city environment. The photograph has a nostalgic and historical feel, evoking a bygone era.

Text analysis

Google

EAST HIRT
EAST
HIRT