Human Generated Data

Title

Social Settlements: United States. California. San Francisco. "Telegraph Hill Neighborhood Association": Telegraph Hill, San Francisco, Cal.: First Settlement House. Summit of Telegraph Hill.

Date

1907

People

Artist: Floride Green, American 1863-1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.408.1

Human Generated Data

Title

Social Settlements: United States. California. San Francisco. "Telegraph Hill Neighborhood Association": Telegraph Hill, San Francisco, Cal.: First Settlement House. Summit of Telegraph Hill.

People

Artist: Floride Green, American 1863-1936

Date

1907

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.408.1

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.2
Countryside 96.3
Building 96.3
Rural 96.3
Shelter 96.3
Nature 96.3
Outdoors 96.3
Housing 86.2
Art 81.9
Drawing 81.9
Urban 81
Sketch 71.1
City 70.6
Road 70.6
Street 70.6
Town 70.6
House 68.1
Hut 59.5
Shack 58.3
Advertisement 57.3
Neighborhood 56.6

Clarifai
created on 2019-06-05

people 98.1
no person 97.1
print 96.9
vintage 94.3
art 92.4
street 91.8
calamity 91.3
painting 91.2
retro 89.9
old 89.2
building 87.2
vehicle 87
graffiti 85.1
text 85.1
group 84.7
illustration 84.7
town 82.2
house 82.1
adult 81.1
war 80.6

Imagga
created on 2019-06-05

building 56.3
architecture 43.4
facade 40.4
sketch 34.6
old 34.2
structure 32.2
house 29.4
window 27.1
drawing 26.9
wall 26.8
brick 22.4
representation 20.8
city 20
exterior 19.4
ancient 19.1
home 18.4
balcony 17.5
history 17
roof 16.2
sky 16
town 15.8
travel 15.5
door 15.5
construction 15.4
historic 14.7
buildings 14.2
stone 13.5
windows 13.5
university 13.4
church 13
winter 12.8
aged 12.7
snow 12.6
warehouse 12.4
tourism 12.4
street 12
architectural 11.5
urban 11.4
graffito 11.3
decoration 11
vintage 10.8
village 10.6
medieval 10.6
religion 9.9
trees 9.8
antique 9.5
cold 9.5
historical 9.4
grunge 9.4
glass 9.3
wood 9.2
dirty 9
billboard 9
metal 8.9
shop 8.8
school 8.7
garage 8.7
scene 8.7
nobody 8.6
barbershop 8.4
dwelling 7.9
abandoned 7.8
arch 7.8
factory 7.7
industry 7.7
obsolete 7.7
estate 7.6
traditional 7.5
destination 7.5
signboard 7.3
industrial 7.3
tourist 7.3
detail 7.2
landmark 7.2
tower 7.2
scenic 7

Google
created on 2019-06-05

Text 86.9
Paper product 71
House 70.2
Building 65.5
History 60.4
Illustration 57.7

Microsoft
created on 2019-06-05

outdoor 86.6
house 76.7
old 49.2

Color Analysis

Feature analysis

Amazon

Person
Poster

Clarifai

Window
House
Person
Clothing

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 90.7%

AWS Rekognition

Person 89.6%

AWS Rekognition

Person 89.1%

AWS Rekognition

Person 85.1%

AWS Rekognition

Person 77.7%

AWS Rekognition

Person 64.1%

AWS Rekognition

Poster 57.3%

Clarifai

Window 87.3%

Clarifai

Window 84.1%

Clarifai

House 84.5%

Clarifai

House 77.5%

Clarifai

House 67.7%

Clarifai

House 66.7%

Clarifai

House 64.5%

Clarifai

House 48%

Clarifai

House 47.6%

Clarifai

House 38.6%

Clarifai

House 36%

Clarifai

House 35.3%

Clarifai

Person 37.5%

Clarifai

Clothing 33.1%

Categories

Imagga
created on 2019-06-05

streetview architecture 62.4%
paintings art 36.8%

Captions

Microsoft
created by unknown on 2019-06-05

a sign in front of a building 84.4%
a sign on the side of a building 84.3%
an old photo of a building 78.7%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing in front of a mountain

Created by general-english-image-caption-blip-2 on 2025-07-07

an old photo of a group of people sitting on the sidewalk

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This historic photograph shows a group of people gathered in front of buildings at the base of Telegraph Hill in San Francisco, California. The scene captures urban life in what is labeled as the "First Settlement House at Summit of Telegraph Hill."

The foreground features cobblestone streets and a group of individuals, including adults and children, appearing to socialize or pose for the photograph. Behind them are wooden structures with signs. One prominent sign reads "NEAR-LINEN," advertising sheets, pillowcases, and lace products from "D. Samuels Lace House Co." Another sign is partially visible advertising cigars and the name "G. Michelot."

The background showcases the rocky slope of Telegraph Hill, ascending steeply with several small houses perched at the summit. Overhead, utility lines stretch across the image. The overall atmosphere reflects a bustling, yet rugged area characteristic of early 20th-century San Francisco.

Created by gpt-4o-2024-08-06 on 2025-06-12

This is a historical photograph depicting a group of people standing outside near some buildings. The image is labeled as the "First Settlement House Summit of Telegraph Hill." The buildings appear to be situated at the base of a rocky hill with some structures visible at the summit. The settlement house and other adjacent buildings have signage, one of which advertises "NEAR-LINEN" sheets and pillowcases from "D. Samuels Lace House Co." There is also a sign for "G. Michelot" above an awning. The group of people, including children, appear to be posing for the photograph, and they are standing on a cobblestone street. The scene captures a slice of life and architecture from the era in which it was taken.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a historic street scene in what appears to be an early settlement or mining town. In the foreground, there is a group of people standing on the sidewalk in front of a building with a sign that reads "NEAR-LINEN SHEETS & PILLOW CASES D.SAMUELS & CO." Behind this building, there is a steep rock face or cliff, indicating the town is situated in a rugged, mountainous terrain. The caption at the bottom of the image identifies this as the "First Settlement House" at the "Summit of Telegraph Hill."

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a historical black and white photograph showing buildings at the summit of Telegraph Hill in San Francisco. The image shows a commercial building with a large sign advertising "NEAR-LINEN SHEETS & PILLOW CASES" from "D. SAMUELS ICE HOUSE CO." on Sutter Street. There's a two-story wooden building with a storefront visible on the right side of the image. In the background, you can see the steep, rocky face of Telegraph Hill rising up behind the buildings. A small group of people are gathered on the street in front of the buildings. The photograph appears to be from the late 19th or early 20th century, and the caption identifies it as "First Settlement House Summit of Telegraph Hill."

The image provides an interesting glimpse into the early development of this famous San Francisco neighborhood, showing both commercial activity and the natural topography of the hill that was such a distinctive feature of the area.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a sepia-toned photograph of the First Settlement House, located at the Summit of Telegraph Hill in San Francisco, California. The photograph appears to be from the early 20th century, likely taken in the 1900s.

Key Features:

  • Building: The building in the center of the photograph is a two-story structure with a sign that reads "NEAR-LINEN" and "SHEETS & PILLOW CASES." Below this sign, there is another sign that reads "D. SAMUELS LACE HOUSE CO." The building has a wooden exterior and a pitched roof.
  • Street: In front of the building, there is a cobblestone street with a few people standing on it. A group of children are gathered near the bottom of the photograph, and a man is standing on the street, looking up at the building.
  • Telegraph Hill: In the background, there is a large rocky hillside with a few buildings perched on top. The hillside is covered in trees and bushes, and there are power lines running across the top of the photograph.
  • Signs: There are several signs visible in the photograph, including the "NEAR-LINEN" sign and the "D. SAMUELS LACE HOUSE CO." sign. There is also a sign that reads "SUTTER ST. COR. GRANT AVENUE" and another sign that reads "MILL RIGHTS."
  • People: There are several people visible in the photograph, including the group of children and the man standing on the street. There are also a few people standing on the hillside in the background.
  • Overall: The photograph provides a glimpse into the history of the First Settlement House and the surrounding area. It shows the building and its surroundings in a state of disrepair, with peeling paint and worn-out signs. Despite this, the photograph still conveys a sense of community and activity, with people gathered in front of the building and on the street.

Summary:

The photograph is a historical image of the First Settlement House, located at the Summit of Telegraph Hill in San Francisco, California. The building appears to be in a state of disrepair, with peeling paint and worn-out signs. Despite this, the photograph still conveys a sense of community and activity, with people gathered in front of the building and on the street. The photograph provides a unique glimpse into the history of the area and the people who lived there.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

This image is a vintage black-and-white photograph of a settlement house on Telegraph Hill in San Francisco, California. The photograph features a large rock face with buildings constructed on top of it and around its base.

In the foreground, a group of children are gathered near the street, while a sign on the side of a building reads "NEAR-LINEN" and advertises sheets and pillowcases from D. Samuels Lace House Co. The photograph is captioned "First Settlement House Summit of Telegraph Hill."

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

A black-and-white photograph of a building with a sign that reads "Near-Linen" and "The Best Sheets & Pillow Cases" is on the side of the building. The building has a wooden door and a window. There are people standing in front of the building, and some of them are wearing hats. There is a pole with a wire attached to it. On the right side of the building, there is another building with a sign that reads "CIGAR & MICHELOTTI."

Created by amazon.nova-pro-v1:0 on 2025-06-06

The image is a vintage photograph of a street scene. It features a row of buildings with a signboard in front of one of them. The signboard reads "NEAR-LINEN" and "D.SAMUELS ICE HOUSE CO." The buildings have awnings, and one of them has a lamppost in front. There are people standing in front of the buildings, and some are sitting on the ground. The photograph has a vintage filter, giving it a sepia tone.

Google Gemini

Created by gemini-2.0-flash on 2025-05-08

Here's a description of the image:

This black and white photograph, likely taken in the early 20th century, depicts a street scene titled "First Settlement House, Summit of Telegraph Hill." The street is paved with cobblestones.

A group of children stand on the corner in front of the buildings. The building to the left is a wooden structure with a large advertisement for "NEAR-LINEN" sheets and pillowcases, belonging to the D. Samuels Lace House Co. The ad also mentions the location as Sutter St. cor. Gra Avenue, Mill Agents. Next to it is a two-story wooden building with a storefront. The awning over the storefront is partially drawn.

In the background, a steep rocky hill rises behind the buildings. At the top of the hill, some houses or structures are visible.

An electrical pole stands prominently in the foreground, with wires running across the scene.

The photograph has an aged, sepia tone, and the caption is handwritten in the lower margin.

Created by gemini-2.0-flash-lite on 2025-05-08

Here's a description of the image:

Overall Impression:

The image is a vintage black and white photograph, likely from the late 19th or early 20th century. It depicts a street scene with buildings, a group of people, and a prominent geological feature in the background. The photograph has a somewhat faded quality, typical of older prints.

Key Elements:

  • Buildings: The photograph features a few buildings. The most prominent is a two-story structure on the right with windows on the front.
  • Commercial Signage: The building on the left has a sign on the side advertising "Near-Linen" (sheets & pillow cases), and includes "D. Samuels Ice House Co."
  • People: A group of children are gathered on the street, some standing, some seated.
  • Background Landscape: A large, rocky hillside, probably Telegraph Hill, dominates the background. Small structures are visible on the hillside.
  • Utility Poles and Wires: Utility poles with electrical wires are present, indicating the presence of a developed infrastructure.
  • Text: The title "First Settlement House, Summit of Telegraph Hill" is handwritten at the bottom of the photograph, indicating its subject and location.

Composition and Style:

  • Perspective: The photograph is taken from a ground-level perspective, making the buildings and people appear in the foreground.
  • Lighting: The lighting appears natural, possibly from a sunny day, with some shadows cast by the buildings.

Context and Possible Interpretation:

The photograph likely documents a view of the "First Settlement House" located on Telegraph Hill. The presence of the advertisement and the people suggests a thriving commercial area. The image offers a glimpse into the everyday life of the time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a historical photograph depicting a street scene at the summit of Telegraph Hill, featuring what is labeled as the "First Settlement House." The photograph shows a group of people, including adults and children, standing in front of a wooden building. The building has a sign advertising "Near-Linen" sheets and pillowcases, and another sign for "D. Samuels Ice House Co." with an address of Sutter St. Cor. Grant Avenue.

In the background, there is a large rocky outcrop, which appears to be a significant natural feature of the area. The buildings are modest wooden structures typical of the late 19th or early 20th century. The street is cobblestone, and there are utility poles with wires running across the scene. The overall atmosphere suggests a historical urban setting, likely in San Francisco, given the reference to Telegraph Hill.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black and white photograph depicting the "First Settlement House" located at the summit of Telegraph Hill in San Francisco. It appears to be from the late 19th or early 20th century, judging by the style of the buildings and the attire of the people.

In the foreground, there is a wooden building with a sign that reads "NEAR LINEN" and "THE BEST SHEETS & PILLOW CASES." Below that, it mentions "D. Samuels Ice House Co." and provides an address: "SUTTER ST. COR. GRA[ ] AVENUE. WILL AGENTS." There is also a smaller sign next to it that says "CIGAR G. MICHELOTTI."

To the right of the wooden building is a taller structure with a more formal architectural style, featuring a two-story facade with several windows. The ground in front of the buildings is paved with cobblestones, and there are a few people standing near the wooden building, seemingly posing for the photograph.

In the background, the steep, rocky terrain of Telegraph Hill is visible, with some additional buildings and structures perched atop the slope. The photograph has a vintage feel, with some wear and tear visible on the edges, suggesting it is a historical photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This image is an old photograph of a settlement house located at the summit of Telegraph Hill. The photograph shows a group of children standing in front of a building with a sign that reads "NEAR LINEN SHEETS & PILLOW CASES. D. SAMUELS ICE HOUSE CO. SUTTER ST. COR. GRANITE AVENUE. WILL AGENTS." The building appears to be a two-story structure with a gabled roof and a porch. The street in front of the building is paved with cobblestones, and there is a telephone pole with wires running across the image. In the background, there is a rocky hillside with some houses perched on it. The photograph has a sepia tone and is labeled at the bottom with the text "First Settlement House Summit of Telegraph Hill."

Text analysis

Amazon

SHEETS
HOUSE
D.SAMUELS
First
SUTTER
INEN
of
CE
"NEAR- INEN
AVENUE
"NEAR-
Hill.
CASES
summit of Telegro roph Hill.
settlement
First settlement House
Telegro
1
GRA
summit
COR
SUTTER ST. COR GRA AVENUE
D.SAMUELS CE HOUSE COX
roph
BEST SHEETS PILLow CASES
SH 1
BEST
House
SH
ST.
PILLow
COX

Google

3 1 "NEAR-LINEN THE AEST SHEETS 8 PILLOW CASES D.SAMUELS CE HOUSE CO IGARS GAMIGHELOTT SUTTER ST. COR.GRA AVENUE, MILL AGENTS First Settlement Hous e Summit of Teleg raph Hil/
3
1
"NEAR-LINEN
THE
AEST
SHEETS
8
PILLOW
CASES
D.SAMUELS
CE
HOUSE
CO
IGARS
GAMIGHELOTT
SUTTER
ST.
COR.GRA
AVENUE,
MILL
AGENTS
First
Settlement
Hous
e
Summit
of
Teleg
raph
Hil/