Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Greenwich House": Greenwich House, New York City.: A Rookery.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3594

Human Generated Data

Title

Social Settlements: United States. New York. New York City. "Greenwich House": Greenwich House, New York City.: A Rookery.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3594

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Banister 94.6
Handrail 94.6
Human 75.2
Interior Design 72.6
Indoors 72.6
Window 71.5
Building 64.8
Art 59.5
Drawing 59
Office Building 58.6
Wood 57.2

Clarifai
created on 2019-06-05

no person 99.6
architecture 98.8
building 97.7
people 97.5
monochrome 97.3
street 95.1
window 94.5
city 93.8
expression 91.4
urban 90.3
group 89.6
home 87.5
house 86.1
vehicle 85.9
outdoors 85.4
retro 84.8
business 84.2
glass items 83.5
art 82.8
travel 81.7

Imagga
created on 2019-06-05

sketch 100
drawing 100
representation 65.4
architecture 48.8
construction 38.5
building 36.7
structure 32
plan 29.3
architect 25.1
design 24.2
drafting 23.6
blueprint 23.5
house 22.8
city 22.5
project 22.1
office 22
paper 22
engineering 21
urban 20.1
business 18.8
draft 18.6
designer 17.4
window 16.6
build 15.2
print 15.1
engineer 14.4
home 14.4
tower 14.3
interior 14.2
contractor 13.6
glass 13.2
industry 12.8
modern 12.6
old 12.5
wall 12.2
metal 12.1
industrial 11.8
builder 11.6
architectural 11.5
sky 11.5
pencil 11.4
draw 11.4
buildings 11.3
idea 10.7
technical 10.6
diagram 10.6
perspective 10.4
graphic 10.2
work 10.2
exterior 10.1
travel 9.9
blueprints 9.9
new 9.7
built 9.7
development 9.5
liner 9.5
roof 9.3
room 9.1
scheme 8.9
housing 8.9
steel 8.8
scale 8.7
graph 8.6
floor 8.4
style 8.2
reflection 8.1
high 7.8
apartment 7.7
concrete 7.7
finance 7.6
passenger ship 7.6
estate 7.6
pen 7.6
tall 7.5
vintage 7.4
balcony 7.4
ship 7.4
inside 7.4
support 7.3
detail 7.2
landmark 7.2
step 7.2
futuristic 7.2

Google
created on 2019-06-05

Architecture 76.3
House 71.7
Building 65
History 54.1

Microsoft
created on 2019-06-05

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 20-38
Gender Female, 50.8%
Sad 46.1%
Surprised 45.6%
Happy 46.8%
Angry 45.5%
Confused 46.2%
Disgusted 45.8%
Calm 49%

AWS Rekognition

Age 14-23
Gender Female, 54.1%
Sad 53%
Surprised 45.2%
Angry 46.3%
Calm 45.3%
Happy 45.1%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 10-15
Gender Female, 54.6%
Angry 45.2%
Calm 50%
Disgusted 45.7%
Happy 47.8%
Confused 45.7%
Surprised 45.4%
Sad 45.2%

AWS Rekognition

Age 17-27
Gender Male, 54.4%
Confused 47.5%
Happy 45.4%
Sad 46.4%
Surprised 46.4%
Angry 46.9%
Disgusted 45.7%
Calm 46.7%

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person

Clarifai

Window
House
Door
Stairs
Human face
Person

AWS Rekognition

Person 64.8%

AWS Rekognition

Person 62.6%

Clarifai

Window 79.8%

Clarifai

Window 79.8%

Clarifai

Window 56.8%

Clarifai

Window 43.9%

Clarifai

Window 41.8%

Clarifai

Window 36.4%

Clarifai

Window 34.3%

Clarifai

House 51.8%

Clarifai

Door 48%

Clarifai

Stairs 43.6%

Clarifai

Human face 38.1%

Clarifai

Human face 35.6%

Clarifai

Person 35%

Categories

Imagga
created on 2019-06-05

streetview architecture 99.5%

Captions

Microsoft
created by unknown on 2019-06-05

a large white building 60.6%
a close up of a white building 60.5%
a large white building in the background 58.1%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-29

a photograph of a group of people sitting on a balcony

Created by general-english-image-caption-blip-2 on 2025-07-07

an old photo of a group of people on the balcony of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image shows the exterior of a multi-story building with wooden siding, windows with shutters, and a fire escape. The architecture is older and utilitarian, with a narrow balcony area enclosed by wooden slats. Shadows from the fire escape create a pattern across the building's surface, adding contrast to the lighting. Wooden supports or beams are visible in the foreground, suggesting structural reinforcements or construction.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a group of sailors gathered on a second-story wooden porch. The building is made of wooden planks with shuttered windows. There are shadowed stairs and safety railings, leading up the side of the building likely serving as an emergency fire escape. The sunlight creates strong shadows on the building's exterior, and the men are dressed in naval uniforms indicative of early 20th-century sailors, wearing hats and uniform coats. The porch has a slatted wooden railing, and additional items, potentially tools or ropes, can be seen hanging or leaning against the structure. The scene has a vintage, historical feel, likely capturing a moment of the past.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows an old, black and white photograph of a building with multiple levels of wooden balconies and staircases. The building appears to be a residential structure, with windows and shutters visible. There are several people visible on the balconies and stairs, but their faces are not clearly identifiable. The overall scene has a vintage, historic feel to it.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The black and white photograph shows a group of people standing on the balcony or fire escape of an old, multi-story building. The building has many windows with shutters, and the balcony has horizontal wooden slats for railings. The people appear to be looking out or down from the balcony. Based on their clothing and the style of the building, this image seems to be from an earlier time period, likely the early to mid 20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a vintage black and white photograph showing a fire escape on the exterior of what looks like an apartment building or similar urban structure. The fire escape has several people gathered on it, appearing to be posing for the photograph. The building's facade shows typical architectural elements of early 20th century construction, including shuttered windows and a light-colored exterior wall. The angle of the photograph is taken from below, looking upward at the fire escape structure, which creates an interesting diagonal composition in the frame. The image has the characteristic grainy quality typical of photographs from this era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of a group of people gathered on the fire escape of a building, likely taken in the early 20th century.

The fire escape is constructed of metal and features multiple levels, with the group of people standing on the top level. The individuals are dressed in clothing typical of the time period, including hats, coats, and dresses. They appear to be engaged in conversation or socializing, with some looking directly at the camera while others gaze off into the distance.

In the background, the exterior of the building is visible, with wooden siding and windows that are partially open. The overall atmosphere of the image suggests a sense of community and social interaction among the group of people gathered on the fire escape.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a multi-story building with a fire escape. The building has multiple windows and a door on the ground floor. A group of people are gathered on the fire escape, which is attached to the side of the building. The fire escape has multiple levels and appears to be made of metal.

In the foreground, there is a ladder leading up to the fire escape. The background of the image shows the side of the building, with several windows and a door visible. The overall atmosphere of the image suggests that it was taken in an urban setting, possibly in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph of a group of people standing on a balcony of a building. The photograph has a vintage look, suggesting it was taken several decades ago. The people on the balcony are looking down at the street below, and some of them are smiling. The building has a wooden balcony with a railing, and a ladder is leaning against the wall on the right side of the image. There is also a fire escape on the left side of the building. The photograph has a slightly blurry effect, which adds to its vintage feel.

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white photo shows a group of people standing on the balcony of a house. The balcony has a wooden fence, and a wooden ladder is placed on the right side. The people are looking downward, and some of them are wearing hats. The house has windows with shutters, and a fire escape is attached to the wall. The shadows of the people and the house are cast on the wall.

Google Gemini

Created by gemini-2.0-flash on 2025-05-29

The photograph shows a light-colored building with a fire escape, balcony, and a group of people looking out from the balcony. The building appears to be made of wood, and has a somewhat rundown or old-fashioned appearance.

The fire escape is made of metal and consists of multiple tiers. The ladders are visible against the building.

A wooden balcony is attached to the building. A group of people, mainly children, are standing on the balcony, looking out with expressions of excitement or curiosity.

The light in the image is somewhat harsh, causing shadows and highlighting the details of the building and the fire escape. The image appears to be a vintage photograph.

Created by gemini-2.0-flash-lite on 2025-05-29

The image shows a vintage photograph of a building, likely an apartment or tenement, with a fire escape system. The fire escape dominates the left side of the image, and a group of children are huddled on a wooden balcony or landing. They appear to be looking towards a point below them and are partially obscured by a cloud or smoke. The architecture suggests a period likely in the early 20th century. The style of the photograph, its graininess, and the lack of color further support this vintage aesthetic.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a black-and-white photograph depicting a group of children gathered on a fire escape attached to a multi-story building. The building appears to be an older residential structure, possibly an apartment or tenement building, with wooden siding and shutters.

The fire escape is made of metal and has several levels, with the children standing on the second level. The children seem to be enjoying themselves, with some leaning over the railing and others sitting or standing on the metal grating. The fire escape is positioned outside windows, suggesting that it serves multiple apartments.

The photograph captures a moment of playfulness and community among the children, likely during a time when fire escapes were common features in urban residential areas. The image has a nostalgic feel, possibly reflecting a bygone era of urban life. The lighting suggests it might be daytime, with shadows cast by the building and the fire escape.

Qwen

No captions written

Text analysis

Google

(REEE
(REEE