Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Emmanuel House": Emmanuel House, Boston, Mass.: The Neighborhood.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3022.3

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Emmanuel House": Emmanuel House, Boston, Mass.: The Neighborhood.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.3022.3

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 99.7
Pedestrian 99.7
Road 98.2
Asphalt 97.6
Tarmac 97.6
Path 88.3
Zebra Crossing 71.3
People 62.7
Apparel 62.3
Clothing 62.3
Outdoors 60.8
Coat 59.1
Overcoat 59.1
Town 59.1
Street 59.1
City 59.1
Urban 59.1
Building 59.1
Walkway 59
Sidewalk 57.7
Pavement 57.7
Wall 55.5

Clarifai
created on 2019-06-06

people 99.9
group 99.5
many 99
adult 97.9
man 96.2
military 94.9
group together 94.8
home 91.7
street 87.5
soldier 87.4
road 87.3
woman 85.9
administration 85.6
war 85.6
several 85.2
one 85.2
building 84.8
art 83.9
wear 83.5
bedrock 81.5

Imagga
created on 2019-06-06

architecture 47
ruler 42.9
history 39.4
grave 39.2
tourism 38.8
stone 38.4
ancient 35.5
old 34.9
building 33.9
travel 31
column 29.8
monument 29
temple 27.8
city 27.5
famous 27
arch 26.8
tourist 26.4
landmark 25.3
historic 24.8
culture 20.5
sculpture 20.2
historical 19.8
art 18.9
exterior 18.5
cemetery 17.8
statue 17.2
fortress 16.5
columns 15.7
structure 15.1
place 14.9
palace 14.8
ruin 14.6
heritage 14.5
religion 14.4
sky 14.1
ruins 13.6
house 13.2
wall 13
church 13
street 12.9
roman 12.7
marble 12.6
facade 12.2
town 12.1
brick 11.9
past 11.6
construction 11.1
vacation 10.7
architectural 10.6
cathedral 10.6
attraction 10.5
door 10.5
outdoors 10.5
memorial 9.8
gate 9.7
buildings 9.5
color 8.9
civilization 8.8
antique 8.7
traditional 8.3
window 8.3
to 8
tomb 7.9
day 7.9
entrance 7.7
site 7.5
desert 7.5

Google
created on 2019-06-06

Microsoft
created on 2019-06-06

building 99.4
outdoor 92.9
person 84.1
old 74.5
clothing 56

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 6-13
Gender Female, 50.4%
Confused 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 49.7%
Angry 49.5%
Happy 50.2%
Calm 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.4%
Disgusted 49.5%
Happy 49.9%
Angry 49.5%
Calm 49.8%
Surprised 49.6%
Confused 49.5%
Sad 49.7%

AWS Rekognition

Age 14-23
Gender Female, 50.5%
Surprised 49.5%
Disgusted 50.3%
Sad 49.5%
Calm 49.5%
Confused 49.5%
Angry 49.5%
Happy 49.6%

AWS Rekognition

Age 16-27
Gender Male, 50.1%
Angry 49.9%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Sad 49.7%
Happy 49.5%
Disgusted 49.8%

Feature analysis

Amazon

Person

Clarifai

Window
Building
Footwear
Clothing
Person

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 96.3%

AWS Rekognition

Person 92%

AWS Rekognition

Person 82%

AWS Rekognition

Person 71.8%

AWS Rekognition

Person 64.9%

Clarifai

Window 66.3%

Clarifai

Window 61.6%

Clarifai

Window 51.2%

Clarifai

Window 42.9%

Clarifai

Window 38.3%

Clarifai

Window 38.2%

Clarifai

Window 37.1%

Clarifai

Window 33.9%

Clarifai

Building 63.2%

Clarifai

Footwear 60.6%

Clarifai

Footwear 52.8%

Clarifai

Footwear 51.8%

Clarifai

Footwear 49.4%

Clarifai

Footwear 48.3%

Clarifai

Footwear 42.1%

Clarifai

Footwear 39.8%

Clarifai

Footwear 36.7%

Clarifai

Footwear 36.3%

Clarifai

Footwear 35.9%

Clarifai

Clothing 47.3%

Clarifai

Person 45.8%

Clarifai

Person 44.5%

Clarifai

Person 42.5%

Clarifai

Person 39.2%

Clarifai

Person 36.4%

Categories

Imagga
created on 2019-06-06

streetview architecture 99.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of people standing on a sidewalk

Created by general-english-image-caption-blip-2 on 2025-07-07

a group of children standing on the sidewalk outside of a building

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image shows a group of young children gathered on the sidewalk in an urban environment. The brick building in the background has several windows and architectural features like small balconies or decorative railings. The street appears unpaved or partially paved, with some scattered debris visible. The scene conveys a historical or vintage feel, likely capturing everyday life in a city neighborhood during an earlier time period.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a group of children standing and sitting along a sidewalk in an urban setting. They appear to be dressed warmly, suggesting a cold weather season. The children are positioned against a brick building, which features several windows and what looks like ledges or small balconies. The sidewalk is lined with debris and dirt, hinting at an early 20th-century city environment in a possibly working-class neighborhood. Shadows indicate sunlight is shining, giving the photo a warm, sepia-toned overall appearance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to be a black and white photograph from an earlier time period. It shows a group of people, likely children or young adults, standing on the sidewalk in front of a brick building with ornate architectural details. The building has large windows and a raised entryway. The people in the image are bundled up in coats and scarves, suggesting a cold or winter setting. The ground in front of the building appears to be unpaved and somewhat uneven. The overall scene conveys a sense of an urban, older neighborhood setting.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-13

The sepia-toned photograph depicts a group of children standing and sitting in an alleyway or narrow street between brick buildings. The children appear to be wearing coats and hats typical of the early 20th century. One child is sitting on the ground while the others are standing and gathered together, seemingly engaged in conversation or play. The buildings have arched entryways and windows. The ground is dirt or gravel. The overall scene suggests an urban setting, possibly in a working-class neighborhood, captured sometime in the early 1900s based on the clothing styles and photographic technique.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This appears to be a vintage sepia-toned photograph, likely from the early 1900s, showing several children standing along the sidewalk in front of a brick building. The building has a traditional urban architectural style with windows and doors typical of that era. The sidewalk appears to be concrete, with what looks like dirt or unpaved street in the foreground. The children are wearing winter coats and appear to be gathered casually along the building's facade. The image has the characteristic soft focus and slight fading common to photographs from this time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image depicts a group of children standing on a sidewalk in front of a brick building. The children are dressed in coats and hats, suggesting that the photo was taken during the winter season. The building behind them appears to be an apartment complex or tenement, with multiple windows and a balcony visible.

In the foreground, the children are arranged in a line, with one child sitting on the ground to the left of the group. The child sitting is wearing a light-colored coat and hat, while the other children are dressed in darker coats and hats. The children appear to be between the ages of 5 and 10 years old.

The background of the image shows a dirt road or sidewalk in front of the building, with some debris scattered about. The overall atmosphere of the image suggests a cold and possibly impoverished environment, with the children dressed in warm clothing to protect themselves from the elements.

Overall, the image provides a glimpse into the lives of children living in a urban environment during the winter months, highlighting the challenges they may face in terms of poverty and access to resources.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a sepia-toned photograph of a group of children standing on the sidewalk in front of a brick building. The children are dressed in coats and hats, suggesting that it may be cold outside.

The building has several windows and doors, and there appears to be some debris or trash on the ground in front of it. The overall atmosphere of the image suggests that it was taken in an urban setting, possibly during the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of children standing on the sidewalk in front of a building. The children are wearing winter clothing, with some of them having hats. The building has brick walls and a wooden balcony with a railing. The sidewalk is dirty, and there are some scattered objects on it. The image has a vintage look, with a sepia tone and a slightly blurred effect.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A vintage black-and-white photo shows a group of children in front of a building with brick walls. The children are wearing long-sleeved shirts, pants, and boots. Some of them are standing on the sidewalk, while others are sitting on the ground. The building has a balcony with a concrete frame, and there are windows on the ground floor. The ground is covered with dirt and some scattered pieces of paper.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

Overall Impression: The image is a sepia-toned photograph, likely taken in the early to mid-20th century. It features a group of children posing or interacting near a brick building. The atmosphere is one of a bygone era.

Setting:

  • Building: A large brick building dominates the background. It has multiple windows, some with decorative details like overhanging balconies. The building appears to be a multi-story residence.
  • Street: The children are positioned on a sidewalk/street area, which has some debris and gravel. The sidewalk is alongside the brick building.
  • Light: The light suggests it could be a sunny day, creating shadows from the building's features.

People:

  • Children: The photo's subjects are a group of children. They seem to be dressed in winter or fall clothes, like coats and hats.
  • Positions: Some of the children are standing, and one is sitting. They are likely interacting with each other.

Atmosphere: The image captures a slice of life from a past time, with a nostalgic feel due to the monochrome tone and the children's clothing.

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

This is a vintage sepia-toned photograph featuring a group of young children on a city street. They are positioned along a sidewalk in front of a large brick building, which has multiple windows and architectural details such as overhanging bay windows.

On the left side of the image, a child is seated on the edge of the sidewalk, while the other children are standing or walking. The children are dressed in what appears to be period clothing, with long coats and various styles of hats or hairstyles. The building behind them creates a backdrop of vertical lines and shadows, adding depth to the composition.

The street itself is unpaved and looks somewhat rough, contrasting with the cleaner lines of the sidewalk. The overall tone of the photograph is evocative of a bygone era, likely dating back to the early to mid-20th century. The picture is framed by a visible border around the edges.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image depicts a vintage scene of children standing and walking along a sidewalk in front of a large brick building. The photograph is in sepia tone, suggesting it is quite old, likely from the early 20th century.

The children are dressed in what appears to be early 20th-century attire, with several of them wearing coats and hats, indicating cooler weather. The children are engaged in various activities; some are standing in groups, while others are walking. The building behind them has multiple stories with large windows and awnings, suggesting it might be an institutional building, possibly a school or a community center.

The sidewalk is relatively clean, but there are some patches of dirt and debris visible on the ground. The overall atmosphere of the image conveys a sense of daily life from a bygone era.

Qwen

No captions written