Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.:A Typical Tenement.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2898.3

Human Generated Data

Title

Social Settlements: United States. Illinois. Chicago. "University of Chicago Settlement": University of Chicago Settlement, Chicago Ill.:A Typical Tenement.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2898.3

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 99.2
Housing 92.2
Building 92.2
Urban 75.7
Mammal 75.3
Animal 75.3
Neighborhood 73.2
Home Decor 72.5
Vehicle 68.7
Transportation 68.7
Outdoors 67.1
House 65.7
Nature 64.6
Porch 58
Food 57.7
Meal 57.7
Tree 56.9
Plant 56.9
Grass 56.2
Siding 55.3

Clarifai
created on 2019-06-05

people 99.7
home 99
no person 98.8
war 97.4
group 97
administration 96.3
military 96.2
group together 94.7
vehicle 93
adult 92.9
calamity 92.6
soldier 92.4
many 91
government 89.7
building 86.1
house 85.9
offense 85.8
two 80.9
man 80.7
architecture 80.6

Imagga
created on 2019-06-05

building 70.9
structure 59.8
architecture 39.5
school 36.9
house 30.4
sky 27.5
billboard 23.6
cinema 22.2
home 19.2
signboard 19.1
theater 18.7
rural 18.5
exterior 18.5
trees 17.8
roof 16.4
old 16
grass 15.8
construction 14.6
landscape 14.2
university 12.9
graffito 12.8
clouds 12.7
winter 11.9
brick 11.5
new 11.4
tree 10.8
farm 10.7
windows 10.6
country 10.6
modern 10.5
estate 10.5
facade 10.4
public house 10.3
church 10.2
residence 10.1
fence 10
england 9.5
lawn 9.4
travel 9.2
history 9
barn 8.8
residential 8.6
industry 8.5
window 8.4
wood 8.4
park 8.2
freight car 8.2
countryside 8.2
outdoors 8.2
decoration 8.2
village 8.2
car 8.2
religion 8.1
water 8
hut 7.9
ancient 7.8
sunny 7.8
houses 7.8
historical 7.5
site 7.5
snow 7.5
tourism 7.4
historic 7.3
design 7.3
scenery 7.2
wall 7.2
scenic 7
urban 7

Google
created on 2019-06-05

House 89.5
Building 79.5
Home 77.7
Almshouse 70.7
Residential area 68.8
Architecture 65.5
Cottage 60.8
History 54.1

Microsoft
created on 2019-06-05

outdoor 99.9
building 99.8
house 95.4
old 90.2
carriage 34.9
drawn 33.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-44
Gender Female, 50.5%
Sad 50.1%
Calm 49.6%
Disgusted 49.6%
Happy 49.6%
Confused 49.6%
Angry 49.6%
Surprised 49.5%

AWS Rekognition

Age 19-36
Gender Female, 50.5%
Sad 49.7%
Happy 49.8%
Disgusted 49.7%
Calm 49.6%
Angry 49.6%
Confused 49.6%
Surprised 49.6%

Feature analysis

Amazon

Person
Horse

Clarifai

House
Window
Person

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 96.1%

AWS Rekognition

Person 95.9%

AWS Rekognition

Person 93.9%

AWS Rekognition

Person 92.5%

AWS Rekognition

Person 92.5%

AWS Rekognition

Person 92.2%

AWS Rekognition

Person 91.4%

AWS Rekognition

Person 90.8%

AWS Rekognition

Person 88.4%

AWS Rekognition

Person 86.8%

AWS Rekognition

Person 82.9%

AWS Rekognition

Person 72.5%

AWS Rekognition

Person 70.1%

AWS Rekognition

Person 62.9%

AWS Rekognition

Person 43.6%

AWS Rekognition

Horse 75.3%

Clarifai

House 90.1%

Clarifai

House 79.6%

Clarifai

House 73.9%

Clarifai

Window 51.3%

Clarifai

Window 49.6%

Clarifai

Window 49%

Clarifai

Window 48.1%

Clarifai

Window 47.8%

Clarifai

Window 47.4%

Clarifai

Window 47.3%

Clarifai

Window 46.2%

Clarifai

Window 45.1%

Clarifai

Window 44%

Clarifai

Window 42.7%

Clarifai

Window 42.2%

Clarifai

Window 41.7%

Clarifai

Window 41.7%

Clarifai

Window 40.1%

Clarifai

Window 40%

Clarifai

Window 38.5%

Clarifai

Window 37.3%

Clarifai

Window 35.3%

Clarifai

Person 38.9%

Categories

Imagga
created on 2019-06-05

streetview architecture 99.8%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-19

a photograph of a group of people standing in front of a house

Created by general-english-image-caption-blip-2 on 2025-07-07

an old black and white photo of a group of people standing in front of a large house

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

This photograph features a street scene from the late 19th or early 20th century. It captures a group of children standing together in front of a large wooden building with horizontal siding, multiple windows adorned with shutters, and a wraparound elevated walkway. A small dog is visible near the group of children.

The central building appears to be a school, orphanage, or communal housing based on its size and design. It sits on a slightly elevated foundation, with a wooden ramp leading to the entrance. To the left is a smaller wooden house, while to the right is likely another residential building with ornate architectural details.

The foreground includes a wooden plank sidewalk crossing a grassy area with scattered debris and rubbish, suggesting a relatively modest, rural or small-town setting. Two adults stand off to the far right near the entrance of a different building. The overall tones are muted, characteristic of a black-and-white or sepia photograph, and the handwritten note "Sept. 3 12" suggests the photo was taken or labeled on that date in 1912.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image is a historical photograph, likely from the early 20th century, depicting a group of children standing in front of a large wooden building in an urban area. The building has a simple, rectangular shape with a pitched roof and shuttered windows, which are characteristic of that era. There is a wooden boardwalk in front of the children, and the surrounding area appears to be a bit dusty or unkempt, with grass and some debris scattered around. On the left, there's another building visible, and on the right, a smaller, more ornate structure. A few adults are also present, standing on and near stairs on the right side of the image. The writing in the top left corner, “Sept. 3, '12” suggests that the photograph was taken on September 3, 1912. The atmosphere of the image reflects a glimpse into an earlier time, with children dressed in period clothing, perhaps outside of a school or community building.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-11

The image appears to be a black and white photograph of a two-story wooden building with multiple windows and a porch. In front of the building, there is a group of people, mostly children, standing on a wooden platform or deck. The ground in front of the building is covered in grass and debris. The image has a historical feel, suggesting it was taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-11

This is a black and white historical photograph showing a large two-story wooden house with horizontal siding and shuttered windows. In front of the house is a wooden boardwalk or platform, and a group of what appears to be children are lined up along it. There's also a dog visible in the scene. The house has multiple chimneys and appears to be part of a row of similar houses, with other structures visible on either side. The architecture and style of the photograph suggests this was taken in the late 19th or early 20th century. The image has numbers "5/13" written in the top corner, possibly indicating a date or catalog reference. The ground appears somewhat bare and unlandscaped around the wooden walkways.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

The image is a vintage black-and-white photograph of a large, two-story house with a group of children standing in front of it. The house has a light-colored exterior and a dark roof, with several windows on both floors. A wooden walkway leads to the front door, which is located on the right side of the house.

In front of the house, a group of approximately 15 children are standing in a line, facing the camera. They are all dressed in dark clothing, with some wearing hats or caps. To the left of the children, a dog is visible, standing on the grassy area in front of the house.

On the right side of the image, another house is partially visible, with a few people standing on its porch. The background of the image shows a clear sky, suggesting that the photo was taken on a sunny day.

Overall, the image appears to be a historical photograph of a residential area, possibly from the early 20th century. The presence of children and a dog suggests a family-oriented community, while the architecture of the houses indicates a rural or suburban setting.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image is a black-and-white photograph of a large house with a group of children standing in front of it. The house has two stories, with a porch on the first floor and a deck on the second floor. There are several windows on both floors, and a chimney rises from the roof.

In front of the house, there is a group of about 15 children standing in a line. They appear to be dressed in old-fashioned clothing, with some wearing hats and others wearing coats. Some of the children are looking at the camera, while others are looking away.

To the left of the house, there is another building that appears to be a smaller house or a shed. In the background, there are several other houses and buildings visible, although they are not clearly defined.

The overall atmosphere of the image suggests that it was taken in the early 20th century, possibly in a rural or suburban area. The clothing and hairstyles of the children, as well as the style of the houses, are consistent with this time period.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-23

The black-and-white image shows a group of children standing in front of a building, possibly a school. The children are wearing hats and shoes, and some of them are holding hands. The building has a balcony with a railing and a staircase. There are two dogs standing in front of the building. The building has many windows, and there is a fence on the left side.

Created by amazon.nova-lite-v1:0 on 2025-05-23

The image appears to be a black-and-white photograph of a school building with children standing in front of it. The building has a wooden structure with several windows and a porch. Some people are standing on the porch, and a few are sitting on the railings. A dog is standing on the ground in front of the building. The image has a watermark with the date "5/13" in the upper left corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Impression:

The image is a sepia-toned photograph that appears to be from the late 19th or early 20th century. It depicts a group of people, primarily children, posing near a wooden building. The scene suggests a school or community center.

Details:

  • Buildings: The main structure is a large, two-story wooden building with a simple, gabled roof. It features multiple windows with shutters. A wooden ramp extends from the front entrance. To the left is a smaller building and to the right a multiple story building.
  • People: A group of boys, likely school-aged, are lined up near the building. They are dressed in dark coats and hats, typical of the era. In the doorway of the building is a person in a suit. There are other people standing by the building on the right.
  • Environment: The setting seems to be a somewhat overgrown area. There's a dirt area in front of the building, with a path made of wooden planks. Grass and weeds are visible. A small dog is in the background.
  • Tone: The photograph has a nostalgic, historical feel due to the monochrome tones, clothing styles, and the architecture.

In summary, the photograph offers a glimpse into the past, possibly a school or community setting in a late 19th or early 20th-century American town.

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

The image shows a group of people standing in front of a two-story building. There are trees in the background and the image appears to be taken from a slightly elevated position. The scene has a vintage feel, possibly a historical photograph of a school or public building.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image depicts a historical photograph of a group of people standing in front of a two-story wooden building. The building appears to be a school or a community center, given the presence of both adults and children. The structure has a simple, rectangular design with a pitched roof and multiple windows on both floors.

In front of the building, there is a wooden walkway or ramp leading up to the entrance, which is elevated above the ground level. This suggests that the area might be prone to flooding or that the building was constructed to be accessible despite uneven terrain.

The group of people consists of men, women, and children, all dressed in clothing typical of the late 19th or early 20th century. The men are wearing suits and hats, while the women are in long dresses. The children are also dressed formally, with the boys in suits and the girls in dresses. A dog is present in the scene, standing near the group.

To the left of the main building, there is another smaller wooden structure, possibly a house or an additional facility. The overall setting appears to be rural or semi-rural, with unpaved ground and sparse vegetation.

The photograph has a handwritten annotation in the upper left corner, which reads "54312," but the significance of this number is unclear without additional context. The image captures a moment in time, providing a glimpse into the social and architectural history of the period.

Qwen

No captions written

Text analysis

Amazon

010
IH5

Google

ПAIAA а2ЯЯ
ПAIAA
а2ЯЯ