Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.413

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. Hale House: Hale House, Boston, Mass.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.413

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Human 98.4
Advertisement 88
Poster 87.7
Art 76.9
Apparel 76.4
Clothing 76.4
Text 72.2
Collage 70
Paper 69.2
Photography 65.4
Photo 65.4
Face 65
Portrait 65
Brochure 61.9
Flyer 61.9
People 61.4
Building 60.8
Housing 60.8

Clarifai
created on 2019-06-05

no person 98.8
empty 96.9
retro 96.1
painting 95.6
museum 94.6
picture frame 94
art 93.7
nostalgia 92
blank 90.6
people 88.8
paper 87.2
nature 86.6
graphic design 86.1
exhibition 85.7
dirty 85.4
illustration 82.4
desktop 82.4
old 80.7
moment 80
indoors 79.3

Imagga
created on 2019-06-05

envelope 77.7
container 47.8
paper 41.9
blank 36.9
web site 36.8
card 34.8
frame 33.4
message 28.3
insulating material 27.3
note 26.7
empty 24.9
border 24.4
board 20.9
design 20.8
business 20.7
building material 20.5
template 17.4
sign 16.6
post 16.2
office 16.1
pattern 15.1
letter 14.7
old 14.6
communication 14.3
vintage 14.1
space 14
retro 13.9
page 13.9
decoration 13.8
copy 13.3
text 13.1
letterhead 12.8
symbol 12.8
stationery 12.5
write 12.2
greeting 12.1
banner 12
aged 11.8
art 11.7
modern 11.2
texture 11.1
scrapbook 10.7
happy 10.7
invitation 10.6
grunge 10.2
document 10.2
element 9.9
holding 9.9
album 9.7
creative 9.7
reminder 9.7
poster 9.5
sheet 9.4
black 9
stamp 8.8
correspondence 8.8
advertising 8.6
mail 8.6
leaf 8.6
collection 8.1
brown 8.1
graphic 8
textured 7.9
holiday 7.9
antique 7.8
layout 7.8
postcard 7.7
clean 7.5
label 7.5
cover 7.4
man 7.4
notebook 7.4
object 7.3
present 7.3
home 7.2
school 7.2
icon 7.1
idea 7.1

Google
created on 2019-06-05

Microsoft
created on 2019-06-05

gallery 99.9
scene 99.8
room 99.1
wall 97.1
indoor 96.4
posing 95.5
painting 92.7
office 69.9
picture frame 62.2
decorated 59.5
person 58.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 17-27
Gender Female, 50.3%
Happy 49.5%
Sad 49.8%
Angry 49.5%
Surprised 49.5%
Calm 50.1%
Confused 49.5%
Disgusted 49.5%

Feature analysis

Amazon

Person

Clarifai

Tree
Person
Window
Picture frame
Clothing
Human head

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 92.9%

AWS Rekognition

Person 86.7%

AWS Rekognition

Person 82.6%

AWS Rekognition

Person 82.1%

AWS Rekognition

Person 68.2%

AWS Rekognition

Person 66.7%

AWS Rekognition

Person 56.1%

Clarifai

Tree 87.1%

Clarifai

Tree 68.5%

Clarifai

Tree 56.3%

Clarifai

Tree 42.7%

Clarifai

Person 69.6%

Clarifai

Person 66.1%

Clarifai

Person 63.1%

Clarifai

Person 59.9%

Clarifai

Person 43.1%

Clarifai

Person 42.5%

Clarifai

Person 42.4%

Clarifai

Person 40.1%

Clarifai

Person 37.9%

Clarifai

Window 57.4%

Clarifai

Window 54.7%

Clarifai

Window 45.5%

Clarifai

Window 43.2%

Clarifai

Window 42.4%

Clarifai

Window 40.1%

Clarifai

Window 36.1%

Clarifai

Window 34.8%

Clarifai

Window 33.8%

Clarifai

Window 33.1%

Clarifai

Picture frame 41.8%

Clarifai

Picture frame 39.7%

Clarifai

Clothing 35.7%

Clarifai

Clothing 34.2%

Clarifai

Clothing 34%

Clarifai

Human head 33.5%

Categories

Imagga
created on 2019-06-05

paintings art 95.9%
text visuals 3.4%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-05

a book with pictures of people in the park

Created by general-english-image-caption-blip on 2025-05-19

a photograph of a group of people standing around a group of people

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

This image features a gray backing with three black-and-white photographs mounted on it. The title "Hale House, Boston, Mass." appears at the top center.

  1. Top Left Photo: Labeled underneath as "The Playground, A round lot," it shows children playing around a tall central pole, with ribbons extending from the pole. They appear to be participating in a coordinated activity, possibly a maypole dance. The setting looks like a yard surrounded by buildings.

  2. Top Right Photo: Depicts a group of people seated outdoors amidst a wooded area. They are gathered together in a relaxed manner, suggesting a leisurely outing or picnic. The caption below reads "In the Country."

  3. Bottom Right Photo: Shows four individuals seated in tall grass or shrubs in a natural environment. They are dressed in formal attire, which contrasts with their outdoor setting. This photo is also captioned "In the Country," tying together the theme of countryside outings.

The photos collectively highlight moments of recreation and relaxation associated with Hale House, Boston.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image is a historical photograph collage mounted on a gray board labeled "Hale House, Boston, Mass." It features three separate black-and-white photographs.

The largest photograph on the left side depicts a group of children participating in a traditional Maypole dance. They are outdoors, in a playground setting marked as "The Playground; A round lot." The children are arranged in a circle around the Maypole, holding onto ribbons extending from the top of the pole, and appear to be in casual clothing indicative of the early 20th century.

To the right are two smaller photographs arranged vertically.

The top smaller photograph shows a group of people seated together on a picnic blanket in a woodland or country setting. The description beneath this photo reads "In the Country." They are gathered among trees, suggesting leisure or an outing, possibly as part of a community or family event.

The bottom smaller photograph captures a group of individuals sitting in a slightly more rugged country environment, with bushes or natural foliage visible. This image also features the caption "In the Country," reinforcing the idea of these being outdoor recreational or social scenes.

Together, these images reflect elements of community life or social recreation associated with Hale House in Boston, Massachusetts, during this period.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-11

The image appears to be a collage of three black and white photographs. The top photograph shows a crowded urban street scene with people walking on a raised wooden walkway. The middle photograph shows a group of people sitting outdoors in a wooded area, likely picnicking or relaxing. The bottom photograph shows a group of people, likely men, standing together in a rural outdoor setting. The overall collage is titled "Hale House, Boston, Mass."

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-11

This is a historical album page titled "Hale House, Boston, Mass." containing three black and white photographs. The largest photo on the left shows children playing what appears to be a maypole game in a playground, with ribbons or ropes extending from a central point. The image is labeled "The Playground." The two smaller photos on the right appear to be outdoor scenes - the top one shows a group of people in a wooded setting, and the bottom one labeled "In the Country" shows a small group in what looks like a rural or pastoral setting. All the photos appear to be from the early 1900s based on the clothing styles and photographic quality.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

The image depicts a page from an old photo album or scrapbook, featuring three black-and-white photographs. The top-left photograph shows children playing with a maypole in a courtyard, while the top-right photograph depicts people sitting on the ground in a wooded area. The bottom-right photograph appears to be a group of people posing for a photo.

The page has a beige background and features handwritten text at the top that reads "Hale House, Boston, Mass." There are also captions below each photograph, although they are too small to read clearly. The overall atmosphere of the image suggests a nostalgic and historical feel, likely dating back to the early 20th century.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image is a vintage photograph collage featuring three black-and-white images, each with a white border, arranged on a beige background. The top-left image shows children playing with a large, circular, rope-like structure in a schoolyard, while the top-right image depicts a group of people in a wooded area. The bottom-right image features two men standing together in front of a wooded backdrop.

The collage includes handwritten captions and labels, including "Hale House, Boston, Mass." at the top, "The Playground" below the left image, and "In the Country" below the right image. The overall atmosphere suggests a nostalgic and educational setting, possibly from a historical or cultural context.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-23

The image is a black-and-white photograph with a sepia filter. It features three smaller photographs arranged on a page. The top left photograph shows a group of people standing in a circle holding a maypole. The top right photograph shows a group of people sitting on a rock in the forest. The bottom photograph shows a group of people standing in a field. The photographs are labeled with the text "Hale House, Boston, Mass."

Created by amazon.nova-lite-v1:0 on 2025-05-23

The image shows a collage of three photographs attached to a beige-colored background. The first photograph on the left is labeled "Hale House, Boston, Mass." and depicts a group of people standing in front of a building, possibly engaged in a traditional dance or activity. The second photograph in the middle is labeled "In the Country" and shows a group of people sitting on the ground in a natural setting, possibly a forest or park. The third photograph on the right is labeled "The Playground" and shows a group of people standing in front of a building, possibly a playground or recreational area. The collage appears to be a collection of photographs taken at different locations, possibly showcasing the activities and lifestyle of people in Boston, Massachusetts, during a specific time period.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-29

This is a page from an old photo album, showcasing a collection of photographs. The album is a muted gray color.

The main photograph on the page is a larger one on the left, showing a group of children dancing around a maypole in what appears to be a playground in a vacant lot. The children, dressed in various outfits, are holding ribbons attached to the pole. The background reveals buildings.

There are two smaller photographs. The top one shows a group of people, presumably women, sitting and gathering in a forest setting. The bottom photograph features a group of men, dressed in more formal attire, standing in a somewhat overgrown outdoor setting.

The caption "Hale House, Boston, Mass." indicates the location where the photographs were taken. There is text associated with the images, labeling the first image as "The Playground a vacant lot" and the second as "In the Country."

Created by gemini-2.0-flash on 2025-04-29

The image is a page from an old photograph album, with a gray background and three black-and-white photos mounted on it. The title at the top of the page reads, "Hale House, Boston, Mass."

The largest photo, positioned on the left side of the page, shows a group of children and adults in what is labeled "The Playground a vacant lot." They appear to be performing a maypole dance, with long ribbons attached to a tall pole in the center. The buildings in the background suggest an urban setting.

Two smaller photos are placed to the right of the first one. The upper one depicts a group of people, mainly women and children, seated on a rock or hill in a wooded area. The lower photo shows a group of five young boys standing together in a field or forest. The caption below this photo reads, "In the Country."

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image is a vintage photograph album page from Hale House, Boston, Massachusetts. It features three black-and-white photographs.

  1. The Playground (a recent lot):

    • The first photograph shows a group of children playing in a playground. The playground appears to be set up in a vacant lot, as indicated by the caption.
    • Children are engaged in various activities, and a few adults are supervising them.
    • The background shows buildings, suggesting an urban setting.
  2. In the Country:

    • The second photograph depicts a group of people in a wooded area.
    • They are sitting and standing among trees and foliage, indicating a more rural or natural setting.
    • The group seems to be enjoying a leisurely outing or picnic.
  3. In the Country (lower image):

    • The third photograph also shows a group of people in a rural setting.
    • They are standing and sitting near a rocky area, possibly by a stream or river.
    • The group appears to be enjoying the outdoors, dressed in casual attire suitable for a day in the countryside.

The photographs capture moments of leisure and recreation, both in urban and rural environments, reflecting the social and community activities associated with Hale House in Boston during that time.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a photograph album page, likely from the early 20th century, featuring multiple black-and-white photographs. The title at the top of the page reads "Hale House, Boston, Mass." The photos are labeled with descriptive captions below them.

  1. The largest photo on the left is labeled "The Playground. A vacant lot." It shows a group of children playing with a large, stringed game, possibly a game of "cat's cradle" or a similar string game. They are outdoors, on a dirt ground, and the setting appears to be a vacant lot or a temporary playground.

  2. The top right photo is labeled "In the Country." It shows a group of adults and children sitting on a rock in a wooded area, likely in a rural or park-like setting.

  3. The bottom right photo is also labeled "In the Country." It features a group of children standing together outdoors, possibly posing for the photograph. They appear to be in a natural, outdoor environment, similar to the scene in the "In the Country" photo above.

The overall theme of the page seems to document life and activities at Hale House, possibly a children's home or an institution, with a focus on the children's play and outdoor experiences.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This image is a scanned page from an old photo album or scrapbook featuring three black-and-white photographs. The page is labeled "Hale House, Boston, Mass." at the top.

  1. The left photograph is titled "The Playground, A vacant lot." It shows a group of children and adults engaged in outdoor activities, possibly a game involving ropes, on a dirt surface in front of a building that appears to be Hale House.

  2. The top-right photograph is not labeled but shows a group of people, including children, sitting on a grassy area near trees. They appear to be posing for the picture.

  3. The bottom-right photograph is titled "In the Country." It features a group of four children standing together, dressed in hats and clothing typical of the early 20th century. The background includes trees and a natural setting.

The overall layout and style of the photographs suggest they were taken in the early 1900s.

Text analysis

Amazon

Boston,
Hale
House,
Hale House, Boston, Mass.
Mass.
the
in the coundry
in
coundry
I

Google

G S 29- Hale House, Boston, Mass. Aacnf lot In the Coundry
G
S
29-
Hale
House,
Boston,
Mass.
Aacnf
lot
In
the
Coundry