Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Elizabeth Peabody House": Elizabeth Peabody House, Boston, Mass.

Date

c. 1903

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2985

Human Generated Data

Title

Social Settlements: United States. Massachusetts. Boston. "Elizabeth Peabody House": Elizabeth Peabody House, Boston, Mass.

People

Artist: Unidentified Artist,

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.2985

Machine Generated Data

Tags

Amazon
created on 2019-06-06

Human 97.1
Clinic 92.1
Text 68.3
Art 65.1
Advertisement 58
Indoors 57.6
Room 57.6
Hospital 55.8

Clarifai
created on 2019-06-06

retro 96.4
paper 95.8
blank 95.4
picture frame 93.9
desktop 93.7
old 93.2
art 92.8
people 92.4
empty 92
vintage 89.9
wear 86.9
no person 86.6
texture 86.1
nostalgia 85.9
antique 85.6
dirty 85.6
painting 84.7
design 84.2
museum 84.1
exhibition 83.6

Imagga
created on 2019-06-06

envelope 100
container 77.8
insulating material 47.3
paper 42.5
building material 35.7
grunge 32.4
old 28.6
texture 28.5
vintage 27.3
retro 27.1
card 26.8
blank 26.6
empty 23.2
message 22.9
post 22
antique 21.7
note 21.2
aged 19.9
letter 17.4
dirty 17.2
brown 16.9
document 16.7
frame 16.7
board 16.3
cardboard 15.4
design 14.9
page 14.9
business 14
stamp 13.9
ancient 13.8
postcard 13.4
postage 12.8
mail 12.5
space 12.4
grungy 12.3
textured 12.3
office 12.1
border 11.8
pattern 11.6
carton 11.4
text 11.4
art 11.1
postal 10.8
yellow 10.6
parchment 10.6
damaged 10.5
old fashioned 10.5
box 10.3
money 10.2
decorative 10
backgrounds 9.7
faded 9.7
worn 9.6
symbol 9.4
write 9.4
sheet 9.4
currency 9
copy 8.9
correspondence 8.8
advertising 8.6
travel 8.5
wallpaper 8.4
communication 8.4
banner 8.3
rough 8.2
map 8.2
collection 8.1
bank 8.1
world 8
ragged 7.8
reminder 7.8
notice 7.8
rusty 7.6
finance 7.6
horizontal 7.5
sign 7.5
savings 7.5
cash 7.3
earth 7.3
global 7.3
color 7.2
material 7.2

Google
created on 2019-06-06

Photograph 95.4
Text 93.7
Snapshot 82.5
Room 71.4
Font 68.6
Art 67.7
Paper 62.8
History 60.4
Illustration 60.2
Stock photography 59.4
Collection 57.1

Microsoft
created on 2019-06-06

person 95.4
gallery 86.9
clothing 81.6
scene 77.1
book 52.3
room 50
envelope 49.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 10-15
Gender Female, 50.5%
Calm 49.8%
Confused 49.5%
Happy 49.7%
Surprised 49.6%
Angry 49.7%
Disgusted 49.5%
Sad 49.7%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%
Calm 49.6%
Sad 50.3%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.7%
Happy 49.5%
Disgusted 49.5%
Confused 49.7%
Calm 49.8%
Surprised 49.6%
Sad 49.6%

AWS Rekognition

Age 14-23
Gender Female, 50.2%
Confused 49.5%
Disgusted 49.6%
Angry 49.6%
Calm 49.8%
Sad 49.8%
Happy 49.6%
Surprised 49.6%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Sad 50.4%
Confused 49.5%
Calm 49.5%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 27-44
Gender Female, 50.5%
Angry 49.6%
Calm 49.9%
Disgusted 49.5%
Surprised 49.5%
Sad 49.8%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Male, 50.2%
Confused 49.6%
Angry 49.6%
Disgusted 49.5%
Calm 49.8%
Happy 49.5%
Surprised 49.6%
Sad 49.9%

Feature analysis

Amazon

Person

Clarifai

Table
Clothing
Person
Human face
Picture frame

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 88.9%

AWS Rekognition

Person 86.7%

AWS Rekognition

Person 86.4%

AWS Rekognition

Person 85.4%

AWS Rekognition

Person 79.9%

AWS Rekognition

Person 74%

AWS Rekognition

Person 73.8%

AWS Rekognition

Person 72.6%

AWS Rekognition

Person 56.7%

Clarifai

Table 79.1%

Clarifai

Table 75.8%

Clarifai

Table 49.9%

Clarifai

Table 45.3%

Clarifai

Clothing 77.3%

Clarifai

Clothing 62.6%

Clarifai

Clothing 55.7%

Clarifai

Clothing 52.7%

Clarifai

Clothing 51.9%

Clarifai

Clothing 51%

Clarifai

Clothing 50.9%

Clarifai

Clothing 50.6%

Clarifai

Clothing 50%

Clarifai

Clothing 47.8%

Clarifai

Clothing 47.1%

Clarifai

Person 58.6%

Clarifai

Person 58.1%

Clarifai

Person 58.1%

Clarifai

Person 56.8%

Clarifai

Person 49.6%

Clarifai

Person 40.9%

Clarifai

Person 39.5%

Clarifai

Person 37.8%

Clarifai

Human face 38.2%

Clarifai

Human face 35.5%

Clarifai

Picture frame 33.8%

Categories

Imagga
created on 2019-06-06

text visuals 64.7%
paintings art 34.9%

Captions

Microsoft
created by unknown on 2019-06-06

a vintage photo of a computer 37.4%
a vintage photo of a person 32%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people in a kitchen with a stove and a stove

Created by general-english-image-caption-blip-2 on 2025-07-07

two photographs of people in a kitchen and dining room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image is a sepia-toned photograph printed on a matte sheet showcasing two separate scenes from the Elizabeth Peabody House in Boston, Massachusetts. The text “Elizabeth Peabody House, Boston, Mass.” is printed at the top center of the sheet.

On the left, titled "Clay Modeling," there is a group of young girls seated around a table engaged in an arts and crafts activity, working with clay. They are wearing aprons and are focusing on their tasks, suggesting a hands-on learning environment. The room appears to have shelves and decorations, including framed pictures, and has a warm and cozy atmosphere.

On the right, titled "Cooking Class," there is a group of young girls in a kitchen setting. They are standing around a table, preparing food or actively participating in a cooking lesson. All of the figures are wearing aprons. Visible in the room are kitchen-related furniture and tools, such as pots, a stove, and a kettle.

These images depict educational activities for children held in the Elizabeth Peabody House, promoting practical skills like arts and crafts and cooking.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image comprises two sepia-toned photographs mounted on a single sheet representing scenes from the Elizabeth Peabody House in Boston, Massachusetts.

The photograph on the left is labeled "Clay Modeling" and depicts a group of young girls gathered around a table. They are all focused on clay modeling activities. The girls are seated and standing around the table, working on what appear to be clay objects. Everyone is wearing similar dark-colored attire with aprons.

The photograph on the right is labeled "Cooking Class" and shows a scene of six women or older girls in a kitchen setting. They are standing around a table, which has various cooking items on it. The women are dressed in what appears to be uniforms, consisting of long-sleeved tops and aprons. The room has a large stove and some cooking utensils visible.

The top of the image has a label for "Elizabeth Peabody House, Boston, Mass." suggesting that these activities are part of the programming at this institution.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows two photographs depicting scenes from the Elizabeth Peabody House in Boston, Massachusetts.

The left photograph shows a group of people engaged in a clay modeling activity, seated around a table in what appears to be a classroom or workshop setting. The right photograph shows a group of people seated around a table, seemingly participating in a cooking class or demonstration in a kitchen-like environment.

The photographs provide a glimpse into the educational and vocational activities taking place at the Elizabeth Peabody House, an institution that likely played a role in the lives of the individuals depicted.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a historical photograph showing two different activities at the Elizabeth Peabody House in Boston, Massachusetts. The image is divided into two sepia-toned photographs:

On the left is a "Clay Modeling" class, showing a group of students seated around a large table, working on their clay projects. They appear to be wearing light-colored aprons or smocks while they work.

On the right is a "Cooking Class" scene, showing several people in long dresses and aprons gathered around a table in what appears to be a kitchen setting. There's a stove visible in the background, along with various kitchen implements.

Both photographs appear to be from the early 1900s, based on the clothing styles and photographic quality. The Elizabeth Peabody House was a settlement house that provided educational and social services to immigrant communities in Boston during this period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image presents a vintage photograph of two sepia-toned images, each depicting a group of women engaged in distinct activities within a room. The photographs are arranged side by side on a white background, with the title "Elizabeth Peabody House, Boston, Mass." written above them in black text.

  • Left Image: Clay Modeling
    • The left image shows a group of women gathered around a table, engaged in clay modeling. They are all dressed in white aprons and appear to be focused on their work.
    • The room is well-lit, with natural light pouring in through the windows. The walls are adorned with various objects, including a painting and a vase.
    • The atmosphere is one of creativity and collaboration, as the women work together to shape and mold the clay into various forms.
  • Right Image: Cooking Class
    • The right image depicts a group of women standing around a table, participating in a cooking class. They are all dressed in white aprons and appear to be engaged in a lively discussion.
    • The room is equipped with various cooking utensils and ingredients, suggesting that the women are learning how to prepare a meal together.
    • The atmosphere is one of camaraderie and shared learning, as the women work together to prepare a delicious dish.

In summary, the image showcases two photographs of women engaging in creative and practical activities within a shared space. The left image highlights the importance of collaboration and creativity, while the right image emphasizes the value of shared learning and community building.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a sepia-toned photograph of two scenes, each depicting a group of women engaged in different activities. The left scene shows a group of women gathered around a table, with one woman standing and the others seated, all wearing aprons. The right scene depicts a group of women standing in a kitchen, also wearing aprons, with various cooking utensils and equipment visible.

At the top of the image, the text "Elizabeth Peabody House, Boston, Mass." is written in black font. Below this, the words "Clay Modeling" are handwritten in cursive on the left side, while "Cooking Class" is written on the right side. The background of the image features a light-colored wall or paper, with a dark border surrounding it. Overall, the image appears to be a vintage photograph showcasing the activities of women at the Elizabeth Peabody House in Boston, Massachusetts.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The image is a photograph of two separate scenes. The image is sepia-toned, giving it an old-fashioned look. The top of the image contains a label that reads "Elizabeth Peabody House, Boston, Mass." Below the label are two photographs. The photograph on the left shows a group of women in a room with a table in the middle. They are wearing aprons and appear to be engaged in an activity. The photograph on the right shows a group of women in a kitchen. They are also wearing aprons and are standing around a table with various kitchen items on it.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a sepia-toned photograph featuring two distinct scenes. On the left side, it shows a group of women engaged in clay modeling, seated around a table, with one woman standing and guiding them. The scene is set in a room with a fireplace, picture frames on the wall, and a window. On the right side, it depicts a group of women in aprons, engaged in a cooking class. They are around a table, with one woman standing and another holding a bowl. The room has a stove, a shelf, and a clock on the wall. Both scenes are labeled at the bottom with "Clay Modeling" and "Cooking Class," respectively. The image also includes a header at the top with the text "Elizabeth Peabody House, Boston, Mass."

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

The image is a two-panel photograph, presented on a larger tan-colored matte. The top of the matte reads "Elizabeth Peabody House, Boston, Mass." in a simple font. Above the right-hand panel is some handwritten text, partially visible.

  • Left Panel: Clay Modeling This panel shows a classroom setting. A group of young women or girls are gathered around tables, seemingly working with clay. A woman, possibly a teacher or instructor, stands near the group. The room has a warm, slightly sepia tone, and there is a fireplace and artwork visible on the wall.

  • Right Panel: Cooking Class This panel depicts a cooking class. Several women, most of whom are wearing aprons or white dresses, are gathered around a table with cooking utensils and possibly ingredients. There is a stove and other cooking equipment visible in the background. The room has a similar warm tone and appears to be a domestic setting.

The entire image has a historical feel.

Created by gemini-2.0-flash on 2025-05-05

Here is a description of the image:

The image is a sepia-toned, scanned document or photograph, presenting two distinct scenes from the Elizabeth Peabody House in Boston, Massachusetts. Above the two images, the text reads "Elizabeth Peabody House, Boston, Mass." in a simple, sans-serif font.

To the left, a group of girls, some wearing aprons, are gathered around a rectangular table, deeply engaged in a "Clay Modeling" class. The room is filled with various items displayed on shelves and framed pictures hanging on the walls. A picture rests above a fireplace. The girls are positioned in various angles around the table, with some seated on chairs and others standing.

To the right, another group of women, some adorned in white aprons, are participating in a "Cooking Class." They surround a table filled with kitchen utensils and ingredients. In the backdrop is wallpaper with a patterned design and additional framed pictures on the wall. Next to the table, an old-fashioned stove is visible, complete with pots and pans, signifying the cooking activity.

In the upper right corner, there's a small, handwritten note or code, and beneath each image, the names of the activities: "Clay Modeling" and "Cooking Class," respectively. The images appear to be from a historical record, possibly a collection or report documenting the activities at the Elizabeth Peabody House. The layout suggests a presentation or catalog format.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image shows two photographs depicting activities at the Elizabeth Peabody House in Boston, Massachusetts. The photographs are labeled "Clay Modeling" and "Cooking Class."

  1. Clay Modeling (Left Photograph):

    • A group of children and a teacher are gathered around a table, engaged in a clay modeling activity.
    • The children appear to be working on individual clay projects, with the teacher providing guidance and instruction.
    • The room is well-lit, with shelves and cabinets in the background, suggesting it is a classroom or workshop space.
  2. Cooking Class (Right Photograph):

    • A small group of children and an instructor are participating in a cooking class.
    • The children are wearing aprons and are seated at a table, likely preparing or handling food.
    • The instructor is standing near the table, possibly demonstrating or supervising the activity.
    • The setting includes a stove and kitchen utensils, indicating a practical cooking environment.

Both photographs capture educational and hands-on activities aimed at teaching children practical skills in a structured setting at the Elizabeth Peabody House.

Qwen

No captions written

Text analysis

Amazon

Elizabeth
Peabody
Boston,
Elizabeth Peabody House, Boston, Mass.
House,
Mass.
Modeting
Cloy
Cloy Modeting Coong
Coong
G Se19o

Google

G S Elizabeth Peabody House, Boston, Mass. Cloy Modeling Cookng Claas
G
S
Elizabeth
Peabody
House,
Boston,
Mass.
Cloy
Modeling
Cookng
Claas