Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States

Date

c. 1895

People

Artist: James E. West, American active 1890s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.20

Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States

People

Artist: James E. West, American active 1890s

Date

c. 1895

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.20

Machine Generated Data

Tags

Amazon
created on 2022-06-03

Human 99.7
Clothing 89.4
Apparel 89.4
Text 80.3
Advertisement 70.8
Face 66.8
Art 63.6
Page 62.5
Portrait 60.1
Photography 60.1
Photo 60.1
Collage 55.3

Clarifai
created on 2023-10-29

people 99.7
man 98.8
two 98.7
no person 98.6
wear 98.3
woman 97.2
one 97.1
adult 96
print 95.8
group 94.6
painting 94.4
art 94
paper 93.2
retro 93.1
three 92.8
child 91.9
portrait 91.4
outerwear 89.8
outfit 88.9
war 88.8

Imagga
created on 2022-06-03

sketch 37.7
drawing 35.4
representation 23.9
people 21.2
dress 20.8
fashion 20.3
boutique 19.6
adult 19.5
berry 18.8
model 17.9
book jacket 17.7
sexy 16.9
sensuality 16.3
black 16.2
attractive 15.4
clothing 15.3
body 15.2
hair 15
face 14.9
portrait 14.9
edible fruit 14.8
costume 14.5
elegance 14.3
posing 14.2
person 14.2
jacket 13.9
women 13.4
human 12.7
art 11.8
wrapping 11.4
make 10.9
man 10.7
design 10.7
pretty 10.5
culture 10.2
covering 10.1
cute 10
lady 9.7
style 9.6
color 9.4
sensual 9.1
cartoon 8.9
celebration 8.8
symbol 8.8
elegant 8.6
slick 8.4
traditional 8.3
holding 8.2
blond 8.2
fruit 8.1
bride 8.1
lovely 8
smiling 8
flowers 7.8
male 7.8
party 7.7
silk 7.7
old 7.7
grunge 7.7
hairstyle 7.6
happy 7.5
fun 7.5
silhouette 7.4
vintage 7.4
clip art 7.4
event 7.4
dance 7.2
religion 7.2
creation 7.1

Google
created on 2022-06-03

Microsoft
created on 2022-06-03

text 99.3
person 93.9
clothing 93.8
dress 86.1
woman 82.4
room 68.9
poster 67.8
gallery 67.2
old 49.4
screenshot 15.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 73-83
Gender Male, 100%
Happy 93.2%
Surprised 7%
Fear 5.9%
Calm 4.7%
Sad 2.2%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 43%
Happy 24.4%
Sad 11.1%
Surprised 8%
Confused 7.9%
Fear 6.4%
Angry 6%
Disgusted 2.1%

AWS Rekognition

Age 27-37
Gender Male, 100%
Calm 56.9%
Sad 18.1%
Confused 12.1%
Surprised 9.9%
Fear 6.9%
Angry 2.9%
Disgusted 2%
Happy 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster

Clarifai

Tree
Man
Clothing
Footwear
Human face

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 97.2%

AWS Rekognition

Person 96.7%

AWS Rekognition

Poster 50.5%

Clarifai

Tree 71.1%

Clarifai

Tree 65.5%

Clarifai

Tree 52.2%

Clarifai

Tree 43.8%

Clarifai

Man 68.8%

Clarifai

Man 55%

Clarifai

Clothing 65.9%

Clarifai

Footwear 63.4%

Clarifai

Footwear 51.6%

Clarifai

Footwear 51.2%

Clarifai

Footwear 48.8%

Clarifai

Human face 60.1%

Clarifai

Human face 41.5%

Clarifai

Human face 40.9%

Categories

Imagga
created on 2022-06-03

paintings art 98.8%
text visuals 1.1%

Captions

Microsoft
created by unknown on 2022-06-03

a vintage photo of a person 66.7%
a vintage photo of a person in a room 66.6%
a vintage photo of a store 56.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-01

three photographs of people in a garden with a woman in a dress and a man in a suit

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a book opened to show a couple of people

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image is a historical triptych composition featuring three photographs depicting members of Shaker Communities in the United States.

  • The left photograph shows a person standing outside on grass, dressed in simple clothing and holding a manual push mower in a garden setting. A hedge and part of a building are visible in the background.

  • The central photograph portrays a figure seated indoors in a wooden rocking chair wearing traditional Shaker attire, with a small box or object placed on the ground beside them. The setting includes a wall-mounted picture frame and a simple lamp.

  • The right photograph features another individual standing outdoors on a pathway, holding tools or wooden objects. The person is dressed in long, simple garments and a hat. The background includes a fence, trees, and buildings.

A caption in the center reads "Shaker Communities, United States," and labels below provide identification of each individual and their roles or names.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a sepia-toned triptych photograph featuring three different scenes or individuals associated with Shaker communities in the United States. The left panel shows a person standing on a grassy lawn holding an old-fashioned push mower. In the background, there are trees and a glimpse of a house. The middle panel depicts an individual sitting in a rocking chair indoors, holding a small book or pamphlet. The room has simple, modest furnishings, which align with Shaker simplicity. The right panel displays a person standing on a path with a grassy area beside them, holding a scythe and wearing a wide-brimmed hat. A white picket fence can be seen in the background, along with a building and some trees. The panels are labeled "I," "II," and "III," corresponding to the names and titles listed below the images: Elder Daniel Offord, Sister Eliza Johnson (in Shaker chair), and Brother Charles Greaves.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-10

The image shows three photographs depicting members of the Shaker communities in the United States. The first photograph shows an elderly man with a long beard working in a garden with a lawn mower. The second photograph shows a woman in traditional Shaker dress sitting in a chair. The third photograph shows an elderly man with a long beard walking outside. The image is titled "Shaker Communities, United States" and provides captions identifying the individuals shown.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-10

The image shows three black and white photographs of elderly individuals from Shaker communities in the United States. The first photograph depicts an elderly man mowing a lawn with a push mower. The second shows an elderly woman sitting in a chair, wearing a long dress and bonnet. The third photograph captures an elderly man with a long beard standing outside a building. The caption below the photographs reads "I. Elder Daniel Offord, II. Sister Eliza Bowers (In Shaker chair), III. Brother Charles Greaves".

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-10

This is a historical photograph showing three members of a Shaker community in the United States. The image is presented as a triptych (three separate photos) mounted on a light-colored background. The left photo shows a person with a lawn mower in an outdoor setting. In the center, there's a person seated in what's noted as a "Shaker chair" wearing traditional long dress and bonnet in an indoor setting. The right photo shows another person standing outdoors. The photos appear to be from the late 19th or early 20th century, given their sepia tone and the style of dress and equipment shown. The title at the top reads "Shaker Communities, United States."

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a vintage photograph of three men, likely taken in the early 20th century. The photograph is divided into three sections, each featuring a different man.

  • The first section shows a man standing in a yard, wearing a hat and holding a lawn mower. He has a long white beard and is dressed in a suit and tie.
  • The second section depicts a man sitting in a chair, wearing a long robe and holding a book. He also has a long white beard and appears to be an older man.
  • The third section shows a man standing in a yard, wearing a hat and holding a large piece of wood. He has a long white beard and is dressed in a suit and tie.

The background of the photograph is a light-colored wall with a window and a door. There are also some trees and bushes visible in the background.

Overall, the photograph appears to be a formal portrait of three men, possibly taken for a family album or as part of a community project. The men's clothing and hairstyles suggest that the photograph was taken in the early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

This image presents a triptych of sepia-toned photographs, each featuring a member of the Shaker community in the United States. The central panel showcases a woman seated in a Shaker chair, while the left and right panels depict men engaged in outdoor activities.

Central Panel:
The central photograph features a woman seated in a Shaker chair, with her hands resting on the armrests. She is attired in traditional Shaker clothing, including a long dress and a head covering. The background of the image appears to be an interior setting, possibly a room within a Shaker dwelling.

Left Panel:
The left photograph captures a man standing in a yard, holding a scythe or sickle. He is dressed in casual attire, consisting of a jacket, pants, and a hat. The background of the image reveals a well-manicured lawn, suggesting that the man is engaged in gardening or agricultural activities.

Right Panel:
The right photograph portrays a man standing on a sidewalk, holding a tool that resembles a rake or hoe. He is attired in a long coat and hat, and the background of the image features a building and trees, indicating that he is likely working in a garden or yard.

Caption:
Below the central photograph, a caption provides information about the individuals depicted in the images. The caption reads:

  1. Elder Daniel Offord
  2. Sister Eliza Boyson (In Shaker chair)
  3. Brother Charles Greaves

This caption suggests that the photographs are part of a larger collection or album documenting the lives and activities of Shaker community members.

Overall:
The triptych of photographs offers a glimpse into the daily lives and traditions of the Shaker community in the United States. The images showcase the community's emphasis on simplicity, hard work, and self-sufficiency, as well as their unique cultural practices and attire.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

Three black-and-white photographs are displayed on a beige background. The first image shows an elderly man holding a lawn mower, with a fence and trees in the background. The second image depicts a woman sitting in a chair, with a plant and picture frame on the wall behind her. The third image shows a man standing in a yard, holding a wooden stick, with a house and trees in the background. The images are labeled "I," "II," and "III," and the text "Shaker Communities, United States" is written at the top.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image shows a photo album with three photographs. The first photograph features a man wearing a hat and holding a lawn mower. The second photograph shows a woman sitting in a chair. The third photograph shows a man standing in front of a house. All three photographs have labels with names and descriptions. The album is open to the page with the three photographs, and the page has a white border.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

This sepia-toned photograph is a triptych depicting three portraits of individuals associated with the Shaker communities in the United States.

The first panel (I) shows Elder Daniel Offord, standing outdoors, holding a push lawn mower. He is wearing a hat, suit, and has a long beard. Behind him is a manicured lawn, trees, and a building.

The second panel (II) features Sister Elisa Royson sitting in a Shaker chair, indoors. She wears a long, flowing dress and a shawl. Decorative items are visible in the background.

The third panel (III) presents Brother Charles Greaves outdoors, standing in a yard, wearing a suit, hat, and holding objects that appear to be related to carpentry or gardening. Behind him are trees, a fence, and a building.

The photos are mounted on a light-colored card and labeled. The title "Shaker Communities, United States" appears across the top of the center panel.

Created by gemini-2.0-flash on 2025-04-30

Here is a description of the image:

This image is a composite featuring three sepia-toned photographs mounted on a cream-colored card. The top of the central panel is labeled "Shaker Communities, United States."

  • Left Panel (I): A full-length portrait of an older man, identified as "Elder Daniel Offord," wearing a suit, hat, and a full beard. He is holding a push lawn mower, standing on a grassy lawn with trees and a house in the background.
  • Center Panel (II): A full-length portrait of an older woman, identified as "Sister Elisa Royson (In Shaker chair)." She is sitting in a rocking chair indoors, with a table, decorations, and paintings on the wall behind her. A footstool sits at the base of the chair.
  • Right Panel (III): A full-length portrait of an older man, identified as "Brother Charles Greaves." He is standing on a pathway next to a grassy area and a house in the background. He is dressed in a suit and hat, and he is holding what appears to be a fishing rod and reel.

Beneath the three panels, there is a description of each portrait, providing the names of the individuals. The overall composition gives a glimpse into the lives of members of the Shaker community.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-29

The image depicts three individuals from Shaker Communities in the United States. The photographs are labeled with Roman numerals and captions identifying the subjects. Here is a detailed description of each photo:

  1. Photo I (left):

    • Subject: Elder Daniel Offord.
    • Activity: He is seen operating a manual lawn mower on a grassy area.
    • Attire: He is wearing a suit with a bow tie and a hat.
  2. Photo II (center):

    • Subject: Sister Elma Royse.
    • Activity: She is seated in a Shaker chair.
    • Attire: She is dressed in traditional Shaker attire, including a long dress, an apron, and a bonnet.
  3. Photo III (right):

    • Subject: Elder Albert Green.
    • Activity: He is standing on a pathway with a broom in hand, appearing to be engaged in cleaning or maintenance.
    • Attire: He is wearing a suit and a hat, similar to Elder Daniel Offord.

The images are sepia-toned, giving them a historical feel, and the subjects are engaged in activities typical of the Shaker lifestyle, emphasizing simplicity, hard work, and traditional attire. The title "Shaker Communities, United States" is displayed at the top center of the image.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-28

This image appears to be a page from a photograph album or scrapbook, likely from the early 20th century, as indicated by the style of the photographs and the sepia tone. The page is titled "Shaker Communities, United States," suggesting that the photographs are related to members of Shaker communities in the United States.

There are three photographs on the page:

  1. On the left, a man is standing outdoors in a grassy area, holding a tool or implement, possibly related to gardening or maintenance. The label below the photo identifies this individual as "I. Elder Daniel Offord."

  2. In the middle, a woman is seated in a rocking chair indoors, wearing traditional attire, possibly a dress and apron. The label below the photo identifies her as "II. Sister Elina Royson [In Shaker chair]."

  3. On the right, another man is standing outdoors on a pathway, holding a long object that could be a tool or a piece of wood. The label below this photo identifies him as "III. Brother Charles Greaves."

The photographs are arranged vertically and are separated by small dividers. The page is aged, with some wear visible along the edges, adding to the historical feel of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-28

The image is a triptych of black and white photographs from the Shaker Communities in the United States. Each photograph is labeled with a Roman numeral (I, II, III) and a brief description.

  1. I: The left photograph shows a man, identified as Elder Daniel Offord, standing outdoors on a lawn. He is holding a lawn mower and is dressed in a suit and a hat. The background includes a house and some trees.

  2. II: The middle photograph is of a woman, identified as Sister Eliza Royson, seated in a Shaker chair indoors. She is wearing a long dress and a scarf, and her hair is pulled back tightly. The setting appears to be a room with a table and some plants in the background.

  3. III: The right photograph shows another man, identified as Brother Charles Greaves, standing outdoors on a path. He is holding a long, flat object, possibly a tool or a piece of wood, and is dressed in a coat and a hat. The background includes a house and some trees.

The photographs are arranged on a page with a heading that reads "Shaker Communities, United States." Below the photographs, there is a caption that provides the names and roles of the individuals depicted in each photograph.

Text analysis

Amazon

United
Elder
States
Shaker
Shaker Communities, United States
Brother
Communities,
(In
Daniel
Elder Daniel offord
I.
Brother Charles Greaves
Charles
offord
Greaves
(In Shaker chair)
111:
chair)
Elisa
Royson
Bieter Elisa Royson
Bieter
11

Google

Shaker Communities, United States. 选聘 I. II. 111: Brother Charles Greaves Elder Daniel Offord Bister Riina Roynon (In Shaker chair)
Shaker
Communities
,
United
States
.
选聘
I.
II
111
:
Brother
Charles
Greaves
Elder
Daniel
Offord
Bister
Riina
Roynon
(
In
chair
)