Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States: I. Sister Catherine Allen and Sister Martha Burger in reception room.

Date

c. 1903

People

Artist: James E. West, American active 1890s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.247.1

Human Generated Data

Title

Social Revolution (?): United States. New York. Mt. Lebanon. Shaker Communities: Shaker Communities, United States: I. Sister Catherine Allen and Sister Martha Burger in reception room.

People

Artist: James E. West, American active 1890s

Date

c. 1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.247.1

Machine Generated Data

Tags

Amazon
created on 2022-06-25

Room 98.8
Indoors 98.8
Person 97.9
Human 97.9
Person 97.3
Court 90.5
Furniture 87.5
Painting 66.6
Art 66.6
Living Room 57.8
Waiting Room 56.4

Clarifai
created on 2025-01-10

people 100
furniture 97.6
portrait 97.2
room 95.8
child 94.9
seat 94.1
two 93.7
woman 93.5
chair 93.2
adult 92.3
easy chair 92.2
one 91.3
sit 90.4
art 89.9
wear 88.1
indoors 87.2
man 85.8
leader 85.7
administration 82.7
music 82.3

Imagga
created on 2022-06-25

dress 23.5
kin 22
old 21.6
people 20.6
statue 19.4
man 18.1
person 17.9
religion 17.9
musical instrument 17.8
groom 16.7
fashion 16.6
love 15.8
gown 15.3
adult 14.9
church 14.8
lady 14.6
clothing 14.2
catholic 14.1
bride 13.4
couple 13.1
art 13
male 12.8
style 12.6
sculpture 12.5
happiness 12.5
religious 12.2
monument 12.1
mother 11.6
vintage 11.6
god 11.5
culture 11.1
wedding 11
two 11
portrait 11
wind instrument 10.9
holy 10.6
faith 10.5
antique 10.5
ancient 10.4
women 10.3
wall 10.3
architecture 10.1
history 9.8
family 9.8
vestment 9.7
interior 9.7
outfit 9.6
married 9.6
bouquet 9.4
black 9
home 8.8
marble 8.7
cathedral 8.6
wife 8.5
historical 8.5
stone 8.4
teacher 8.4
traditional 8.3
city 8.3
happy 8.1
new 8.1
costume 8.1
detail 8
room 7.9
face 7.8
men 7.7
marriage 7.6
elegance 7.6
clothes 7.5
outdoors 7.5
suit 7.4
percussion instrument 7.4
tradition 7.4
historic 7.3
holiday 7.2
hair 7.1

Google
created on 2022-06-25

Microsoft
created on 2022-06-25

person 95.8
clothing 94.5
man 90.5
old 57.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 48-54
Gender Female, 100%
Calm 99.3%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Happy 0.1%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 49-57
Gender Female, 100%
Calm 97.3%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Angry 1%
Confused 0.7%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 43
Gender Female

Microsoft Cognitive Services

Age 52
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting
Person 97.9%
Person 97.3%
Painting 66.6%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-29

a photograph of a woman in a long dress standing next to a man -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts a vintage indoor setting with two women dressed in formal, early 20th-century clothing. One woman is standing, wearing a long dress with a cape-like detail, while the other is seated in a chair near a wooden writing desk. The room is furnished with a side table adorned with a potted fern resting on a lace-trimmed cloth, positioned near a closed door. Large curtains frame a window that lets in natural light, and a small wastebasket with papers is visible near the seated woman. The interior has a warm, traditional aesthetic, with patterned carpet and ornamental details suggesting a domestic or formal environment.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts an interior scene from an earlier time period, likely the early 20th century. Two women are present, one standing and one sitting. The standing woman is dressed in a formal, long-sleeved gown with a wide collar. The sitting woman is seated in a chair by a window, wearing a similar style gown and holding a cloth or handkerchief.

The room is decorated in a Victorian or Edwardian style, featuring floral wallpaper and a patterned carpet. There is a large wooden cabinet or writing desk along the wall, with papers and possibly a book on top. The window has sheer curtains, and outside, it's possible to see some trees or foliage. In front of the standing woman is a small table with a white lace cloth, with a large bowl or planter holding a fern. There is also a chair to the side, and a small wastebasket on the floor. Overall, the scene conveys a sense of domesticity and formality from a bygone era.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph from an earlier era, depicting two people in a room. The man is standing and wearing formal attire, while the woman is seated in a chair. The room has a piano, a table with a decorative tablecloth, and a window that provides natural light. The overall atmosphere suggests this is a formal or professional setting, possibly a home or office. The individuals are not identified, but the image conveys a sense of the time period in which it was taken.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph that appears to be from the Victorian or Edwardian era. It shows two women in a domestic interior setting. They are wearing long, dark dresses typical of the period, with high collars and full-length skirts. One woman is standing near what appears to be a piano or organ, while the other is seated by a window. The room is decorated with period furnishings including a small table with a white lace tablecloth and a potted fern. There's a patterned carpet on the floor and curtains at the window. The photograph has the formal, staged quality common to photography of that era, with subjects posed rather stiffly in their domestic environment.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of two women in a room, likely taken in the late 19th or early 20th century.

Room Description:

  • The room has a wooden floor and walls.
  • A large window on the right side of the room allows natural light to enter.
  • A curtain hangs from the window, partially covering it.
  • A table with a white tablecloth and a plant sits to the left of the women.
  • A chair is positioned to the left of the table.
  • A rug covers the floor in front of the table.
  • A desk with a chair behind it is situated between the women.
  • A cabinet is mounted on the wall behind the desk.
  • A basket containing papers or documents is placed on the floor to the right of the desk.

Women's Clothing:

  • The woman on the left wears a long dress with a shawl draped over her shoulders.
  • The woman on the right sits in a chair, wearing a long dress with her hands resting on her lap.

Overall Impression:

  • The image appears to be a formal portrait of the two women, possibly taken in a home or office setting.
  • The women's clothing and the room's furnishings suggest a middle-class or upper-class household.
  • The image conveys a sense of elegance and refinement, with the women posing in a dignified manner.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of two women in a room. The woman on the left stands beside a table with a plant, while the woman on the right sits in a chair. The room features a window, a desk, and a cabinet, with a rug on the floor. The overall atmosphere suggests a formal or professional setting, possibly from the late 19th or early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

An old photo of two women standing in a room. The woman on the left is standing in front of a cabinet, while the woman on the right is sitting on a chair. A potted plant is on the table in front of them. A window with curtains is on the right side, and a chair is on the left. A desk is in front of the window, and a trash bin is on the right.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image is a black-and-white photo of two women in a room. One woman is standing, while the other is sitting. The standing woman is wearing a long dress with a cape and a white inner shirt. She is standing next to a desk with a plant on top. The woman sitting is wearing a long dress and is sitting on a chair with a pillow. There is a window with curtains on the right side.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

This sepia-toned photograph features a domestic interior with two women. The woman on the left is standing, while the other is seated. Both are dressed in dark, long skirts and jackets. The woman on the left has her hand resting on a small, dark wood desk. A white curtain hangs in the window to the right. A table with a plant and a table with a small desk is in front of the woman. The overall tone is one of formality and the image gives off an old-fashioned feel.

Created by gemini-2.0-flash on 2025-06-16

This is a sepia-toned, full-shot photograph of two women standing in an interior room, most likely from the late 19th or early 20th century. The photograph appears to be of a formal nature, typical of the era.

On the left, a woman stands with a serious expression. She has short hair and is wearing a long, dark dress with a high collar and a large, light-colored shawl-like collar that drapes over her shoulders. Her hand rests gently on the side of a dark, wooden secretary desk, which is placed against the wall.

To the left of the standing woman, a small, round table is draped with a white cloth with a decorative fringe. On top of the table, a large plant in a white pot adds a touch of domesticity to the scene.

The second woman is seated in a chair on the right side of the frame. She is wearing similar attire to the first woman, including a dark dress and a light-colored shawl. She is also wearing glasses. Her gaze is directed towards the camera, and she holds a small, light-colored object (possibly a handkerchief or piece of paper) in her hands.

Behind the seated woman, a window is visible, partially covered by sheer curtains. The light from the window illuminates the scene, highlighting the subjects.

The room's decor includes patterned wallpaper and a small area rug on the floor. The furniture appears to be made of dark wood, and the overall ambiance is one of formality and domesticity. A small, cylindrical container filled with what appears to be papers or letters is on the floor near the seated woman. The photograph has a classic, historical feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image is a sepia-toned photograph depicting an interior scene from what appears to be the late 19th or early 20th century. The setting is a room with wooden walls and a large window on the right side, covered with sheer curtains.

In the room, there are two women dressed in period attire. The woman on the left is standing and wearing a long, dark dress with a high collar and long sleeves. She has a serious expression and is leaning slightly on a piece of furniture, possibly a piano or a cabinet.

The woman on the right is seated on a chair, also wearing a long, dark dress with a high collar. She is holding a piece of cloth or a handkerchief in her hands and appears to be looking at the camera.

To the left of the standing woman, there is a small table covered with a white, lace-edged tablecloth. On the table, there is a potted plant with fern-like leaves. The floor is covered with a patterned rug, and there is a small stool or footrest near the seated woman.

The overall atmosphere of the image suggests a formal, possibly staged, portrait typical of the era, capturing a moment of domestic life.

Text analysis

Amazon

Sib