Human Generated Data

Title

Untitled (family portrait with three figures standing and seated, heavy overpainting)

Date

1890s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2901

Human Generated Data

Title

Untitled (family portrait with three figures standing and seated, heavy overpainting)

People

Artist: Unidentified Artist,

Date

1890s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.2901

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.6
Human 99.6
Painting 99.1
Art 99.1
Person 98.6
Person 98.5

Clarifai
created on 2023-10-25

people 99.5
painting 98.8
art 98.2
man 97.9
religion 94.9
woman 93.6
adult 93.2
group 91.7
lid 91.2
illustration 91.2
print 90.9
priest 89.1
elderly 88.6
three 88.4
Renaissance 88.4
wear 88.3
two 87.7
child 86.7
saint 81.9
winter 81.1

Imagga
created on 2022-01-09

metropolitan 50.2
wicker 22.4
people 20.1
man 18.8
male 18.4
vestment 17.6
portrait 16.8
person 16.6
culture 16.2
work 16.1
clothing 15.8
face 14.9
gown 14.9
couple 13.9
happy 13.8
rattan 13.6
costume 13.5
smiling 13
sitting 12.9
old 12.5
product 12.5
traditional 12.5
holiday 12.2
men 12
adult 11.7
religion 11.6
mother 11.2
dress 10.8
switch 10.8
outerwear 10.6
cheerful 10.6
together 10.5
outdoors 10.4
religious 10.3
senior 10.3
fashion 9.8
father 9.6
love 9.5
lifestyle 9.4
colorful 9.3
church 9.2
art 9.2
lady 8.9
family 8.9
pray 8.7
scene 8.7
creation 8.6
happiness 8.6
faith 8.6
child 8.4
tradition 8.3
tourism 8.2
instrument of punishment 8.2
history 8
home 8
oriental 8
women 7.9
look 7.9
travel 7.7
golden 7.7
holy 7.7
god 7.7
outdoor 7.6
historical 7.5
vintage 7.4
gold 7.4
color 7.2
smile 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

clothing 97.9
text 97.8
person 97.1
painting 96.2
old 90.2
woman 84.4
human face 80.7
drawing 67.4
clothes 20.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-53
Gender Male, 55.5%
Calm 77.9%
Disgusted 5.3%
Fear 5.1%
Confused 4.4%
Sad 3.5%
Angry 1.5%
Surprised 1.4%
Happy 0.9%

AWS Rekognition

Age 19-27
Gender Female, 100%
Calm 78.6%
Sad 18.3%
Confused 1.2%
Angry 0.7%
Fear 0.5%
Surprised 0.3%
Disgusted 0.3%
Happy 0.1%

AWS Rekognition

Age 61-71
Gender Male, 100%
Calm 96.9%
Sad 2.8%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%
Fear 0%
Surprised 0%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 15
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 99.6%
Person 98.6%
Person 98.5%
Painting 99.1%

Categories

Captions

Microsoft
created by unknown on 2022-01-09

an old photo of a person 70.8%
an old photo of a person 70.7%
an old photo of a man and a woman 47.7%

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people sitting around a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This image depicts a formal, vintage group portrait featuring three individuals in period attire. The image showcases richly textured clothing with intricate patterns, highlighting the era's fashion. The central figure is seated, dressed in a tailored suit, while the others stand or sit beside him. Furniture such as a wooden chair with a woven back and a plush stool are also present, enhancing the image's atmospheric and historical feel. The background appears painted, with light strokes creating a muted blend of blue tones. A vibrant red fabric adds color contrast to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts a vintage family portrait with three people, appearing to be a group of adults. The individuals are dressed in what seems to be late 19th-century or early 20th-century attire. The person on the left is wearing a long patterned dress with layered fabric, the person in the center is seated and dressed in a three-piece suit with a tie, and the person on the right is wearing a light-colored dress with lace details. There is a wooden chair with intricate carvings beside them, and a reddish-brown, square cushion or stool in front of the chair. The background features a painted backdrop that is light blue with some abstract brush strokes, giving a soft and antique feel to the composition.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image depicts three people in traditional clothing from what appears to be a historical or cultural setting. There is a man sitting in a chair, holding what looks like a wooden frame or device. Next to him is a woman wearing a red shawl, and another man standing beside them. The background is a muted, greenish-blue color, giving the image an antique or vintage feel. The people in the image are not identified, as per the instructions provided.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a vintage daguerreotype or early photograph from the mid-1800s. The image shows a group of people in period clothing, with one person standing and others seated. They are arranged around what appears to be a yarn winder or spinning wheel device. The clothing styles are typical of the Victorian era, with the subjects wearing dark, formal attire. The photograph has the characteristic blue-gray tint common to daguerreotypes of that period, and there is some visible aging and deterioration around the edges of the image. The furniture visible includes what appears to be a red-upholstered chair. The composition is formal, as was typical of photography from this era, when exposure times were long and subjects needed to remain still.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image is a vintage photograph of three individuals, likely from the 19th century. The photograph appears to be a daguerreotype or an early form of photography.

Key Features:

  • Three Individuals: The photograph features three people, two women and one man, posing together.
  • Clothing: The individuals are dressed in formal attire, with the man wearing a suit and hat, and the women wearing long dresses and coats.
  • Background: The background of the photograph is a plain blue wall, with a chair or bench visible behind the individuals.
  • Condition: The photograph shows signs of aging, with scratches, fading, and discoloration evident on the surface.

Conclusion:

The image is a historic photograph that provides insight into the fashion and social norms of the time period. The photograph's condition suggests that it has been preserved for many years and may hold significant historical value.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image depicts a family portrait, likely taken in the mid-19th century, based on the clothing and style of the individuals. The photograph is faded and appears to be an old daguerreotype or tintype.

  • Family Members:

    • A woman stands on the left side of the image, wearing a long coat with a plaid pattern and a fur-trimmed shawl. She has her hands clasped together in front of her.
    • A man sits in a chair in the center of the image, wearing a dark-colored suit with a white shirt and black bow tie. He has a hat on his head and is looking directly at the camera.
    • A young girl stands to the right of the man, wearing a yellow dress with a white apron and a hat. She is holding a small object in her hand and looking down at it.
  • Background:

    • The background of the image is a light blue color, with some darker shadows around the edges. There is a red curtain or blanket hanging behind the family members.
  • Furniture:

    • The man is sitting in a wooden chair with a red cushion. The chair has a simple design with a backrest and armrests.
    • There is a red curtain or blanket hanging behind the family members, which may be a backdrop or part of the furniture.
  • Overall:

    • The image is a formal portrait of a family, likely taken for sentimental or commemorative purposes. The clothing and style of the individuals suggest that they are from a middle-class background. The image is faded and worn, indicating that it has been handled and displayed over time.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

A painting depicts a family of three, with a woman standing on the left, a man sitting on the right, and a young girl in the middle. The woman is wearing a long dress with a floral pattern, while the man is dressed in a suit and tie. The young girl is wearing a white dress with a red ribbon. The painting is framed in a wooden frame with a white border.

Created by amazon.nova-pro-v1:0 on 2025-06-02

The image appears to be an old photograph, possibly taken in the 19th century, featuring three people standing together. The woman on the left is wearing a plaid dress, while the man in the middle is dressed in formal attire. The woman on the right is wearing a dress with a white apron and a necklace. Behind them, there is a chair and a red cloth.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

This is a portrait of three people, likely from the 19th century, due to the style and type of the photograph.

  • Composition: The portrait features three figures posed against a plain blue background. The man is seated in a chair, the woman to his left is standing, leaning on the back of the chair, and the child is standing to the man's right. The background also appears to have some painted decor behind the child, possibly a seat or backdrop.

  • People:

    • The man is seated and appears to be the patriarch, dressed in a suit and bow tie. He is wearing a head covering.
    • The woman standing to the left is wearing a patterned dress.
    • The child, positioned on the right, wears a dress, apron, and has some type of jewelry.
  • Artistic Quality: The image has a hand-colored appearance, with subtle variations in the coloring of clothing and skin tones. The portrait has a slight aged or vintage look.

  • Overall Impression: It evokes a sense of nostalgia and provides a glimpse into a past era, potentially a portrait of a family. The individuals appear dignified and composed.

Created by gemini-2.0-flash on 2025-05-17

The image appears to be a hand-tinted portrait of a family, likely taken in the mid to late 19th century. There are three individuals: an older woman on the left, an older man seated in the center, and a younger girl on the right. The background is a muted blue.

The older woman stands to the left, dressed in a long, patterned dress with a high collar. She rests her hands on the back of a wooden chair with a dark red cushion.

In the center, the older man is seated, wearing a dark suit with a bow tie and a cap. He has a solemn expression and is gazing directly at the viewer.

To the right, the younger girl stands with a serious expression. She wears a long dress or coat, a white apron, and a long necklace. Behind her, there's what appears to be a decorative screen or wall with a red fabric draped over it.

The style of the photo suggests it could be an ambrotype or tintype that has been hand-colored to add depth and realism. The overall tone of the image is somber and formal, which was common for portrait photography of that era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image appears to be a vintage, hand-colored photograph or a painting, depicting three individuals in formal attire. Here are the details:

  1. Background and Setting:

    • The background is a plain, muted blue.
    • There is a red drapery in the background, adding a touch of color to the scene.
    • The floor appears to be covered with a red carpet or rug.
  2. Subjects:

    • Left Individual: A person standing, wearing a patterned coat or shawl over a dress. They have a serious expression and are holding onto the back of a chair.
    • Center Individual: An older person seated in a chair, dressed in formal attire including a dark coat, white shirt, and a bow tie. They are wearing a head covering, possibly a cap.
    • Right Individual: Another person standing, wearing a yellowish coat or shawl over a white dress with a lace apron. They are also holding onto the back of a chair and have a serious expression.
  3. Furniture:

    • There are two chairs in the image. The one on the left is empty, while the one in the center is occupied by the older individual.
    • The chairs have a distinctive design with curved backs and appear to be made of wood.
  4. Artistic Style:

    • The image has a somewhat faded and aged appearance, suggesting it might be quite old.
    • The colors are muted and the overall tone is subdued, giving it a historical feel.

This image likely represents a family portrait from the 19th or early 20th century, capturing a moment of formality and solemnity.