Human Generated Data

Title

Sarah Stevenson Harrison (wife of Gabriel Harrison) and her children

Date

c. 1857

People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.43

Human Generated Data

Title

Sarah Stevenson Harrison (wife of Gabriel Harrison) and her children

People

Artist: Mathew B. Brady & Studio, American active 1844 - 1895

Date

c. 1857

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from Special Collections, Fine Arts Library, Harvard College Library, Bequest of Evert Jansen Wendell, 2010.43

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 98.6
Clothing 92.2
Apparel 92.2
Texture 90.2
Performer 85.5
Art 84.9
Dress 79.8
People 74.3
Female 71.8
Portrait 64.8
Photography 64.8
Photo 64.8
Face 64.8
Leisure Activities 62.6
Polka Dot 59.4
Costume 58.9
Dance 56.6
Woman 56.1
Dance Pose 55

Clarifai
created on 2023-10-25

people 100
group 99.9
wear 99.8
adult 99.3
portrait 99.2
child 98.6
woman 98.5
three 98.5
two 96.5
royalty 96.2
costume 95.8
actress 95.5
offspring 95.4
four 95
dress 95
son 94.3
outfit 94.3
several 92.7
princess 92.6
art 92.2

Imagga
created on 2022-01-09

dress 55.1
kin 47.8
groom 38
bride 35.5
wedding 29.4
couple 28.7
fashion 27.1
portrait 26.5
people 26.2
love 24.4
clothing 23.6
adult 23.5
costume 23.4
person 23.1
happiness 22.7
attractive 21.7
happy 20.7
face 20.6
bouquet 19.8
marriage 19
man 18.8
elegance 16.8
black 16.5
married 16.3
lady 15.4
gown 15.1
bridal 14.6
posing 14.2
traditional 14.1
style 14.1
clothes 14
model 14
culture 13.7
celebration 13.5
smile 13.5
flowers 13
robe 12.8
veil 12.7
romantic 12.5
garment 12.4
male 12.1
sexy 12
two 11.9
old 11.8
pose 11.8
flower 11.5
hair 11.1
kimono 11
make 10.9
pretty 10.5
art 10.2
lifestyle 10.1
holding 9.9
commitment 9.8
wed 9.8
romance 9.8
together 9.6
wife 9.5
party 9.5
smiling 9.4
church 9.2
husband 9.2
mother 9
new 8.9
family 8.9
masquerade 8.9
carnival 8.7
ceremony 8.7
standing 8.7
engagement 8.7
cute 8.6
hairstyle 8.6
luxury 8.6
performer 8.6
elegant 8.6
studio 8.4
blond 8.3
makeup 8.2
park 8.2
outdoors 8.2
dancer 8.1
women 7.9
matrimony 7.9
brunette 7.8
theater 7.8
outfit 7.7
formal 7.6
loving 7.6
fashionable 7.6
head 7.6
dark 7.5
vintage 7.4
mature 7.4
emotion 7.4
cheerful 7.3
stylish 7.2
ruler 7.1
handsome 7.1
mask 7.1
day 7.1
look 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 97.4
person 97.3
dress 93.2
clothing 92.9
sport 86.2
dance 85.4
dancer 81.4
posing 77.6
old 77.4
smile 74.2
white 73.8
woman 71.7
black 70.7
people 70.2
costume design 57.5
vintage 42.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Male, 51.9%
Calm 99.5%
Sad 0.2%
Confused 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Female, 100%
Calm 97.6%
Sad 1.6%
Confused 0.3%
Angry 0.2%
Surprised 0.2%
Happy 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 12-20
Gender Female, 79.4%
Calm 93.4%
Sad 6.1%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 27-37
Gender Female, 100%
Calm 77.8%
Angry 15%
Sad 3.8%
Confused 2.2%
Surprised 0.5%
Fear 0.3%
Happy 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting

Clarifai

No features identified

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 94.7%

AWS Rekognition

Person 94.5%

AWS Rekognition

Painting 84.9%

Categories

Imagga
created on 2022-01-09

people portraits 76.9%
events parties 22.3%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people standing around a woman in a dress

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts a vintage family portrait consisting of four individuals. The central figure, dressed in an elaborate black gown with polka dots and a velvet cape, appears seated, suggesting a position of prominence. Surrounding this individual are three children, each in distinctive period attire. On the left, a child stands near a wooden table, wearing a long coat with large buttons. To the right, another child stands wearing a richly decorated cape-like outfit with intricate embroidery or trim, paired with boots. The child in the back is dressed in formal attire, including a dark jacket. The setting features a patterned carpet and a simple studio backdrop with draped fabric, indicating an indoor photographic studio environment common in the 19th century.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image depicts a historical family portrait featuring four individuals. The central figure is a woman dressed in a long, polka-dotted gown with a dark cape or shawl. She is seated, and her attire suggests fashion from the Victorian era. To her right, a child stands, wearing a coat with ornate designs and a matching cap. To her left, a slightly older child is captured in a long, textured, button-up coat, leaning against a small table with a top hat placed upon it. Another child stands behind the seated woman, wearing a dark suit. The setting appears to be a studio with a neutral backdrop and a richly patterned carpet on the floor.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a family portrait from the Victorian era. It shows four individuals - two young children, a woman in the center wearing an elaborate polka dot dress, and a man standing behind her. The woman in the center is the focal point of the image, wearing a long, dark dress with a patterned skirt. The two children are dressed in formal attire as well, with the boy wearing a dark suit and the girl wearing a patterned dress. The overall tone of the image is formal and posed, characteristic of Victorian-era portraiture.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a formal Victorian-era family portrait, likely from the 1860s, showing a group of four people. The photograph is in sepia tones, typical of that period. The central figure is wearing an elaborate dark dress with polka dots and a voluminous cape or cloak. To her sides are three younger figures - one in a textured coat with double buttons, another in dark formal attire, and on the right, a figure in a decorated dress with trim and a matching hat. The photograph was taken in a studio setting with a plain backdrop and some furniture visible, including what appears to be a decorative side table. The clothing and formal poses are characteristic of Victorian photography, when having one's picture taken was a significant event requiring careful preparation and one's finest attire.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a vintage black-and-white photograph of a woman and three children posing for a formal portrait. The woman, positioned centrally, wears a dark-colored dress with a long skirt featuring white polka dots and a matching cape. She has dark hair styled in an updo and is adorned with a dark-colored shawl or cape draped over her shoulders.

To the left of the woman stands a young boy, dressed in a dark-colored coat and pants, with his arms crossed. On the right side of the woman is another young boy, wearing a dark-colored coat with white trim and a matching hat, paired with a white dress and black boots. The third child, a girl, is positioned behind the woman, wearing a dark-colored coat with white trim and a matching hat, along with a white dress and black boots.

The background of the image features a plain wall, with a dark-colored curtain on the right side and a wooden table with a chair on the left side. The overall atmosphere of the image suggests a formal family portrait, likely taken in the late 19th or early 20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a woman and three children, likely from the Victorian era. The woman sits in the center, wearing a long dress with a dark-colored bodice and a full skirt featuring white polka dots. She has a dark shawl draped over her shoulders and a dark headpiece or hat.

To her left stands a young boy, dressed in a dark coat with his arms crossed. On her right are two children: a girl wearing a dark coat with white trim and a hat, and a boy in a light-colored coat with large buttons. The background features a plain wall, a curtain on the right side, and a patterned rug or carpet on the floor. The overall atmosphere suggests a formal family portrait from the 19th century.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white image shows a woman and three kids, probably a family. The woman is sitting on a chair, and the three kids are standing behind her. The woman is wearing a dress and a shawl. The kids are wearing coats. The woman is looking at the camera, while the kids are looking in different directions. Behind them is a curtain, and on the left side is a table with a hat on top.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a vintage photograph of a family portrait featuring four individuals. The woman in the center, likely the matriarch, is seated with a serene expression. She is dressed in a long, polka-dotted dress with a high collar and a wide skirt. The two children standing on either side of her are also dressed in matching outfits, with the child on the right wearing a bonnet and the child on the left wearing a fur-lined coat. The child on the left is standing with his arms crossed, while the child on the right is holding the woman's hand. The background is plain and monochromatic, adding to the vintage feel of the image.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-07

Here's a description of the image:

Overall:

The image is a formal studio portrait, likely from the mid-to-late 19th century, given the attire and photographic style. It features a woman seated with three children standing around her. The photograph is a sepia tone, creating a vintage feel.

People:

  • The Woman: She is the central figure, seated and wearing an elaborate, dark dress with a full skirt. She has a dark veil or headpiece and a somber expression.
  • The Children:
    • On the woman's left, a younger boy leans on a small table. He is wearing a warm, thick coat.
    • Behind him is an older boy in a dark suit. He stands with his arms crossed.
    • On the woman's right, a child (likely a boy) wears a coat with fur trim and a matching hat, paired with a white dress or skirt. He holds the woman's hand.

Setting & Composition:

  • The backdrop is a plain studio background with a draped curtain on the right side.
  • The composition is formal and arranged, typical of portraits of this era.
  • The lighting is soft, casting gentle shadows, suggesting a studio setting with natural or diffused light.

Attire & Details:

  • The clothing worn by all individuals indicates wealth and social standing.
  • The woman's dress features a polka-dotted skirt.
  • The details in the clothing, such as the fur trim, and the formal poses emphasize the formality of the image.

Overall Impression:

The portrait gives off a sense of dignity, formality, and perhaps a hint of seriousness, which were characteristic of the time. It is a visual record of a family and their status in society.

Created by gemini-2.0-flash on 2025-05-07

Here is a description of the image:

The image is a formal sepia-toned portrait of a woman and three children. The woman is seated in the center, wearing a large dress with a polka-dot pattern and a dark, heavy cloak with what appears to be velvet fabric. A lace-like headpiece adorns her head. She has a serious expression.

To the woman's left, a young boy stands leaning on an ornate table. He wears a thick, buttoned coat. Behind him, a taller boy stands with his arms crossed, also wearing a dark-colored suit or coat.

On the woman's right, a child in a fancy coat with a decorative border stands holding the woman's hand. The child also wears a matching hat and a light-colored dress under the coat.

The background is a plain backdrop, with a dark curtain visible on the right side of the frame. The floor is covered with a patterned rug. The overall style of the photograph suggests it was taken in the 19th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a vintage black-and-white photograph featuring a woman and three children, likely from the late 19th century or early 20th century. Here is a detailed description:

  1. Setting: The photograph appears to be taken in a studio setting, as indicated by the backdrop and the formal poses of the subjects.

  2. Subjects:

    • Woman (Central Figure): The central figure is a woman dressed in a voluminous, polka-dotted dress with a full skirt, typical of Victorian-era fashion. She is wearing a dark cape and a bonnet, which suggests a formal or semi-formal attire. Her posture is upright and poised, with one hand resting on the shoulder of the child next to her.
    • Children:
      • Child on the Left: A young child, likely a boy, is standing to the left of the woman. He is wearing a heavy, fur-like coat with large buttons and appears to be leaning slightly against a small table or stand.
      • Child in the Middle: Another child, possibly a boy, stands behind the woman. He is dressed in dark, formal clothing, including a jacket and a high-collared shirt. His arms are crossed in front of him.
      • Child on the Right: A young girl is standing to the right of the woman. She is wearing a dark dress with intricate white embroidery or lace detailing, along with a matching hat. Her outfit includes a white pinafore over the dress.
  3. Poses and Expressions: All subjects are looking directly at the camera, maintaining a serious and composed demeanor, which was common in early photography due to long exposure times.

  4. Attire: The clothing worn by all individuals suggests a time period when formal attire was common for portraits. The styles, including the woman's dress and the children's outfits, reflect the fashion trends of the late 19th century.

This photograph captures a moment in time, showcasing the fashion and photographic styles of the era, and likely represents a family portrait.

Qwen

Text analysis

Google

<-DIe
<-DIe