Human Generated Data

Title

Susan McAndrew

Date

1895

People

Artist: Gertrude Käsebier, American 1852 - 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of John McAndrew, P1971.13

Human Generated Data

Title

Susan McAndrew

People

Artist: Gertrude Käsebier, American 1852 - 1934

Date

1895

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of John McAndrew, P1971.13

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 95.3
Blanket 75.1
Baby 73.8
Art 68.1
Newborn 63
Apparel 57.3
Clothing 57.3
Worship 55.1
Prayer 55.1

Clarifai
created on 2018-03-22

people 99.8
one 98.8
child 98.7
portrait 98.4
baby 96.9
adult 96
wear 94.6
son 93.9
art 90.3
profile 81.5
two 81.2
offspring 79.9
man 79.4
woman 79.1
administration 77.5
affection 75.6
facial expression 74.9
leader 73.8
painting 73.8
newborn 70.6

Imagga
created on 2018-03-22

child 25.6
person 23.1
towel 21.6
bath towel 21.2
baby 21.1
people 20.6
grandfather 18.5
statue 17.9
face 17.8
adult 17.5
sculpture 17.5
portrait 17.5
bath linen 17
grandma 16.1
old 16
body 16
happy 15
mother 14.6
man 14.2
parent 13.8
love 13.4
care 13.2
sexy 12.9
human 12.7
linen 12.6
happiness 12.5
childhood 12.5
family 12.5
little 12.4
skin 12.3
male 12.3
cute 12.2
smile 12.1
stone 12.1
attractive 11.9
dress 11.7
innocence 11.5
cheerful 11.4
couple 11.3
one 11.2
marble 11
smiling 10.9
pretty 10.5
ancient 10.4
fur coat 10.1
coat 9.9
religion 9.9
lady 9.7
newborn 9.7
innocent 9.7
black 9.6
clothing 9.5
hair 9.5
bath 9.5
culture 9.4
lifestyle 9.4
father 9.4
relax 9.3
head 9.2
art 9.2
historic 9.2
fashion 9
kid 8.9
angel 8.8
home 8.8
boy 8.7
hands 8.7
antique 8.7
toddler 8.6
architecture 8.6
model 8.6
expression 8.5
historical 8.5
monument 8.4
park 8.2
healthy 8.2
closeup 8.1
garment 8.1
looking 8
close 8
husband 7.8
infant 7.7
relaxation 7.5
senior 7.5
fun 7.5
decoration 7.2
history 7.2
daughter 7.2
women 7.1

Google
created on 2018-03-22

Microsoft
created on 2018-03-22

person 99.6
text 87
old 74.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-5
Gender Female, 98.8%
Surprised 2.8%
Angry 5.1%
Disgusted 5.5%
Sad 13.3%
Confused 5.5%
Happy 1.7%
Calm 66.1%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Human face
Clothing
Human nose
Human eye
Human hair
Human mouth

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 73.2%

Clarifai

Human face 92.8%

Clarifai

Human face 79.3%

Clarifai

Clothing 81.2%

Clarifai

Clothing 54.5%

Clarifai

Clothing 51.4%

Clarifai

Human nose 44.9%

Clarifai

Human nose 34.6%

Clarifai

Human eye 41.9%

Clarifai

Human eye 41.2%

Clarifai

Human hair 38.9%

Clarifai

Human hair 34.3%

Clarifai

Human mouth 34.3%

Categories

Captions

Microsoft
created by unknown on 2018-03-22

a vintage photo of a person 92.6%
a vintage photo of a girl 86.2%
a black and white photo of a person 86.1%

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-28

an old photograph of a woman holding a baby

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a woman in a white dress holding a baby

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts an intimate moment with a person draped in a dark outfit featuring a delicate lace detail around the shoulder and neck area. A second figure, wrapped in a soft, light-colored blanket, appears to be nestled closely to the first figure, creating a sense of warmth and tenderness. The overall composition is softly lit, emphasizing the textures and fabrics while maintaining a subdued and evocative atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image shows a person holding a baby wrapped in a soft, light-colored blanket. The person is wearing a garment with a decorative lace collar. The background is dark, which makes the figures stand out more prominently against it. The lighting is subdued, giving the image a soft and serene atmosphere.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This appears to be a vintage black and white photograph showing a tender moment between what appears to be a parent and infant. The adult is wearing a lace-detailed top or dress, while the baby is wrapped in a light-colored blanket or gown. The photograph has a soft, intimate quality typical of early 20th century portrait photography, with a dark background that makes the light clothing stand out in contrast. The composition draws the viewer's eye to the gentle interaction between the two subjects.

Created by claude-3-haiku-20240307 on 2024-12-31

The image appears to show a woman cradling a baby, both of whom are wrapped in a soft, fuzzy blanket. The woman is looking down tenderly at the baby, creating a serene and intimate scene. The image has a grainy, black and white quality that gives it a timeless, nostalgic feel.

Created by claude-3-5-sonnet-20241022 on 2024-12-31

This appears to be a vintage black and white photograph showing a tender moment between a parent and child. The adult is wearing what appears to be a lace-detailed top, while the baby is wrapped in light-colored, flowing fabric that could be a christening gown or similar formal infant attire. The photograph has a soft, intimate quality typical of early 20th century portrait photography, with subtle lighting and a dark background that creates a gentle, nurturing mood.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image depicts a tender moment between a woman and a baby, captured in a black-and-white photograph. The woman, positioned on the right side of the frame, is dressed in a dark-colored dress with a lace collar, her hair neatly pulled back. She gently cradles the baby in her arms, who is wrapped in a white blanket and appears to be looking directly at the camera. The background of the image is a solid, dark color, which serves to emphasize the intimate connection between the woman and the baby. The overall atmosphere of the image is one of warmth and affection, conveying a sense of love and care between the two subjects.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This image is a vintage photograph of a woman and a baby. The woman is dressed in dark clothing with a white lace collar, while the baby is wrapped in a white blanket. The background is dark, suggesting that the photo was taken indoors. The overall atmosphere of the image is one of warmth and intimacy, capturing a tender moment between the woman and the baby.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

The image is a black-and-white photograph of a woman holding a baby. The woman is dressed in a long dress with a lace collar and a white apron, which suggests that she might be a nurse or a caregiver. The baby is wrapped in a white cloth, and the image has a vintage feel to it. The baby is looking at the camera, while the woman is looking down at the baby. The image is a close-up shot, and the background is blurry, which adds to the vintage feel of the photograph.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The image is a black-and-white photograph of a woman holding a baby. The woman is wearing a white apron with a lace collar and a black dress. She is holding the baby close to her chest with her right hand, while her left hand is supporting the baby's back. The baby is wrapped in a white blanket, and its head is slightly tilted to the side. The woman's face is partially obscured by the baby, but she appears to be looking down at the baby with a gentle expression. The image has a vintage feel to it, possibly taken in the early 20th century.

Google Gemini

Created by gemini-2.0-flash on 2025-05-07

The image is a monochrome vintage photograph of a woman holding a baby, both looking at the camera. The woman is seen from the shoulders up, wearing a dark dress with a large, ornate white lace collar that drapes over her shoulders. She has dark hair pulled back from her face, and her head is slightly bent as she looks down at the baby.

The baby is wrapped in a light-colored blanket or shawl that covers most of the body. The baby's face is visible, with a slightly serious expression. The bottom edge of the blanket is frayed or has some loose threads hanging down.

The background is a dark, solid color, providing contrast to the light-colored blanket and the lace collar. The image has a soft focus, typical of older photographs, and the tones range from dark blacks to light grays. There is a sense of intimacy and tenderness in the way the woman is holding the baby. The photograph is vertically oriented and looks like it could be a portrait taken during the early 20th century.

Created by gemini-2.0-flash-lite on 2025-05-07

Here is a description of the image:

The image is a black and white portrait of a woman and a baby. The woman is standing behind the baby, holding the baby in her arms. The baby is wrapped in a white blanket. The woman is wearing a dark dress with a lace collar. The background is dark. The image has a soft, gentle feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a vintage black-and-white photograph featuring a woman holding a baby. The woman appears to be looking down at the baby with a gentle expression. She is wearing a dress with a lace collar, which is visible on her right shoulder. The baby is swaddled in a blanket, and its face is partially visible. The photograph has a soft, nostalgic quality, suggesting it might be quite old. The background is dark, which helps to highlight the subjects in the foreground. The overall mood of the image is tender and intimate, capturing a moment of connection between the woman and the baby.

Qwen