Human Generated Data

Title

Untitled (woman posed sitting with two daughters in matching dresses)

Date

1936

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9091

Human Generated Data

Title

Untitled (woman posed sitting with two daughters in matching dresses)

People

Artist: Martin Schweig, American 20th century

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9091

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.7
Apparel 99.7
Human 99.5
Dress 98.4
Face 98.1
Female 96.6
Woman 89.2
Costume 88.8
Necklace 83.9
Accessories 83.9
Jewelry 83.9
Accessory 83.9
People 80
Shorts 74
Portrait 73.7
Photography 73.7
Photo 73.7
Girl 71
Advertisement 59.9
Fashion 58.5
Indoors 57.3
Poster 56.6
Glasses 56

Clarifai
created on 2023-10-26

people 99.8
group 99.4
woman 98.9
adult 98.6
indoors 96.2
three 95.8
four 95.7
monochrome 95.4
family 94.4
veil 92.2
television 91.8
child 90.9
two 90.5
wear 89.7
man 89.5
movie 89
several 89
group together 86
interaction 85.4
portrait 84.9

Imagga
created on 2022-01-23

groom 96.6
couple 40.1
bride 34
people 30.1
wedding 28.5
love 28.4
man 26.9
happiness 26.6
person 26.3
mother 24.7
happy 24.4
portrait 23.9
adult 23.4
male 22.8
dress 22.6
kin 20.8
bouquet 17.9
home 17.5
married 17.3
two 16.9
smiling 16.6
husband 16.3
loving 16.2
family 16
nurse 15.5
parent 15.2
marriage 15.2
men 13.7
romance 13.4
attractive 13.3
smile 12.8
fashion 12.8
face 12.8
celebration 12.8
women 12.7
pretty 12.6
wife 12.3
cheerful 12.2
human 12
gown 11.7
black 11.4
together 11.4
sexy 11.2
grandma 10.9
lifestyle 10.8
bridal 10.7
romantic 10.7
ceremony 10.7
flowers 10.4
relationship 10.3
future 10.2
elegance 10.1
indoor 10
house 10
wed 9.8
veil 9.8
lady 9.7
fun 9.7
tender 9.6
looking 9.6
hair 9.5
sitting 9.4
day 9.4
window 9.2
room 9.1
business 9.1
child 8.9
newly 8.9
office 8.8
tenderness 8.8
engagement 8.7
boyfriend 8.7
girlfriend 8.7
expression 8.5
pair 8.5
clothing 8.2
new 8.1
lovely 8
interior 8
wedded 7.9
romanticism 7.9
cute 7.9
holiday 7.9
matrimony 7.9
flower 7.7
youth 7.7
comfortable 7.6
casual 7.6
style 7.4
gorgeous 7.2
summer 7.1
businessman 7.1
indoors 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.4
posing 96.4
clothing 91
smile 90.1
dress 89.9
wedding dress 88.9
woman 87.6
person 86.5
human face 85.6
bride 78.1
image 49.5
old 44.4
painting 15.4
picture frame 7.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 62.3%
Calm 99.8%
Surprised 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Sad 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Female, 53.7%
Calm 76.7%
Surprised 20.6%
Happy 1.4%
Angry 0.4%
Disgusted 0.4%
Sad 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Female, 59.5%
Surprised 53.9%
Calm 40.4%
Happy 3.4%
Confused 0.9%
Disgusted 0.6%
Sad 0.5%
Angry 0.3%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses

Clarifai

Picture frame
Woman
Human face
Clothing

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 93.5%

AWS Rekognition

Sunglasses 68.8%

Clarifai

Picture frame 93.1%

Clarifai

Woman 83.1%

Clarifai

Woman 68.8%

Clarifai

Woman 65.9%

Clarifai

Woman 38.3%

Clarifai

Human face 73.7%

Clarifai

Human face 73.7%

Clarifai

Human face 71.2%

Clarifai

Human face 64.3%

Clarifai

Clothing 73.6%

Categories

Imagga
created on 2022-01-23

paintings art 84.6%
text visuals 7.4%
people portraits 3.9%
food drinks 2.5%
events parties 1.2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a photo of the family.

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a black and white photograph of a woman and two children

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image depicts three individuals seated on a floral-patterned couch in a well-decorated living room. The seating arrangement suggests a familial or close relationship among them. Behind the couch, there is a lamp with an ornate lampshade and a framed portrait displayed on a surface. To the right, sheer curtains allow light to filter into the room. A vase of flowers is visible, adding charm and elegance to the setting. The attire of the individuals features delicate details and designs, indicative of formal or semi-formal wear.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image is a black and white photo negative showing three people sitting on a floral-patterned sofa in a living room setting. The figures consist of two children and an adult, likely a mother and her daughters, based on their attire and the way they are seated. The children are each wearing dresses with short sleeves and collars, featuring buttons down the front. The adult, wearing a dress with a decorative neckline, is seated in the middle. Behind them, there is a lamp with a decorative lampshade, a framed portrait on the wall, and a vase with flowers on a table. The room also features curtains and other typical living room decor.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-23

The image shows three women sitting on a couch in what appears to be a living room. They are dressed in formal attire, with the woman in the center wearing a white dress and the two women on either side wearing white blouses with dark skirts. The room contains a lamp, a framed portrait on the wall, and some floral arrangements. The image has a vintage, black and white aesthetic.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-23

The black and white photograph depicts a woman sitting between two young girls on an ornate couch or sofa. The woman is wearing an elegant light-colored dress with short sleeves, and her hair is styled in a wavy bob. The two girls are wearing matching dresses with collars and buttons down the front. Behind them is a lamp with a decorative lampshade and what appears to be a framed portrait on the wall. The image has a nostalgic, vintage feel, likely from the early to mid 20th century based on the clothing and decor styles.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-23

This is a black and white photograph that appears to be from an earlier era, possibly the 1920s or 1930s. The image shows three people seated on a floral-patterned couch or settee. They are all wearing white clothing - the person in the middle wears what appears to be a white dress with decorative details at the neckline, while the two on either side are wearing similar sailor-style collared outfits. In the background, there's a table lamp with a decorative shade and what appears to be a framed photograph on display. The lighting in the photograph creates an interesting negative effect, making the subjects appear to glow against the darker background. The setting suggests this was taken in someone's home, with typical interior decorations of the period visible.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a woman and two young girls sitting on a couch in a living room. The woman, who appears to be the mother, is wearing a long dress with a brooch at the neckline. She has short, wavy hair and is sitting in the middle of the couch with her hands resting on her lap.

To her left is a young girl who is also wearing a dress with a collar and buttons down the front. She has short hair and is sitting with her hands in her lap. To the woman's right is another young girl who is also wearing a dress with a collar and buttons down the front. She has short hair and is sitting with her hands in her lap.

In the background, there is a lamp with a floral shade, a vase of flowers, and a picture frame on the back of the couch. The walls of the room are painted a light color, and there are curtains on the right side of the image.

The overall atmosphere of the image is one of warmth and comfort, suggesting that the family is enjoying a quiet moment together in their home.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of three women sitting on a couch. The woman in the middle is wearing a white dress with a brooch, and the two women on either side are wearing matching dresses with dark trim and buttons down the front. They are all wearing head coverings.

Behind them is a lamp with a floral shade, a framed picture of a man, and a vase of flowers. The background appears to be a living room or parlor, with a wall and curtains visible behind the couch. The overall atmosphere of the image suggests a formal or posed photograph, possibly taken in the early 20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The image shows three women sitting on a couch, probably posing for a photograph. The woman in the middle is wearing a white dress and a necklace. The two women on either side are wearing similar dresses with a ribbon on the shoulders. A lamp is placed on the left side of the couch, and a flower vase is on the right side. A picture frame is mounted on the wall behind the couch.

Created by amazon.nova-pro-v1:0 on 2025-06-09

A black-and-white image of three people, perhaps a family, sitting on a couch with pillows. The woman in the middle is wearing a necklace and a white dress. On her left is a child wearing a dress with a collar. On her right is another child wearing a dress with a collar and a ribbon. Behind them is a lamp with a shade and a picture frame.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

Overall: The image appears to be a black and white negative photograph. It's a portrait of a woman and two young girls. They are seated together on a floral patterned couch, suggesting a domestic setting.

Details:

  • Subjects: A woman sits in the center, likely the mother or matriarch figure, with two young girls on either side of her.
  • Attire: They are all dressed in light-colored clothing. The girls appear to be wearing matching dresses with dark trim and collars. The woman is wearing a dress or top and skirt, and may have a brooch on her chest.
  • Setting: The setting appears to be a well-appointed living room.
  • Furniture/Decor: The floral patterned sofa is a prominent feature. A lamp with a decorative shade is visible behind the woman, and a framed picture hangs on the wall behind the sofa.

Style/Era: The image style suggests a vintage photograph, likely from the early to mid-20th century. The clothing styles, the interior decor, and the overall aesthetic point to this timeframe.

Created by gemini-2.0-flash on 2025-05-18

Here's a description of the image:

This is a black and white photograph featuring a woman and two girls seated on a sofa. The image appears to be a negative, meaning the colors are inverted.

The woman is in the center, wearing a dress with a brooch or decorative clasp at the neckline. She looks directly at the camera. The two girls are positioned on either side of her. They are dressed in similar outfits with a collar that is somewhat scalloped and vertical stripes. They also look forward, towards the camera. They are all on a sofa that has a patterned material.

Behind the sofa, there's a lamp with a decorative lampshade. To the left is what looks like a picture frame with a portrait inside it. A vase of flowers sits to the right of the woman. A window with drapery or blinds is also to the right.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a black-and-white photograph featuring three individuals sitting on a floral-patterned sofa. The setting appears to be a well-furnished living room, with decorative elements such as a lamp with an ornate shade, a framed photograph on the wall, and a vase with flowers on a side table.

In the center of the image is an adult woman wearing a light-colored dress with a high neckline and long sleeves. She has short, wavy hair and is adorned with a noticeable necklace. Her posture is upright, and she is looking directly at the camera.

Flanking the woman on either side are two young girls, likely her daughters, dressed in matching outfits. The girls are wearing light-colored dresses with dark trim and sailor-style collars. They both have short, curly hair and are also looking at the camera. The girl on the left is smiling slightly, while the girl on the right has a more neutral expression.

The overall ambiance of the photograph suggests a formal or special occasion, given the coordinated attire and the composed poses of the subjects. The image captures a moment of familial togetherness and elegance.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-13

This is a black-and-white photograph featuring three individuals seated on a floral-patterned couch. The setting appears to be a living room, as indicated by the lamp, a framed portrait on the wall, and a vase with flowers. The individuals in the center and on the right seem to be wearing matching outfits, which include dresses with short sleeves and sailor-style collars. The person in the center is slightly elevated, possibly on a cushion, and is wearing a lighter dress with a noticeable decorative element around the neckline. The two individuals on either side are seated closely, with their hands clasped in their laps. The overall mood of the image is formal and elegant, suggesting it might be a portrait or a family photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-13

This black-and-white photograph features three women seated together on a couch in an elegant and formal setting, suggesting a family portrait. The central figure appears to be older, possibly a mother, while the two individuals on either side of her seem younger, likely her daughters. All three women are dressed in matching or complementary white attire, with the younger women wearing similar sailor-style dresses. The older woman in the center is wearing a white dress with a decorative brooch at the neckline.

Behind them, there is a lamp with a patterned lampshade, and a framed photograph of a man is placed on a surface nearby. A vase of flowers is also visible on the right side of the image. The background includes a patterned wallpaper and curtains, adding to the formal and ornate atmosphere of the scene. The overall composition and attire suggest a sense of unity and elegance within the family.

Text analysis

Amazon

notos