Human Generated Data

Title

Untitled (portrait of woman with two girls on living room couch, Philadelphia)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12215

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of woman with two girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12215

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.5
Furniture 98.4
Living Room 95
Indoors 95
Room 95
Clothing 82.3
Apparel 82.3
People 81.8
Sitting 75.8
Hearth 75.1
Plant 56.4
Tree 56.4
Home Decor 56.3

Clarifai
created on 2019-11-16

people 99.7
woman 97.9
adult 97.9
family 97
child 96.9
group 96.8
man 96.7
two 96.7
furniture 96.4
room 95.4
portrait 93.7
indoors 92
sit 91.6
seat 89.6
girl 89.2
offspring 88.8
wear 88.8
one 88.4
three 88.1
chair 87.9

Imagga
created on 2019-11-16

kin 66.5
people 21.2
dress 19.9
portrait 18.8
person 17
sexy 16.9
fashion 16.6
love 16.6
adult 15.9
happiness 14.9
model 14.8
sitting 14.6
groom 14.5
sculpture 14.5
bride 14.4
couple 13.9
old 13.9
happy 13.8
art 13.7
two 13.6
posing 13.3
pretty 13.3
attractive 13.3
lady 13
room 12.3
hair 11.9
architecture 11.8
history 11.6
statue 11.4
face 11.4
wedding 11
romantic 10.7
ancient 10.4
passion 10.3
women 10.3
monument 10.3
sensual 10
religion 9.9
fun 9.7
marble 9.7
mother 9.5
man 9.4
culture 9.4
skin 9.3
world 9.3
elegance 9.2
building 9.1
style 8.9
interior 8.9
looking 8.8
body 8.8
brunette 8.7
lifestyle 8.7
male 8.6
luxury 8.6
smile 8.6
bouquet 8.5
column 8.5
travel 8.5
traditional 8.3
tourism 8.3
one 8.2
sensuality 8.2
smiling 8
black 7.9
look 7.9
elegant 7.7
child 7.7
stone 7.6
historical 7.5
vintage 7.4
blond 7.4
parent 7.4
historic 7.3
decoration 7.3
cheerful 7.3
indoor 7.3
new 7.3
make 7.3
family 7.1
life 7.1
indoors 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

sitting 94.1
clothing 91.8
indoor 91
furniture 88.4
text 88.2
person 86.2
smile 78.7
woman 75.2
fireplace 74.1
couch 70.4
house 50.5
old 47.5
seat 42.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Female, 54.9%
Angry 45%
Happy 45%
Disgusted 45%
Confused 45%
Surprised 45%
Calm 55%
Fear 45%
Sad 45%

AWS Rekognition

Age 2-8
Gender Female, 53.7%
Calm 45.1%
Disgusted 45%
Happy 45%
Fear 45%
Confused 45%
Angry 45%
Surprised 45%
Sad 54.9%

AWS Rekognition

Age 11-21
Gender Female, 52%
Angry 45.9%
Sad 46.6%
Confused 45.1%
Surprised 45%
Happy 45%
Disgusted 45.1%
Calm 52.3%
Fear 45.1%

AWS Rekognition

Age 9-19
Gender Male, 50.3%
Angry 49.7%
Happy 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 50.2%
Surprised 49.5%

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 10
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Couch
Fireplace

Clarifai

Dress
Footwear
Girl
Human face
House
Human leg
Pillow
Couch
Fireplace
Human arm

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 97.5%

AWS Rekognition

Couch 97.8%

AWS Rekognition

Fireplace 74.2%

Clarifai

Dress 84.7%

Clarifai

Dress 74%

Clarifai

Dress 72.3%

Clarifai

Footwear 84.2%

Clarifai

Footwear 77.7%

Clarifai

Footwear 75.9%

Clarifai

Footwear 75.4%

Clarifai

Footwear 75.2%

Clarifai

Footwear 70.9%

Clarifai

Footwear 62.4%

Clarifai

Footwear 41.8%

Clarifai

Footwear 35.5%

Clarifai

Girl 78%

Clarifai

Human face 74.1%

Clarifai

Human face 61.4%

Clarifai

Human face 57%

Clarifai

Human face 34.3%

Clarifai

House 63.8%

Clarifai

Human leg 52%

Clarifai

Human leg 45.4%

Clarifai

Human leg 38.1%

Clarifai

Human leg 33%

Clarifai

Pillow 51.3%

Clarifai

Couch 51.3%

Clarifai

Couch 33.6%

Clarifai

Fireplace 50.9%

Clarifai

Human arm 34.9%

Categories

Imagga
created on 2019-11-16

people portraits 37.7%
paintings art 36.2%
streetview architecture 25.7%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-27

a photograph of a woman sitting on a couch with two children

Created by general-english-image-caption-blip-2 on 2025-07-10

a woman and two children sitting on a couch

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts a classic vintage interior with elegant furnishings and decor. There is a marble fireplace adorned with decorative objects, including porcelain figurines and feather arrangements in vases. The wall behind features an ornate patterned design with mural-like artwork, while a statue stands nearby on a side table. The furniture includes a velvet couch and a striped upholstered armchair. The setting conveys a sense of sophistication and timeless style.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image depicts a vintage setting with an ornate living room interior. Three people are sitting on an elegant, upholstered sofa. The room features a decorative fireplace mantel, adorned with various small figurines and flanked by large feather decorations in vases. The wallpaper has an elaborate design, possibly depicting scenes or intricate patterns. There is also a striped upholstered armchair partially visible in the foreground. On a side table next to the sofa, there is a statue of a figure, contributing to the room's classic and formal atmosphere. The overall ambiance suggests a sophisticated and historic style.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows three women sitting in a lavishly decorated room. The room features ornate furniture, a fireplace with a decorative mantel, and floral wallpaper. The women are dressed in formal attire, suggesting this is a portrait or family photograph. The image has a vintage, black and white aesthetic, indicating it was likely taken some time in the past.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be from the 1940s or early 1950s. The image shows three people seated on an elegant velvet couch in what appears to be a formal living room. The room features ornate wallpaper with floral and scenic designs, a marble fireplace with decorative items on the mantel including what look like feather plumes, and refined furnishings.

The subjects are wearing clothing typical of the era - the woman in the middle wears a dark dress suit, while the two younger individuals wear dresses with short sleeves and full skirts. The furniture includes the velvet couch they're sitting on and what appears to be a striped chair or ottoman visible at the bottom of the frame.

The interior design reflects an upper-class or wealthy household of the period, with its formal decor and architectural details. The photograph has the formal, posed quality common to portrait photography of that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-02

The image is a black and white photograph of a woman and two young girls sitting on a couch in a living room.

  • The woman is wearing a dark-colored dress and sitting in the middle of the couch.
    • She has short hair and is looking at the camera.
    • Her legs are crossed, and she is holding a small object in her hands.
  • The girl on the left is wearing a light-colored dress and sitting on the edge of the couch.
    • She has curly hair and is looking down.
    • Her legs are straight out in front of her.
  • The girl on the right is wearing a striped dress and sitting on the right side of the couch.
    • She has straight hair and is looking down.
    • Her legs are crossed, and she is holding a small object in her hands.

The background of the image shows a living room with a fireplace, a chair, and a plant on the mantle. The walls are decorated with floral wallpaper, and there is a nutcracker on a shelf behind the couch.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-02

The image is a black-and-white photograph of three women sitting in a living room. The woman on the left is a young girl with curly hair, wearing a dress and Mary Jane shoes. She sits on a velvet sofa with her legs crossed. In the middle is an older woman with short, wavy hair, wearing a dark dress and heels. She sits next to the girl on the sofa. On the right is another young girl with curly hair, wearing a striped dress and Mary Janes. She sits in a chair.

Behind them is a marble fireplace with a plant on top. The wall behind the sofa has a floral patterned wallpaper. The overall atmosphere suggests a formal family portrait from the mid-20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-01

The image is a black-and-white photograph of a family sitting on a couch in front of a fireplace. The woman in the center is wearing a black dress and has her hands clasped together. The two young girls are sitting on either side of her, one wearing a white dress and the other a dress with a striped pattern. The fireplace is decorated with a marble mantel and a vase with flowers. There are also two lamps on the wall, one on either side of the fireplace.

Created by amazon.nova-pro-v1:0 on 2025-06-01

The black-and-white image shows a woman and two young girls sitting on a couch in a room. The woman is wearing a blouse and skirt, while the girls are wearing dresses. They are sitting close to each other, and the woman is looking to the right. Behind them is a fireplace with a vase and a statue on top. On the left side, there is a wall with a painting.

Google Gemini

Created by gemini-2.0-flash on 2025-06-16

In a vintage black-and-white photograph, a woman and two young girls are seated in a room with elaborate decor. The woman, positioned in the center, wears a dark, formal dress and has a serious expression. To her left, a younger girl with curly hair is seated on a plush sofa, wearing a light-colored dress. To the woman's right, another girl, slightly older, sits in a chair and wears a striped dress with white socks and dark shoes.

The room's decor is notable for its intricate wallpaper featuring floral and avian designs, along with decorative objects such as a statue of a figure in traditional attire. Behind the group, a marble fireplace is adorned with floral arrangements and decorative pieces. The room's opulence is further emphasized by the ornate moldings and the striped fabric of an armchair partially visible on the right side of the frame. The photograph has a classic, formal portrait style typical of the mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-11

Certainly! Here's a description of the image:

Overview:

The image is a black and white photograph of a woman and her two daughters seated in what appears to be a lavishly decorated room. The overall aesthetic suggests a sense of formality and wealth.

People:

  • Woman: She is centrally positioned, wearing a dark, tailored suit. Her hair is neatly styled, and her expression is serious. She is seated, likely on a velvet sofa, with her legs crossed at the knee.
  • Children: There are two young girls, sitting with the woman. One is seated to the left, and is wearing a dress with a floral pattern. The other is to the right of the mother, wearing a striped dress. They seem to be a bit somber, but well-dressed.

Setting:

  • Room: The room is elegantly furnished. The background shows a wall decorated with ornate wallpaper, depicting an Asian style landscape. There is a grand fireplace with a marble mantelpiece.
  • Furniture: The family is seated on a curved, velvet sofa. There is also a striped armchair visible.
  • Decor: Above the fireplace is an ornate arrangement of plants, ornaments, and a mirror. Candlesticks are mounted on the wall, adding to the room's sophisticated ambiance.

Overall Impression:

The photograph conveys an image of a well-to-do family. The formal attire and interior design suggest a setting of wealth, possibly captured during a formal portrait session. The expressions of the subjects add a hint of seriousness or formality to the atmosphere.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image is a black-and-white photograph featuring three individuals in a well-furnished room. The setting appears to be an elegant, vintage living room with ornate decorations.

  1. People:

    • There are three individuals: an adult woman and two young girls.
    • The adult woman is seated in the center on a chair, dressed in a formal outfit with a dark jacket and skirt.
    • The two girls are seated on either side of the woman. The girl on the left is sitting on a sofa and is wearing a dress with a light pattern and dark shoes. The girl on the right is seated on a chair, wearing a dress with a striped pattern and dark shoes.
  2. Room Decor:

    • The room has a large fireplace with a decorative mantelpiece adorned with various ornaments, including vases, figurines, and plants.
    • The wall behind the individuals features intricate wallpaper with a floral or botanical design.
    • There is a tall, ornate candelabra on the left side of the image.
    • The furniture includes a sofa and chairs, with the sofa having a striped cushion.
  3. Atmosphere:

    • The overall ambiance of the room is sophisticated and formal, indicative of a bygone era, likely the early to mid-20th century.
    • The photograph has a number "6730" written in the top right corner, which might be a cataloging or identification number.

The image captures a moment of formality and elegance, with the individuals posed in a manner suggesting a family portrait or a special occasion.

Qwen

No captions written

Text analysis

Amazon

6730

Google

G730
G730