Human Generated Data

Title

Untitled (portrait of woman with two girls on living room couch, Philadelphia)

Date

c. 1940, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12218

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of woman with two girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12218

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.7
Furniture 99.4
Living Room 97.1
Indoors 97.1
Room 97.1
Home Decor 96.8
Sitting 88.6
Hearth 84.5
Clothing 77.4
Apparel 77.4
People 67.6
Linen 66
LCD Screen 56.4
Electronics 56.4
Screen 56.4
Display 56.4
Monitor 56.4

Clarifai
created on 2019-11-16

people 99.7
family 98.5
woman 97.1
adult 96.2
child 96.2
two 96.1
man 96.1
group 95.6
furniture 94.6
room 94.3
portrait 93.5
sit 93.3
indoors 92.3
seat 91.8
chair 90.5
couple 88.4
three 88
music 86
four 85.5
offspring 85.4

Imagga
created on 2019-11-16

kin 90.7
people 24.5
portrait 22
couple 21.8
dress 21.7
love 19.7
happy 18.2
happiness 17.2
person 15.7
adult 15.6
mother 15.5
man 15.5
sexy 15.3
fashion 15.1
groom 14.5
attractive 14
sitting 13.7
face 13.5
bride 13.4
old 13.2
room 13
model 12.4
lifestyle 12.3
male 12.2
body 12
home 12
pretty 11.9
hair 11.9
two 11.9
romantic 11.6
family 11.6
posing 11.5
interior 11.5
lady 10.5
art 10.4
world 10.3
women 10.3
parent 10.2
smiling 10.1
wedding 10.1
elegance 10.1
traditional 10
vintage 9.9
cheerful 9.8
style 9.6
luxury 9.4
passion 9.4
holiday 9.3
blond 9.2
sensuality 9.1
romance 8.9
color 8.9
looking 8.8
child 8.8
celebration 8.8
gift 8.6
party 8.6
culture 8.5
bouquet 8.5
casual 8.5
human 8.2
makeup 8.2
fun 8.2
indoor 8.2
one 8.2
year 8.2
sensual 8.2
decoration 8.2
new 8.1
together 7.9
look 7.9
boy 7.8
affectionate 7.7
sofa 7.7
father 7.7
loving 7.6
skin 7.6
studio 7.6
lying 7.5
joy 7.5
leisure 7.5
night 7.1
architecture 7
indoors 7
husband 7

Google
created on 2019-11-16

Photograph 96.4
Picture frame 87.5
Snapshot 85.9
Photography 70.6
Classic 68.6
Black-and-white 68.3
Room 65.7
Family 60.5
Art 58.1
Sitting 54.1
Vintage clothing 53.5
Style 51

Microsoft
created on 2019-11-16

indoor 96.2
furniture 92.1
clothing 91.1
person 86.4
couch 85.9
smile 82.4
woman 72.4
text 66.2
chair 56
human face 54.4
seat 37.4
fireplace 20.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 32-48
Gender Female, 55%
Calm 54.3%
Sad 45.1%
Angry 45.3%
Disgusted 45.1%
Happy 45.1%
Surprised 45%
Fear 45%
Confused 45%

AWS Rekognition

Age 8-18
Gender Female, 52.8%
Confused 45%
Disgusted 45%
Surprised 45%
Calm 53.4%
Angry 45.4%
Sad 46%
Happy 45%
Fear 45.1%

AWS Rekognition

Age 3-9
Gender Female, 54.6%
Angry 45%
Sad 54.4%
Happy 45%
Disgusted 45%
Calm 45.6%
Confused 45%
Surprised 45%
Fear 45%

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 15
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Fireplace
Couch

Clarifai

No features identified

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.7%

AWS Rekognition

Fireplace 94.3%

AWS Rekognition

Couch 82.4%

Categories

Imagga
created on 2019-11-16

streetview architecture 63.2%
paintings art 26.1%
people portraits 9.8%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-02

a photograph of a woman sitting on a couch with two children

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

The image depicts a vintage room setting featuring elaborately designed wallpaper with intricate botanical and scenic patterns. A marble fireplace serves as the centerpiece, adorned with decorative items including vases filled with dried foliage and small animal figurines. The furniture includes a curved sofa with plush upholstery and a striped armchair. A statue stands near the corner, adding an ornate touch to the luxurious room atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image depicts a family scene in an elegant, vintage living room. Three people are seated on a cushioned sofa in front of a decorative fireplace. The room features ornate wallpaper with a botanical and landscape pattern. The mantle is adorned with decorative objects and flanked by large, elaborate arrangements of feathers or foliage in vases. The furniture includes a sofa and a striped armchair, suggesting a formal and traditional interior design. The setting indicates a sense of warmth and sophistication.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-17

The image shows a black and white photograph of three people sitting in an elegant, ornate room. In the foreground, there are two young girls sitting on a couch, one wearing a patterned dress and the other a plainer dress. Behind them is an adult woman, likely their mother, sitting in a chair. The room is decorated with ornate wallpaper, a fireplace mantel with decorative items, and a chandelier overhead. The overall scene conveys a sense of an upper-class or wealthy household from an earlier era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-17

This is a black and white photograph that appears to be from the 1940s or early 1950s. It shows a formal living room setting with elegant decorative elements including a marble fireplace, ornate wallpaper with a botanical pattern, and decorative vases with feather arrangements on the mantel. Three people are seated on what appears to be a velvet sofa or settee - a woman in dark clothing in the middle and two young girls in patterned dresses on either side. The girls are wearing ankle socks and mary jane style shoes. Next to the sofa is a striped upholstered chair. The room has a very formal, upper-class appearance typical of mid-century interior design.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-07

The image is a black and white photograph of a woman and two children sitting on a couch in a living room.

  • The woman is wearing a dark-colored dress and has short hair.
    • She is sitting in the middle of the couch with her legs crossed.
    • Her hands are resting on her lap.
  • The child on the left is a young girl with curly hair.
    • She is wearing a light-colored dress and black shoes.
    • She is sitting on the edge of the couch with her legs dangling.
  • The child on the right is also a young girl with curly hair.
    • She is wearing a striped dress and white socks.
    • She is sitting on the edge of the couch with her legs crossed.

The background of the image shows a living room with a fireplace, a mantle, and a wall with floral wallpaper. There are also some decorative items on the mantle, such as vases and figurines. The overall atmosphere of the image is one of warmth and comfort, suggesting that it was taken in a home setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-07

This image is a vintage black-and-white photograph of a woman and two young girls seated in front of a fireplace. The woman, dressed in a dark dress with a white blouse underneath, sits on a couch between the two girls. The girl on the left wears a light-colored dress with dark shoes, while the girl on the right is dressed in a striped dress with white socks and dark shoes.

The room's decor features a fireplace with a marble mantel, adorned with various objects, including vases and figurines. A large mirror hangs above the fireplace, reflecting the room's interior. The walls are decorated with floral wallpaper, and a statue stands behind the couch. The overall atmosphere of the image suggests a formal family portrait, likely taken in the mid-20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph of a woman and two young girls sitting on a couch in a room. The woman is wearing a dress and shoes, while the two girls are wearing dresses and socks. They are all looking in the same direction, possibly at the camera. The room has a fireplace with a marble mantel and a plant on top. There is also a lamp and a chair in the room.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The image is a black-and-white photograph of a woman and two young girls sitting on a couch in a living room. The woman is wearing a black dress, and the girls are wearing dresses. The woman is sitting in the middle, with one girl on each side. The girl on the left is wearing shoes, while the girl on the right is wearing sandals. There is a fireplace behind them, with a vase on top.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-11

Certainly! Here's a description of the image:

Overall Impression:

The image is a vintage, black and white photograph likely from the mid-20th century. It depicts a woman and two young girls posed formally in an elegantly decorated interior.

Key Elements:

  • Subjects: A woman in a dark dress sits in the middle, with two young girls on either side of her. The girls are wearing dresses, one sitting on a curved sofa.
  • Setting: The scene is set in a luxurious room. Notable elements include:
    • Wallpaper with a detailed pattern, possibly depicting a landscape scene with birds and floral elements.
    • A marble fireplace, adorned with decorative items.
    • A mirror above the fireplace.
    • A statue on the wall.
    • High-end furniture.
  • Composition: The subjects are well-centered. The photographer appears to have used a wide angle to capture the interior.

Atmosphere:

The photograph evokes a sense of formality, elegance, and possibly a touch of reserved emotion, common in portraits from that era. The setting suggests a wealthy or privileged background.

Created by gemini-2.0-flash on 2025-05-11

Here's a description of the image:

This black and white photograph shows a woman seated with two young girls in a well-appointed room. The woman, dressed in a dark dress with a v-neckline and a small embellishment, sits in the center. The girl to her left wears a light-colored dress with a floral pattern and dark shoes. The girl to the right is in a striped dress, white socks, and open-toed sandals.

They are seated on a sofa and chair. The backdrop includes ornate wallpaper with a decorative motif and a dark statue standing on a pedestal. Behind them is a fireplace with a marble-like surround, topped with decorative items and greenery. To the right of the fireplace, striped chairs are visible.

The photograph, labeled with the number "6727" at the top, seems to capture a formal or posed family portrait in what appears to be an affluent home.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-08

The image depicts a vintage, black-and-white photograph of three individuals seated in a formal living room. The setting appears to be from the mid-20th century, likely the 1940s or 1950s, based on the clothing and decor.

In the center of the image, there is a woman wearing a dark dress with a V-neck and short sleeves. She is seated on an armchair with a patterned upholstery. On either side of her are two young girls, presumably her daughters. The girl on the left is wearing a light-colored dress with a floral or lace pattern and sandals. The girl on the right is wearing a striped dress and sandals as well.

The room is elegantly decorated with wallpaper featuring a scenic design, possibly of trees and landscapes. There is a fireplace in the background with a marble mantel adorned with decorative items, including vases and figurines. Above the fireplace, there is a large mirror framed by ornate molding. The furniture includes a striped armchair in the foreground and another patterned armchair on the left.

The overall atmosphere of the photograph suggests a formal family portrait, capturing a moment of domestic life in a well-appointed home.

Qwen

Text analysis

Amazon

6727

Google

6127
6127