Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)

Date

c. 1940, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12217

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12217

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Furniture 99.7
Human 99.7
Indoors 96.9
Living Room 96.9
Room 96.9
Apparel 91
Clothing 91
Sitting 81.5
Shorts 78.2
Female 76.4
People 69.1
Girl 59.6
Woman 59
Armchair 57.9

Clarifai
created on 2019-11-16

people 99.5
child 98.2
family 97.5
group 97.5
portrait 97
woman 95.8
adult 95.4
two 93.3
girl 92.4
offspring 91.4
man 91.2
three 89.8
room 89.4
love 89.2
baby 88.4
son 88.3
four 86
couple 85.3
sit 82.4
furniture 82.1

Imagga
created on 2019-11-16

kin 100
mother 42.2
couple 35.7
happy 32.6
love 30.8
family 30.2
male 29.5
portrait 29.1
parent 28.7
adult 28.5
people 28.4
happiness 26.6
man 26.2
smiling 24.6
together 24.5
child 23.8
women 20.6
father 20.3
lifestyle 20.2
person 20.1
dress 19
attractive 18.9
two 17.8
home 17.5
husband 17.2
smile 16.4
sitting 16.3
wife 16.1
cute 15.8
fun 15.7
holding 15.7
boy 15.6
daughter 15.6
lady 15.4
girls 14.6
relationship 14
brunette 13.9
bride 13.4
married 13.4
loving 13.4
cheerful 13
fashion 12.8
face 12.8
pretty 12.6
romance 12.5
posing 12.4
togetherness 12.3
casual 11.9
day 11.8
couch 11.6
handsome 11.6
romantic 11.6
marriage 11.4
human 11.2
sexy 11.2
outdoors 11.2
kid 10.6
world 10.6
indoors 10.5
dad 10.3
youth 10.2
wedding 10.1
room 10
joy 10
black 9.6
men 9.4
elegance 9.2
studio 9.1
group 8.9
interior 8.8
looking 8.8
hug 8.7
model 8.6
culture 8.5
dark 8.3
park 8.2
children 8.2
sensuality 8.2
groom 8.2
hair 7.9
standing 7.8
affection 7.7
30s 7.7
expression 7.7
son 7.7
sofa 7.7
sibling 7.6
style 7.4
teen 7.3
20s 7.3
teenager 7.3

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

smile 98.1
clothing 97.9
human face 96.8
indoor 93.1
woman 92.7
text 92.5
person 85.8
dress 85.6
old 55.7
posing 37.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 5-15
Gender Female, 85.7%
Fear 0.1%
Happy 0.1%
Calm 91.7%
Surprised 0.1%
Disgusted 0.2%
Angry 1.7%
Sad 5.9%
Confused 0.2%

AWS Rekognition

Age 5-15
Gender Female, 99.8%
Happy 96.5%
Sad 0.5%
Disgusted 0.3%
Fear 0.2%
Calm 1.8%
Angry 0.2%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 2-8
Gender Female, 93.9%
Surprised 0%
Sad 48.7%
Disgusted 0%
Calm 51.1%
Fear 0.1%
Angry 0%
Happy 0%
Confused 0%

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Couch

Clarifai

Human face
Girl
Footwear
Furniture
Human leg
Human nose
Human arm
Clothing
Dress
Human hair

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.3%

AWS Rekognition

Couch 95.2%

Clarifai

Human face 98.2%

Clarifai

Human face 96.4%

Clarifai

Human face 96.1%

Clarifai

Human face 64.6%

Clarifai

Girl 91.3%

Clarifai

Girl 78.1%

Clarifai

Girl 76.7%

Clarifai

Footwear 67.7%

Clarifai

Footwear 59.5%

Clarifai

Furniture 43.5%

Clarifai

Furniture 38.1%

Clarifai

Human leg 43.3%

Clarifai

Human leg 41.5%

Clarifai

Human leg 38%

Clarifai

Human leg 33.4%

Clarifai

Human nose 42.8%

Clarifai

Human nose 37%

Clarifai

Human arm 38.7%

Clarifai

Clothing 37.1%

Clarifai

Dress 34.6%

Clarifai

Human hair 34.1%

Categories

Imagga
created on 2019-11-16

people portraits 93.4%
paintings art 6.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-19

a photograph of a group of three girls sitting on a couch

Created by general-english-image-caption-blip-2 on 2025-07-10

three young girls sitting on a couch in front of a fireplace

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image depicts three young girls seated on a luxurious, upholstered sofa in an elegant interior setting. The room features ornate wallpaper with intricate designs, including a landscape scene and stylized floral motifs. Behind the sofa, a marble fireplace mantle is decorated with various objects such as vases holding tall decorative grasses and small figurines. The overall ambiance suggests a refined and sophisticated environment.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image shows three young girls sitting on an upholstered sofa in an ornate room. The two girls on the right are wearing similarly styled dresses, with vertical stripes and puffed sleeves. The girl on the left is wearing a floral patterned dress with short sleeves and ruffles. Behind them is a richly decorated room, featuring detailed wallpaper with natural motifs, including trees and animals. There is a large decorative mantle in the background adorned with ornaments and plants. A tall lamp stands to the left of the fireplace. Overall, the setting appears opulent and showcases the fashion and decor typical of a past era.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image shows three young girls sitting on a couch in what appears to be an old-fashioned interior setting. The girls are wearing patterned dresses and have different expressions on their faces - one is smiling, while the other two have more serious expressions. In the background, there is a decorative mantelpiece with various ornaments and a large framed painting on the wall. The overall scene has a vintage, nostalgic feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a vintage black and white photograph from perhaps the 1930s or 1940s. The image shows three young girls sitting on what appears to be a velvet or plush couch in what looks like a formal living room setting. They are wearing typical dresses of the era - one in a floral or dotted pattern and two in striped patterns. The room has decorative wallpaper with floral designs and there are ornate shelves or mantels visible in the background with various decorative items displayed. The photograph has the slightly formal, posed quality that was common in home photography of that period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

This image is a black-and-white photograph of three young girls sitting on a couch in a formal room. The girls are dressed in dresses, with the two on the right wearing matching striped dresses and the girl on the left wearing a floral dress. They are all facing the camera, with their hands clasped together in front of them.

The room features a fireplace with a marble mantle, adorned with various objects such as vases, figurines, and a plant. The walls are decorated with wallpaper and a large piece of artwork or tapestry. The overall atmosphere suggests a formal or posed setting, possibly for a family portrait or special occasion.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image is a black-and-white photograph of three young girls sitting on a couch in a living room.

The girl on the left has dark hair and is wearing a light-colored dress with a floral pattern. The girl in the middle has light hair and is wearing a dress with a striped pattern. The girl on the right has dark hair and is wearing a dress with a striped pattern.

The couch they are sitting on is upholstered in a light-colored fabric and has a rounded back. Behind them, there is a fireplace with a marble surround and a vase on top. To the left of the fireplace, there is a large painting or tapestry hanging on the wall. The walls of the room are painted white, and there are decorative molding and trim around the edges of the walls and ceiling.

The overall atmosphere of the image suggests that it was taken in the 1940s or 1950s, based on the style of clothing and the decor of the room.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-23

The image is a black-and-white photograph featuring three young girls sitting on a couch. They are all wearing dresses with floral patterns. The girl on the left has her hands clasped together and is looking forward. The girl in the middle is looking sideways, and the girl on the right is looking forward with her hands clasped together. Behind them is a fireplace with a marble mantel and a vase on top.

Created by amazon.nova-pro-v1:0 on 2025-05-23

The black-and-white photo shows three young girls sitting on a couch in the living room. The girl in the middle is smiling, while the other two are looking straight. They are wearing dresses with buttons and sandals. Behind them is a fireplace with vases, figurines, and other decorative items on top. On the left is a wall with a painting of a landscape and a statue.

Google Gemini

Created by gemini-2.0-flash on 2025-04-28

Here is a description of the image:

This black and white photograph features three young girls sitting on a couch, seemingly posed for a portrait. The girl on the left has short, dark hair with a bow. She is wearing a light-colored dress with a floral pattern and short, puffy sleeves. The middle girl is fair-haired and smiling slightly. She is wearing a dress with a striped pattern and short sleeves, buttoned down the front. The girl on the right has dark, wavy hair and a somber expression. She is wearing a dress identical to the one worn by the middle girl.

They are sitting on a plush couch, and the background of the photograph is quite ornate. Behind them is a wall covered in a busy wallpaper pattern featuring floral and scenic elements. In the corner, there is a decorative statue. Behind the girls, there is a marble fireplace mantle adorned with vases, decorative figures, and a row of feathers. A portion of what looks like a room's interior, including a floor with some objects and furniture, is visible on the lower right of the frame.

Created by gemini-2.0-flash-lite on 2025-04-28

Here's a description of the image:

Overall Impression:

The image is a vintage black and white photograph featuring three young girls seated on a plush, curved sofa. The setting appears to be a well-appointed, possibly opulent, interior.

Details:

  • The Girls: The girls are the central subjects. From left to right, their ages and expressions seem to vary:
    • Girl 1: She is the youngest, and wears a floral dress, her face is somewhat serious, possibly shy or reserved.
    • Girl 2: Looks to be of an older age than the first girl, with an amicable expression.
    • Girl 3: She has a serious expression.
  • Setting:
    • Sofa: The sofa is the main seating element. It has a rounded shape, seems to be made of a dark fabric, and has a velvet or similar texture.
    • Background:
      • A decorative wallpaper with a repeating floral or scenic pattern can be seen.
      • A small statue can be seen on the wall.
      • A fireplace is present in the background, with ornaments on the mantle.
      • Decorative touches such as what may be a decorative plant can be seen.
  • Style: The image's vintage aesthetic points to the mid-20th century.

Overall Tone:
The image suggests a captured moment from a refined or upper-class domestic environment. The picture's framing, pose, and interior suggest an intentional, staged photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image is a vintage black-and-white photograph featuring three young girls sitting together on a sofa. They are dressed in similar-style dresses, with the two older girls wearing matching striped dresses with short sleeves and the youngest girl wearing a dress with a floral pattern and short sleeves. The girls are seated closely together, with the youngest on the left, the middle child in the center, and the oldest on the right.

The setting appears to be a formal living room or parlor. The background includes an ornate wallpaper with a floral design, a mantelpiece adorned with decorative items such as vases and figurines, and a large potted plant on the mantel. The sofa they are sitting on has a plush, upholstered look, and there is a small table with a lamp visible to the right side of the image. The overall atmosphere suggests a well-decorated, traditional interior from an earlier era.

Qwen

No captions written

Text analysis

Google

72
72