Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)

Date

c. 1940, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12214

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of three girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12214

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Furniture 99.7
Human 99.7
Indoors 97.5
Room 97.5
Living Room 97.5
Sitting 83.2
Skin 77.7
People 75.2
Female 71.3
Shorts 70.5
Clothing 70.5
Apparel 70.5
Girl 66
Child 60.6
Kid 60.6
Woman 59.5
Teen 59.5
Blonde 59.5

Clarifai
created on 2019-11-16

people 99.7
child 98.8
family 98.7
portrait 97.1
group 97
two 96.6
adult 96.3
woman 95.8
offspring 93.8
room 92.5
man 91.5
girl 91.1
sit 89.5
son 89.5
three 89.4
baby 89.2
furniture 88.2
love 87.1
indoors 86.5
four 85.8

Imagga
created on 2019-11-16

kin 63.5
mother 58.5
parent 38.8
happy 34.5
couple 33.1
adult 33
people 31.8
love 31.6
family 30.3
man 28.9
happiness 26.6
portrait 26.5
child 26.1
male 25.6
lifestyle 23.9
attractive 23.8
together 22.8
sibling 22.8
fashion 22.6
couch 22.2
father 22
home 21.5
person 21.2
face 20.6
cute 20.1
smiling 19.5
model 19.4
boy 19.1
casual 18.6
smile 18.5
sexy 18.5
loving 18.1
fun 18
husband 17.3
sitting 16.3
daughter 16.3
body 16
hair 15.9
lady 15.4
looking 15.2
wife 15.2
kid 14.2
brother 14.1
brunette 13.9
cheerful 13.8
sofa 13.7
women 13.4
pretty 13.3
son 13.1
dad 12.9
human 12.7
sensuality 12.7
black 12.6
dark 12.5
romance 12.5
youth 11.9
girls 11.9
skin 11.9
elegance 11.8
dress 11.7
hug 11.6
posing 11.6
indoors 11.4
room 11
two 11
studio 10.6
jeans 10.5
relationship 10.3
adorable 10.2
20s 10.1
indoor 10
joy 10
handsome 9.8
interior 9.7
play 9.5
eyes 9.5
togetherness 9.4
passion 9.4
lying 9.4
playing 9.1
children 9.1
blond 9
one 9
married 8.6
day 8.6
expression 8.5
adults 8.5
relaxing 8.2
life 8.1
clothing 8.1
little 7.9
living room 7.8
desire 7.7
world 7.7
laugh 7.7
laughing 7.6
lingerie 7.4
holding 7.4
style 7.4
lips 7.4
make 7.3
group 7.3
domestic 7.2

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

clothing 97.3
human face 94.6
smile 94.3
woman 87.9
text 87.7
person 86
dress 77.9
posing 54.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-16
Gender Female, 99.9%
Angry 1.8%
Surprised 0%
Sad 93.4%
Happy 0%
Disgusted 0.1%
Confused 1%
Calm 3.3%
Fear 0.3%

AWS Rekognition

Age 8-18
Gender Female, 82%
Happy 0%
Fear 0.1%
Sad 5%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Calm 94.4%
Angry 0.3%

AWS Rekognition

Age 26-42
Gender Female, 54%
Surprised 45.4%
Fear 45.2%
Disgusted 45%
Calm 53.5%
Angry 45.2%
Confused 45.1%
Happy 45.3%
Sad 45.3%

Microsoft Cognitive Services

Age 14
Gender Female

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Couch

Clarifai

Human face
Girl
Clothing
Footwear
Human leg
Human hair
Human hand
Furniture
Human nose
Picture frame
Human arm

AWS Rekognition

Person 99.7%

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99%

AWS Rekognition

Couch 98.2%

Clarifai

Human face 97.9%

Clarifai

Human face 91.8%

Clarifai

Human face 91.2%

Clarifai

Human face 61%

Clarifai

Girl 89.6%

Clarifai

Girl 80.1%

Clarifai

Clothing 80%

Clarifai

Clothing 35.3%

Clarifai

Clothing 33.7%

Clarifai

Footwear 52.5%

Clarifai

Human leg 43.5%

Clarifai

Human leg 37%

Clarifai

Human leg 35.1%

Clarifai

Human leg 33.5%

Clarifai

Human hair 39.2%

Clarifai

Human hand 38.9%

Clarifai

Furniture 38.9%

Clarifai

Furniture 34.4%

Clarifai

Human nose 38.1%

Clarifai

Human nose 33.7%

Clarifai

Picture frame 36.7%

Clarifai

Picture frame 35.9%

Clarifai

Human arm 35.9%

Categories

Imagga
created on 2019-11-16

people portraits 79.5%
paintings art 19.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a group of three girls sitting on a couch

Created by general-english-image-caption-blip-2 on 2025-07-10

three girls sitting on a couch in front of a fireplace

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows three children sitting on a couch in an ornate room. The two children on the right are wearing matching striped dresses with puffed short sleeves, while the child on the left is wearing a lighter-colored outfit with delicate detailing. The setting features intricate wallpaper with floral and scenic patterns. Behind the couch, a statue is visible, and a marble fireplace adorned with vases, ferns, and decorative figurines occupies the background in a sophisticated interior.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts three children sitting on a velvety couch in an elegant and ornately decorated room. The two children on the right are wearing matching dresses with a striped pattern, while the child on the left is dressed in a lighter, possibly lace, outfit. The room has elaborate wallpaper featuring a floral and scenic design, adding to its sophisticated ambiance. Behind the children, there is a marble fireplace topped with decorative objects, including a vase of plumes and figurines. A statue resembling an ornate lamp or sculpture stands between the couch and the wall, contributing to the room's luxurious aesthetic.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows three young girls sitting on a couch in an ornate, old-fashioned room. The girls are wearing patterned dresses and appear to be from an earlier time period. Behind them, there is a decorative fireplace mantel with various ornaments and a painting on the wall. The overall scene has a vintage, nostalgic feel to it.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a vintage black and white photograph showing three young people sitting on what appears to be a velvet sofa or settee in what looks like an elegant room. The room has decorative wallpaper with floral patterns and a marble fireplace mantel decorated with ornamental items and what appears to be a large feathery plant or decoration. The subjects are wearing clothing typical of the mid-20th century - two are in patterned dresses with puff sleeves, and one is in what appears to be a lighter-colored dress. The photograph has the formal composition and interior setting characteristic of mid-century family portraiture.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-06

The image is a black-and-white photograph of three young girls sitting on a couch in a room with ornate decorations.

The girls are all wearing dresses and have their hands in their laps. The girl on the left has dark hair and is wearing a white dress with lace trim. The girl in the middle has light hair and is wearing a striped dress with buttons down the front. The girl on the right has dark hair and is wearing a similar striped dress to the girl in the middle.

The couch they are sitting on is upholstered in a dark fabric and has a curved back. Behind them is a marble fireplace with a vase of flowers on top and a few decorative objects on the mantle. To the left of the fireplace is a large mirror with a floral patterned frame. The walls of the room are painted white and have a floral patterned wallpaper on them. The floor is made of wood and has a rug in front of the fireplace.

The overall atmosphere of the image is one of elegance and refinement, suggesting that the girls are from a wealthy or upper-class family. The ornate decorations and the girls' formal attire support this interpretation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-06

The image is a black-and-white photograph of three young girls sitting on a couch in a room with a fireplace. The girl on the left has dark hair and is wearing a light-colored dress. The two girls in the middle have light hair and are wearing matching dresses. The room has a fireplace with a marble mantle, and there are various objects on the mantle, including vases and figurines. The walls of the room are decorated with floral wallpaper and a large mirror. The overall atmosphere of the image suggests a formal or special occasion, possibly a family gathering or portrait session.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph of three young girls sitting on a couch. The girl on the left is sitting on the edge of the couch, while the other two girls are sitting next to each other. The girl in the middle is looking directly at the camera, while the girl on the right is looking to the side. Behind them is a fireplace with a mantelpiece that has a vase and other objects on it.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black-and-white image shows three young girls sitting on a couch, probably in a living room. The girl on the left is sitting with her legs crossed, while the other two are sitting with their legs slightly apart. Behind them is a fireplace with a vase and a statue on top. On the left side, there is a statue and a wall with a floral design.

Google Gemini

Created by gemini-2.0-flash on 2025-05-04

Here is a description of the image:

This is a black and white photograph of three young girls sitting on a settee in what appears to be a luxurious interior. The photograph has a vintage feel.

The three girls are arranged side by side. The two girls in the center and to the right are dressed similarly in striped dresses with short sleeves. The girl on the left wears a lighter colored, patterned dress with a ruffled neckline. They all sit with their hands clasped or resting on their laps.

The settee is upholstered in a smooth material and has a slightly rounded shape. Behind the settee, the room is decorated with ornate wallpaper featuring floral and bird designs. A decorative sculpture of a figure stands against the wall.

To the right of the settee, there is a marble fireplace with a mirror above it. The mantelpiece is adorned with decorative items, including vases, sculptures, and what appears to be dried floral arrangements. The interior of the fireplace is dark.

The photograph is framed by a black border, and there is some white marking in the upper right corner. The image has a slight sheen.

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression: The image is a black and white photograph depicting three young girls sitting together on a curved, velvet-covered sofa. The scene is set indoors, in a room with elegant decor.

Details:

  • The Girls:
    • They appear to be around the ages of 6-10.
    • They are all dressed in dresses, one has a patterned dress, the other two have dresses with a striped design.
    • Their expressions are somewhat serious or reserved.
    • The one on the left is slightly blurred.
  • The Sofa: The sofa is a dark color, possibly velvet, with a curved back. It's the focal point of the image.
  • Background:
    • The wall is adorned with decorative wallpaper.
    • There is a fireplace with a marble mantelpiece.
    • A statue and other decorative items are visible on the mantelpiece.
  • Overall Tone: The image evokes a sense of formality and perhaps a glimpse into the lives of children from a more privileged background.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

This black-and-white photograph captures a scene from what appears to be a formal sitting room. The image features three young girls seated on a plush, upholstered couch. The two older girls, positioned in the middle and on the right, are wearing matching dresses with short puffed sleeves and a striped pattern. The youngest girl, seated on the left, is wearing a lighter-colored dress with a different pattern. All three girls have similar hairstyles, with the two older girls having their hair parted in the middle and styled neatly.

The room itself is decorated with an air of elegance. The wallpaper features a detailed, possibly floral or scenic design. Behind the girls, there is a fireplace mantel adorned with various decorative items, including a vase with flowers, a small statue, and what appears to be a clock or another decorative piece. There are also candlesticks and other ornamental objects on the mantel. The room has a traditional, perhaps early to mid-20th century, ambiance.

The photograph has a vintage feel, possibly due to its monochromatic nature and the style of the clothing and decor, suggesting it could be from the early to mid-20th century. The image has a slightly blurred quality, which adds to its nostalgic and historical aesthetic.

Qwen

No captions written