Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Philadelphia)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12074

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (portrait of woman with three girls on living room couch, Philadelphia)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12074

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.4
Clothing 94.6
Apparel 94.6
Footwear 93.8
Female 93.5
Accessories 92.3
Accessory 92.3
People 91.5
Furniture 88.3
Dress 86.7
Woman 79.6
Family 75.8
Art 72.9
Girl 71.9
Face 70.8
Photography 69
Photo 69
Portrait 68.5
Sitting 58.6
Couch 57.8
Shorts 55.3

Clarifai
created on 2023-10-26

people 99.9
adult 98.5
woman 97.9
two 96.9
man 96
wear 94.8
group 90.6
monochrome 90.6
wedding 87.3
actress 85.7
leader 84.2
sit 83.3
three 83.1
furniture 82.8
indoors 82.7
portrait 82.2
child 82.1
home 81.8
administration 81.7
street 81.6

Imagga
created on 2022-01-15

salon 50.4
chair 41.8
seat 27.7
barber chair 25.5
man 24.2
people 24
person 23.6
portrait 20.1
adult 18.7
male 18.5
room 18.1
furniture 17.1
old 16.7
wheelchair 16.3
home 15.9
hairdresser 15.8
sitting 14.6
interior 14.1
indoors 14
fashion 13.6
family 13.3
happy 13.2
senior 13.1
shop 12.9
smile 12.8
smiling 12.3
lifestyle 12.3
indoor 11.9
health 11.8
lady 11.4
couple 11.3
mature 11.2
women 11.1
love 11
teacher 10.6
patient 10.3
men 10.3
professional 10.1
inside 10.1
dress 9.9
luxury 9.4
architecture 9.4
mother 9.3
house 9.2
life 9.2
aged 9
medical 8.8
looking 8.8
illness 8.6
barbershop 8.3
vintage 8.3
care 8.2
worker 8.2
educator 7.9
happiness 7.8
face 7.8
ancient 7.8
model 7.8
elderly 7.7
sofa 7.7
two 7.6
casual 7.6
window 7.5
one 7.5
style 7.4
furnishing 7.4
business 7.3
mercantile establishment 7.2
history 7.2
posing 7.1
work 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

person 98.2
text 97
outdoor 88
clothing 82.5
furniture 82.1
wedding dress 77.8
posing 53.8
bride 53.3
black and white 51.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 93%
Calm 94.4%
Surprised 3%
Happy 1%
Sad 0.9%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 90.3%
Sad 71%
Happy 23.7%
Calm 3.2%
Surprised 0.5%
Disgusted 0.5%
Angry 0.4%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 27-37
Gender Female, 94.2%
Calm 99.3%
Happy 0.4%
Sad 0.1%
Fear 0%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 30-40
Gender Male, 99.6%
Calm 97.2%
Sad 1%
Happy 0.7%
Disgusted 0.5%
Confused 0.2%
Surprised 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 16-22
Gender Female, 83.5%
Calm 85.6%
Sad 5.7%
Surprised 2.2%
Happy 2%
Fear 1.9%
Disgusted 1.1%
Angry 0.9%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Tie

Clarifai

Footwear
Woman
Human face
Dress
House
Human leg
Human hair
Plant
Clothing
Fashion accessory

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 82.1%

AWS Rekognition

Shoe 93.8%

AWS Rekognition

Shoe 84.1%

AWS Rekognition

Tie 92.3%

Clarifai

Footwear 94.3%

Clarifai

Footwear 93.5%

Clarifai

Footwear 91.9%

Clarifai

Footwear 72.2%

Clarifai

Footwear 68.6%

Clarifai

Footwear 64.8%

Clarifai

Footwear 57.3%

Clarifai

Footwear 53.2%

Clarifai

Footwear 49.1%

Clarifai

Footwear 40.5%

Clarifai

Footwear 37.9%

Clarifai

Footwear 34.5%

Clarifai

Woman 85.6%

Clarifai

Woman 75.1%

Clarifai

Woman 60.3%

Clarifai

Woman 60.1%

Clarifai

Human face 79.5%

Clarifai

Human face 78.5%

Clarifai

Human face 76.7%

Clarifai

Human face 69.2%

Clarifai

Human face 44%

Clarifai

Dress 59.5%

Clarifai

Dress 49%

Clarifai

House 52.2%

Clarifai

Human leg 50.3%

Clarifai

Human leg 48.8%

Clarifai

Human leg 38.1%

Clarifai

Human leg 36.6%

Clarifai

Human leg 36.5%

Clarifai

Human hair 46.7%

Clarifai

Plant 34.6%

Clarifai

Clothing 34.1%

Clarifai

Fashion accessory 33.1%

Categories

Imagga
created on 2022-01-15

streetview architecture 52.1%
people portraits 34.4%
events parties 8.5%
interior objects 2.9%
paintings art 1.6%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

photograph of a family in a bathtub.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a woman sitting on a couch with two children

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image shows a sophisticated interior space decorated with detailed wallpaper featuring floral and pastoral designs. A large statue stands prominently, adding an artistic touch to the room. A fireplace mantel in the background is adorned with a candelabra and a potted fern. The setting includes a curved sofa and patterned armchairs, reflecting elegant and classic decor. Several individuals are positioned in the room, creating a sense of a familial or social gathering.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image is a black and white negative of a domestic interior setting, likely a living room. The background features intricately patterned wallpaper with floral and natural motifs. There is an ornamental statue placed on a mantelpiece or ledge. A decorative candle holder is mounted on the wall. Several potted plants adorn the top of what appears to be a fireplace mantel. The room is furnished with a sofa and a chair, both upholstered, with a patterned or textured fabric. The space portrays a sense of classic or vintage style with a combination of decorative elements and furniture.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a black and white photograph depicting a group of people seated in an ornate, floral-patterned room. The room features decorative curtains, candelabras, and other furnishings that suggest an elegant, high-society setting. The people in the image are dressed in formal attire, with some wearing elaborate costumes or masks, creating an atmosphere of mystery and theatricality. The overall scene conveys a sense of opulence and a certain air of intrigue or celebration.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a vintage black and white photograph, likely from the mid-20th century, showing a living room or parlor setting. The room features ornate wallpaper with floral and bird designs, and what appears to be a couch or seating area. The image appears to be a negative or inverted photograph, where the tones are reversed from what would normally be seen. The interior decoration suggests this was taken in an upscale home, with elegant furnishings and decorative elements visible in the background. The photograph has a somewhat formal composition typical of the era's indoor photography.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

This image is a black and white photograph of a woman and three young girls in a living room. The woman, seated in a chair, wears a white dress with a V-neckline and white shoes. The three girls, all with blonde hair, wear dresses and Mary Jane shoes. Two of the girls sit on a couch, while the third stands behind the woman.

The room features a fireplace with a mirror above it, a statue on a shelf, and a floral wallpaper. The overall atmosphere suggests a formal family portrait from the early 20th century.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black and white photograph of a woman and two young girls in a room with floral wallpaper.

The woman sits in a chair on the right side of the image, wearing a white dress and white shoes. She has short, curly hair and is turned slightly towards the camera. The girl on the left sits on a couch, wearing a striped dress and white shoes. She has long blonde hair and is turned towards the woman. The girl on the right stands behind the couch, wearing a striped dress. She has long blonde hair and is turned towards the camera.

The background of the image shows a room with floral wallpaper, a mirror, and a fireplace. The overall atmosphere of the image is one of warmth and comfort, suggesting a happy family moment.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The black and white photo shows four people, three of whom are wearing dresses. One of them is sitting on a chair, while the other three are standing, and they are all smiling. The woman sitting on the chair is wearing a white robe, while the others are wearing dresses. Behind them is a couch with a pillow. A statue is placed in front of the wall with a floral design.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image shows a black-and-white photograph of a family posing for a picture in a room. The family consists of a woman sitting on a chair, a young girl sitting on the woman's lap, another young girl sitting on a couch, and a young boy standing next to the couch. The room has a floral wallpaper, a fireplace, and a statue of a person. The image has a watermark with the text "A.C.A. 6721" in the top left corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

Here is a description of the image:

The image is a vintage-looking photograph, likely a negative due to the inverted colors. It depicts a woman and three children posing inside a room with elegant decor.

Here's a breakdown:

  • Composition: The subjects are arranged in a group. One woman sits in a chair, and two children are on a curved sofa to her left, another one is standing behind them.

  • Attire: The individuals are dressed in what appears to be outfits from the mid-20th century. The woman in the chair is wearing a white dress, and the children are in dresses as well.

  • Setting: The room is ornately decorated. The walls are covered in a dark wallpaper with intricate floral and bird motifs. There's a decorative statue on a stand. A fireplace or mantle is visible.

  • Overall Impression: The photograph evokes a sense of formality and elegance. The lighting is even and the composition suggests a posed family portrait.

Created by gemini-2.0-flash on 2025-05-18

This is a black and white negative image featuring a woman and three girls. The woman is seated in a chair, wearing a light-colored dress. To her left, two girls are sitting on a couch, both dressed in patterned dresses and wearing shoes. Standing behind them is another girl in a similar dress. The room is decorated with patterned wallpaper, a statue, and plants. The image has a vintage feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image appears to be a vintage black-and-white photograph featuring four individuals, likely a family, posing in a formal setting. The room is elaborately decorated with ornate wallpaper featuring floral and classical motifs.

Here are some detailed observations:

  1. People in the Photo:

    • Seated Adult: The central figure is an adult seated on an armchair, wearing a light-colored dress and white shoes.
    • Standing Adult: To the right of the seated adult, another adult is standing, dressed in a striped dress and also wearing white shoes.
    • Children: Two children are positioned on either side of the seated adult. The child on the left is standing and wearing a striped dress and white shoes, while the child on the right is seated on the arm of the chair, wearing a darker dress with a ruffled collar and white shoes.
  2. Room Decor:

    • Wallpaper: The wallpaper is intricate, featuring a dark background with detailed floral and classical designs.
    • Furniture: The room contains elegant furniture, including a sofa and armchairs. The armchair where the adult is seated has a patterned upholstery.
    • Decorative Elements: There are various decorative items, such as a candelabra on the wall, potted plants, and what appears to be a decorative screen or panel with more floral designs.
  3. Lighting and Atmosphere:

    • The lighting in the room seems to be natural, possibly coming from a window not visible in the frame, giving the photograph a soft, even illumination.
    • The overall atmosphere of the photo suggests a formal, possibly special occasion, given the attire of the individuals and the elegance of the room.

This photograph likely captures a moment from the mid-20th century, judging by the style of clothing and the decor.

Qwen

No captions written

Text analysis

Amazon

6721
A70A
MJI7 YE3 A70A
MJI7
YE3

Google

O MJI3 YT37A2 A73A
O
MJI3
YT37A2
A73A