Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

Date

1955

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7872

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Ben Stahl and family in living room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7872

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Furniture 99.7
Chair 99.7
Room 99.6
Indoors 99.6
Person 98.9
Human 98.9
Person 98.1
Person 96.8
Dining Table 91.9
Table 91.9
Chair 89.1
Dining Room 87.3
Chair 84.7
Chair 83.8
Person 78.1
Dressing Room 74
Restaurant 71.9
Living Room 57.6
Home Decor 57.2
Meal 56.2
Food 56.2
Waiting Room 55.5

Clarifai
created on 2023-10-25

chair 99.9
furniture 99.8
room 99.8
indoors 99.5
seat 99.5
table 99.4
inside 98.8
window 97
people 96.5
dining room 96.4
mirror 96.2
sit 94.1
interior design 93.3
hotel 92.7
monochrome 92.2
lamp 92
family 91.9
home 90.9
house 90.8
group 90.8

Imagga
created on 2022-01-09

room 66.8
chair 63.4
interior 56.6
table 55.3
furniture 52.7
restaurant 34.8
modern 33.7
seat 33
house 30.9
home 29.4
floor 27.9
dining 27.6
decor 27.4
design 26.5
glass 24.8
window 24.3
hall 23.8
wood 23.4
luxury 22.3
inside 22.1
dinner 21.2
chairs 20.6
indoors 20.2
contemporary 19.8
style 19.3
comfortable 18.2
architecture 18
nobody 17.1
empty 16.9
wall 16.4
light 16
classroom 16
indoor 15.5
tables 14.8
building 14.7
kitchen 14.7
apartment 14.4
residential 14.4
hotel 14.3
drink 14.2
cafeteria 13.9
folding chair 13.8
toilet 13.8
structure 13.4
lamp 13.3
food 13.3
tile 13.1
decoration 13
elegant 12.9
counter 12.7
plant 12.7
setting 12.5
living 12.3
lunch 12.2
office 12.1
party 12
bar 12
elegance 11.8
stylish 11.8
meal 11.4
decorate 11.4
service 11.1
business 10.9
eat 10.9
area 10.8
sofa 10.7
stool 10.1
banquet 9.9
upscale 9.9
estate 9.5
wine 9.3
3d 9.3
domestic 9
drawer 8.9
furnishing 8.9
stove 8.9
reception 8.8
catering 8.8
wooden 8.8
center 8.8
real 8.5
space 8.5
bathroom 8.4
event 8.3
cook 8.2
patio 8.2
door 8.1
dining table 8
lifestyle 8
cabinets 7.9
vase 7.9
urban 7.9
napkin 7.8
life 7.8
ceremony 7.8
lighting 7.7
relax 7.6
relaxation 7.5
blackboard 7.5
residence 7.5
wedding 7.4
refrigerator 7.2
steel 7.1
day 7.1

Google
created on 2022-01-09

Furniture 95.6
Table 93.1
Chair 92.8
Black 89.5
Plant 86.7
Black-and-white 85.6
Style 83.9
Building 82.7
Line 81.9
Monochrome 76.5
Tints and shades 76.3
Monochrome photography 75.9
Event 68
Rectangle 67.6
Room 67.4
Window 61.2
Classic 55.2
Dining room 54.9
Tablecloth 53.3
History 53.2

Microsoft
created on 2022-01-09

table 99
vase 97.3
chair 96.8
coffee table 93.6
house 89.1
kitchen & dining room table 89.1
text 83
interior design 72.3
curtain 71.1
mirror 70.2
black and white 69.1
bed 65.8
white 64.8
couch 59.5
studio couch 53.8
room 50.9
furniture 47.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 94.4%
Calm 98.5%
Happy 0.6%
Sad 0.4%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair
Person
Chair 99.7%
Chair 89.1%
Chair 84.7%
Chair 83.8%
Person 98.9%
Person 98.1%
Person 96.8%
Person 78.1%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a woman in a dress and a man in a chair -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This image appears to be a photo negative, which reverses the colors and tones of the scene. It depicts a family or group of people in a mid-century modern living space with large windows, furniture, and plants visible both indoors and outdoors. There are several chairs placed around a coffee table, and the space has a light and open feel. In the negative, light areas appear dark and dark areas appear light, making the trees and greenery outside seem starkly white, and the people and furniture have a ghostly inverted appearance. The individuals include adults and children engaged in different activities, such as play and interaction, creating a casual and familial atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a photographic negative showing a family scene inside a living room. The negative features five people, likely a family, with two adults and three children. The setting appears to be mid-20th-century, possibly the 1950s or 1960s, judging by the style of furniture and clothing.

In the foreground, there is a round coffee table with objects on it, including what seems to be a magazine or book, and some small items. Surrounding the coffee table are several chairs and a sofa.

The adult man is sitting and appears to be engaged with one of the children, a young boy on the floor who seems to be playing with blocks or a toy on a small table. The adult woman, seated on the sofa, is near a girl standing close to her. The girl is wearing a dress and facing the camera. There’s another child partially visible who seems to be a girl.

In the background, large windows showcase a view of lush greenery, possibly indicating a tropical or semi-tropical location. The room is filled with light, suggested by the contrast in the negative image, which indicates bright outdoor sunlight shining into the room.

Overall, the image captures a moment of family interaction in a domestic and possibly tropical or vacation setting, characterized by its mid-century modern interior design.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows an indoor living space with several people seated and interacting. There appears to be a large window or glass wall that provides a view of an outdoor area with plants and vegetation. The furniture in the room includes chairs, tables, and other decorative elements. The people in the image seem to be engaged in some kind of social activity or conversation, though I cannot identify any specific individuals.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white image shows a group of people, likely a family, sitting and standing on an outdoor patio or porch area. The patio is furnished with several chairs and tables, and there are plants and foliage visible in the background, giving the space a tropical or resort-like feel.

The people in the image appear to be casually dressed, with the women wearing dresses or skirts and the men in short-sleeved shirts. Based on their positioning and interactions, they seem to be relaxing and enjoying each other's company in this outdoor setting.

The architecture of the space features a flat roof supported by columns, creating a covered area that provides shade from the sun. The walls behind the group have large window openings, allowing for a view of the lush greenery outside.

Overall, the image captures a leisurely scene of a group spending time together in a comfortable and inviting outdoor living space, possibly at a vacation home or resort.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white photograph from what looks like the 1950s, showing a mid-century modern interior living space. The room features several pieces of characteristic modernist furniture including clean-lined lounge chairs and small round coffee tables. There are several people in the room, including what appears to be family members relaxing in the space. The walls appear to have an interesting textural or mural treatment, and there are plants or tropical foliage decorating the space. The overall aesthetic is very typical of mid-century modern design with its emphasis on clean lines, open spaces, and bringing the outdoors in through both architectural elements and decorative plants.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a family in a living room.

The room has a high ceiling and is furnished with a couch, two chairs, a coffee table, and a side table. The furniture is arranged in a conversational circle, with the couch at the back and the chairs and tables in front of it. There are plants and trees visible through the windows behind the furniture.

In the foreground, a woman sits on the couch, while a man and a child sit in the chairs. A woman stands behind the couch, and another woman stands to the right of the chairs. The atmosphere of the image is one of relaxation and leisure, with the family enjoying each other's company in a comfortable and well-appointed living room.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

The image depicts a black-and-white photograph of a family in a living room. The family consists of two adults and three children, with the adults sitting on a couch and the children playing on the floor. The room is furnished with a coffee table, chairs, and a rug, and features large windows that offer a view of the outdoors. The overall atmosphere of the image suggests a relaxed and casual gathering of the family in their home.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The black-and-white image depicts a living room scene with a large mural behind a family. The mural features a forest-like landscape with trees and plants. The family consists of two women, a man, and a young child. The women are seated on a couch, with one of them holding a glass and the other standing behind the man. The man is sitting with his legs crossed, and the child is standing near him. The living room is furnished with white chairs and tables.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black and white image shows a group of people in a room. A man and a woman are sitting on a couch, while a boy is sitting on the floor. A woman is standing in front of them. There are two round tables in the middle of the room, with books on top. On the right side, there is another chair. Behind them, there is a glass wall with plants and trees outside.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

The image appears to be a photographic negative showing a family in a mid-century modern setting, possibly a sunroom or a living area with extensive outdoor views.

In the foreground, there are two modern-style armchairs. Between them is a small, round coffee table with a book or magazine on it. A larger, rectangular coffee table stands in front of a white couch where an adult male wearing a patterned shirt and a young child are sitting. It seems like the child is engaged with something on the table.

Behind them on the couch, an adult female in a patterned dress is seated, and next to her, a young girl stands wearing a dress, looking straight at the camera. The background consists of large windows offering a view of lush greenery, trees, and plants, suggesting a tropical or subtropical environment.

The room appears well-lit, possibly due to the large windows, and the furniture has a clean, minimalistic aesthetic typical of the mid-century modern design era. The overall composition is a staged family portrait, capturing a moment of leisure or social interaction.

Created by gemini-2.0-flash-lite on 2025-05-17

Certainly! Here's a description of the image:

Overall Impression:

This is a negative image, likely of a photograph. It depicts a mid-century modern living space with a family or group of people. The scene is bright due to the inverted colors.

Setting:

  • The room seems to open up to an outdoor space. Large glass windows or sliding doors let in a lot of light and offer a view of lush foliage.
  • The interior features clean lines and minimalist furniture, consistent with the mid-century modern style.

People:

  • There appears to be a family or group of people in the scene, including a man, a woman, a young child, and possibly a teenage girl.
  • The adults are seated. The man and child are seated on the floor, possibly playing or interacting with an object.
  • The woman is in a floral dress. The teenage girl is wearing a dress as well.

Furniture and Objects:

  • Two armchairs with clean lines are positioned on the left and right side.
  • A white bench is placed against the window.
  • A small coffee table is in the center, with a side table.
  • There is a rug on the floor.
  • A plant is visible near the window.

Overall Vibe:

The image conveys a sense of leisure and relaxed living. The light and spaciousness of the room suggest a comfortable, inviting atmosphere. The scene looks like a typical home for the time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a vintage indoor scene, likely from the mid-20th century, featuring four people in a living room setting. The room is decorated with modern furniture, including low-backed chairs, a coffee table, and a side table. The decor includes various plants, a lamp, and other small decorative items.

The people in the image are dressed in casual, summery attire. Two women are seated on a couch, engaged in conversation or an activity. One woman is wearing a patterned dress, and the other is in a lighter-colored dress. A young girl stands beside the couch, wearing a sleeveless dress and holding an object, possibly a book or a magazine. A young boy is kneeling on the floor in front of the couch, also holding an object, which looks like a toy or a book.

The room has large windows or glass doors that provide a view of the outdoors, where more plants and a staircase are visible. The overall ambiance of the scene is relaxed and domestic, suggesting a family or friends gathering in a comfortable, well-appointed home. The photograph has a slightly faded, vintage quality, enhancing the nostalgic feel of the image.

Text analysis

Amazon

41572.
KODAK--A-ITW

Google

41572. MJI7-- YT37A°2 - - XAGOX
41572.
MJI7--
YT37A°2
-
XAGOX