Human Generated Data

Title

Untitled (family posing on patio)

Date

1957

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8986

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family posing on patio)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1957

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8986

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 97.3
Human 97.3
Furniture 96.6
Person 96.6
Person 93.4
Person 92.1
Indoors 89.5
Room 89
Person 87.1
Person 85
Living Room 84.6
Housing 77.9
Building 77.9
Table 77.8
Monitor 65.7
Electronics 65.7
Display 65.7
Screen 65.7
Tabletop 64
Desk 62.1
LCD Screen 59.9
Flooring 58.1
Shelf 57
Chair 56.7
Cafeteria 55.9
Restaurant 55.9

Clarifai
created on 2023-10-25

furniture 99.8
room 99.7
desk 98.3
people 98
indoors 96.7
home 95.8
bookcase 95.4
chair 94.2
group 93.9
monochrome 93.5
many 92.9
shelf 92.6
adult 90.1
table 87.7
seat 86.7
leader 85.2
headquarters 85.1
group together 84.9
man 84.4
no person 81.6

Imagga
created on 2022-01-09

interior 77.1
room 73.5
kitchen 63.6
house 54.4
furniture 53.5
home 52.7
modern 47
table 46.1
decor 40.7
chair 40.3
design 36.1
inside 35.9
floor 35.4
restaurant 33.8
indoor 32
wood 31.7
luxury 30.1
architecture 27.9
contemporary 27.3
building 26.4
apartment 25.9
stove 25.5
counter 24.6
style 24.5
cafeteria 23.1
decoration 22.5
indoors 21.1
dining 21
cabinet 21
area 21
structure 20.7
residential 20.1
window 19.8
oven 19.7
light 19.4
wall 18.8
lamp 18.1
glass 17.9
3d 17.8
office 16.8
estate 16.2
chairs 15.7
cook 15.6
empty 15.5
food 14.7
tile 14.6
expensive 14.4
sofa 14.4
nobody 14
space 14
sink 13.7
comfortable 13.4
decorate 13.3
living 13.3
refrigerator 13
stylish 12.7
domestic 12.7
wooden 12.3
island 11.9
cabinets 11.9
stool 11.9
real estate 11.7
drawer 10.9
granite 10.8
residence 10.7
lighting 10.6
new 10.5
plant 10.5
real 10.5
bar 10.2
desk 10
door 9.9
appliances 9.9
upscale 9.9
tables 9.9
hood 9.8
steel 9.7
carpet 9.7
classroom 9.6
render 9.5
lifestyle 9.4
clean 9.2
center 9
remodel 8.9
ceiling 8.9
hardwood 8.9
appliance 8.9
microwave 8.8
urban 8.7
cooking 8.7
work 8.6
mirror 8.6
construction 8.6
dinner 8.4
classic 8.4
shelf 8.2
studio apartment 7.9
spacious 7.9
rug 7.9
living room 7.8
stainless 7.8
vase 7.8
comfort 7.7
elegant 7.7
sliding door 7.7
hotel 7.6
rendering 7.6
drink 7.5
case 7.5
marble 7.4

Google
created on 2022-01-09

Black 89.8
Window 89.7
Rectangle 87.6
Black-and-white 86.6
Architecture 85.2
Table 85.1
Style 83.9
Building 81.6
Tints and shades 76.9
Monochrome 76.9
Monochrome photography 76.8
Shelving 76.7
Shelf 76.1
Chair 74.2
Glass 71.4
Space 71.3
Room 69.8
Design 68.4
Font 66
Darkness 64.2

Microsoft
created on 2022-01-09

furniture 98.2
table 97
text 96.4
chair 88
indoor 85.8
building 85.1
black and white 76.7
person 59.2
desk 5.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Female, 95%
Happy 84.8%
Calm 7.8%
Sad 5%
Confused 1.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 25-35
Gender Male, 84.6%
Calm 94.4%
Happy 4.7%
Sad 0.4%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Female, 61.8%
Calm 100%
Sad 0%
Happy 0%
Disgusted 0%
Angry 0%
Surprised 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person
Person 97.3%
Person 96.6%
Person 93.4%
Person 92.1%
Person 87.1%
Person 85%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of people sitting in chairs in a room -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This image appears to be a photographic negative of a mid-century modern outdoor gathering. There is a group of people, likely family or friends, seated and standing near a swimming pool in a patio area. They are relaxing on modern, stylish furniture such as lounge chairs and armchairs.

In the foreground, there is a rolling cart with plates and food items. The structure in the background seems to be a mid-century modern home characterized by large windows, a mix of smooth panels, and a textured wall. Palm trees and greenery add to the relaxed, upscale atmosphere of the scene, suggesting it might be set in a warm, sunny location.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image appears to be a photographic negative. It depicts a group of people gathered outdoors in what seems to be a modern residential setting. The individuals are seated in chairs and loungers around a patio area near a swimming pool. Based on the setup, it appears to be a casual gathering, possibly a poolside party or barbecue.

In the foreground, there is a wheeled cart or table with dishes and food items, hinting at a meal or refreshments being served. The architecture of the house in the background is mid-century modern, with large windows and clean lines. There are also glass block elements and lush vegetation, suggesting this is in a warm climate.

The people in the image are dressed in casual attire indicative of a leisurely, relaxed environment. They are interacting and enjoying each other's company, but the specific details of their expressions are not clear due to the negative nature of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows an outdoor patio or lounge area of what appears to be a mid-20th century modern building. The patio features large glass windows and sliding doors that open up to the outdoor space. There are several people seated around a table, seemingly engaged in conversation or a social gathering. The furnishings and decor have a mid-century modern aesthetic, with low-slung chairs and a mobile serving cart or table. The overall scene conveys a sense of relaxation and leisure in a well-designed, architectural setting.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The black and white photograph shows a group of people sitting around a table in what appears to be an outdoor patio or courtyard area of a building. The building has large glass windows and a brick exterior visible. On the table are various food items and dishes, suggesting the group is having a meal or snack together. Palm trees or plants can be seen through the windows, adding a tropical or warm climate feel to the setting. The people are dressed casually in short-sleeved shirts, giving the impression of a relaxed social gathering or meeting taking place.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a black and white photograph from what looks like the 1950s or 1960s, showing a mid-century modern home or building with several people relaxing on outdoor furniture on a patio or deck area. The architecture features clean lines, large windows, and a distinctive brick or block wall detail. There are palm trees visible, suggesting this is likely in a warm climate location. The furniture appears to be typical of the mid-century period, with what look like lounge chairs and a rolling cart or serving table. The scene suggests a casual, social gathering in a residential setting. The overall composition captures the indoor-outdoor living style that was popular in mid-century modern architecture.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a group of people gathered in front of a mid-century modern-style building, likely taken in the 1950s or 1960s.

Scene Description:

  • The building features a flat roof and a large, open courtyard with a pool in the foreground.
  • A group of approximately eight people are seated or standing in the courtyard, surrounded by lounge chairs and tables.
  • The individuals are dressed in casual attire, including shorts, t-shirts, and sundresses, suggesting a warm and relaxed atmosphere.
  • The building's architecture is characterized by clean lines, minimal ornamentation, and an emphasis on functionality, typical of mid-century modern design.

Visual Elements:

  • The photograph is taken in black and white, which adds to the retro aesthetic of the scene.
  • The image is framed by a white border, with a small notation at the top indicating the film number and date.
  • The overall effect is one of serenity and leisure, capturing a moment in time when people could relax and enjoy each other's company in a beautiful outdoor setting.

Context:

  • The image appears to be a snapshot of everyday life, perhaps taken during a social gathering or party.
  • The mid-century modern style of the building and the clothing worn by the individuals suggest that the photograph was taken during a specific era in American history.
  • The image may have been taken for personal or professional purposes, such as documenting a social event or showcasing the building's architecture.

Conclusion:

  • The photograph provides a glimpse into the past, capturing a moment in time when people could come together and enjoy each other's company in a beautiful outdoor setting.
  • The image's retro aesthetic and mid-century modern design elements make it a unique and interesting piece of visual history.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a group of people gathered in the courtyard of a modernist-style house. The house features large windows and sliding glass doors, with a balcony on the second floor. The courtyard is furnished with lounge chairs and a table, where the group is seated or standing. The atmosphere appears to be relaxed and social, with the individuals engaged in conversation. The overall setting suggests a warm and sunny day, possibly during the 1950s or 1960s, given the architectural style and clothing of the individuals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of people sitting on chairs around a table in an outdoor area. The people are wearing casual clothing, and some of them are wearing hats. The table has several items on it, including plates, bowls, and cups. The chairs are arranged in a circular pattern, and there is a large wall with a window in the background. The image has a watermark in the top right corner.

Created by amazon.nova-pro-v1:0 on 2025-06-03

In a black-and-white photograph, a group of people is sitting on the chairs, and a few are standing on the balcony of a building. A table with bowls, plates, and cups is placed in front of them. A man is standing near the wall, and a few potted plants are kept beside him. The glass wall is behind them, and some trees are spotted through the glass wall.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here's a description of the image:

The image is a black and white negative showing a group of people gathered outdoors near a modern, multi-story building with a pool. The scene suggests a leisurely social gathering or party.

Here are some key observations:

  • Setting: The building is clearly a prominent part of the scene. It features large rectangular windows and what appears to be decorative brickwork on one side. There's a pool and a patio area visible in the foreground. The style of the architecture suggests a mid-century modern aesthetic.

  • People: Several people are visible. They are casually dressed and seem to be enjoying themselves. Some are seated in lawn chairs. There's a table with food or drinks on it.

  • Overall Impression: The image evokes a sense of leisure, possibly a party or informal gathering at a private residence. The architectural style, the setting, and the people's attire all contribute to a sense of a mid-century lifestyle.

Created by gemini-2.0-flash on 2025-05-01

The image depicts an inverted black and white photograph of a group of people gathered near a swimming pool, outside a modern house. The house has a rectangular design, with large windows and what appears to be slatted shades or blinds. A section of the exterior wall is decorated with a grid pattern of square blocks.

Seven people are visible in the image. They are seated in lounge chairs or standing, engaged in conversation or relaxation. A table on wheels is placed in the foreground, holding plates and what appear to be serving dishes, suggesting a meal or gathering is taking place. A pool is nearby. The image seems to be a historical photograph of a group of people enjoying leisure time in an upscale, modern setting. The image is of a negative, and therefore the colors are inverted.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a group of people relaxing in a modern, open-air patio setting. The scene appears to be from a mid-20th century era, likely the 1950s or 1960s, given the style of the architecture, furniture, and clothing.

The setting includes a contemporary building with large windows and a distinctive design. The patio is furnished with sleek, minimalist chairs and a low table, which has a few items on it, including what looks like a coffee service.

Several individuals are seated or standing around the patio. The people are dressed in casual attire typical of the period, with some men wearing short-sleeved shirts and others in casual pants and shirts. One man is standing with his hands on his hips, seemingly engaged in conversation.

The overall atmosphere suggests a leisurely gathering, possibly a social event or a casual meeting. The design elements, such as the clean lines of the furniture and the building's architecture, reflect the mid-century modern style that was popular during that time.

Text analysis

Amazon

MJI7-
ROK