Human Generated Data

Title

Untitled (family sitting on deck near the water)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8840

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (family sitting on deck near the water)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8840

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Restaurant 99.7
Human 98.3
Furniture 97.6
Cafeteria 93.4
Cafe 93.3
Food Court 87.4
Food 87.4
Meal 75.4
Porch 70.3
Sitting 68.2
Table 64.2
Clothing 58.4
Apparel 58.4
Room 56.8
Indoors 56.8
Dining Table 55.8

Clarifai
created on 2023-10-25

people 99.8
monochrome 98.7
child 98.3
furniture 98.3
group 97.5
group together 96.6
man 95.8
family 95.8
chair 95.7
room 95.6
indoors 95.4
home 95
sit 94.9
adult 94.9
seat 93.4
many 93
woman 93
boy 92.6
several 91.5
recreation 89.9

Imagga
created on 2022-01-09

interior 33.6
room 33.5
house 30.9
table 29.9
home 27.9
furniture 26.4
chair 24.3
building 23.6
architecture 22.8
structure 22.5
modern 22.4
window 20.5
decor 18.5
luxury 17.1
glass 17.1
floor 16.7
design 16.3
center 16.2
office 15.8
style 15.6
restaurant 15.3
inside 14.7
indoor 14.6
patio 14.2
living 14.2
residential 13.4
wood 13.3
contemporary 13.2
decoration 13
monitor 12.3
business 12.1
city 11.6
dining 11.4
estate 11.4
classroom 10.8
kitchen 10.8
light 10.7
indoors 10.5
urban 10.5
empty 10.3
seat 10.3
travel 9.8
chairs 9.8
real 9.5
elegant 9.4
relax 9.3
umbrella 8.8
residence 8.7
construction 8.5
outdoor 8.4
plant 8.3
exterior 8.3
lifestyle 7.9
upscale 7.9
wall 7.8
electronic equipment 7.8
desk 7.8
black 7.8
nobody 7.8
class 7.7
shop 7.7
expensive 7.7
sofa 7.6
hotel 7.6
lamp 7.6
decorate 7.6
place 7.4
balcony 7.4
island 7.3
people 7.2
tourist 7.2
area 7.1
counter 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

building 99.2
text 97.8
store 51.2
window 21.6
several 10.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 98.7%
Sad 88.8%
Calm 7.4%
Confused 1.7%
Happy 1.1%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair

Clarifai

No features identified

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 91.7%

AWS Rekognition

Chair 97.6%

Categories

Imagga
created on 2022-01-09

streetview architecture 96.1%
nature landscape 1.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a woman sitting in a chair in a room with a large window

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This image is a black-and-white negative photograph showing a group of people gathered in a covered patio area. The setting appears to be tranquil and characterized by lush greenery, with various plants and foliage surrounding the scene. The patio features metal furniture, including chairs and tables adorned with ornamental designs.

The group consists of mostly women engaged in conversation or leisure activities. Some are seated while others stand. The individuals wear mid-20th century-style clothing, with dresses and skirts being prominent. In the background, the view opens up to trees and what seems to be waterfront elements, such as a boat or dock, suggesting a tropical or coastal location. A palm tree further emphasizes this setting. The structural elements of the patio, including beams and columns, provide a shaded environment.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image appears to be a photographic negative, which results from reversing the usual brightness values of a photograph. In this outdoor setting, on what seems to be a covered patio or terrace, several people are gathered. They are surrounded by potted plants and foliage, with outdoor furniture including sofas and a table.

There are four adults sitting together, engaged in conversation or reading. They appear to be interacting comfortably in a relaxed environment. In the background, through the openings of the terrace, you can see trees and possibly some boats, indicating the setting might be near a waterfront. The details are somewhat tricky to discern due to the image being a negative, but it is clear there's a sense of leisure and interaction among the people present in this space.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to depict an interior scene of what seems to be a flower shop or greenhouse. The space is filled with various potted plants, flowers, and other decorative items. Several people can be seen in the image, including what appears to be a florist or shop owner assisting customers. The overall atmosphere suggests a serene and tranquil setting, with the lush greenery and floral arrangements creating a visually appealing environment.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white photograph shows a group of elderly people sitting on a porch or patio area surrounded by many potted plants and flowers. The porch has a wooden roof structure overhead. The people appear to be relaxing and socializing together, with some reading books or newspapers. Based on their clothing and the setting, the image seems to be from an earlier time period, likely the early to mid 20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white photograph of what looks like a covered porch or veranda area. The space has several decorative elements including hanging lanterns and potted plants or foliage around the perimeter. There are several people seated in what appears to be outdoor furniture, with one person standing, possibly a server or staff member. The furniture appears to be ornate metal or wrought iron pieces typical of outdoor patio furniture. The setting suggests this might be at a restaurant, hotel, or similar hospitality venue. The architectural details show supporting columns and what looks like a covered ceiling area. The overall atmosphere appears relaxed and social, suggesting this might be a leisure or dining setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a group of people sitting on a patio, surrounded by lush plants and trees. The patio is covered with a roof, providing shade for the individuals seated on metal chairs and a couch. A man stands in the center, holding a tray with a drink, while the others appear to be engaged in conversation or enjoying their beverages.

In the background, a body of water can be seen, possibly a lake or ocean, with a dock or pier visible in the distance. The overall atmosphere of the image suggests a relaxed and social gathering, possibly a party or celebration, taking place in a warm and sunny location.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people gathered in a covered outdoor area, possibly a patio or porch. The scene appears to be from the mid-20th century, likely the 1950s or 1960s.

In the foreground, there are several pieces of furniture, including chairs, tables, and a bench. The furniture is arranged in a conversational circle, with some people sitting and others standing. The individuals in the photo are dressed in casual attire, with the women wearing dresses and the men wearing shirts and pants.

The background of the image features a railing that separates the patio from the surrounding area. Beyond the railing, there are trees and other vegetation visible, suggesting that the location is a residential area or a park.

Overall, the image captures a relaxed and social atmosphere, with the group of people enjoying each other's company in a pleasant outdoor setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image depicts a group of women sitting on chairs in an outdoor setting, possibly on a porch or veranda. The setting appears to be a garden or a patio with lush greenery, including trees and plants. The women are dressed in vintage clothing, suggesting the image might be from the mid-20th century. The image is in black and white, which adds to its nostalgic feel.

In the center of the image, there is a woman standing, possibly serving drinks or food to the seated women. She is wearing a white apron, indicating her role in the scene. The seated women appear to be engaged in conversation or enjoying each other's company. The atmosphere is relaxed and friendly.

In the background, there are more plants and trees, as well as a fence or railing that separates the porch from the rest of the garden. The image also includes a watermark in the bottom right corner, which reads "39481-B," likely indicating the photographer or the source of the image.

Overall, the image captures a moment of leisure and social interaction among a group of women in a beautiful outdoor setting. The black and white format adds to the timeless quality of the image, making it a nostalgic and charming depiction of a bygone era.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The image is a black-and-white photograph of a group of people sitting on chairs in a patio area. The image has a vintage filter. The people are sitting on chairs around a table. A person is standing behind the table. There are potted plants on the sides of the patio. The patio is covered with a roof. There are trees in the distance. There is a watermark with the text "39481-B" at the bottom right corner.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Scene:

The image appears to be a negative print, depicting a group of people relaxing on a covered patio or lanai. The scene is lush with foliage and overlooks what seems to be a body of water in the background.

Details:

  • People: There are several people, likely adults, seated in various chairs, socializing or possibly being served by a maid-like woman. The people are dressed in mid-century casual attire.
  • Setting: The patio is enclosed by a framework of pillars, and a corrugated metal or similar material roof. The space is filled with potted plants, and some decorative elements. The background shows a waterfront with what may be boats or a pier.
  • Furniture: There are ornate wrought iron style tables and chairs.
  • Lighting: The lighting is somewhat diffused, given that it's an indoor space.

Style and Context:

The image style, fashion, and surroundings suggest that it was taken during the mid-20th century, perhaps in a tropical or subtropical location.

Created by gemini-2.0-flash on 2025-05-17

The image is a vintage black and white photograph, showing a group of people relaxing on a covered patio, potentially near a body of water.

The patio is defined by architectural columns supporting a simple roof structure, with glimpses of the landscape visible in the background, hinting at a waterfront location.

On the left side, there are multiple individuals sitting in chairs around tables, engaged in conversation or simply relaxing. A woman in a dark shirt and white apron is standing, possibly serving the seated guests. Another woman is seated with a child on her lap, while two other women are seated separately on the opposite side of the patio. The atmosphere suggests a casual and social gathering.

The style of dress and the overall composition of the image suggest a mid-20th century time period. The plants add a touch of nature to the scene, enhancing the relaxed atmosphere of the patio.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a group of people gathered in what appears to be an outdoor patio or veranda area. The setting is adorned with various plants, including large potted plants and hanging plants, which contribute to a lush and cozy ambiance.

Four individuals are seated in different types of chairs, engaged in what seems to be a casual conversation or social gathering. One person is standing and appears to be serving or interacting with the seated individuals. The furniture includes wrought-iron chairs and tables, which are typical of outdoor patio furniture.

The area is covered by a roof, providing shade and shelter. The background features a fence and more greenery, indicating a well-maintained garden or backyard. The attire of the individuals suggests a relaxed, possibly evening setting, with some wearing hats and comfortable clothing.

Overall, the image captures a moment of leisure and social interaction in a serene, plant-filled outdoor space.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black-and-white photograph capturing a social gathering in what appears to be an outdoor or semi-outdoor setting, likely a lounge or patio area, at night. The scene is framed by large windows or glass panels that allow a view of the night sky and some silhouetted palm trees or decorative plants.

In the foreground, there is a group of people seated on metal-framed furniture with ornate designs, engaged in conversation. The individuals are dressed in formal attire, suggesting a special occasion or evening event. A server, dressed in a white apron and hat, stands at the center of the group, holding what seems to be a drink or a small plate, possibly serving refreshments. The server is the focal point of the image, with the guests seated around.

The setting is adorned with decorative elements, such as hanging lights or lanterns, which add to the ambiance of the venue. The atmosphere appears relaxed and festive, with the guests enjoying their time together. The overall composition emphasizes the social interaction and the elegance of the setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white image depicts a group of women in a well-lit, semi-outdoor setting at night. The women are dressed in elegant attire, with some wearing hats. They are seated on various chairs and conversing with each other. The scene is adorned with lush plants and decorative elements, creating a cozy and refined atmosphere. In the background, there is a railing and a view of the night sky with some structures visible. The overall ambiance suggests a social gathering or a party. The image has a vintage feel, indicated by the style of clothing and the black-and-white format. There is a watermark or label in the bottom right corner with the text "39481-B."

Text analysis

Amazon

39481-B
VAGOY

Google

39481-3
39481-3