Human Generated Data

Title

Untitled (patio and courtyard of Sandcastle Hotel)

Date

c. 1960

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11496

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (patio and courtyard of Sandcastle Hotel)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11496

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Person 99.1
Human 99.1
Person 94.6
Person 92.5
Person 92.3
Person 92
Person 88.9
Person 84.7
Person 84.4
Road 83.1
Chair 79.5
Furniture 79.5
Person 79
Meal 77.4
Food 77.4
Tree 76.7
Plant 76.7
Building 70.9
Water 70.6
Person 67.5
People 66.6
Palm Tree 65.1
Arecaceae 65.1
Villa 64.7
Housing 64.7
House 64.7
Urban 63.4
Theme Park 60.7
Amusement Park 60.7
City 58.3
Town 58.3
Nature 56.8
Path 56.7
Person 55.3

Clarifai
created on 2023-10-25

monochrome 99.3
people 99.2
many 96.9
group 96
beach 95.4
water 94.2
chair 94.1
group together 93.5
no person 92.7
street 92.4
umbrella 91.4
man 91.1
vehicle 89.5
watercraft 89
adult 88
furniture 87.6
sea 87.2
city 87.1
tree 86.1
summer 86

Imagga
created on 2022-01-14

chairlift 36
stage 30.9
sky 29.3
ski tow 28.8
conveyance 24.6
platform 24.5
architecture 21.9
water 21.3
building 20.5
structure 18.6
city 18.3
tower 17
cloud 16.4
construction 16.3
travel 16.2
landscape 14.9
scene 14.7
night 14.2
tourism 14
urban 14
landmark 13.5
bridge 13.5
history 13.4
cityscape 13.2
winter 12.8
industrial 12.7
river 12.5
outdoor 12.2
industry 12
old 11.8
power 11.8
sea 11.7
park 11.7
menorah 11.3
environment 10.7
wheeled vehicle 10.4
work 10.3
light 10
black 9.6
beach 9.5
cold 9.5
symbol 9.4
man 9.4
famous 9.3
dark 9.2
business 9.1
candelabrum 9.1
transportation 9
reflection 8.9
skyline 8.5
boat 8.4
house 8.4
ocean 8.3
silhouette 8.3
transport 8.2
crane 8.1
equipment 7.9
shopping cart 7.9
day 7.8
factory 7.8
sunny 7.7
culture 7.7
downtown 7.7
monument 7.5
smoke 7.4
technology 7.4
ecology 7.3
road 7.2
summer 7.1
rural 7

Google
created on 2022-01-14

Water 91.2
Plant 91.2
Organism 87.4
Tree 87.4
Black-and-white 84.3
Arecales 83.9
Font 83.7
Adaptation 79.4
Palm tree 75.8
Monochrome photography 73.5
Art 71.2
Monochrome 71.1
Window 69
Building 68.4
Design 68.2
Landscape 67.4
History 65.6
Town 63.9
Paper product 62.3
Illustration 60.6

Microsoft
created on 2022-01-14

text 99.9
tree 90.1
playground 87.4
black and white 84.6
sky 71
palm tree 67.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 27-37
Gender Male, 75.6%
Happy 29.2%
Sad 28%
Fear 16%
Calm 10.7%
Angry 5.1%
Surprised 4.8%
Disgusted 3.8%
Confused 2.5%

AWS Rekognition

Age 22-30
Gender Male, 78.8%
Calm 37%
Sad 23%
Angry 13%
Fear 7.7%
Surprised 7.5%
Confused 5.3%
Disgusted 3.7%
Happy 2.8%

Feature analysis

Amazon

Person
Chair
Person 99.1%
Person 94.6%
Person 92.5%
Person 92.3%
Person 92%
Person 88.9%
Person 84.7%
Person 84.4%
Person 79%
Person 67.5%
Person 55.3%
Chair 79.5%

Captions

Microsoft
created by unknown on 2022-01-14

a vintage photo of a city 79.7%
a vintage photo of a street 73.1%
a vintage photo of some people 66.1%

Clarifai
created by general-english-image-caption-blip on 2025-05-23

a photograph of a black and white photo of a person sitting at a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This is a black and white inverted image (negative), showing a sunny outdoor scene in a resort-like setting. The lawn area is occupied by people, some seated and others standing, engaging in leisure activities like conversation or games. Palm trees are scattered throughout the yard, suggesting a tropical or coastal vibe. Modern buildings with clean lines are visible in the background, indicating a mid-20th century architectural style. The atmosphere appears relaxed, and the arrangement of chairs and umbrellas suggests a social and recreational environment.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a photographic negative showing an outdoor scene, likely at a resort. In the foreground, there is a circular area with several people sitting in lounge chairs around tables, which appears to be a social gathering or recreational setting. Some individuals are standing, and one person seems to be holding a golf club, possibly putting on a mini-golf course. The area is surrounded by tall palm trees, adding to the tropical and leisurely atmosphere of the scene.

In the background, there are two buildings with a modern architectural style, characterized by flat roofs and horizontal lines. The buildings have two stories, and there are outdoor staircases leading to balconies. The scene depicts a sunny environment, typical of a warm-weather resort, and the presence of palm trees and lounge chairs suggest it might be near a beach or a pool.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows an outdoor scene at night. There are several palm trees in the foreground, and in the background there appears to be a hotel or motel complex with multiple buildings. In the center of the image, there are several people seated at tables or lounging on chairs, suggesting this is some kind of outdoor dining or social area. The overall scene has a tropical, resort-like atmosphere.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a vintage black and white photograph of an outdoor courtyard or patio area at what looks like a motel or resort. The space is decorated with tall palm trees and features several lounge chairs arranged in a circular pattern. There's a large umbrella in the center of the seating area. The setting appears to be from around the 1950s or 1960s, based on the architectural style and furniture design. Several people can be seen relaxing in the chairs and standing around the area. The buildings in the background are typical mid-century modern motel-style structures with clean lines and a two-story design. The photo has a nighttime or evening atmosphere, with the lighting creating dramatic contrasts between light and shadow.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black and white photograph of a group of people gathered in a courtyard, surrounded by palm trees and other tropical plants. The courtyard is paved with a dark-colored material, possibly asphalt or concrete, and features several circular patterns that resemble golf holes. A large umbrella stands in the center of the courtyard, providing shade for the group.

In the foreground, several individuals are seated in chairs or standing around the courtyard, some holding golf clubs or other objects. The atmosphere appears to be relaxed and social, with people chatting and enjoying each other's company.

In the background, a large building with a balcony can be seen, suggesting that this may be a resort or hotel. The overall scene conveys a sense of leisure and recreation, with the group of people enjoying the beautiful surroundings and each other's company.

The image is likely from the mid-20th century, given the style of clothing and the presence of golf clubs, which were popular recreational activities during that time period. The photograph was taken in a studio setting, as evidenced by the artificial lighting and the lack of natural shadows. The image has been preserved and digitized, allowing it to be shared and appreciated by a wider audience.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a tropical resort or hotel, featuring a large open area with palm trees and people engaging in various activities. The scene appears to be set at night, with the sky dark and the only light coming from the building's windows and what seems to be spotlights on the ground.

In the foreground, there are several groups of people gathered around tables and chairs, some of whom are playing games or socializing. A few individuals are standing or walking around the area, while others are seated on the grass. The atmosphere seems relaxed and casual, with people enjoying each other's company in a beautiful outdoor setting.

In the background, there are several buildings that appear to be part of the resort or hotel complex. These structures have multiple levels and balconies, suggesting that they may be guest rooms or other amenities. The overall impression is one of a luxurious and peaceful retreat, where guests can unwind and enjoy the natural beauty of their surroundings.

The image also features a handwritten notation at the bottom, which reads "46745-A." This could be a reference number or code used by the photographer or the resort itself, but its exact meaning is unclear without further context. Overall, the image presents a serene and inviting scene that captures the essence of a tropical getaway.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a resort or hotel courtyard with several palm trees, chairs, and tables arranged in a circular pattern. There are several people sitting and standing in the courtyard, some of them wearing swimwear. In the background, there is a building with stairs and a balcony. The image has a watermark in the bottom right corner that reads "46745-A."

Created by amazon.nova-pro-v1:0 on 2025-06-08

A black-and-white photo of the hotel's patio area with several people sitting on chairs around tables. Some of them are standing, including the person holding a stick and probably cleaning the area. There are umbrellas on the tables. There are several palm trees in the area. In the distance, there is a staircase leading to the second floor of the building. The photo has a number, "46745-A," written on the bottom.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The image appears to be a black and white negative photograph of a resort or hotel scene. Here's a breakdown:

  • Setting: The scene is outdoors, likely near a beach or tropical area, suggested by the prominent palm trees. There's a grassy area with what looks like a patio with several round designs, maybe the placement for people to play a specific game.
  • Architecture: There are several buildings visible, possibly hotel or motel rooms. The structures have a mid-century modern aesthetic with clean lines.
  • People: Several people are scattered around the patio, some are sitting in chairs, others are playing a game, with an item resembling a golf club. The photograph suggests a leisurely, relaxing atmosphere.
  • Composition: The composition is well-framed, with the palm trees acting as leading lines and framing elements. The focus is on the people and their activities, capturing the essence of a vacation setting.
  • Technical Aspects: The photograph is a negative, evidenced by the reversed tones (white is dark, dark is light). The presence of negative markings (perforations and the numbering) confirms this.
  • Overall Impression: The image evokes a sense of nostalgia, likely capturing a moment in time from the mid-20th century. It paints a picture of a relaxed, social environment.

Created by gemini-2.0-flash on 2025-05-17

This is a black and white image, possibly a photographic negative, of a leisure area at what appears to be a resort or hotel. The scene is dotted with palm trees and what looks like a building with multiple levels in the background.

In the foreground, there is a group of people engaged in various activities. Some are seated in chairs arranged around circular patches on the grass, while others are standing and appear to be playing a game or engaging in some sort of activity. There's a black umbrella shading a group of people seated at a table.

The overall atmosphere seems relaxed and recreational, suggesting a vacation or resort setting. The image is somewhat high-angle, providing a comprehensive view of the leisure area.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a vintage, black-and-white photograph of a resort or hotel courtyard at night. The scene is illuminated by artificial lights, highlighting various features of the area.

Key elements in the image include:

  1. Palm Trees: Several tall palm trees are scattered throughout the courtyard, contributing to a tropical ambiance.
  2. Seating Areas: There are multiple seating arrangements with chairs and tables, where people are gathered, socializing, and relaxing.
  3. People: The courtyard is populated with people, some standing and conversing, while others are seated. The attire suggests a casual or semi-formal setting, with some individuals in suits and dresses.
  4. Umbrellas: A few large umbrellas provide shade over some of the seating areas.
  5. Buildings: In the background, there are multi-story buildings, likely part of the resort or hotel, with balconies overlooking the courtyard.
  6. Landscaping: The area is well-maintained with manicured lawns and possibly some flower beds, though the details are harder to discern in the black-and-white image.
  7. Lighting: The scene is lit by several light sources, creating a warm and inviting atmosphere.

The overall impression is of a leisurely, social gathering in a well-appointed, tropical-themed outdoor space, likely from a mid-20th-century era given the style of clothing and furniture.

Text analysis

Amazon

46745-A.

Google

46745- A•
46745-
A•