Human Generated Data

Title

Untitled (Yogyakarta, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5053

Human Generated Data

Title

Untitled (Yogyakarta, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5053

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Neighborhood 100
Architecture 100
Monastery 100
City 100
Road 100
Street 100
Urban 100
House 99.9
Housing 99.9
Villa 99.9
Metropolis 99.7
Garden 99.3
Nature 99.3
Outdoors 99.3
Potted Plant 99.1
Hotel 98.8
Resort 90.7
Tree 89.9
Condo 88.3
Office Building 75.9
Path 70.9
Fence 57.9
Hedge 57.9
Sidewalk 57.6
Campus 57
Arbour 57
Arch 56.5
Spire 56
Tower 56
Shop 55.7
Shopping Mall 55.7
High Rise 55.2

Clarifai
created on 2018-05-10

street 96.6
architecture 95.9
city 95.7
building 94.6
house 94.5
home 93.4
town 92.4
no person 91
monochrome 90.4
people 90.3
nature 89
war 87.6
tree 87.4
travel 86.8
urban 86.3
sight 85.2
modern 85.2
road 84.8
group 84.1
cityscape 81.9

Imagga
created on 2023-10-05

picket fence 61
building 53.1
fence 50.9
architecture 43.4
city 37.4
barrier 36.9
structure 36.6
greenhouse 27.9
travel 26.1
obstruction 24.7
snow 24.2
sky 22.3
tourism 22.3
house 20.4
landscape 18.6
church 17.6
historic 17.4
summer 17.4
street 16.6
old 16
town 15.8
urban 15.7
trees 15.1
garden 14.8
cemetery 14.5
weather 14.4
religion 14.3
famous 14
dome 13.9
tree 13.5
history 13.4
river 13.4
night 13.3
vacation 13.1
water 12.7
palace 12.5
buildings 12.3
historical 12.2
home 12
residence 11.9
park 11.7
residential 11.5
tourist 10.9
road 10.8
landmark 10.8
houses 10.7
flowers 10.4
scene 10.4
destination 10.3
monument 10.3
construction 10.3
clouds 10.1
university 10.1
light 10
tower 9.9
attraction 9.6
panorama 9.5
capital 9.5
grass 9.5
hill 9.4
color 8.9
roof 8.8
property 8.7
temple 8.7
village 8.7
cityscape 8.5
plant 8.5
outdoor 8.4
wall 8
day 7.9
culture 7.7
flower 7.7
skyline 7.6
place 7.5
center 7.4
exterior 7.4
scenery 7.2
holiday 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

sky 99.1
outdoor 98.9
house 76.7
white 73.5
town 32.8

Color Analysis

Feature analysis

Amazon

Building
Person
Plant

Clarifai

Tree
House
Window

AWS Rekognition

Building 93.6%

AWS Rekognition

Building 79.3%

AWS Rekognition

Person 85.8%

AWS Rekognition

Plant 70%

Clarifai

Tree 90.6%

Clarifai

Tree 88.7%

Clarifai

Tree 80.5%

Clarifai

Tree 79.5%

Clarifai

Tree 79%

Clarifai

Tree 78.7%

Clarifai

Tree 76.2%

Clarifai

Tree 73.9%

Clarifai

Tree 62.3%

Clarifai

Tree 59.2%

Clarifai

Tree 58.2%

Clarifai

Tree 53.3%

Clarifai

Tree 51.8%

Clarifai

Tree 49.1%

Clarifai

Tree 34.5%

Clarifai

Tree 33.4%

Clarifai

House 80.5%

Clarifai

House 78.6%

Clarifai

House 76.8%

Clarifai

House 71.1%

Clarifai

House 61%

Clarifai

House 54.8%

Clarifai

House 51.3%

Clarifai

House 46.9%

Clarifai

House 40.6%

Clarifai

Window 63.3%

Clarifai

Window 63.2%

Clarifai

Window 62.1%

Clarifai

Window 61.6%

Clarifai

Window 60.2%

Clarifai

Window 59.7%

Clarifai

Window 58.1%

Clarifai

Window 54.6%

Clarifai

Window 52.9%

Clarifai

Window 52.4%

Clarifai

Window 46.8%

Clarifai

Window 44.3%

Clarifai

Window 43.9%

Clarifai

Window 43.4%

Clarifai

Window 43.2%

Clarifai

Window 42.1%

Clarifai

Window 40%

Clarifai

Window 36%

Clarifai

Window 35.5%

Clarifai

Window 34.2%

Clarifai

Window 34%

Categories

Imagga
created on 2023-10-05

paintings art 66.5%
streetview architecture 30.6%
nature landscape 1.6%

Captions

Microsoft
created by unknown on 2018-05-10

a large white building 93.5%
a black and white photo of a house 93.4%
a black and white photo of a building 93.3%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a black and white photo of a building with a clock tower

Created by general-english-image-caption-blip-2 on 2025-07-08

an old black and white photo of a courtyard

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This black-and-white image depicts a small urban square or park surrounded by buildings. The foreground features neatly maintained landscaping, including bushes, plants, and a tiled pathway that leads toward the center of the scene. There appears to be seating and umbrellas within the park area, hinting at its use as a public gathering space or community area.

In the background, the buildings exhibit a mix of architectural styles, with some adorned with decorative facades. The central building stands out with its ornate gabled design, suggesting that it might hold some significance, perhaps as a commercial or cultural space. Palm trees are visible throughout, adding to the tropical ambiance.

The overall scene suggests a peaceful community environment, likely located in a warm or tropical region, captured during the mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a black and white photograph depicting a town square with a central garden area. The garden is lined with plants and shrubs along a pathway, which seems to lead towards the background buildings. There are benches visible along the path, and several tables with umbrellas, suggesting it could be a place for relaxation or dining. In the background, there is a row of distinct buildings with varied architectural styles, including one with a decorative facade that might be a prominent public or commercial building. Palm trees are visible, contributing to a tropical or subtropical ambiance. Several people can also be spotted walking around in the area. Overall, the image captures a lively urban setting, possibly in a warm climate given the presence of palm trees and outdoor seating.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image shows a scenic outdoor area with lush greenery and landscaping. There are several buildings visible, including what appears to be a historic or ornate structure with a distinctive architectural style. The scene has a quaint, charming atmosphere, with tables and umbrellas suggesting it may be a public plaza or outdoor dining area. The overall impression is one of a well-maintained, picturesque urban setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white photograph showing what appears to be a courtyard or plaza area in what looks like a tropical or warm climate setting. There are several colonial or art deco style buildings visible in the background, with one building featuring a distinctive ornamental top structure. The foreground shows a paved walkway lined with landscaped gardens and palm trees. There are some outdoor seating areas with umbrellas visible, suggesting this might be a commercial or recreational area. The architecture and vegetation style suggests this photo might have been taken somewhere in Southeast Asia or a similar tropical region, possibly during the mid-20th century.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image is a black-and-white photograph of a courtyard with a walkway and plants, surrounded by buildings.

  • The courtyard is in the foreground of the image.
    • It has a walkway that leads to a set of stairs.
    • There are several plants and trees in the courtyard.
    • In the background, there are several buildings, including a large white building with a tower on the right side of the image.
    • The buildings appear to be old and have a colonial or tropical style architecture.
    • The sky is overexposed and appears white.
  • The overall atmosphere of the image suggests that it was taken in a warm and sunny location, possibly in a tropical or subtropical region.
    • The presence of palm trees and other tropical plants in the courtyard supports this idea.
    • The style of the buildings also suggests a colonial or historical influence.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

The image is a black-and-white photograph of a tropical garden, with a pathway leading to a building in the background. The garden features several potted plants and trees, as well as lounge chairs and umbrellas. In the foreground, there are two large potted plants on either side of the pathway, which is made of stone or brick. The pathway leads to a small fountain or pool, surrounded by more plants and trees. In the background, there is a large building with a clock tower, which appears to be a hotel or resort. The overall atmosphere of the image suggests a relaxing and peaceful environment, possibly a vacation spot or a retreat.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image depicts a historical town square with a monochromatic filter, giving it a vintage look. The square is surrounded by buildings with classic architectural styles, some featuring ornate designs and tall windows. The buildings are lined up on both sides of the square, creating a symmetrical layout.

In the center of the square, there is a garden with various plants and trees, including palm trees. The garden is bordered by a brick pathway that leads to the center of the square.

Several people are walking around the square, some are standing near the buildings, and others are sitting on benches under umbrellas. The square is bustling with activity, and there are also some vehicles parked in the area.

The image captures a sense of nostalgia and a glimpse into the past, with its vintage filter and historical architecture. It portrays a lively town square that was once a hub of activity and community gatherings.

Created by amazon.nova-pro-v1:0 on 2025-05-25

The image is a black-and-white photo of a courtyard with a walkway in the middle. On the left side, there are several potted plants and a small tree. On the right side, there is a fountain with a small pool of water. In the distance, there are several buildings, including a tall tower. There are also several trees and a few people walking around the area.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

Here is a description of the image:

The image is a monochrome photograph of a city square or park. A paved pathway, likely for pedestrians, extends from the foreground into the middle ground, flanked by manicured bushes and planters.

Behind the greenery, there's a collection of buildings with varying architectural styles. Some appear to be older structures with traditional designs, while others are more modern. Palm trees are interspersed among the buildings, adding a tropical feel to the scene. There are also benches or lounge chairs scattered in the park, suggesting a space for relaxation.

The overall impression is of a well-maintained public space within an urban setting, showcasing a mix of architectural elements and natural landscaping.

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Impression:

The image is a black and white photograph depicting a public square or park. It has a historical feel, likely from the mid-20th century or earlier, given the architecture and photographic style.

Foreground:

  • A paved walkway leads into the center of the image, lined on either side by green bushes planted in square containers, which give the landscape a manicured appearance.
  • More shrubbery and landscaping are present in the foreground, creating a sense of depth.

Midground:

  • There are buildings of various styles, including what appears to be a mix of colonial-era structures.
  • White tables and sunshades are scattered around the middle-ground, in front of the buildings.
  • There appear to be statues.

Background:

  • Additional buildings and structures are visible in the distance.
  • The sky is not very clear.

Other observations:

  • The photo appears to be taken on a sunny day.
  • The photograph is a historic image of a public space.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image depicts a historical photograph of a building complex with a prominent central structure that appears to be a pavilion or gazebo. The architecture of the central structure features intricate details and a multi-tiered roof, which suggests it might be of cultural or historical significance.

Surrounding the central structure are well-maintained gardens with neatly trimmed hedges and pathways. The gardens are adorned with white umbrellas, indicating seating areas, possibly for visitors or guests. There are also palm trees and other greenery, adding to the aesthetic appeal of the place.

The buildings flanking the central structure are multi-storied and have a colonial architectural style, with large windows and balconies. The overall setting suggests a public or semi-public space, possibly a park, a hotel, or a government building complex. The image conveys a sense of orderliness and tranquility, with the gardens and buildings harmoniously blending together.

Qwen

No captions written