Human Generated Data

Title

Untitled (Ryoanji Rock Garden, Kyoto, Japan)

Date

March 14, 1960-April 22, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3228

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (Ryoanji Rock Garden, Kyoto, Japan)

People

Artist: Ben Shahn, American 1898 - 1969

Date

March 14, 1960-April 22, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.3228

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 99.3
Person 99.3
Person 97.1
Person 96.8
Person 95.6
Reptile 91.3
Animal 91.3
Turtle 91.3
Sea Life 91.3
Person 89.8
Outdoors 89.2
Water 88.6
Person 88.4
Person 88.2
Person 88.2
Apparel 87.8
Clothing 87.8
Leisure Activities 86.8
Adventure 86.8
Sitting 83.4
Bird 82.1
Person 76.3
Indoors 73.7
Nature 71
Handrail 70.8
Banister 70.8
People 68.9
Footwear 65.2
Shoe 65.2
Female 65.1
Wood 63.1
Building 63.1
Person 61.3
Shorts 60.4
Countryside 59.6
Port 58.2
Dock 58.2
Waterfront 58.2
Pier 58.2
Kid 57.4
Child 57.4
Room 57.2
Flooring 55.7
Person 42.5

Clarifai
created on 2018-03-23

people 99.9
group together 98.9
many 98.9
group 98.1
adult 98
administration 93.7
man 93.5
leader 91.7
several 91
wear 89.9
recreation 89.7
military 89.1
home 89.1
vehicle 88.2
woman 88.1
chair 84.7
war 84
outfit 82.1
watercraft 81.9
bench 80.9

Imagga
created on 2018-03-23

snow 27.7
winter 23
travel 19
urban 18.3
city 17.4
forest 16.5
outdoors 16.4
park 16.3
landscape 15.6
cold 15.5
classroom 14.8
walking 14.2
room 13.5
people 13.4
blackboard 12.7
transportation 12.5
walk 12.4
tree 12.3
man 12.2
scene 12.1
trees 11.6
old 11.1
hall 11.1
tunnel 10.8
mountain 10.7
night 10.6
woods 10.5
wall 10.5
business 10.3
architecture 10.2
street 10.1
transport 10
light 10
road 9.9
way 9.7
group 9.7
building 9.5
sport 9.4
season 9.3
chair 9
scenery 9
interior 8.8
train 8.7
weather 8.5
tourist 8.4
black 8.4
outdoor 8.4
mountains 8.3
speed 8.2
vacation 8.2
new 8.1
railway 7.8
world 7.8
station 7.8
glass 7.8
motion 7.7
sky 7.6
pine 7.6
traffic 7.6
wood 7.5
town 7.4
water 7.3
peaceful 7.3
ski 7.3
person 7.2
sidewalk 7.2
recreation 7.2
holiday 7.2
activity 7.2
adult 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

bench 99.4
outdoor 99.4
person 90.5
park 77.1

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 23-38
Gender Male, 54.5%
Angry 46.3%
Surprised 45.2%
Happy 45.1%
Sad 51.1%
Calm 46%
Disgusted 45.2%
Confused 46.1%

AWS Rekognition

Age 20-38
Gender Male, 53.9%
Happy 45.4%
Disgusted 45.9%
Angry 46.1%
Surprised 46.3%
Sad 45.7%
Calm 49.8%
Confused 45.8%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Confused 45.4%
Calm 45.5%
Angry 45.6%
Sad 46.8%
Surprised 45.4%
Disgusted 50.5%
Happy 45.7%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Angry 45.4%
Confused 45.5%
Disgusted 45.1%
Surprised 45.7%
Sad 50.7%
Calm 47.6%
Happy 45.1%

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Calm 47.3%
Disgusted 45.5%
Angry 46.3%
Happy 46.5%
Confused 45.5%
Surprised 45.7%
Sad 48.2%

AWS Rekognition

Age 15-25
Gender Male, 54.7%
Disgusted 45.2%
Confused 45.4%
Angry 45.4%
Surprised 45.1%
Calm 45.9%
Happy 45%
Sad 52.9%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Sad 49.8%
Disgusted 49.5%
Angry 49.6%
Happy 49.6%
Surprised 49.5%
Calm 50%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 51.1%
Confused 45.1%
Surprised 45%
Angry 45.1%
Sad 54.8%
Happy 45%
Calm 45%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Male, 50.5%
Happy 49.5%
Angry 49.5%
Disgusted 49.7%
Calm 49.5%
Sad 50.2%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 23-38
Gender Female, 50%
Sad 49.6%
Calm 50.3%
Confused 49.5%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Happy 45.1%
Disgusted 45.9%
Confused 45.1%
Calm 53.4%
Sad 45.1%
Angry 45.2%
Surprised 45.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Turtle
Bird
Shoe
Person 99.3%
Person 97.1%
Person 96.8%
Person 95.6%
Person 89.8%
Person 88.4%
Person 88.2%
Person 88.2%
Person 76.3%
Person 61.3%
Person 42.5%
Turtle 91.3%
Bird 82.1%
Shoe 65.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-11

a photograph of a group of people sitting on a bench in front of a pond -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image depicts a group of people seated on a wooden platform observing a Japanese Zen rock garden. The garden features meticulously raked gravel and a single rock formation positioned centrally. A wall and trees in the background provide a sense of enclosure and tranquility. The setting appears to be traditional, with the architecture featuring wooden beams and tiled flooring. The individuals seem engaged, some holding material likely related to the site.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts a group of people seated on a wooden platform or veranda, observing a traditional Japanese rock garden, also known as a Zen garden. The garden features meticulously raked gravel in a wavy pattern, with a few large stones artistically placed. In the background, there is a wooden fence or wall lined by lush trees. The setting suggests an atmosphere of tranquility and contemplation, typical of a Zen garden intended for meditation and reflection. The people appear to be engaging with the scene, some of them holding what seems to be pamphlets or brochures, possibly indicating that they are visitors or students learning about the garden.

Anthropic Claude

Created by claude-3-haiku-20240307 on 2024-12-30

The image shows a group of people sitting on a wooden bench overlooking a pond or water feature. The scene appears to be set in a traditional Japanese or East Asian garden, with lush greenery and trees visible in the background. The individuals appear to be contemplating or observing something in the water, potentially a small rock or sculpture in the center of the pond. The overall atmosphere conveys a sense of tranquility and thoughtfulness.

Created by claude-3-opus-20240229 on 2024-12-30

The black and white image shows a group of men sitting on benches in an outdoor setting, likely at a temple or shrine given the traditional Japanese architecture visible. In the foreground is a stone or gravel area with a small decorative rock or sculpture. The men appear to be sitting quietly, perhaps meditating or participating in a religious or spiritual gathering. The setting has a peaceful, contemplative atmosphere.

Created by claude-3-5-sonnet-20241022 on 2024-12-30

This is a black and white photograph taken at what appears to be a Japanese Zen rock garden (karesansui). A group of visitors are seated along wooden steps or benches at the edge of the garden, many of them appear to be reading or studying from books or papers. They're observing a minimalist landscape that features a raked sand or gravel area with what looks like a single rock formation. The garden has the characteristic stripped-down aesthetic of traditional Zen gardens, with its carefully maintained gravel pattern and stone placement. Trees can be seen in the background across what might be a pond or water feature. The image has a contemplative, studious atmosphere typical of these sacred spaces in Japanese culture.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image is a black-and-white photograph of a group of young men sitting on a bench, with one man lying on the ground in front of them.

The group of young men are all dressed in casual attire, such as button-down shirts and slacks, and are seated on a long wooden bench that runs along the right side of the image. They appear to be engaged in some sort of activity, possibly reading or writing, as they hold papers in their hands.

In the foreground, on the left side of the image, there is a large expanse of sand or gravel, with a small rock or boulder in the center. The rock is partially buried in the sand, and it appears to be surrounded by a small depression or crater.

The background of the image features a low wall or fence, behind which are several trees and bushes. The overall atmosphere of the image suggests a peaceful and serene setting, possibly a park or garden.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

This black-and-white photograph captures a serene scene of a group of people seated on a wooden platform, intently focused on papers in their hands. The platform, comprising multiple levels, is situated adjacent to a meticulously raked sand garden, which features a solitary rock at its center. The garden's edge is demarcated by a narrow strip of gravel, adding a touch of texture to the otherwise smooth expanse of sand.

In the background, a low wall and lush trees create a sense of depth and tranquility, while the overall atmosphere of the image exudes a sense of contemplation and focus. The individuals' attention to the papers in their hands suggests that they may be engaged in a collective activity or discussion, adding a layer of social interaction to the otherwise peaceful setting.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image shows a black-and-white photograph of a group of people sitting on a wooden bench. They appear to be engaged in reading, with some holding books or papers. The setting appears to be outdoors, with a stone path and a body of water visible in the background. The people are dressed in formal attire, with some wearing glasses and leather shoes. The overall mood of the image is one of quiet contemplation and study.

Created by amazon.nova-pro-v1:0 on 2025-06-02

The black-and-white photo shows a group of people sitting on the benches in front of a building. They are all wearing eyeglasses and formal attire. Some of them are holding papers and looking at them, while others are looking in the same direction. On the left, there is a concrete walkway with a stone wall and a pile of rocks on the ground. Behind them, there are trees and a fence.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-30

Here is a description of the image:

The black and white photograph captures a serene scene, likely in a Japanese garden. The image is dominated by two key elements: a meticulously raked sand garden and a group of people observing it.

Foreground: The left side of the image showcases the sand garden, marked by a smooth, light-toned surface with a small rock formation at its center. A narrow channel filled with small stones runs along the garden's edge.

Background: To the right, a wooden structure provides a platform where many people sit and stand, facing the garden. Most are wearing suits, reading papers, or simply observing the scene, suggesting they are attending a formal event or a quiet moment of contemplation. A row of tall trees and a dark wall further create a sense of depth and enclosure.

Overall Impression: The photograph evokes a sense of tranquility and thoughtfulness. The formal attire of the people, the precise garden, and the architectural elements suggest a cultural setting where peace and contemplation are valued. The composition is well-balanced, directing the viewer's attention from the meticulously arranged garden to the observers. It's likely that the photograph was taken in the mid-20th century.

Created by gemini-2.0-flash on 2025-05-30

Here is a description of the image:

The black and white photograph captures a scene at the Ryoan-ji zen garden, where a large group of people is seated on a covered veranda, gazing towards the iconic rock garden. The garden itself consists of carefully raked white gravel with a single, large moss-covered rock in the foreground.

The veranda is part of a traditional Japanese building, with a visible roofline. A pathway of patterned stone tiles runs parallel to the veranda, separated from the garden by a narrow trough filled with pebbles.

The people on the veranda appear to be a mix of ages, mostly young adults. Many are holding papers or pamphlets, possibly informational guides about the garden. The overall atmosphere seems contemplative, as the viewers observe the serene simplicity of the zen garden. The image evokes a sense of cultural appreciation and quiet observation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-30

This black-and-white photograph captures a group of people sitting on a long wooden bench, observing a meticulously raked gravel garden. The garden appears to be a traditional Japanese rock garden, known as a Zen garden, characterized by its minimalistic design and careful arrangement of rocks and gravel. The people are dressed in a mix of traditional and modern clothing, and some are holding papers or books, suggesting they might be tourists or students studying the garden's design and significance. The setting is serene, with a backdrop of trees and a traditional wooden structure, adding to the tranquil and contemplative atmosphere. The image conveys a sense of peace and reflection, typical of Zen gardens, which are designed to promote meditation and mindfulness.