Human Generated Data

Title

Untitled (Barong Dance, Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5227

Human Generated Data

Title

Untitled (Barong Dance, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5227

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Architecture 94.7
Building 94.7
Monastery 94.7
House 92.8
Housing 92.8
City 92.4
Road 92.4
Street 92.4
Urban 92.4
Villa 85.1
Garden 84.6
Nature 84.6
Outdoors 84.6
Porch 84.1
Plant 81.9
Tree 81.9
Face 76.3
Head 76.3
Palm Tree 57.8
Brick 57.1
Patio 56.5
Arbour 56.1
Ruins 55.8
Shelter 55.2
Potted Plant 55.2
Path 55.1
Altar 55.1
Church 55.1
Prayer 55.1
Furniture 55.1

Clarifai
created on 2018-05-10

people 100
group 99.7
group together 99.2
many 99.2
man 96.6
adult 95.9
administration 93.9
home 93.3
several 93.2
soldier 93.2
monochrome 93
street 92.7
war 92.6
military 91.9
print 90.9
vehicle 89.6
crowd 89.6
engraving 87.1
art 86.9
child 85.7

Imagga
created on 2023-10-06

snow 100
weather 54.1
building 40
architecture 35.9
city 25
old 23.7
stone 22.7
structure 22.7
street 21.2
travel 21.1
house 18.5
tourism 18.2
winter 16.2
town 15.8
tree 15.6
history 15.2
landscape 14.9
sky 14.7
trees 14.2
urban 14
ancient 13.8
historic 13.8
sidewalk 13.5
brick 13.4
cold 12.9
support 12.8
religion 12.6
wall 12.4
window 12.2
church 12
tourist 11.8
temple 11.7
historical 11.3
landmark 10.8
facade 10.7
park 10.7
entrance 10.6
rural 10.6
lamp 10.5
step 10.2
column 10.1
light 10
fence 10
road 9.9
bench 9.9
door 9.7
home 9.6
culture 9.4
season 9.4
arch 8.8
country 8.8
statue 8.7
forest 8.7
scene 8.7
windows 8.6
outdoor 8.4
monument 8.4
picket fence 8.3
device 8.1
steps 7.8
district 7.8
sill 7.7
construction 7.7
village 7.7
seat 7.6
path 7.6
wood 7.5
exterior 7.4
tower 7.2
barrier 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 99.6
old 84.7
past 27

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 12-20
Gender Female, 99.7%
Calm 94.3%
Surprised 6.4%
Fear 6.4%
Sad 2.4%
Confused 2.2%
Happy 0.4%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 2-8
Gender Female, 83.2%
Fear 75.4%
Happy 15.9%
Calm 13.5%
Surprised 7.1%
Disgusted 4.5%
Sad 3.6%
Confused 1.4%
Angry 1.4%

Feature analysis

Amazon

Person
Adult
Male
Man
Staircase

Clarifai

Tree
Stairs
Person
Clothing
House
Footwear
Umbrella
Human face

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 95%

AWS Rekognition

Person 65.6%

AWS Rekognition

Person 62.7%

AWS Rekognition

Adult 96.8%

AWS Rekognition

Male 96.8%

AWS Rekognition

Man 96.8%

AWS Rekognition

Staircase 92.8%

Clarifai

Tree 82.2%

Clarifai

Tree 77.7%

Clarifai

Tree 69%

Clarifai

Tree 47.7%

Clarifai

Tree 43.2%

Clarifai

Tree 41.7%

Clarifai

Tree 34.8%

Clarifai

Tree 34%

Clarifai

Tree 33.2%

Clarifai

Stairs 63.2%

Clarifai

Person 48.1%

Clarifai

Person 39.5%

Clarifai

Person 34.3%

Clarifai

Clothing 48%

Clarifai

Clothing 46.6%

Clarifai

House 47.1%

Clarifai

Footwear 45%

Clarifai

Umbrella 43.3%

Clarifai

Human face 42.2%

Clarifai

Human face 39.6%

Categories

Imagga
created on 2023-10-06

streetview architecture 99.9%

Captions

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-06

an old black and white photo of a temple

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a horse drawn carriage in a garden

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a traditional Balinese temple entrance, characterized by intricately carved stone gates and statues. Two individuals are visible wearing traditional Balinese attire and walking down a flight of stairs, which leads to the temple complex. The surrounding area is adorned with ceremonial elements, including white umbrellas and decorative flags. Palm trees in the background add to the tropical setting, and there is a peaceful and cultural ambiance to the scene.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts an ornate and intricately carved stone gate or entrance, likely part of a temple or ceremonial structure. The architecture is typical of Southeast Asian, possibly Balinese design, featuring decorative motifs and reliefs. There are two individuals dressed in traditional attire ascending the stone steps, which are decorated with foliage and flags. This suggests a festive or ceremonial occasion. Two large ceremonial umbrellas are visible, adding to the cultural significance of the scene. In the background, tropical palm trees enhance the location's exotic and cultural ambiance.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image appears to depict an ornate, tropical-style building or structure with intricate carvings and decorations. There are palm trees and other lush vegetation surrounding the structure, creating a verdant, tropical setting. The building has a covered entryway with steps leading up to it, and there appear to be people visible in the scene, though they are not the focus of the image. The overall impression is one of a vibrant, richly decorated and landscaped tropical environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white historical photograph showing what appears to be a Balinese temple or ceremonial grounds. The image features traditional Balinese architecture with ornately decorated gates or split gates (known as candi bentar), ceremonial umbrellas (payung), and palm trees in the background. There are steps leading up through the gates, and the structures show detailed stone carvings typical of Balinese Hindu temples. The composition includes traditional poles or pillars, and the overall scene suggests this was taken during the colonial period in Indonesia, likely in the early to mid-20th century.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image is a black-and-white photograph of a Balinese temple, featuring two statues of people in traditional attire. The temple's architecture is ornate, with intricate carvings and sculptures adorning its walls. In the foreground, a set of stairs leads up to the temple entrance, where the two statues are positioned. One statue appears to be a woman, while the other is a man, both dressed in traditional Balinese clothing.

To the right of the stairs, a tall pole supports a white umbrella, adding a touch of elegance to the scene. The background of the image reveals a serene atmosphere, with palm trees swaying gently in the breeze. The overall ambiance of the photograph exudes a sense of tranquility and cultural richness, capturing the essence of Balinese heritage.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image is a black-and-white photograph of a temple in Bali, Indonesia. The temple is made of stone and features intricate carvings and statues. There are several people in traditional Balinese clothing standing on the steps leading up to the temple, and there is a flagpole with a white flag flying in front of the temple. In the foreground, there is a person sitting on the ground, and in the background, there are palm trees and other vegetation. The overall atmosphere of the image suggests a sense of reverence and spirituality, as the people are dressed in traditional attire and the temple is adorned with intricate carvings and statues.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-30

A black-and-white photograph shows two people, perhaps performing a traditional dance, on the stairs of a temple. They are wearing traditional costumes and headdresses. The stairs are decorated with plants and flowers. A flag is hoisted on a pole on the right side of the stairs. A few trees are behind the temple. On the bottom right corner, a person is sitting on the ground, perhaps watching the performance.

Created by amazon.nova-lite-v1:0 on 2025-05-30

The image appears to be a black-and-white photograph of a traditional Balinese temple or shrine. The temple has intricate carvings and sculptures, and there are steps leading up to it. Two people are standing on the steps, one of whom is wearing a mask and holding a flag. There is a person sitting on the ground in the foreground, possibly a visitor or a performer. The temple is surrounded by plants and trees, and there is a lamp or umbrella in front of it.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-05

Here's a description of the image:

The image is a black and white photograph depicting a scene from a historical setting, possibly in Bali or a similar Southeast Asian location. The composition focuses on an ornate, temple-like structure, suggesting a religious or ceremonial context.

Here's a breakdown:

  • Architecture: The central feature is a multi-tiered structure with detailed carvings and embellishments, including a traditional gateway. It appears to be made of stone or a similar durable material.
  • Figures: Two people, likely dressed in traditional attire, are moving up the stone stairs. They are presumably part of a ceremony or performance.
  • Setting: The surrounding environment includes lush vegetation, suggesting a tropical climate. Palm trees are visible.
  • Atmosphere: The photograph's tone is historical and cultural. The composition is framed in an older photographic style, reinforcing the sense of the past.

Created by gemini-2.0-flash on 2025-05-05

Here is a description of the image:

This black and white photograph depicts a scene featuring two individuals on a set of stairs leading into what appears to be a traditional Balinese compound or temple.

The stairs are wide and ascend to a highly ornamented gateway. The gateway itself is a stone structure with intricate carvings and sculptures, indicative of Balinese architecture. A white flag and a traditional Balinese umbrella are positioned near the gateway, adding to the cultural context.

Two individuals, possibly performers, are seen on the stairs. They are dressed in attire that suggests a traditional Balinese dance or ceremony. Their poses and gestures hint at a performance.

In the foreground, there is a person sitting on the ground, possibly an observer or participant in the event. The background is filled with the lush foliage of palm trees, which is a common sight in Bali. The lighting is somewhat flat, typical of older photographs, and the scene has a documentary quality, capturing a moment in time from a cultural event.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a traditional Balinese temple scene, likely from Indonesia. The architecture features intricately carved stone structures with ornate designs, typical of Balinese Hindu temples. The setting includes a staircase leading up to a temple entrance, flanked by tall pillars adorned with elaborate carvings.

Two people are seen ascending the stairs, dressed in traditional attire. One person is wearing a sarong and a headpiece, while the other is dressed in a long, flowing garment. The temple is decorated with various ceremonial items, including a large umbrella (known as a "tedung" in Balinese culture) and hanging ornaments.

The background shows palm trees and other tropical vegetation, adding to the serene and spiritual ambiance of the scene. The overall atmosphere suggests a ceremonial or ritualistic event taking place at the temple.

Qwen