Human Generated Data

Title

Untitled (Yogyakarta, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5051

Human Generated Data

Title

Untitled (Yogyakarta, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5051

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Art 99.5
Face 94.1
Head 94.1
Prayer 86.5
Buddha 62.7
Sculpture 61.6
Statue 61.6
Architecture 56.6
Building 56.6
Monastery 56.6
Temple 56.3
Shrine 55.2
Figurine 55.2

Clarifai
created on 2018-05-10

sculpture 98.3
art 98.2
statue 97.8
people 96.1
ancient 96
man 94.1
religion 93.6
figure 93.4
symbol 92.6
old 92.2
culture 92.2
one 92
god 90.5
antique 89.1
figurine 88.7
retro 86.6
vintage 86.4
travel 86.3
illustration 85.2
spirituality 84.5

Imagga
created on 2023-10-06

sculpture 70.6
column 55
statue 53.9
totem pole 52.1
carving 49
religion 46.7
temple 45.2
art 41.3
culture 40.2
ancient 37.2
structure 36.8
stone 28.7
history 27.8
travel 27.5
old 27.2
religious 25.3
god 24.9
plastic art 22.9
architecture 22.2
traditional 19.2
tourism 19
oriental 18.9
spiritual 18.3
meditation 18.2
historic 17.4
figure 17
antique 16.8
spirituality 16.3
china 16
monument 15.9
east 15.9
decoration 15.5
head 15.1
gold 14.8
tradition 14.8
heritage 14.5
famous 14
worship 13.5
face 13.5
peace 11.9
prayer 11.6
building 11.3
carved 10.8
belief 10.7
pray 10.7
holy 10.6
faith 10.5
historical 10.4
bust 10.3
tourist 10.1
decorative 9.2
southeast 8.9
detail 8.9
sacred 8.8
artistic 8.7
palace 8.7
golden 8.6
color 8.4
church 8.3
city 8.3
design 7.9
idol 7.9
museum 7.9
bangkok 7.9
meditate 7.9
praying 7.8
contemplation 7.8
sitting 7.7
doll 7.5
style 7.4
mask 7.4

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

indoor 91
old 49.1

Color Analysis

Feature analysis

Amazon

Baby
Person

Clarifai

Human face
Person
Clothing
Human arm
Human nose
Human hand
Human mouth

AWS Rekognition

Baby 99%

AWS Rekognition

Person 99%

Clarifai

Human face 82.9%

Clarifai

Person 55.3%

Clarifai

Clothing 50.2%

Clarifai

Human arm 46.6%

Clarifai

Human nose 45%

Clarifai

Human hand 35.1%

Clarifai

Human mouth 33.1%

Categories

Imagga
created on 2023-10-06

paintings art 71.2%
interior objects 11.3%
food drinks 11.1%
people portraits 2.2%
streetview architecture 1.6%
events parties 1.2%

Captions

Microsoft
created by unknown on 2018-05-10

a person sitting on a table 31.4%
an old photo of a person 31.3%
a person sitting at a table 31.2%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-07-07

a statue of a hindu god sitting on a bench

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a statue of a man with a sword

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image shows a detailed statue of a seated figure, crafted in an intricate design typical of traditional artistic styles. The figure is adorned with ornamental accessories, including arm bands and a belt with engraved details. It is holding a symbolic object resembling a gada (mace) in its right hand, while sitting on a patterned pedestal featuring floral motifs. The statue is positioned in an area with a tiled floor and a roof structure supported by columns visible in the background.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts an intricately crafted statue of a figure sitting in a kneeling position. The statue holds a club or mace in its right hand and is made of carved stone or metal. The figure wears ornate earrings, a necklace, and belt around the waist. The statue is set on a decorative base. The setting appears to be a covered area outdoors, with another structure and a patterned floor visible in the background.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a large, ornate statue of a deity or mythological figure. The statue appears to be made of metal or stone, and it is decorated with intricate carvings and patterns. The figure has a large, exaggerated facial expression with a wide, toothy grin. It is holding some objects in its hands, though the details are not entirely clear in the black and white image. The statue is situated in what appears to be an indoor setting, with some other architectural elements visible in the background.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-14

The black and white image shows a large stone statue or idol of a humanoid figure. The figure is depicted in an exaggerated, stylized manner with a large rounded body, short limbs, and an oversized head. The face has bulging eyes, a broad nose, and an open mouth showing teeth.

The statue is standing on an ornate pedestal or platform with decorative carvings and moldings. It appears to be holding objects in each hand, possibly ritual implements or offerings. The overall style suggests this may be a religious or mythological figure from an ancient culture, captured in a revered sculptural form.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This is a black and white photograph of what appears to be a traditional Hindu or Buddhist temple statue or deity figure. The statue is corpulent and has a jovial expression, standing on an ornately decorated lotus pedestal. The figure is holding what look like ceremonial objects or scepters in both hands and is adorned with traditional jewelry and ornaments. The statue appears to be made of metal or stone and has distinctive features including large earrings and a rotund belly. This style of statue is commonly found in temples across South and Southeast Asia. The photograph seems to have been taken indoors, possibly within a temple or religious building.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image depicts a black-and-white photograph of a statue of a Hindu deity, likely Hanuman, kneeling on a platform and holding a staff in each hand. The statue is positioned in front of a building with a tiled floor and a wall featuring a window. The statue's attire includes a loincloth and a necklace, and it has a distinctive hairstyle adorned with a headband. The background of the image shows a building with a tiled floor and a wall featuring a window, providing context for the statue's placement.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image depicts a black and white photograph of a statue, likely situated in a temple or shrine. The statue is of a large, imposing figure with a wide face, prominent nose, and large ears adorned with earrings. It wears a headband and has a strap across its chest, accompanied by a sword in its right hand and a staff in its left. The statue's attire includes a loincloth and a belt around its waist.

The statue is positioned on a pedestal, which features intricate carvings along its edges. In the background, a tiled floor and a wall with a dark section at the bottom are visible. The overall atmosphere of the image suggests a place of worship or reverence, with the statue being the central focus of attention.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-28

The image features a black-and-white photograph of a statue of a deity, possibly from a Hindu temple. The statue is seated on a pedestal, with intricate designs and patterns adorning the base. The deity is depicted with a large, round head, a long, pointed nose, and a wide, open mouth, giving it a fierce and intimidating appearance. The statue holds a mace in one hand and a snake in the other, symbolizing power and protection. The deity is adorned with jewelry, including a necklace, earrings, and a crown, adding to its regal appearance. The statue is set against a plain background, with a white wall and a tiled floor visible in the background.

Created by amazon.nova-pro-v1:0 on 2025-05-28

The statue of a man is placed on a pedestal, which is placed on the floor. The statue has a big belly, a mustache, and a beard. It is holding a snake in its right hand and a trident in its left hand. The statue is wearing a necklace and bracelets. Behind the statue, there is a wall with a frame mounted on it. The frame has a picture of a man.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Here is a description of the image:

The image is a black and white photograph featuring a large, ornate statue. The statue appears to be of a deity or a mythical figure, characterized by a stout physique, a broad face with large features (eyes, ears, nose, mouth), and elaborate decorative elements. It is standing on a decorative pedestal, suggesting that it is an important object of veneration. The statue holds a large ornate object, possibly a mace or scepter, in one hand, and has another object in its other hand, which is partially obscured.

The setting looks to be an outdoor space, likely a temple or a similar location. The background shows partial elements of a building, possibly a veranda or a covered walkway, which further supports this interpretation. The overall style and detailing of the statue suggest a possible origin from Southeast Asia, particularly with the elements and the posture, likely depicting a deity like Yaksha or similar guardian figures.

Created by gemini-2.0-flash on 2025-05-01

The photograph is a black and white image of a statue standing on a decorative base in front of a building. The statue depicts a figure with exaggerated features, including large ears with circular ornaments, a broad nose, and a slight underbite with visible teeth. It appears to be holding a scepter-like object in its left hand and a rounded object in its right. The figure has a sturdy build with a small chest and a sash across the chest. It's wearing a decorative headdress and what appears to be a short skirt or loincloth.

The statue stands on a multi-tiered base adorned with lotus-like designs. Behind the statue, there's a building with a corrugated metal roof and an open structure supported by pillars. A window is visible in the building's wall. The setting seems to be an outdoor area with a patterned floor. The overall atmosphere is somewhat grainy, typical of older black and white photography.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a statue of a deity, likely from Hindu mythology. The statue is made of stone and features intricate carvings and details. The deity is standing in a relaxed posture with one leg bent and the other straight, and it is holding two objects in its hands. The right hand holds a cylindrical object, possibly a mace or a club, while the left hand holds another object that appears to be a staff or a similar elongated item.

The deity has a distinctive facial expression with prominent, wide-open eyes and a smiling mouth with visible teeth. It is adorned with various ornaments, including large earrings, necklaces, and bracelets. The statue is dressed in traditional attire, with a cloth wrapped around the waist and a belt-like ornament.

The statue is placed on a pedestal that also features decorative carvings. The background shows part of a traditional building, possibly a temple, with a tiled roof and a wall with some architectural details. The overall setting suggests that this statue is located in a religious or cultural site.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image depicts a black and white photograph of a statue of a seated figure adorned with elaborate and ornate attire. The figure is sitting with one leg crossed over the other, holding a staff or mace in one hand and a snake in the other. The statue is intricately detailed, featuring a large, prominent nose, a mustache, and large, round earrings. The figure is also wearing a headdress and a belt with decorative elements. The background appears to be an indoor setting with a roof structure and some decorative elements visible. The overall style of the statue suggests it may be of religious or cultural significance, possibly representing a deity or a mythological character.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white image features a stone statue of a seated figure with an ornate and traditional design. The figure appears to be a deity or a mythological character, adorned with intricate jewelry and elaborate attire. The figure has a crown on its head, large earrings, and a beaded necklace. It is holding a staff or scepter in its right hand, while its left hand is raised in a gesture. The statue is seated on a pedestal, and the background shows part of a building with a roof and some decorative elements. The overall style suggests it is from a temple or a place of worship.