Human Generated Data

Title

Untitled (Borobudur, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5119

Human Generated Data

Title

Untitled (Borobudur, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5119

Machine Generated Data

Tags

Amazon
created on 2023-10-05

Archaeology 100
Baby 95.2
Person 95.2
Baby 94.7
Person 94.7
Baby 94.4
Person 94.4
Person 91.4
Face 89.2
Head 89.2
Baby 88
Person 88
Person 85.7
Person 77
Baby 74.4
Person 74.4
Art 57.7
Architecture 55.9
Building 55.9
Temple 55.9
Wall 55.2

Clarifai
created on 2018-05-10

people 99.7
engraving 98.7
art 98.2
many 97.3
ancient 97.2
man 96.7
antique 95.4
group 94.2
etching 93.6
old 92.7
sculpture 91
soldier 90.7
adult 87.3
historic 86.3
war 85.7
no person 85.4
vintage 85.1
archaeology 83.8
empire 82.3
leader 81.5

Imagga
created on 2023-10-05

wall 66.3
stone 62.8
structure 56
brick 49.9
old 48.8
memorial 48
brass 45.8
stone wall 39.4
texture 38.9
surface 38
architecture 36.8
pattern 35.6
ancient 34.6
fence 33.1
construction 32.5
cement 30.9
textured 30.7
material 30.4
weathered 29.5
rock 28.7
rough 28.3
building 27.9
grunge 26.4
brown 25.8
dirty 25.3
concrete 24.9
history 24.2
barrier 23.3
tunnel 23.2
aged 21.7
detail 20.9
wallpaper 20.7
solid 19.4
masonry 18.7
passageway 18.7
backdrop 18.2
exterior 17.5
vintage 17.4
stones 17.1
bricks 16.6
tile 16.6
antique 16
stucco 15.9
design 15.8
urban 15.7
built 15.4
horizontal 15.1
house 15.1
obstruction 15
passage 14.9
brickwork 14.8
close 14.3
monument 14
retro 13.9
blocks 13.6
cracked 13.6
block 13.4
historical 13.2
building material 12.9
sculpture 12.9
ruin 12.7
past 12.6
city 12.5
color 12.2
stonewall 11.8
gray 11.7
temple 11.6
worn 11.5
backgrounds 11.4
culture 11.1
carving 11.1
paint 10.9
frame 10.8
traditional 10.8
granite 10.8
clay 10.7
tourism 10.7
broken 10.6
travel 10.6
grungy 10.4
build 10.4
closeup 10.1
wood 10
art 10
mortar 9.8
plaster 9.8
gravestone 9.8
crack 9.7
facade 9.6
aging 9.6
tie 9.5
row 9.3
famous 9.3
way 9
ruined 8.9
civilization 8.8
ruins 8.8
pieces 8.7
architect 8.7
obsolete 8.6
strong 8.4
black 8.4
decorative 8.4
effect 8.2
religion 8.1
brace 7.9
rubble 7.9
abandoned 7.8
statue 7.8
orange 7.7
damaged 7.6
rusty 7.6
outdoors 7.5
place 7.5
natural 7.4
decoration 7.3
wooden 7

Microsoft
created on 2018-05-10

old 81
stone 5.7

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 27-37
Gender Female, 99.6%
Calm 49.2%
Happy 24.9%
Surprised 10.6%
Fear 7.9%
Sad 5.8%
Confused 3.3%
Angry 2.3%
Disgusted 1.8%

AWS Rekognition

Age 20-28
Gender Female, 99.3%
Happy 61.5%
Angry 17.1%
Fear 7.7%
Surprised 7.6%
Calm 7.1%
Sad 3.8%
Disgusted 1.8%
Confused 1.5%

AWS Rekognition

Age 24-34
Gender Female, 99.3%
Happy 86.7%
Fear 7.4%
Surprised 6.5%
Angry 4.8%
Sad 2.9%
Confused 1.6%
Disgusted 0.5%
Calm 0.1%

AWS Rekognition

Age 28-38
Gender Female, 94.4%
Sad 100%
Surprised 6.3%
Fear 5.9%
Calm 0.7%
Angry 0.3%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 56.5%
Sad 17.9%
Confused 9.3%
Surprised 8%
Fear 6.7%
Disgusted 6.7%
Happy 3.5%
Angry 2.7%

AWS Rekognition

Age 24-34
Gender Male, 99.6%
Sad 99.6%
Calm 24.9%
Surprised 7.7%
Fear 6.3%
Happy 3.5%
Disgusted 0.9%
Confused 0.5%
Angry 0.4%

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Baby
Person
Baby 95.2%
Baby 94.7%
Baby 94.4%
Baby 88%
Baby 74.4%
Person 95.2%
Person 94.7%
Person 94.4%
Person 91.4%
Person 88%
Person 85.7%
Person 77%
Person 74.4%

Categories

Captions

Microsoft
created by unknown on 2018-05-10

an old photo of a person 70%
old photo of a person 65.6%
an old photo of a building 64.2%

Clarifai
created by general-english-image-caption-blip on 2025-05-20

a photograph of a stone carving of a man and a woman -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image depicts an intricate stone relief with detailed carvings. On the left side, there is a figure wearing a crown or headdress, seated in a regal posture, possibly symbolizing divinity or royalty. Surrounding this prominent figure are several smaller human figures engaged in various poses and activities, including holding objects or interacting with one another. The relief captures a dynamic scene, showcasing elements of ancient storytelling or cultural representation, with ornate patterns and architectural elements integrated into the artwork.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image depicts an ancient stone relief carving that features several figures engaged in a scene that appears to involve social interaction or a gathering. On the left side, there is a seated figure adorned with a headdress and holding an object, suggesting a person of importance or royalty. Next to this figure, another individual is facing the seated figure, appearing to be in conversation or presenting something. The background shows a group of people seated together, possibly in discussion or listening to an event. The carving displays intricate details such as facial expressions, postures, and clothing, which suggest the cultural significance and artistic craftsmanship of the depicted scene.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of a stone carving depicting a scene with multiple figures.

The carving is made of stone and features a group of people in various poses, including sitting, standing, and lying down. The figures are arranged in a way that suggests they are part of a larger scene or story. Some of the figures appear to be holding objects or interacting with each other.

The background of the image is a plain white surface, which suggests that the photograph was taken in a studio or laboratory setting. There are no other objects or details visible in the image beyond the stone carving itself.

Overall, the image appears to be a historical or archaeological photograph of an ancient stone carving, possibly from a temple or monument. The level of detail and craftsmanship in the carving suggests that it may be from a significant cultural or religious site.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of a stone wall with carvings. The wall is made up of rectangular stones, and the carvings depict various figures in different poses. Some of the figures appear to be seated, while others are standing or kneeling. The carvings are intricate and detailed, suggesting that they were created by skilled artisans.

The overall atmosphere of the image is one of ancient history and culture. The use of stone as a medium for the carvings suggests that the image is from a time long past, and the level of detail and craftsmanship involved in creating the carvings implies a high level of artistic skill and attention to detail.

It's worth noting that the image appears to be a photograph of a photograph, as evidenced by the white border around the edges of the image. This suggests that the original photograph may have been taken at some point in the past, and then rephotographed or scanned at a later date.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image is a black-and-white photograph of an ancient stone wall adorned with intricate carvings. The carvings depict various human figures engaged in different activities, such as sitting, standing, and interacting with each other. Some of the figures appear to be musicians, playing instruments like flutes and drums. The wall itself is made of stone blocks and has a weathered appearance, suggesting its age and historical significance. The carvings are detailed and well-preserved, showcasing the artistic skills of the ancient civilization that created them. The image likely depicts a scene from a temple or other important structure, providing insight into the cultural and religious practices of the time.

Created by amazon.nova-pro-v1:0 on 2025-05-27

The image is a black-and-white photograph of a stone carving. The carving is of a group of people, with one figure in the center, surrounded by others. The central figure is sitting on a throne, with a crown on his head, and appears to be a king or a ruler. The people around him are kneeling or sitting on the ground, and some of them are holding musical instruments. The carving is intricate and detailed, with fine lines and textures.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

This is a black and white photograph of a relief carving on a stone wall. The carving depicts a scene with multiple figures.

There's a central figure who appears to be a regal personage, seated and adorned with a headdress. To the right of them, a series of other figures are depicted: some are embracing, some are sitting and playing instruments, and others are interacting in various ways. All of the figures appear to be clothed in garments consistent with traditional Southeast Asian art and architecture. The background is formed by a series of stone blocks or bricks stacked to form a wall. The image is well-lit and exhibits strong contrasts, which emphasize the details of the carvings.

Created by gemini-2.0-flash on 2025-04-30

Here is a description of the image:

The black and white photo shows a relief carving on a stone wall. The top of the wall consists of stacked, rectangular blocks.

The carving itself depicts a scene with multiple figures. On the left side of the image, there is a figure sitting on a throne or platform, wearing a crown. Next to them, another figure is seated on a smaller platform. Between the two figures is an intricately carved pillar.

To the right of the figures, there is a crowd of people. Some of them appear to be embracing, while others seem to be playing musical instruments. The figures are somewhat crude and archaic.

The bottom of the image shows the lower portion of the stone wall, also made of rectangular blocks. The overall impression is that of an ancient artifact, possibly part of a temple or historical site.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a section of an ancient stone relief carving. The relief is intricate and features multiple figures in various poses and activities. Here is a detailed summary of the scene:

  1. Left Side:

    • A seated figure, likely a deity or a significant character, is prominently displayed. This figure appears to be in a meditative or contemplative pose.
    • Nearby, there is another figure standing, possibly an attendant or a guardian.
  2. Center:

    • There is a central structure or object, possibly an altar or a throne, with detailed carvings.
    • Surrounding this central object are several figures, some of whom appear to be in dynamic poses, suggesting movement or interaction.
  3. Right Side:

    • Multiple figures are engaged in what seems to be a lively or dramatic scene. Some figures appear to be in motion, possibly dancing or fighting.
    • The figures are intricately carved, showcasing detailed facial expressions and body postures.
  4. Overall Composition:

    • The relief is divided into sections by horizontal and vertical lines, creating a grid-like pattern that helps to organize the scene.
    • The carving style is characteristic of ancient Southeast Asian art, with a focus on narrative storytelling and symbolic representation.

This relief likely comes from a temple or a significant historical site, reflecting cultural, religious, or mythological themes prevalent in the region during the time it was created.