Human Generated Data

Title

Untitled (cremation ceremony, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5038

Human Generated Data

Title

Untitled (cremation ceremony, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5038

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Architecture 99.9
Building 99.9
Outdoors 99.9
Shelter 99.9
Countryside 99.8
Hut 99.8
Nature 99.8
Rural 99.8
Adult 97.5
Male 97.5
Man 97.5
Person 97.5
Person 97
Person 96.3
Person 96.2
Person 95.9
Person 95.6
Person 95.5
Person 94.9
Person 94.7
People 93
Person 92.9
Person 92.4
Person 91.8
Baby 91.8
Person 91.4
Person 91.1
Person 91
Person 90.4
Face 90.3
Head 90.3
Person 90.2
Person 89.3
Adult 86.7
Male 86.7
Man 86.7
Person 86.7
Person 85.6
Person 82.3
Person 81.3
Person 80.8
Person 80.4
Person 79.2
Person 78.5
Person 73
Crowd 71.4
Person 66.8
Person 65.8
Person 63.8
Person 61.2
Person 58.8
Shack 55.5

Clarifai
created on 2018-05-10

people 99.9
group 97.8
man 96.2
crowd 95.8
many 95.5
child 92.7
adult 91.4
woman 90
art 88.2
street 87.5
group together 86.9
music 84.5
wear 81.7
illustration 80.9
monochrome 80.4
vintage 75.8
audience 73.7
administration 73
war 69.7
cavalry 69.2

Imagga
created on 2023-10-07

architecture 46.9
fountain 33.9
statue 30.9
building 29.4
tourism 24.7
old 24.4
travel 23.9
ancient 23.3
city 23.3
sculpture 22.9
religion 22.4
landmark 21.7
famous 21.4
structure 21.2
history 20.6
temple 20.4
culture 19.7
stone 19.1
sky 19.1
park 17.4
palanquin 17.1
monument 16.8
palace 16.3
marble 15.5
historic 14.7
litter 13.7
historical 13.2
water 12.7
outdoor 12.2
fan 12.2
stage 12.1
place 12.1
column 11.5
tree 11.5
god 11.5
tourist 11.2
street 11
art 10.7
heritage 10.6
spirituality 10.6
stall 10.4
conveyance 10.4
church 10.2
garden 10.1
snow 10
cemetery 9.8
night 9.8
traditional 9.1
follower 9
house 9
tower 8.9
roof 8.9
urban 8.7
faith 8.6
construction 8.6
china 8.5
religious 8.4
platform 8.4
summer 8.4
exterior 8.3
scenery 8.1
trees 8
person 8
day 7.8
cloud 7.7
worship 7.7
seller 7.5
landscape 7.4
town 7.4
people 7.3
residence 7.2
spring 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 95.9
outdoor 91.6
people 86.5
group 58.6
old 53.3
crowd 40.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 29-39
Gender Male, 96.2%
Calm 50.8%
Sad 22.8%
Angry 9.8%
Disgusted 9.1%
Surprised 7.7%
Fear 6.6%
Happy 4.4%
Confused 3.4%

AWS Rekognition

Age 22-30
Gender Male, 87%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Happy 0%
Confused 0%
Angry 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 97.8%
Calm 46.9%
Surprised 29.6%
Happy 12.8%
Fear 10.9%
Sad 4.1%
Angry 2.6%
Disgusted 1.1%
Confused 0.6%

AWS Rekognition

Age 23-31
Gender Male, 62.1%
Calm 67.4%
Angry 19.4%
Surprised 7.5%
Fear 6.1%
Sad 4.9%
Confused 1.8%
Happy 1.5%
Disgusted 0.9%

AWS Rekognition

Age 18-26
Gender Female, 93.1%
Calm 63.1%
Sad 50.5%
Surprised 6.7%
Fear 6.3%
Happy 4.7%
Angry 1.3%
Confused 1.1%
Disgusted 1%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Calm 66.8%
Confused 16.9%
Surprised 7.2%
Fear 6.8%
Sad 6.6%
Disgusted 1.8%
Angry 1.6%
Happy 0.6%

AWS Rekognition

Age 9-17
Gender Male, 98.6%
Sad 66.7%
Calm 47.6%
Confused 12%
Surprised 6.8%
Fear 6.5%
Angry 2.6%
Disgusted 2%
Happy 1.4%

AWS Rekognition

Age 18-24
Gender Female, 81.1%
Sad 78.8%
Calm 27.8%
Fear 24.4%
Surprised 6.5%
Happy 6.2%
Angry 3%
Disgusted 1.4%
Confused 0.7%

AWS Rekognition

Age 16-22
Gender Male, 67%
Calm 74.6%
Sad 14.2%
Fear 9.3%
Surprised 6.4%
Angry 1.3%
Disgusted 1.2%
Happy 0.9%
Confused 0.2%

AWS Rekognition

Age 12-20
Gender Female, 78.3%
Calm 99.5%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-24
Gender Male, 57.9%
Calm 83.2%
Surprised 6.4%
Fear 6.3%
Sad 5.7%
Happy 5.2%
Angry 1.5%
Confused 0.9%
Disgusted 0.5%

AWS Rekognition

Age 26-36
Gender Male, 98.9%
Sad 83.8%
Disgusted 46.1%
Calm 6.9%
Surprised 6.5%
Fear 6.5%
Confused 4.4%
Angry 1.3%
Happy 1.2%

Feature analysis

Amazon

Adult
Male
Man
Person
Baby
Adult 97.5%
Adult 86.7%
Male 97.5%
Male 86.7%
Man 97.5%
Man 86.7%
Person 97.5%
Person 97%
Person 96.3%
Person 96.2%
Person 95.9%
Person 95.6%
Person 95.5%
Person 94.9%
Person 94.7%
Person 92.9%
Person 92.4%
Person 91.8%
Person 91.4%
Person 91.1%
Person 91%
Person 90.4%
Person 90.2%
Person 89.3%
Person 86.7%
Person 85.6%
Person 82.3%
Person 81.3%
Person 80.8%
Person 80.4%
Person 79.2%
Person 78.5%
Person 73%
Person 66.8%
Person 65.8%
Person 63.8%
Person 61.2%
Person 58.8%
Baby 91.8%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-21

a photograph of a group of people standing around a stage -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image depicts a gathering of people in a natural outdoor setting, surrounded by tall trees and dense foliage. The focal point is an elevated structure or shrine adorned with decorations, where several individuals are standing or interacting. The crowd, composed of men and women dressed in traditional or casual attire, appears to be involved in a communal or ceremonial activity. Some people wear head coverings or ceremonial headgear, adding to the cultural significance of the scene. The atmosphere suggests a moment of social or religious importance.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a black and white scene of a large gathering of people, possibly participating in a cultural or religious event. The setting appears to be outdoors in a forested area. There is a structure resembling a shrine or small pavilion, elevated and elaborately decorated, under which several people are gathered. The attire of the crowd includes traditional clothing and headwear, suggesting a cultural or traditional significance to the event. The atmosphere seems lively, with people clustered around the structure and engaged in various activities.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to depict a crowded outdoor scene, likely some kind of public event or gathering. There are many people visible, standing or sitting in a wooded area with a large, temporary structure or shelter in the center. The people seem to be dressed in clothing typical of the time period, suggesting this is an older photograph. The overall scene conveys a sense of community and activity, though without being able to identify any specific individuals, I can only describe the general setting and atmosphere captured in the image.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This appears to be a black and white historical photograph showing a crowd gathered around what looks like a raised platform or stage with a decorative pagoda-style roof. The structure appears to be rustic or temporary, made with natural materials. Several people are standing on the elevated platform while a larger crowd observes from ground level. The setting appears to be outdoors with trees visible in the background. The style of dress and quality of the photograph suggests this was taken sometime in the mid-20th century. The gathering seems to be some kind of public event or ceremony, though the specific nature is unclear from this image alone.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a group of people gathered around a small, elevated structure with a pointed roof. The structure appears to be a traditional Indonesian or Balinese temple, adorned with intricate carvings and decorations.

In the foreground, a group of men are standing on a platform attached to the structure, while others are gathered around the base, observing the scene. Some individuals are wearing traditional clothing, including sarongs and head wraps, while others are dressed in more modern attire.

The background of the image features a dense forest with tall trees, suggesting that the event is taking place in a rural or natural setting. The overall atmosphere of the image is one of reverence and celebration, with the group of people gathered around the temple structure conveying a sense of community and shared experience.

The image appears to be a historical photograph, likely taken during a cultural or religious festival, and provides a glimpse into the traditions and customs of a specific community or region.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a crowd gathered around a raised platform, where several individuals are standing. The platform is adorned with a roof and features a group of people, some of whom are dressed in traditional attire, including sarongs and head coverings. The crowd surrounding the platform appears to be engaged in some form of ceremony or celebration, with many of the onlookers also wearing traditional clothing.

In the background, trees and foliage are visible, suggesting that the event is taking place outdoors. The overall atmosphere of the image is one of community and cultural heritage, with the gathering of people and the traditional attire worn by many of them evoking a sense of shared identity and tradition.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The black-and-white photo shows a group of people standing in front of a small stage or platform in a forest area. The stage has a roof and some decorations, and it appears to be a makeshift structure. The people are wearing traditional clothing, and some are wearing hats. The photo appears to be taken during a cultural event or festival, as there are many people gathered in the area.

Created by amazon.nova-pro-v1:0 on 2025-06-07

The black-and-white photo shows a group of people gathered in an outdoor area, probably for a religious ceremony. Some people are standing on the platform, while others are sitting on the ground. The platform has a roof, and it is decorated with hanging decorations. Some people are wearing hats, while others are wearing slippers. The area is surrounded by trees, and it seems that sunlight is shining on the ground.

Google Gemini

Created by gemini-2.0-flash on 2025-05-25

Here is a description of the image:

The black and white photograph depicts a crowded outdoor scene, possibly capturing a cultural event or gathering. In the background, tall trees with numerous branches are visible, creating a natural backdrop.

In the center of the scene, there is a small, ornate structure, possibly a pavilion or shrine, with several people standing underneath it. The structure has a roof and appears to be decorated with intricate details.

A large crowd of people, all dressed in casual attire, surrounds the structure, suggesting that they are either observing or participating in whatever is happening there. The people in the crowd are diverse, with both men and women present.

The photograph is taken from a slightly low angle, giving a sense of the scale of the event and the number of people in attendance. The lighting is soft, and the overall tone of the image is documentary, suggesting that it was taken to capture a specific moment in time.

Created by gemini-2.0-flash-lite on 2025-05-25

Here's a description of the image:

Overall Impression: The image is a black and white photograph of a gathering or ceremony taking place outdoors, likely in a tropical setting. It appears to be an older photograph, possibly from the mid-20th century or earlier.

Main Subject:

  • A group of men stand under a structure that resembles a ceremonial canopy or pavilion. The structure is ornate, with a roof-like top and appears to be built of wood.
  • The men beneath the canopy are dressed in simple clothing, which may be traditional garments.

Surrounding Scene:

  • A large crowd of people surrounds the main area.
  • The background is densely wooded, with tall trees and hanging vines.

Atmosphere: The image suggests a moment of cultural significance, possibly a religious ritual, festival, or public gathering. The expressions on people's faces are hard to distinguish because the quality of the photograph is not that good. The style of the photograph is somewhat reminiscent of historical documentation.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a traditional ceremony or festival taking place in what appears to be a tropical or forested area. The central focus is on a decorated structure, possibly a shrine or a ceremonial platform, adorned with intricate designs and decorations. Several individuals are standing on or near this structure, engaged in what seems to be a ritual or a performance.

A large crowd of people is gathered around the structure, observing the event. Many of the attendees are dressed in traditional attire, which includes sarongs, headwear, and other cultural garments. The atmosphere appears to be solemn and respectful, indicative of a significant cultural or religious occasion.

The background features lush greenery, suggesting that the event is taking place outdoors in a natural setting. The overall scene conveys a sense of community and cultural heritage, with participants actively involved in the ceremony.