Human Generated Data

Title

Untitled (cremation ceremony, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5035

Human Generated Data

Title

Untitled (cremation ceremony, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5035

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Clothing 99.1
Hat 99.1
Back 92.2
Body Part 92.2
Face 87.8
Head 87.8
Cross 76.8
Symbol 76.8
Outdoors 63.7
Gravestone 57.9
Tomb 57.9
People 57.9
Shorts 57.5
Sun Hat 55.7

Clarifai
created on 2018-05-10

people 99.9
group together 99
group 98.4
man 97.5
child 96.8
adult 96.5
many 95
woman 90.8
monochrome 89.3
military 87.8
boy 87.7
several 86.8
war 85.2
recreation 82.9
administration 82
wear 78.4
soldier 78.3
cavalry 77.2
five 73.3
crowd 70.7

Imagga
created on 2023-10-06

military uniform 39.3
statue 34.1
uniform 32.1
sculpture 29.6
clothing 25.3
world 20.1
travel 19.7
old 18.8
history 18.8
religion 17
consumer goods 16.6
art 16.3
people 16.2
man 16.1
architecture 15.6
covering 15.4
culture 15.4
stone 15.2
grandfather 15.2
building 14.3
kin 14.1
tourism 14
monument 14
ancient 13.8
sky 11.5
male 11.4
historical 11.3
antique 11.2
person 11.2
city 10.8
soldier 10.7
historic 10.1
landmark 9.9
vintage 9.9
park 9.9
portrait 9.7
adult 9.7
marble 9.7
fountain 9.6
symbol 9.4
parent 9.3
outdoor 9.2
traditional 9.1
child 9.1
black 9
mother 8.9
love 8.7
father 8.7
religious 8.4
outdoors 8.2
vacation 8.2
dad 8.1
decoration 8
lifestyle 7.9
urban 7.9
boy 7.8
sepia 7.8
heritage 7.7
summer 7.7
house 7.5
commodity 7.5
life 7.4
peace 7.3
girls 7.3
figure 7.2
family 7.1
helmet 7.1
day 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 99.2
outdoor 98.5
people 86.6
group 86.4
standing 84.7
old 76
mammal 51.6
posing 38.6
horse 16.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 13-21
Gender Female, 88%
Sad 50.4%
Calm 38.8%
Angry 32.7%
Surprised 6.4%
Fear 6%
Disgusted 0.5%
Confused 0.4%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 90.2%
Sad 30.1%
Happy 20.9%
Calm 15.1%
Surprised 13.4%
Disgusted 12.9%
Fear 9.7%
Angry 7%
Confused 5.3%

AWS Rekognition

Age 10-18
Gender Female, 99.5%
Sad 75.8%
Surprised 26.6%
Confused 16%
Calm 10.5%
Fear 7.6%
Happy 6.9%
Disgusted 4.6%
Angry 3.5%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Sad 99.9%
Calm 12.9%
Surprised 6.5%
Fear 6.1%
Angry 2.7%
Confused 2.3%
Disgusted 1.7%
Happy 0.6%

AWS Rekognition

Age 13-21
Gender Male, 98.3%
Angry 48.7%
Calm 44.3%
Surprised 7%
Fear 6.1%
Sad 3.3%
Disgusted 1.3%
Happy 0.4%
Confused 0.3%

AWS Rekognition

Age 19-27
Gender Male, 92.6%
Calm 69.1%
Happy 15.6%
Surprised 7%
Angry 6.4%
Fear 6.2%
Sad 3.4%
Disgusted 2%
Confused 1.4%

AWS Rekognition

Age 18-26
Gender Male, 94.4%
Calm 81.7%
Surprised 7.8%
Fear 6.7%
Sad 3.4%
Disgusted 3.2%
Angry 2.9%
Happy 2.9%
Confused 0.9%

AWS Rekognition

Age 27-37
Gender Female, 72%
Happy 48.8%
Fear 38.9%
Calm 11.1%
Surprised 6.5%
Sad 2.9%
Angry 1.4%
Disgusted 0.9%
Confused 0.6%

AWS Rekognition

Age 20-28
Gender Male, 97.9%
Calm 98%
Surprised 6.4%
Fear 5.9%
Sad 2.4%
Angry 0.4%
Confused 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 21-29
Gender Female, 52.6%
Calm 60.4%
Fear 18.8%
Surprised 7%
Sad 5.8%
Happy 5.7%
Angry 2.9%
Disgusted 2.4%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Female, 64.6%
Fear 49.3%
Calm 20.7%
Surprised 13.5%
Angry 7.2%
Happy 5.9%
Sad 5.3%
Confused 5.1%
Disgusted 3.8%

AWS Rekognition

Age 16-22
Gender Female, 96.9%
Calm 58%
Disgusted 35%
Surprised 6.8%
Fear 6%
Sad 2.7%
Happy 1.6%
Confused 1.2%
Angry 1%

AWS Rekognition

Age 12-20
Gender Male, 79.2%
Sad 99.7%
Calm 16.8%
Surprised 7%
Fear 6.4%
Confused 6.3%
Disgusted 2.6%
Happy 1.9%
Angry 1.3%

Microsoft Cognitive Services

Age 10
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Boy
Child
Male
Person
Adult
Man

Clarifai

Clothing
Human face
Man
Tree
Human hair
Human head

AWS Rekognition

Boy 98.6%

AWS Rekognition

Child 98.6%

AWS Rekognition

Male 98.6%

AWS Rekognition

Male 98.6%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 97.5%

AWS Rekognition

Male 88.6%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 97.5%

AWS Rekognition

Person 96.9%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 95.5%

AWS Rekognition

Person 95.5%

AWS Rekognition

Person 94.1%

AWS Rekognition

Person 93.4%

AWS Rekognition

Person 88.6%

AWS Rekognition

Person 88.6%

AWS Rekognition

Person 87.8%

AWS Rekognition

Person 87%

AWS Rekognition

Person 85.5%

AWS Rekognition

Person 82.6%

AWS Rekognition

Person 79.6%

AWS Rekognition

Person 76.2%

AWS Rekognition

Person 76.2%

AWS Rekognition

Person 72.7%

AWS Rekognition

Person 72%

AWS Rekognition

Person 71.1%

AWS Rekognition

Person 61.6%

AWS Rekognition

Person 60.8%

AWS Rekognition

Adult 98.6%

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 97.5%

AWS Rekognition

Adult 88.6%

AWS Rekognition

Man 98.6%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 97.5%

AWS Rekognition

Man 88.6%

Clarifai

Clothing 87.3%

Clarifai

Clothing 84.3%

Clarifai

Clothing 82.2%

Clarifai

Clothing 73.3%

Clarifai

Clothing 70.1%

Clarifai

Clothing 68.3%

Clarifai

Clothing 66.9%

Clarifai

Clothing 60.3%

Clarifai

Clothing 50.5%

Clarifai

Clothing 46.2%

Clarifai

Clothing 45.4%

Clarifai

Clothing 45%

Clarifai

Clothing 44.5%

Clarifai

Clothing 43.3%

Clarifai

Clothing 43%

Clarifai

Clothing 42.2%

Clarifai

Clothing 39.5%

Clarifai

Clothing 38.8%

Clarifai

Clothing 38.7%

Clarifai

Clothing 37.5%

Clarifai

Clothing 37%

Clarifai

Clothing 35.3%

Clarifai

Human face 79.2%

Clarifai

Human face 60.6%

Clarifai

Human face 52.5%

Clarifai

Human face 36.4%

Clarifai

Human face 35.9%

Clarifai

Man 73.8%

Clarifai

Man 73.1%

Clarifai

Man 58.6%

Clarifai

Man 47.1%

Clarifai

Man 43.9%

Clarifai

Man 41.8%

Clarifai

Man 41.2%

Clarifai

Man 40%

Clarifai

Man 39.1%

Clarifai

Man 36.4%

Clarifai

Man 33.3%

Clarifai

Tree 73.5%

Clarifai

Tree 67.3%

Clarifai

Tree 44.2%

Clarifai

Tree 39.9%

Clarifai

Tree 39.2%

Clarifai

Tree 37.4%

Clarifai

Tree 35.1%

Clarifai

Human hair 54.5%

Clarifai

Human head 33.5%

Categories

Imagga
created on 2023-10-06

people portraits 52.4%
paintings art 41.4%
nature landscape 2.5%
streetview architecture 2.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people standing around a large elephant

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of people standing around a wooden structure

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

This black-and-white image depicts a group of people gathered in a forested area, engaged in what appears to be the construction, assembly, or ceremonial preparation of a wooden structure. The scene includes men wearing straw hats and simple work or casual clothing, with some assisting near a structure made of logs and netting. The area is surrounded by trees, suggesting a rural or jungle setting. The wooden platform or construction is the central focus, while the individuals are actively participating or observing. A decorative element above the structure indicates cultural or ceremonial significance.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image depicts a group of people gathered in an outdoor setting, possibly a forest due to the visible trees surrounding them. Many individuals are wearing hats, likely straw hats, and are dressed in casual attire suitable for working or being outdoors in a warm climate. In the center and slightly to the rear of the image, there appears to be a large, elaborate structure or platform with a canopy decorated with drapery. Some individuals are standing or working on this platform, which is elevated and may be part of a ceremony or a group activity. The general environment suggests a communal or work-oriented event.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to depict a large group of people gathered in an outdoor, forested setting. The individuals are dressed in casual clothing, with some wearing hats. There is a structure or sculpture visible in the background, surrounded by the crowd. The overall scene suggests some kind of gathering or event taking place in this natural environment.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This is a black and white historical photograph showing what appears to be a work site or construction area in a wooded setting. There's a group of workers wearing casual attire including white shirts, tank tops, and straw hats. They appear to be gathered around what looks like wooden logs or timber laid out on the ground. The setting suggests this might be a logging operation or construction project in a forested area. The image has the grainy quality typical of mid-20th century photography. In the background, you can see trees and forest vegetation, and some people appear to be working at different levels on what might be a wooden structure or platform.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a group of people gathered around a large animal, likely a moose or elk, that is being transported on a platform. The scene appears to be set in a forest or wooded area, with trees visible in the background.

In the foreground, several men are standing near the platform, some of whom are wearing hats and shirts. One man is holding a cigarette in his hand. The platform itself is constructed from wooden logs and appears to be makeshift.

The overall atmosphere of the image suggests that the people in the photo are engaged in some sort of outdoor activity, possibly related to hunting or logging. The presence of the large animal on the platform implies that it may have been caught or killed in the forest, and the people are gathered to discuss or process it.

The image provides a glimpse into a moment in time, capturing the interaction between humans and their environment in a rural or wilderness setting.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-12

The image depicts a black-and-white photograph of a group of people gathered around a structure in a wooded area. The scene appears to be a communal or ceremonial event, with the individuals present likely participating in or observing the activity.

In the foreground, several men are visible, some wearing hats and others without. They seem to be engaged in conversation or observing the central activity. Behind them, a larger group of people is gathered around a structure that resembles a stage or platform. This structure appears to be constructed from natural materials such as wood and branches.

The background of the image features a dense wooded area, suggesting that the event is taking place in a rural or wilderness setting. The overall atmosphere of the image conveys a sense of community and shared purpose among the individuals present.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

The image is a black-and-white photograph depicting a scene in a forested area. It appears to be a community event or gathering. In the foreground, several people are standing, some wearing hats, and appear to be watching or participating in an activity. In the middle of the image, there is a structure that resembles a makeshift stage or platform, possibly for performances or speeches. On top of this structure, there are people, some of whom are standing while others are seated or leaning against it. The structure is surrounded by a crowd of people, suggesting that it is the focal point of the gathering. The background is filled with trees, indicating that the event is taking place outdoors in a natural setting. Overall, the image conveys a sense of community and togetherness, with people coming together to celebrate or participate in an event in a forested area.

Created by amazon.nova-pro-v1:0 on 2025-05-29

A black and white photo of a group of people gathered in an outdoor area, probably in a forest. They are wearing hats and some are wearing slippers. Some of them are standing on a wooden structure. The structure is made of bamboo and wood. There are trees behind them. A person is standing near the structure, and another person is standing beside him. Some of them are looking at something.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

Here is a description of the image:

The image is a black and white photograph taken outdoors. It appears to depict a gathering of people, possibly an event or ceremony, in a wooded area. A significant focal point is a large, ornate structure, possibly a ceremonial altar or platform, situated in the background. Men are seen interacting with it.

Here's a breakdown:

  • People: A large group of men are present, most of whom are wearing simple clothing, such as shorts, short-sleeved shirts, and straw hats. Some appear to be bare-chested. They are of Asian descent and a few of them can be seen holding objects and looking at the camera.
  • Structure: The main feature in the background is a large structure. It seems to have an arched entrance, and the front is decorated with carvings, and there are decorations such as horns on top. Some men appear to be working around or on the structure.
  • Setting: The scene takes place in a forested or wooded environment. Tall trees are visible in the background. The ground looks to be muddy or covered with vegetation.
  • Atmosphere: The photograph has a historic, possibly anthropological feel. The composition and the attire of the people suggest a cultural or religious event.

Overall, the photograph captures a moment of a gathering, likely a ceremonial event, in a remote, wooded location.

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

The black-and-white photograph shows a crowd of people, mostly men, gathered around a platform structure in what appears to be a wooded area. The people are wearing a mix of casual clothing, including shorts, shirts, and hats. Some men are shirtless. In the foreground, a young man is facing the viewer with a serious expression, while another man beside him is looking to the side and holding a cigarette. Many others are looking towards the platform.

The platform structure is multi-tiered and seems to be made of wood or bamboo. There's some sort of ornate design at the top of the platform, possibly representing animal horns. Some people are standing on the platform, engaged in what might be some kind of ritualistic activity.

The background features a dense forest with tall trees. The image seems to capture a moment of cultural or religious significance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The black-and-white photograph depicts a group of people in a forested area, seemingly engaged in a construction or transportation project. The scene appears to be set in a rural or remote location, likely in a tropical or subtropical region, as indicated by the dense foliage and the attire of the individuals.

Key details of the image:

  1. People and Attire: The people in the image are dressed in light clothing, including shorts and sleeveless shirts, which suggests a warm climate. Some individuals are wearing hats, possibly to shield themselves from the sun.

  2. Activity: The group is working together on what appears to be a large structure made of bamboo or similar materials. Some people are carrying or moving parts of this structure, while others are standing or walking around, possibly coordinating or observing the work.

  3. Setting: The background is filled with tall trees and dense vegetation, indicating a forested environment. The ground is covered with leaves and small plants, typical of a natural, undeveloped area.

  4. Tools and Materials: The materials used in the construction seem to be natural and locally sourced, such as bamboo poles. There are no visible modern tools or machinery, suggesting a reliance on manual labor and traditional methods.

  5. Interaction: Some individuals are engaged in conversation or gesturing, indicating communication and collaboration among the group.

Overall, the image captures a moment of communal effort and cooperation in a natural setting, likely for a purpose related to construction, transportation, or a cultural event.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph depicting a group of people gathered in a forested area. The setting appears to be a rural or remote location, possibly a construction or labor site. In the foreground, a group of individuals is gathered, some wearing hats and casual clothing. They seem to be observing or working on a large structure made of bamboo or wooden logs, which is being built or assembled. The background shows more trees and foliage, indicating a dense forest environment. The overall atmosphere suggests a communal or labor-based activity, possibly related to traditional building practices or construction work in a natural, outdoor setting.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a black-and-white photograph depicting a group of people gathered in what appears to be a forested area. The individuals are dressed in a mix of traditional and modern clothing, with many wearing hats and simple shirts. Some are standing on a makeshift structure made of bamboo poles, while others are on the ground, observing or engaging in conversation. The background includes trees and dense foliage, suggesting a tropical or jungle setting. The atmosphere appears to be one of social or cultural activity, possibly a gathering or celebration.