Human Generated Data

Title

Untitled (cremation ceremony, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5044

Human Generated Data

Title

Untitled (cremation ceremony, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5044

Machine Generated Data

Tags

Amazon
created on 2023-10-06

People 98.3
Wedding 96.8
Plant 95.8
Vegetation 95.8
Tree 94.4
Clothing 91.3
Face 87.6
Head 87.6
Outdoors 81.1
Nature 74.3
Crowd 67.5
Hat 65.5
Land 62.6
Woodland 62.6
Photography 57.9
Hippie 57.4

Clarifai
created on 2018-05-10

people 100
child 98.6
group 98
many 97.3
adult 97.1
group together 96.7
man 95.5
woman 94.8
war 94.2
military 91.3
boy 90.4
administration 87.5
soldier 86.3
family 84
crowd 83.2
recreation 80.1
wear 78.7
skirmish 73.7
street 72.9
uniform 71.9

Imagga
created on 2023-10-06

snow 61.2
winter 43.4
cold 31.9
park 29.6
tree 25.4
landscape 23.8
weather 22.9
forest 21.8
season 21
frost 20.2
ice 19.2
outdoors 18.3
trees 16.9
snowy 16.5
scene 16.4
outdoor 16.1
old 16
sky 15.9
covered 13.6
light 13.4
city 13.3
frozen 12.4
people 12.3
structure 12
architecture 11.7
man 11.4
statue 11.1
street 11
peaceful 11
building 10.8
road 10.8
snowing 10.8
groom 10.7
walk 10.5
couple 10.5
fountain 10.1
blizzard 9.9
travel 9.9
snowfall 9.8
mountain 9.8
frosty 9.8
night 9.8
scenic 9.7
seasonal 9.6
kin 9.6
black 9.6
love 9.5
town 9.3
person 9.2
wood 9.2
historic 9.2
fall 9.1
stone 9.1
fun 9
water 8.7
freeze 8.5
row 8.4
branch 8.2
river 8
rural 7.9
urban 7.9
day 7.8
wall 7.8
pedestrian 7.8
storm 7.7
residential 7.7
two 7.6
path 7.6
garden 7.5
world 7.4
mountains 7.4
spectator 7.3
calm 7.3
chemical weapon 7.3
girls 7.3
scenery 7.2
holiday 7.2
mother 7.1
family 7.1
cool 7.1
country 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

tree 99
outdoor 98.1
person 97.9
group 89
posing 82.4
old 78.6
crowd 1.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Confused 56%
Calm 40.5%
Surprised 6.4%
Fear 6%
Sad 3%
Angry 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Male, 100%
Sad 91.5%
Calm 53.5%
Surprised 6.4%
Fear 6%
Confused 1.6%
Disgusted 0.6%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 20-28
Gender Male, 99.7%
Sad 99.2%
Confused 33.9%
Surprised 6.4%
Fear 6%
Calm 4.7%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 6-14
Gender Female, 96.3%
Sad 99.1%
Calm 29.9%
Surprised 7.3%
Fear 6.3%
Angry 2.7%
Confused 2.3%
Disgusted 1.3%
Happy 0.9%

AWS Rekognition

Age 40-48
Gender Female, 99.6%
Sad 100%
Calm 7.1%
Fear 6.9%
Surprised 6.4%
Confused 0.9%
Disgusted 0.2%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 96.4%
Calm 60.6%
Sad 19.5%
Surprised 9.7%
Happy 7.1%
Fear 6.1%
Confused 4.3%
Disgusted 3%
Angry 2.1%

AWS Rekognition

Age 22-30
Gender Male, 95.1%
Confused 63.3%
Calm 17.6%
Surprised 9.5%
Sad 8.9%
Fear 6.2%
Disgusted 1.5%
Happy 0.6%
Angry 0.5%

AWS Rekognition

Age 23-31
Gender Female, 62%
Sad 94.8%
Calm 27.5%
Surprised 9.9%
Angry 9.7%
Fear 6.3%
Disgusted 5.1%
Confused 2.4%
Happy 1.3%

AWS Rekognition

Age 23-33
Gender Male, 86.3%
Sad 56.4%
Surprised 41.8%
Confused 25.1%
Calm 7.4%
Fear 6.4%
Happy 5.8%
Disgusted 2.9%
Angry 1.3%

AWS Rekognition

Age 12-20
Gender Male, 98.4%
Calm 63.9%
Happy 30%
Surprised 6.6%
Fear 5.9%
Sad 3.5%
Confused 0.9%
Disgusted 0.8%
Angry 0.2%

AWS Rekognition

Age 31-41
Gender Male, 90.1%
Sad 71.1%
Calm 66.4%
Surprised 6.3%
Fear 5.9%
Angry 0.3%
Confused 0.1%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 7-17
Gender Female, 73.2%
Calm 66.2%
Fear 16.5%
Surprised 7.2%
Sad 6.3%
Confused 2.2%
Disgusted 2.1%
Happy 1.6%
Angry 1.1%

AWS Rekognition

Age 16-22
Gender Female, 64.3%
Calm 74.2%
Sad 35.1%
Surprised 6.4%
Fear 5.9%
Angry 1.1%
Happy 0.9%
Disgusted 0.5%
Confused 0.4%

AWS Rekognition

Age 24-34
Gender Male, 76.8%
Calm 50.3%
Angry 31.5%
Surprised 13.2%
Fear 6.2%
Sad 3.5%
Happy 2.1%
Disgusted 1.5%
Confused 0.8%

AWS Rekognition

Age 16-22
Gender Female, 99.6%
Sad 52%
Disgusted 34.5%
Angry 11.5%
Fear 9.8%
Surprised 7.8%
Happy 7.7%
Calm 6.1%
Confused 1.9%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Male
Man
Person
Bride
Female
Woman
Shorts

Clarifai

Clothing
Man
Tree
Human face
Footwear
Woman

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 98.3%

AWS Rekognition

Adult 96.8%

AWS Rekognition

Male 98.5%

AWS Rekognition

Male 98.3%

AWS Rekognition

Man 98.5%

AWS Rekognition

Man 98.3%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 98%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 96.2%

AWS Rekognition

Person 94.7%

AWS Rekognition

Person 93.6%

AWS Rekognition

Person 92.7%

AWS Rekognition

Person 92.5%

AWS Rekognition

Person 89.9%

AWS Rekognition

Person 89.2%

AWS Rekognition

Person 88.4%

AWS Rekognition

Person 82.5%

AWS Rekognition

Person 73.4%

AWS Rekognition

Person 71.1%

AWS Rekognition

Person 66.2%

AWS Rekognition

Bride 96.8%

AWS Rekognition

Female 96.8%

AWS Rekognition

Woman 96.8%

AWS Rekognition

Shorts 78.6%

Clarifai

Clothing 90.3%

Clarifai

Clothing 88.1%

Clarifai

Clothing 87.5%

Clarifai

Clothing 79.3%

Clarifai

Clothing 79%

Clarifai

Clothing 76.8%

Clarifai

Clothing 65.3%

Clarifai

Clothing 65.3%

Clarifai

Clothing 64.5%

Clarifai

Clothing 62.9%

Clarifai

Clothing 58.6%

Clarifai

Clothing 55.5%

Clarifai

Clothing 53.7%

Clarifai

Clothing 51.8%

Clarifai

Clothing 47.2%

Clarifai

Clothing 41.4%

Clarifai

Clothing 36.7%

Clarifai

Clothing 34.4%

Clarifai

Clothing 33.4%

Clarifai

Man 87.8%

Clarifai

Man 79.7%

Clarifai

Man 68.6%

Clarifai

Man 64.1%

Clarifai

Man 63.4%

Clarifai

Man 53.3%

Clarifai

Man 48.9%

Clarifai

Man 47.4%

Clarifai

Man 47.2%

Clarifai

Man 46.5%

Clarifai

Man 37.7%

Clarifai

Man 36.6%

Clarifai

Man 33.2%

Clarifai

Tree 81.5%

Clarifai

Tree 57.4%

Clarifai

Tree 49.7%

Clarifai

Tree 41.1%

Clarifai

Tree 39.8%

Clarifai

Tree 38.3%

Clarifai

Tree 37.4%

Clarifai

Human face 67.5%

Clarifai

Human face 59.1%

Clarifai

Human face 54.8%

Clarifai

Human face 51%

Clarifai

Human face 47%

Clarifai

Human face 46.7%

Clarifai

Human face 45.6%

Clarifai

Human face 45.2%

Clarifai

Human face 41.3%

Clarifai

Human face 41%

Clarifai

Human face 40.1%

Clarifai

Human face 37.4%

Clarifai

Footwear 53.7%

Clarifai

Footwear 45.6%

Clarifai

Footwear 39.8%

Clarifai

Footwear 38.9%

Clarifai

Footwear 35.2%

Clarifai

Footwear 34.6%

Clarifai

Woman 44.5%

Categories

Imagga
created on 2023-10-06

paintings art 37.8%
nature landscape 18.8%
streetview architecture 17.5%
people portraits 10.5%
pets animals 6.9%
interior objects 4.4%
beaches seaside 1.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-05

a photograph of a group of people standing around a fire hydrant

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of people in the woods with a fire

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts a group of people gathered outdoors in what appears to be a forested area. The individuals are dressed in traditional and casual clothing, suggesting it might be part of a cultural or communal event. Some are wearing sarongs, headgear, or woven hats typical of certain traditions. The background features tall trees and hints of smoke or mist, possibly indicating cooking or ceremonial activities taking place nearby. It is a dynamic scene with people engaged in conversation or movement.

Created by gpt-4o-2024-08-06 on 2025-06-12

This black and white image depicts a group of people gathered in a forested area. The people are dressed in traditional clothing, and some are carrying items on their heads, suggesting it might be a cultural or community event. The setting is outdoors, with trees and vegetation visible in the background, adding a natural ambiance to the scene. There is a sense of movement and interaction among the individuals, indicating they might be participating in a procession or gathering. The absence of modern elements in both attire and setting gives the image a historical feel.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to depict a group of people gathered in an outdoor, forested setting. The individuals are dressed in a mix of casual and traditional attire, suggesting this may be some kind of cultural or community event. The image is in black and white, giving it an older, historical feel. The crowd appears to be engaged in some kind of activity or gathering, though the specific nature of the event is not entirely clear from the image alone.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This appears to be a black and white historical photograph showing a group of people gathered in what looks like a forested or wooded area. The individuals are dressed in casual warm-weather clothing typical of a tropical or subtropical climate, including shorts, sleeveless shirts, and some are wearing hats. The setting appears to be outdoors with trees visible in the background. The image quality and style suggests it was taken several decades ago, possibly in the mid-20th century. The group appears to be standing together, though the purpose of their gathering is not immediately clear from the image alone.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-03

The image depicts a group of people gathered in a wooded area, likely during a festival or celebration. The individuals are dressed in casual attire, with some wearing shorts and others in traditional clothing. The scene appears to be set in a tropical or subtropical region, given the lush vegetation and warm climate.

The people in the image seem to be engaged in some sort of activity, possibly a dance or a game. They are all facing the same direction, suggesting that they are participating in a coordinated event. The atmosphere appears to be lively and festive, with the people's body language conveying a sense of joy and camaraderie.

In the background, the trees and foliage create a natural and serene setting, which contrasts with the energetic and dynamic atmosphere of the people in the foreground. Overall, the image captures a moment of communal celebration and joy, highlighting the importance of social connections and shared experiences in human culture.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-03

The image depicts a black-and-white photograph of a group of people gathered in a wooded area. The individuals are dressed in casual attire, with some wearing hats and others barefoot. The scene appears to be set in a tropical or subtropical region, given the lush foliage and warm clothing.

In the foreground, a person's head is partially visible, while the rest of the image shows the group of people standing together. The background features trees and foliage, creating a natural and serene atmosphere. The overall mood of the image is one of community and gathering, as the individuals seem to be engaged in conversation or activity together.

The image has a vintage quality to it, with a grainy texture and a sepia tone that suggests it may have been taken many years ago. Despite the age of the image, it still conveys a sense of warmth and connection among the people depicted.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-02

A black-and-white photo of a group of people standing in a forest area. They are wearing traditional clothing, and some are wearing hats. Some of them are barefoot, while others are wearing shoes. Some of them are holding a stick. In the middle, there is a person wearing a hat who seems to be walking. Behind them, there are trees and a blurry background.

Created by amazon.nova-lite-v1:0 on 2025-06-02

The image is a black-and-white photograph depicting a group of people in a forest setting. The people are engaged in what appears to be a ritual or communal activity. Some of them are walking, while others are standing and observing. The individuals are dressed in traditional clothing, with some wearing hats and others having their heads covered. The forest is dense with trees, and the atmosphere is somewhat smoky, suggesting the presence of a fire or incense. The image captures a moment of cultural or spiritual significance, with the participants appearing focused and engaged in their activity.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-06

Here's a description of the image:

Overall Impression:

The image is a black and white photograph depicting a large gathering of people outdoors, likely in a forested area. The scene appears to be from a historical context, possibly a religious or cultural event. There's a sense of solemnity and perhaps a hint of mystery given the lighting and the expressions of the individuals.

Key Features:

  • People: A diverse group of men and women are present. Some are wearing traditional attire, including head coverings and patterned clothing. Others are dressed in simpler, possibly everyday garments. Some men are shirtless. The expressions on their faces are varied, some seem focused, and some are gazing toward the same direction.
  • Environment: The background is filled with dense trees, indicating a forest setting. Smoke or mist is partially obscuring the scene, adding depth and a slight ethereal quality.
  • Activity: It's difficult to determine the specific activity. It could be a procession, a ceremony, or a gathering. The individuals are likely gathered to witness or participate in an important event.
  • Lighting and Composition: The lighting is somewhat diffused, and there are strong contrasts between light and shadow. The composition is dynamic.

Inference:

The photograph likely captures a moment of cultural or religious importance. The presence of many people in traditional clothing and the setting imply a connection to tradition, and the potential solemnity in the scene suggests significance.

Created by gemini-2.0-flash on 2025-05-06

Here is a description of the image:

The black and white photograph shows a gathering of people in what appears to be a forest or wooded area. The group is diverse in terms of clothing and accessories, suggesting a mix of social and cultural backgrounds.

In the foreground, some men are wearing shorts and are bare-chested, one of whom is wearing a woven hat. Other men are wearing shirts and shorts. Women are dressed in more traditional attire, including blouses, skirts, and head coverings. The people are standing together, but not necessarily engaged in conversation with each other. A few are looking towards the viewer, while others are looking in different directions.

In the background, the trees are densely packed, and there is a general sense of depth and dimension to the forest. There is also a flag visible near the center of the frame. The quality of the photo is consistent with older photography styles.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a group of people gathered outdoors, seemingly in a forested area. The scene appears to be part of a cultural or traditional event, possibly a ritual or ceremony. Here are some notable details:

  1. Setting: The background is lush with trees, indicating a natural, possibly sacred or significant location for the event.
  2. Participants: The people in the image are dressed in a variety of attire. Some are wearing traditional clothing, while others are in more casual or modern clothing. This suggests a mix of traditional and contemporary elements.
  3. Activities: Several individuals are engaged in what appears to be a ceremonial or ritualistic activity. Some are holding objects or performing actions that suggest a ritualistic purpose. For example, one person is holding a flag or banner, and another seems to be carrying a ceremonial item on their head.
  4. Expression and Posture: The expressions and postures of the participants vary, with some appearing focused or solemn, which is typical in ceremonial contexts.

Overall, the image captures a moment from a cultural or traditional event, highlighting the community's engagement in a significant ritual or ceremony within a natural setting.

Qwen

No captions written