Human Generated Data

Title

Untitled (cremation ceremony, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5185

Human Generated Data

Title

Untitled (cremation ceremony, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5185

Machine Generated Data

Tags

Amazon
created on 2023-10-07

Wedding 97.7
Plant 95.4
Tree 95.4
Face 88.8
Head 88.8
Crowd 83.7
Outdoors 80.2
Clothing 79.7
Hat 79.7
People 75.6
Architecture 63.2
Building 63.2
Shelter 63.2
Back 57.7
Body Part 57.7
Amusement Park 57.5
Animal 56.6
Bull 56.6
Mammal 56.6
Carousel 56.3
Play 56.3
Fun 55.1
Theme Park 55.1

Clarifai
created on 2018-05-10

people 100
group 99
many 98.2
adult 97.1
child 96.8
group together 96.2
man 96.1
home 95
administration 88.6
war 86.6
wear 86
military 85.9
woman 85.2
crowd 80.8
soldier 80.5
tent 80.2
street 79.6
leader 77.7
recreation 77.5
boy 77

Imagga
created on 2023-10-07

parasol 34.7
umbrella 28.5
people 19.5
person 18.2
religion 17
seller 17
adult 16.9
man 15.4
outdoors 15.3
religious 14
temple 13.5
travel 12
canopy 11.3
outside 11.1
tradition 11.1
portrait 11
traditional 10.8
marimba 10.7
happy 10.6
building 10.6
human 10.5
old 10.4
shelter 10.4
percussion instrument 10.4
architecture 10.1
clothing 10.1
outdoor 9.9
women 9.5
color 9.4
men 9.4
lifestyle 9.4
water 9.3
business 9.1
couple 8.7
standing 8.7
love 8.7
faith 8.6
god 8.6
holiday 8.6
statue 8.5
culture 8.5
male 8.5
attractive 8.4
fountain 8.1
smiling 7.9
musical instrument 7.9
smile 7.8
happiness 7.8
world 7.8
scene 7.8
summer 7.7
structure 7.6
park 7.4
vacation 7.4
dress 7.2
protective covering 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

tree 97.7
outdoor 95.6
person 94.2
people 88.9
old 86
group 69.8
crowd 42.1

Color Analysis

Face analysis

Amazon

Microsoft

Imagga

AWS Rekognition

Age 20-28
Gender Male, 97.7%
Sad 100%
Calm 16.7%
Surprised 6.3%
Fear 6%
Confused 0.7%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Female, 89.9%
Happy 32.2%
Disgusted 19.7%
Calm 19.4%
Sad 11.8%
Confused 11.4%
Surprised 6.6%
Fear 6.4%
Angry 2.5%

AWS Rekognition

Age 18-26
Gender Male, 99.5%
Calm 92.7%
Surprised 6.9%
Fear 6%
Sad 3%
Confused 1.7%
Disgusted 1.5%
Angry 0.2%
Happy 0.1%

AWS Rekognition

Age 21-29
Gender Male, 60.5%
Calm 86.7%
Surprised 6.8%
Happy 6.1%
Fear 6.1%
Sad 2.6%
Confused 1.6%
Angry 1.4%
Disgusted 1%

AWS Rekognition

Age 16-22
Gender Female, 54.8%
Angry 80.7%
Surprised 18.1%
Fear 6%
Sad 2.6%
Disgusted 1.8%
Calm 1.3%
Confused 0.4%
Happy 0.3%

AWS Rekognition

Age 22-30
Gender Female, 86.5%
Calm 72.4%
Sad 39.8%
Surprised 6.4%
Fear 6.1%
Happy 1.3%
Disgusted 0.8%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Male, 92.8%
Calm 76%
Fear 7.8%
Surprised 7.2%
Sad 5.8%
Angry 5.5%
Happy 2%
Confused 1.8%
Disgusted 1.2%

AWS Rekognition

Age 16-24
Gender Female, 63.9%
Sad 99.6%
Confused 23.2%
Calm 8.8%
Surprised 6.4%
Fear 6%
Angry 0.8%
Disgusted 0.4%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Female, 72.2%
Fear 89.9%
Disgusted 12.5%
Calm 11.2%
Surprised 6.5%
Sad 2.4%
Happy 0.9%
Angry 0.3%
Confused 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Calm 96.3%
Surprised 6.5%
Fear 5.9%
Sad 3.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 11-19
Gender Male, 76%
Calm 58.4%
Sad 13.2%
Angry 9.6%
Fear 7.3%
Surprised 7.3%
Disgusted 5.8%
Confused 4.2%
Happy 2.8%

AWS Rekognition

Age 30-40
Gender Male, 93.6%
Happy 76.5%
Surprised 14.6%
Calm 9.1%
Fear 6.1%
Sad 2.4%
Disgusted 0.8%
Confused 0.6%
Angry 0.6%

AWS Rekognition

Age 18-24
Gender Male, 97.2%
Sad 41.3%
Calm 37.4%
Happy 21.6%
Fear 9.3%
Surprised 7.4%
Confused 2.7%
Disgusted 2.4%
Angry 2.3%

AWS Rekognition

Age 13-21
Gender Female, 70.1%
Sad 85.4%
Calm 43.1%
Fear 10%
Surprised 6.6%
Happy 4.6%
Disgusted 1.4%
Angry 1.2%
Confused 1.1%

AWS Rekognition

Age 20-28
Gender Female, 53.4%
Calm 81.8%
Surprised 7%
Fear 7%
Angry 4.2%
Sad 3.7%
Disgusted 3.2%
Happy 1.9%
Confused 0.8%

AWS Rekognition

Age 13-21
Gender Female, 61.7%
Calm 77.5%
Sad 7.4%
Surprised 7.3%
Fear 6.3%
Happy 5%
Angry 3.3%
Disgusted 1.1%
Confused 1.1%

AWS Rekognition

Age 18-24
Gender Female, 59.3%
Calm 59.7%
Angry 16.6%
Fear 8.8%
Surprised 8%
Confused 6%
Sad 3.7%
Happy 3.1%
Disgusted 1.3%

AWS Rekognition

Age 19-27
Gender Female, 71.4%
Fear 90%
Calm 11.4%
Surprised 7.4%
Disgusted 6%
Sad 2.6%
Happy 2.3%
Angry 1.6%
Confused 1.1%

AWS Rekognition

Age 11-19
Gender Male, 97.8%
Surprised 57.5%
Calm 35.6%
Sad 11.9%
Fear 7.8%
Angry 5.5%
Confused 2.8%
Happy 2.5%
Disgusted 1.5%

AWS Rekognition

Age 27-37
Gender Male, 92.8%
Calm 82.2%
Sad 8.9%
Surprised 7.9%
Fear 5.9%
Disgusted 1.8%
Angry 1.4%
Confused 0.9%
Happy 0.3%

AWS Rekognition

Age 7-17
Gender Male, 95.3%
Calm 89.2%
Disgusted 7.2%
Surprised 6.4%
Fear 6%
Sad 2.7%
Angry 1%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 18-26
Gender Male, 95.6%
Calm 92.7%
Surprised 6.9%
Fear 5.9%
Sad 3%
Happy 1.1%
Disgusted 0.9%
Angry 0.8%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Female, 74%
Angry 28.2%
Happy 22.8%
Fear 15.9%
Calm 15.5%
Surprised 13.9%
Sad 3.6%
Disgusted 1.7%
Confused 1.4%

Microsoft Cognitive Services

Age 34
Gender Female

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Male
Man

Clarifai

Tree
Clothing
Man
Human face
Human hair
Human head

AWS Rekognition

Adult 97.7%

AWS Rekognition

Adult 97%

AWS Rekognition

Adult 96.4%

AWS Rekognition

Adult 96.3%

AWS Rekognition

Adult 95.2%

AWS Rekognition

Bride 97.7%

AWS Rekognition

Bride 96.3%

AWS Rekognition

Bride 95.2%

AWS Rekognition

Female 97.7%

AWS Rekognition

Female 96.3%

AWS Rekognition

Female 95.2%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 96.3%

AWS Rekognition

Person 96.1%

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 95.4%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 94.3%

AWS Rekognition

Person 93.6%

AWS Rekognition

Person 92.4%

AWS Rekognition

Person 91.9%

AWS Rekognition

Person 91.3%

AWS Rekognition

Person 90.2%

AWS Rekognition

Person 89.6%

AWS Rekognition

Person 84.1%

AWS Rekognition

Person 83.7%

AWS Rekognition

Person 83.2%

AWS Rekognition

Person 80.5%

AWS Rekognition

Person 80.3%

AWS Rekognition

Person 69.4%

AWS Rekognition

Person 69%

AWS Rekognition

Person 68%

AWS Rekognition

Person 61.4%

AWS Rekognition

Person 60.6%

AWS Rekognition

Person 60.3%

AWS Rekognition

Person 55.2%

AWS Rekognition

Woman 97.7%

AWS Rekognition

Woman 96.3%

AWS Rekognition

Woman 95.2%

AWS Rekognition

Male 97%

AWS Rekognition

Male 96.4%

AWS Rekognition

Man 97%

AWS Rekognition

Man 96.4%

Clarifai

Tree 88.9%

Clarifai

Tree 55%

Clarifai

Tree 54%

Clarifai

Tree 44.6%

Clarifai

Tree 40.8%

Clarifai

Tree 36.8%

Clarifai

Tree 34.2%

Clarifai

Clothing 86.4%

Clarifai

Clothing 81.7%

Clarifai

Clothing 80.4%

Clarifai

Clothing 78.1%

Clarifai

Clothing 74.4%

Clarifai

Clothing 73.7%

Clarifai

Clothing 71.2%

Clarifai

Clothing 69.4%

Clarifai

Clothing 64.8%

Clarifai

Clothing 64.1%

Clarifai

Clothing 57.9%

Clarifai

Clothing 57.3%

Clarifai

Clothing 56.5%

Clarifai

Clothing 55%

Clarifai

Clothing 52.9%

Clarifai

Clothing 40.8%

Clarifai

Clothing 40%

Clarifai

Clothing 37.1%

Clarifai

Clothing 37%

Clarifai

Clothing 34.5%

Clarifai

Man 82.4%

Clarifai

Man 72.2%

Clarifai

Man 70.8%

Clarifai

Man 66.2%

Clarifai

Man 62.6%

Clarifai

Man 56.6%

Clarifai

Man 55.2%

Clarifai

Man 52.7%

Clarifai

Man 48.7%

Clarifai

Man 47%

Clarifai

Man 46.2%

Clarifai

Man 44.2%

Clarifai

Man 41.5%

Clarifai

Man 40%

Clarifai

Man 39.7%

Clarifai

Man 37.9%

Clarifai

Man 36.5%

Clarifai

Human face 78.5%

Clarifai

Human face 76.3%

Clarifai

Human face 76.2%

Clarifai

Human face 70.5%

Clarifai

Human face 64.7%

Clarifai

Human face 64.6%

Clarifai

Human face 64.1%

Clarifai

Human face 63.6%

Clarifai

Human face 60.4%

Clarifai

Human face 57%

Clarifai

Human face 53.1%

Clarifai

Human face 46.4%

Clarifai

Human face 46%

Clarifai

Human face 44.9%

Clarifai

Human face 43.9%

Clarifai

Human face 38.8%

Clarifai

Human face 36.4%

Clarifai

Human face 33.3%

Clarifai

Human hair 40%

Clarifai

Human hair 37.5%

Clarifai

Human hair 35.7%

Clarifai

Human hair 34.4%

Clarifai

Human hair 33.7%

Clarifai

Human head 38.2%

Categories

Imagga
created on 2023-10-07

paintings art 66.3%
pets animals 10.9%
nature landscape 10.2%
interior objects 9.9%
streetview architecture 1.2%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing around a carousel

Created by general-english-image-caption-blip-2 on 2025-07-05

a crowd of people gathered around a small shrine

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-13

The image depicts a gathering of people outdoors, surrounded by large trees, suggesting a forested or natural environment. A wooden structure with a tiered, decorative roof stands as the central focus, resembling a ceremonial or religious pavilion. People are crowded around the structure, some wearing hats and casual clothing, indicating a community event or social gathering. The atmosphere appears busy, and the setting has a rustic or traditional feel.

Created by gpt-4o-2024-08-06 on 2025-06-13

The image depicts a gathering of people outdoors, likely in a tropical or subtropical area, as indicated by the dense foliage of tall trees in the background. The crowd appears to be assembled around a structure, which looks like a small pavilion or a stage, elevated off the ground. Several individuals are standing on this platform, and it is adorned with some decorations. The people in the crowd are wearing light clothing, some with hats or caps for protection from the sun. The atmosphere suggests a communal event or gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows a large crowd gathered in an outdoor setting, likely some kind of public event or gathering. There appears to be a raised platform or gazebo-like structure in the center, surrounded by a dense crowd of people. The people in the image seem to be from a variety of backgrounds, with some wearing hats and other casual attire. The overall scene conveys a sense of a lively, communal event taking place in a wooded or natural setting.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-19

The black and white image shows a large crowd of people gathered in a wooded area, with many tall trees visible in the background. In the center of the crowd is an ornate canopy or tent structure that appears to be the focal point of the gathering. The people are dressed in light-colored clothing typical of a warm weather outdoor event. Based on the number of attendees and the festive canopy, this seems to be a significant celebration or ceremony taking place in a forest clearing or park-like setting. The grainy, aged quality of the photograph suggests it depicts a historical scene from many decades ago.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white historical photograph showing a large crowd gathered around what appears to be a decorative pavilion or platform with a pagoda-style roof. The structure has an Asian architectural influence and is elevated above the crowd. Several people can be seen standing on the platform itself, while a dense crowd of people wearing various hats and light-colored clothing surrounds it at ground level. The setting appears to be outdoors with trees visible in the background. The image has the grainy quality typical of early to mid-20th century photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image is a black-and-white photograph of a crowd of people gathered around a structure in the woods. The structure, which appears to be a gazebo or pavilion, has a pointed roof and is decorated with flags and other items. The crowd is made up of men, women, and children, all dressed in casual clothing such as t-shirts, shorts, and hats. They are standing in front of the structure, some of them looking at it, while others are talking to each other or walking around.

In the background, there are trees and other foliage, suggesting that the scene is taking place in a wooded area. The overall atmosphere of the image is one of celebration or gathering, as the crowd seems to be enjoying themselves and taking part in some kind of event or ceremony.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of a crowd gathered around a structure, possibly a temple or shrine. The structure is adorned with a pointed roof and features a large crowd of people surrounding it. The individuals in the crowd are dressed in casual attire, including hats and shirts, and appear to be engaged in some sort of activity or ceremony.

In the background, trees and foliage are visible, suggesting that the scene is set in a natural or outdoor environment. The overall atmosphere of the image is one of community and celebration, with the crowd gathered around the structure in a sense of reverence or admiration.

The image appears to be an old photograph, likely taken in the early 20th century, given the style of clothing and the quality of the image. It is possible that the image was taken during a cultural or religious event, such as a festival or ceremony, and serves as a historical record of the time and place in which it was taken.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The black-and-white image shows a large crowd of people gathered in a forest. They are probably attending a festival or cultural event. The crowd is diverse, with people of different ages and backgrounds. In the center of the crowd, there is a small stage with a roof. There are people standing on the stage, and it appears that they are performing or giving a speech. The stage is surrounded by trees, and the crowd is standing in front of it.

Created by amazon.nova-pro-v1:0 on 2025-06-10

The image is a black and white photo of a crowd of people gathered in a forest. The people are gathered around a small elevated stage, with a white roof and a white curtain. The people on the stage are wearing white shirts and shorts. Some of them are standing, while others are sitting on the stage. The people in the crowd are wearing hats and some are wearing sleeveless shirts. The crowd is gathered around the stage, with some people standing and others sitting on the ground.

Google Gemini

Created by gemini-2.0-flash on 2025-06-04

Here is a description of the image:

The image shows a large crowd of people gathered around a raised structure with a pointed roof, possibly a pavilion or shrine. The crowd consists of people of various ages, many wearing hats or head coverings. The structure is surrounded by dense vegetation, including tall trees and hanging vines, suggesting a tropical or jungle environment. The photo appears to be a vintage black and white print, with some wear and tear evident in the image quality.

Created by gemini-2.0-flash-lite on 2025-06-04

Certainly! Here's a description of the image:

Overall Impression:

The image is a black and white photograph capturing a large gathering of people outdoors. It appears to be taken during an event or ceremony.

Key Elements:

  • The crowd: A large crowd of men, women, and children are present. Many people are wearing hats, which suggests a sunny day or a cultural practice.
  • The structure: There's a small, ornate structure in the center of the image, elevated slightly above the crowd. It looks like a pavilion or temple, with a peaked roof.
  • The Setting: The scene is set in a lush, natural environment, with tall trees and greenery in the background. This gives the impression of a tropical or forested area.

Possible Interpretation:

Based on the elements, it appears the image captures a religious or cultural event or a festival. The presence of the structure and the gathering of people suggest a ceremonial purpose.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a large gathering of people in what appears to be a forested area. The crowd is densely packed, with many individuals wearing traditional clothing and headgear, suggesting a cultural or ceremonial event.

At the center of the image, there is a raised platform with a conical roof, which is adorned with decorative elements. Several individuals are standing on this platform, possibly performing a ritual or addressing the crowd. The platform is elevated on poles, and some people are seen climbing or standing on ladders to reach it.

The background is filled with tall trees, indicating that the event is taking place in a natural, outdoor setting. The overall atmosphere suggests a significant communal or religious ceremony, with the crowd's attention focused on the activities happening on the platform. The black-and-white nature of the photograph hints that it might be from an earlier time period.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This black-and-white photograph depicts a gathering in a forested area. A large crowd of people is gathered, many wearing hats and casual clothing, suggesting a casual or rural setting. In the background, there is a makeshift structure with a pointed roof, possibly a shrine or stage, which is adorned with what appears to be offerings or decorations. Several individuals are standing on the structure, possibly performing or participating in an event. The trees and natural surroundings indicate that the event is taking place outdoors, likely as part of a community ritual or celebration. The overall atmosphere appears to be one of communal activity or ceremony.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph depicts a large gathering of people outdoors, possibly for a cultural or religious event. The crowd is densely packed, with many individuals wearing hats and traditional attire. In the background, there is a structure resembling a pavilion or altar, adorned with what appears to be cloth or fabric. The setting is surrounded by trees, suggesting it is taking place in a forested or wooded area. The atmosphere seems to be one of communal participation, with people facing towards the central structure.