Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5026

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5026

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Firearm 99.8
Gun 99.8
Rifle 99.8
Weapon 99.8
Person 98.5
People 97.3
Person 96.4
Person 96.3
Adult 96.3
Female 96.3
Woman 96.3
Person 95.2
Adult 95.2
Female 95.2
Woman 95.2
Bride 95.2
Wedding 95.2
Person 93.7
Person 89.2
Person 85.3
Person 84
Person 83.7
Person 82.5
Person 78.6
Person 76.9
Person 76.2
Face 76
Head 76
Person 76
Person 75.7
Person 75.4
Person 74.7
Person 73.7
Person 72.9
Animal 70.7
Horse 70.7
Mammal 70.7
Person 68
Person 62.2
Sword 61.8
Person 61.1
Clothing 60.6
Glove 60.6
Tartan 55

Clarifai
created on 2018-05-10

people 99.9
group 98.3
adult 97.2
group together 96.6
man 94.8
war 94.2
many 94.2
wear 92.7
military 89.9
woman 86.4
soldier 84.5
weapon 84.4
child 83.7
administration 81
gun 80
vehicle 79.3
street 78
veil 76.6
several 75.8
skirmish 75.7

Imagga
created on 2023-10-06

clothing 31.4
uniform 26.3
sarong 23.7
military uniform 21.9
man 21.5
person 21.5
chain saw 20.8
adult 19.4
gun 18.8
skirt 18.7
male 18.4
people 17.8
military 17.4
outdoor 16
camouflage 16
weapon 16
power saw 15.8
fashion 15.8
soldier 15.6
garment 15.4
covering 15
outdoors 14.5
consumer goods 13.9
war 13.7
portrait 12.3
child 12
power tool 11.9
hunter 11.3
culture 11.1
model 10.9
travel 10.6
pretty 10.5
summer 10.3
guy 10.3
happy 10
face 9.9
recreation 9.9
activity 9.9
attractive 9.8
army 9.7
tool 9.5
two 9.3
leisure 9.1
protection 9.1
danger 9.1
fun 9
machine 8.7
extreme 8.6
outside 8.6
tree 8.5
youth 8.5
equipment 8.5
field 8.4
old 8.4
sport 8.3
training 8.3
active 8.2
park 8.2
style 8.2
private 8.1
smiling 8
life 7.9
boy 7.8
death 7.7
mask 7.7
walk 7.6
human 7.5
religious 7.5
hat 7.5
sports 7.4
teenager 7.3
rifle 7.3
dirty 7.2
cute 7.2
holiday 7.2
history 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

person 98.5
outdoor 98
standing 77.4
posing 60.5
old 48.7

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 20-28
Gender Female, 62.3%
Sad 41.3%
Calm 23.2%
Confused 21.4%
Angry 15.4%
Surprised 7.1%
Fear 6.6%
Happy 6.5%
Disgusted 5.7%

AWS Rekognition

Age 19-27
Gender Male, 96.4%
Sad 50.8%
Surprised 33.8%
Fear 22.1%
Calm 7.7%
Confused 7.2%
Disgusted 4.7%
Angry 3.8%
Happy 3.5%

AWS Rekognition

Age 23-31
Gender Female, 92.2%
Happy 83.2%
Surprised 6.9%
Calm 6.7%
Fear 6.5%
Confused 2.9%
Angry 2.5%
Sad 2.4%
Disgusted 1.3%

AWS Rekognition

Age 12-20
Gender Male, 85.4%
Calm 87.4%
Fear 6.5%
Surprised 6.5%
Angry 4.5%
Disgusted 2.9%
Sad 2.5%
Confused 1.3%
Happy 0.7%

AWS Rekognition

Age 30-40
Gender Female, 60.6%
Calm 90%
Surprised 6.5%
Fear 6.1%
Sad 5.2%
Angry 0.9%
Happy 0.8%
Disgusted 0.7%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 74.5%
Calm 94.4%
Surprised 6.5%
Fear 5.9%
Sad 2.5%
Happy 2.5%
Disgusted 0.7%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 20-28
Gender Female, 95.1%
Sad 99.9%
Calm 15.2%
Surprised 6.6%
Fear 6.6%
Angry 1.7%
Confused 1.5%
Disgusted 0.9%
Happy 0.7%

AWS Rekognition

Age 48-54
Gender Male, 98.8%
Calm 100%
Surprised 6.3%
Fear 5.9%
Sad 2.1%
Angry 0%
Disgusted 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Female, 61.9%
Sad 38.9%
Calm 35.7%
Surprised 20.2%
Confused 12.4%
Fear 6.9%
Angry 4.7%
Disgusted 3.2%
Happy 2.4%

AWS Rekognition

Age 31-41
Gender Male, 64.5%
Calm 57%
Sad 36.8%
Fear 10.3%
Surprised 6.9%
Happy 3.6%
Angry 2.8%
Disgusted 1.7%
Confused 1.6%

AWS Rekognition

Age 23-33
Gender Male, 100%
Happy 81.9%
Angry 9.8%
Surprised 7.6%
Fear 6%
Calm 2.5%
Sad 2.4%
Confused 2%
Disgusted 0.6%

AWS Rekognition

Age 16-24
Gender Female, 97.6%
Surprised 41.5%
Confused 30.3%
Sad 13.6%
Calm 13.3%
Angry 8.5%
Fear 6.9%
Disgusted 2.9%
Happy 1.3%

AWS Rekognition

Age 24-34
Gender Male, 88.3%
Calm 90.3%
Surprised 6.3%
Fear 6%
Sad 4.2%
Confused 2%
Disgusted 1.1%
Happy 0.6%
Angry 0.6%

AWS Rekognition

Age 18-26
Gender Male, 51.2%
Calm 89%
Surprised 6.8%
Fear 6.1%
Angry 3.5%
Sad 3%
Happy 1.4%
Confused 1.3%
Disgusted 0.9%

AWS Rekognition

Age 20-28
Gender Male, 99.3%
Calm 85%
Sad 7.7%
Surprised 6.5%
Fear 6%
Happy 2.3%
Confused 1.3%
Disgusted 0.9%
Angry 0.4%

AWS Rekognition

Age 18-24
Gender Male, 75.5%
Sad 99.7%
Surprised 12.3%
Confused 11.7%
Fear 6.7%
Calm 5.9%
Angry 3%
Disgusted 1.3%
Happy 0.9%

AWS Rekognition

Age 21-29
Gender Female, 54.8%
Sad 37.8%
Calm 23.8%
Happy 21.8%
Surprised 12.6%
Angry 12%
Fear 6.9%
Disgusted 4.5%
Confused 3.2%

AWS Rekognition

Age 27-37
Gender Male, 98.3%
Sad 99.8%
Happy 14.3%
Calm 8.5%
Surprised 7.8%
Fear 6.1%
Angry 1.4%
Disgusted 1.2%
Confused 0.9%

AWS Rekognition

Age 14-22
Gender Male, 99.4%
Calm 91.2%
Surprised 8.9%
Fear 6%
Sad 2.6%
Angry 1.8%
Disgusted 0.4%
Confused 0.3%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 94.5%
Sad 99.6%
Disgusted 10%
Angry 8.3%
Surprised 7.6%
Calm 6.7%
Fear 6.3%
Confused 5%
Happy 1%

AWS Rekognition

Age 23-31
Gender Male, 98.3%
Calm 98.9%
Surprised 6.3%
Fear 5.9%
Sad 2.4%
Angry 0.1%
Disgusted 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 22-30
Gender Female, 85.3%
Calm 74.9%
Sad 24.1%
Surprised 6.5%
Fear 6.2%
Angry 2.3%
Disgusted 1%
Confused 0.9%
Happy 0.7%

AWS Rekognition

Age 23-31
Gender Male, 77.6%
Sad 99.6%
Happy 15.4%
Fear 6.8%
Surprised 6.6%
Confused 6.2%
Calm 5.2%
Disgusted 3.4%
Angry 1.2%

AWS Rekognition

Age 30-40
Gender Female, 50.9%
Calm 98.4%
Surprised 6.6%
Fear 5.9%
Sad 2.2%
Happy 0.6%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Female, 96%
Calm 72.8%
Confused 16.9%
Surprised 8.2%
Fear 6%
Sad 3.2%
Disgusted 2.4%
Angry 0.9%
Happy 0.4%

AWS Rekognition

Age 23-33
Gender Male, 98.7%
Calm 95.7%
Surprised 6.3%
Fear 5.9%
Sad 3.1%
Confused 0.9%
Happy 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 24-34
Gender Male, 93.8%
Fear 96.4%
Surprised 6.5%
Sad 4.4%
Calm 1%
Confused 1%
Angry 0.8%
Disgusted 0.8%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Female
Woman
Bride
Horse
Glove
Person 98.5%
Person 96.4%
Person 96.3%
Person 95.2%
Person 93.7%
Person 89.2%
Person 85.3%
Person 84%
Person 83.7%
Person 82.5%
Person 78.6%
Person 76.9%
Person 76.2%
Person 76%
Person 75.7%
Person 75.4%
Person 74.7%
Person 73.7%
Person 72.9%
Person 68%
Person 62.2%
Person 61.1%
Adult 96.3%
Adult 95.2%
Female 96.3%
Female 95.2%
Woman 96.3%
Woman 95.2%
Bride 95.2%
Horse 70.7%
Glove 60.6%

Categories

Imagga

paintings art 51.1%
nature landscape 32.6%
pets animals 15.6%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a man in a plaidered shirt is holding a sword -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image depicts a group of men participating in a traditional cultural ceremony or performance. They are dressed in traditional attire, including checkered sarongs, woven scarves, and head coverings. Some of them are holding long wooden sticks or spears, possibly as part of a choreographed dance or ritual. The setting appears to be outdoors with spectators standing in the background, observing the activity. The ground is earthy, suggestive of a rural or communal area. The overall atmosphere reflects cultural expression and communal participation.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image appears to show a traditional dance or ritual taking place outdoors. Several people are involved, dressed in ornate clothing that includes sarongs and headgear. They seem to be performing with long sticks or staves, which could be part of a ceremonial dance or martial arts display. The people are positioned in a circular or organized formation, and their clothing is detailed, featuring checkered patterns and draped scarves. In the background, there is a group of onlookers observing the performance, some wearing hats, indicating that the event is a public or communal gathering. The scene conveys a sense of cultural tradition and community involvement.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to depict a traditional cultural celebration or festival. It shows a large crowd of people, many wearing colorful, patterned clothing and headdresses. In the foreground, several individuals are engaged in what looks like a ceremonial dance or performance, with their arms and bodies moving in expressive, rhythmic motions. The overall scene conveys a sense of vibrant cultural activity and community gathering.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a historical black and white photograph showing a traditional cultural performance or ceremony. The people in the image are wearing traditional Indonesian or Malay clothing, including sarongs with plaid and batik patterns, and head coverings. The photograph captures what seems to be a dance or martial arts performance, with performers in motion while a crowd watches in the background. The setting appears to be outdoors on bare ground, and the image quality and style suggests it was taken several decades ago. This could be documenting a traditional pencak silat (Indonesian martial arts) demonstration or a cultural festival from the region.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image depicts a black-and-white photograph of a group of people in traditional attire, likely from an indigenous culture, gathered in a clearing. The individuals are dressed in long-sleeved shirts and sarongs, with some wearing head coverings. They are holding long sticks or spears, which appear to be part of a traditional dance or ritual.

In the background, a crowd of onlookers is visible, observing the scene. The ground is covered in mud and leaves, suggesting that the event is taking place outdoors. The overall atmosphere of the image conveys a sense of community and cultural heritage, with the participants engaged in a traditional practice that is being shared with the audience.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

The image depicts a black-and-white photograph of a group of men engaged in a traditional martial art or dance, possibly from Indonesia. The men are dressed in traditional attire, including turbans and sarongs, and are holding long sticks or swords. They appear to be performing a choreographed routine, with some men standing in a line and others moving around them.

In the background, a crowd of onlookers can be seen watching the performance. The atmosphere suggests a cultural event or festival, possibly a celebration of Indonesian heritage. The image provides a glimpse into the rich cultural traditions of Indonesia and the importance of preserving these customs for future generations.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-26

A black-and-white photo depicts a group of people performing a traditional dance or ritual in an outdoor area. They are dressed in traditional clothing and holding sticks, likely engaged in a ritualistic dance. The individuals are wearing headpieces and some are wearing hats. The people in the background are watching the performance, and some are seated on the ground. The image captures a moment of cultural expression and community participation.

Created by amazon.nova-pro-v1:0 on 2025-05-26

The image is in black and white, and it seems to be a ritual performed by the people in the village. There are three people in the front, holding a stick in their hands, and they seem to be hitting each other. Behind them, a few people are standing and watching the ritual. Some of them are sitting on the ground. On the right side, a person is playing a drum.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

The image captures a moment in what appears to be a traditional ceremony or performance. The scene is captured in black and white, lending a vintage feel to the photograph.

Main Focus:

  • Performers: Several individuals are the central figures. They are dressed in what looks like traditional attire, including head wraps or turbans, long-sleeved white shirts, and plaid or patterned sarongs. They each hold long, thin poles, some of which have objects attached (like a flag or a tassel). Their posture suggests they are engaged in a ritualistic dance or procession.
  • Action and Movement: The blurry quality of some of the figures, particularly their arms and the poles they hold, indicates a sense of motion and dynamism in the scene.

Setting and Context:

  • Environment: The setting appears to be outdoors, possibly on a dusty or muddy ground. There is greenery visible, suggesting it's an open area.
  • Audience: Behind the performers, a group of people is visible, seemingly watching the event. Some are seated, indicating they are spectators. The crowd composition suggests a local community gathering.

Overall Impression:

The image gives a glimpse into a cultural event, likely showcasing a ritual or traditional performance. The expressions on the performers' faces, the costumes, and the context of the onlookers all contribute to a sense of history and community. The photograph is well-composed, capturing a lively moment in a traditional setting.

Created by gemini-2.0-flash on 2025-04-30

The monochrome image depicts a group of traditionally dressed individuals performing what appears to be a ritualistic dance or ceremony.

In the foreground, there are three central figures. They're adorned in long-sleeved shirts, patterned wraps over their shoulders, and checked sarongs or skirts. They also wear what appear to be traditional caps or head coverings. Each figure is wielding a long pole, possibly a spear or a baton, and they're in the middle of a coordinated movement or dance.

In the background, there's a crowd of onlookers. Their expressions are not clearly visible, but they seem to be observing the performance. Some individuals are standing, while others are seated or kneeling.

The setting appears to be outdoors, with a dirt ground that shows signs of being possibly wet or muddy. The overall atmosphere seems to be one of cultural significance, suggesting a traditional performance or ceremony. The photo is of vintage quality, contributing to its ethnographic or historical character.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-28

The image depicts a group of people participating in what appears to be a traditional martial arts performance or demonstration. The participants are wearing traditional attire, which includes checkered sarongs and head coverings. They are holding long sticks or staves, which they are using in a coordinated manner, suggesting that they are performing a choreographed routine.

The setting appears to be outdoors, possibly in a rural or village environment, as indicated by the natural ground and the presence of spectators in the background. The spectators are watching the performance, some standing and others seated. The overall atmosphere seems to be one of cultural celebration or community gathering.

The photograph is in black and white, which, along with the style of clothing and the setting, suggests that it might be from an earlier time period. The image captures a moment of cultural heritage and community engagement.