Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4520.1

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4520.1

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Adult 98.3
Bride 98.3
Female 98.3
Person 98.3
Wedding 98.3
Woman 98.3
Adult 97.8
Bride 97.8
Female 97.8
Person 97.8
Woman 97.8
Adult 97.1
Person 97.1
Male 97.1
Man 97.1
Person 96
Face 95.2
Head 95.2
Adult 94.5
Person 94.5
Male 94.5
Man 94.5
Person 93.6
Person 92.2
Adult 91.1
Bride 91.1
Female 91.1
Person 91.1
Woman 91.1
Crowd 89.6
Person 82.5
Photography 82.1
Portrait 82.1
Person 81.1
Person 78.4
Person 76.1
Person 73.6
Clothing 69
Hat 69
Person 60.3
People 57.6
Baseball Cap 57.2
Cap 57.2
Person 56.8
Festival 56.6
Carnival 56.6
Parade 56.2
Protest 56.2
Accessories 55.8
Sunglasses 55.8
Performer 55.7
Costume 55.5

Clarifai
created on 2018-05-10

people 99.7
group 98
adult 96.6
monochrome 96.5
man 95.8
wear 94.6
group together 93.3
woman 92
administration 90.2
outfit 90.1
leader 88.9
many 88.7
veil 87.8
street 86.1
music 85.2
crowd 84.2
costume 82.5
portrait 81.9
actor 80.4
war 80

Imagga
created on 2023-10-06

mask 92.5
covering 50.3
disguise 48.9
attire 30.6
face 29.1
portrait 28.5
person 26.3
clothing 23.3
carnival 22.4
ski mask 21.2
adult 20.1
negative 20
attractive 19.6
lady 19.5
costume 18.7
sexy 18.5
fashion 18.1
film 17.7
people 17.3
face mask 17
black 16.9
man 16.8
model 14.8
mystery 14.4
masquerade 13.8
fantasy 13.5
hair 13.5
body 12.8
male 12.8
fun 12.7
photographic paper 12.2
studio 12.2
dress 11.7
festival 11.5
goggles 11.4
pretty 11.2
party 11.2
celebration 11.2
style 11.1
glasses 11.1
hat 11
sensual 10.9
art 10.7
smile 10.7
mysterious 10.7
look 10.5
human 10.5
hairstyle 10.5
looking 10.4
eyes 10.3
protective covering 10.2
make 10
stylish 9.9
decoration 9.9
venetian 9.8
consumer goods 9.8
retro 9.8
sunglasses 9.8
one 9.7
happy 9.4
head 9.2
elegance 9.2
world 9.2
makeup 9.2
traditional 9.1
posing 8.9
horror 8.7
expression 8.5
photographic equipment 8.1
cheerful 8.1
lovely 8
women 7.9
colorful 7.9
brunette 7.8
evil 7.8
vogue 7.7
scary 7.7
luxury 7.7
youth 7.7
erotic 7.6
entertainment 7.4
security 7.3
funny 7.3
danger 7.3
color 7.2
romantic 7.1
cool 7.1
happiness 7.1

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

text 96.9

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 71.8%
Happy 14.8%
Confused 7.6%
Surprised 7.3%
Fear 6%
Sad 2.6%
Disgusted 1.5%
Angry 0.7%

AWS Rekognition

Age 27-37
Gender Male, 98.2%
Fear 73%
Calm 24.1%
Surprised 18.7%
Sad 2.8%
Confused 1.3%
Happy 1.2%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 18-24
Gender Female, 86.3%
Calm 76.4%
Happy 16%
Surprised 7%
Fear 6.1%
Sad 2.6%
Confused 2.3%
Disgusted 1.1%
Angry 0.8%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Calm 72.4%
Surprised 9.5%
Fear 6.6%
Happy 5.5%
Disgusted 5.3%
Angry 4.4%
Sad 3.2%
Confused 2.3%

AWS Rekognition

Age 31-41
Gender Male, 99.3%
Calm 98.6%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Happy 0.5%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 13-21
Gender Female, 85.1%
Angry 92.7%
Surprised 6.3%
Fear 6.1%
Sad 3.1%
Calm 2.1%
Happy 0.7%
Disgusted 0.5%
Confused 0.3%

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Male
Man
Adult 98.3%
Adult 97.8%
Adult 97.1%
Adult 94.5%
Adult 91.1%
Bride 98.3%
Bride 97.8%
Bride 91.1%
Female 98.3%
Female 97.8%
Female 91.1%
Person 98.3%
Person 97.8%
Person 97.1%
Person 96%
Person 94.5%
Person 93.6%
Person 92.2%
Person 91.1%
Person 82.5%
Person 81.1%
Person 78.4%
Person 76.1%
Person 73.6%
Person 60.3%
Person 56.8%
Woman 98.3%
Woman 97.8%
Woman 91.1%
Male 97.1%
Male 94.5%
Man 97.1%
Man 94.5%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people dressed in costumes and masks -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-07

The image is in black-and-white negative format, depicting a cultural or traditional gathering. Several individuals are dressed in intricate costumes, featuring patterned fabrics, headpieces, and accessories suggestive of ceremonial or festive attire. The scene appears to be outdoors, with people grouped together, surrounded by trees and possibly a structure in the background. The overall atmosphere conveys a communal event or celebration.

Created by gpt-4o-2024-08-06 on 2025-06-07

The image is a photo negative showing a group of people dressed in traditional attire. They appear to be participating in a cultural or ceremonial event. The clothing features intricate patterns and what seems to be headgear adorned with feathers or other decorations. The background shows a natural setting with trees and possibly a structure in the upper right corner. The people are gathered closely together, suggesting it might be a group photo or part of a public gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to depict a crowd of people wearing elaborate, colorful costumes and masks. In the foreground, there are several figures wearing large, exaggerated masks with distinct facial features. The masks seem to have a tribal or ceremonial aesthetic. Behind them, there is a larger crowd of people in various costumes, creating a lively, festive atmosphere. The image has a black and white, vintage aesthetic, suggesting it may be from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white photograph showing what appears to be a cultural or carnival celebration. The most striking element is a figure wearing a distinctive black mask with painted white eyes and facial features. The mask has a stark, dramatic appearance characteristic of traditional festival or ceremonial masks. The wearer is dressed in what looks like traditional or ceremonial attire including a patterned vest. There are other masked or costumed figures visible in the frame, and a crowd can be seen in the background. The image appears to be a historical photograph, likely documenting a cultural celebration or traditional festival. The credit line indicates this image is from the Harvard University Art Museums collection.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image depicts a black-and-white photograph of a group of people in traditional attire, with one individual wearing a mask. The scene appears to be set in an outdoor environment, possibly during a cultural event or celebration.

In the foreground, a person is prominently featured wearing a mask that covers their face. The mask has a distinctive design, with a dark color and white accents around the eyes and mouth. The individual is dressed in a traditional outfit, which includes a long-sleeved shirt and a headscarf.

Behind the masked person, there are several other individuals visible in the background. They are also dressed in traditional clothing, with some wearing hats or headpieces. The overall atmosphere of the image suggests a sense of community and cultural heritage.

The image is accompanied by a copyright notice at the bottom, which reads "© President and Fellows of Harvard College (Harvard University Art Museums)". This indicates that the photograph is part of a collection held by the Harvard University Art Museums.

Overall, the image provides a glimpse into a cultural event or celebration, highlighting the importance of traditional attire and masks in certain communities.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a group of people dressed in costumes, likely taken at a carnival or masquerade ball. The photo was taken by the President and Fellows of Harvard College (Harvard University Art Museums) in 1970.

  • A woman in the foreground wears a dark-colored dress with a patterned shawl draped over her shoulders. She has a large, ornate mask covering her face, which features a painted design and a veil that hangs down to her chin.
  • To her right stands a man wearing a dark-colored suit and a top hat, his face obscured by a large, elaborate mask.
  • In the background, several other people are visible, all dressed in various costumes and masks. Some of them appear to be dancing or moving around, while others seem to be watching the scene unfold.
  • The overall atmosphere of the image is one of joy and revelry, with the bright colors and lively poses of the costumed individuals creating a sense of energy and excitement.

The image captures a moment of festive celebration, with the elaborate costumes and masks adding to the sense of drama and spectacle.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-24

This is a black-and-white photograph of a group of people in traditional clothing. They are standing in a row, facing the same direction. The people in the front row are wearing masks and hats. The people in the back row are wearing hats and scarves. The masks are painted in black and white. The people in the back row are blurry, and the people in the front row are in focus. The image has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" in the bottom right corner.

Created by amazon.nova-pro-v1:0 on 2025-05-24

A black-and-white photo shows a group of people standing together, possibly at a festival. The people are wearing traditional clothing and hats, and some of them have masks on their faces. The masks have different designs, such as the one in the middle, which has a black face with white eyes and a nose. The photo has a watermark with the text "President and Fellows of Harvard College (Harvard University Art Museums)" at the bottom.

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

The image is a black and white negative photograph, showing a group of people, many of whom are wearing traditional costumes and masks. The composition is a medium shot, focusing on the crowd in the foreground. The subjects appear to be posing or participating in a cultural event or performance.

Several individuals are prominently featured:

  1. Masked Figure: In the center of the frame, there is a person wearing a dark mask with large, distinct white eye holes. The mask has a somewhat human-like face, and the person is dressed in a patterned top and a head covering or veil.

  2. Costumed Person: To the left of the masked figure, another person wears an elaborate costume with a large, crescent-shaped headpiece. The costume includes detailed patterns and possibly feathers or other decorative elements.

  3. Person in Uniform: In the background, slightly to the left, there is a person wearing a uniform-like outfit with a hat. The uniform appears to be military or ceremonial in nature.

  4. People in Hats: Another person in a hat and elaborate garb stands to the left of the frame.

The rest of the crowd consists of faces, many of whom are partially obscured or blurred, giving a sense of depth and movement to the photograph.

The overall impression of the image is one of cultural significance, capturing a moment during a traditional event or performance. The masks and costumes add an element of mystery and ritualistic importance.

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

The image is a black and white negative of a group of people, likely taken outdoors. The central focus is on a person wearing a dark mask with large, stylized eyes and a solemn expression. The mask is framed by a headdress or hood, and the person is dressed in a dark shirt and a patterned scarf.

Several other people are visible in the background, many of whom appear to be wearing hats or head coverings. They are arranged in a close group. Some are looking towards the camera.

The negative aspect of the photograph, where light areas appear dark and dark areas appear light, creates an ethereal and almost otherworldly atmosphere. The faces of the people have an eerie glow. The composition and the masked figure suggest a ritual, performance, or cultural event.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image depicts a group of people participating in a festive parade or celebration, likely a cultural or traditional event. The individuals are dressed in elaborate costumes and masks, which are intricately designed and appear to be handcrafted.

Here are some notable details:

  • The person in the center is wearing a striking mask with large, exaggerated features and a head covering. Their outfit includes a patterned garment and a veil.
  • To the left, another participant is wearing a mask with a large, circular eye and an ornate, feathered headdress.
  • The background shows a crowd of onlookers, some of whom are also dressed in costumes, indicating a lively and communal atmosphere.
  • The overall scene suggests a rich cultural heritage, possibly related to a festival, carnival, or traditional ceremony.

The costumes and masks are likely significant to the event, representing cultural symbols or characters important to the celebration. The image captures a moment of cultural expression and community engagement.

Text analysis

Amazon

and
College
Art
(Harvard
Fellows
Museums)
of
© President and Fellows of Harvard College (Harvard University Art Museums)
President
Harvard
University
P1970.4520.0001
©

Google

O President and Fellows of Harvard College (Harvard University Art Museums) P1970.4520.0001
O
President
and
Fellows
of
Harvard
College
(Harvard
University
Art
Museums)
P1970.4520.0001