Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4544.6

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4544.6

Machine Generated Data

Tags

Amazon
created on 2023-10-05

People 85.6
Outdoors 81.6
Tartan 70.1
Nature 65.3
Head 61.6
Clothing 56.7
Skirt 56.7
Fashion 56.1
Night 55.9
Shorts 55.1

Clarifai
created on 2018-05-10

people 99.6
adult 96.6
war 96.4
wear 95.5
man 94.8
group 94.4
military 94.3
group together 93.4
woman 89.5
soldier 88
monochrome 87.4
vintage 85.3
weapon 83.4
retro 82.6
many 82.5
mammal 82.2
uniform 82.1
skirmish 80.8
old 80.1
transportation system 79.1

Imagga
created on 2023-10-05

tunnel 24.4
dark 23.4
old 19.5
light 19.4
cell 17.8
man 16.1
passageway 15.1
industrial 14.5
dirty 14.5
wall 14
stretcher 13.4
night 13.3
canvas tent 13.2
stone 12.9
person 11.8
passage 11.5
construction 11.1
architecture 10.9
litter 10.9
mine 10.7
adult 10.3
people 10
danger 10
cadaver 9.9
building 9.7
cave 9.4
grunge 9.4
water 9.3
silhouette 9.1
conveyance 9
mask 8.9
autumn 8.8
horror 8.7
way 8.7
industry 8.5
tree 8.5
smoke 8.4
city 8.3
sky 8.3
safety 8.3
protection 8.2
landscape 8.2
factory 7.8
destruction 7.8
spooky 7.8
scene 7.8
fear 7.7
mystery 7.7
power 7.6
house 7.5
work 7.4
inside 7.4
sun 7.2
art 7.2
black 7.2
structure 7.2

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 86.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 28-38
Gender Female, 95.1%
Happy 96.1%
Surprised 6.3%
Fear 6.2%
Sad 2.5%
Angry 0.9%
Calm 0.5%
Disgusted 0.2%
Confused 0.1%

Feature analysis

Amazon

Person
Adult
Female
Woman

Clarifai

Clothing
Tree
Footwear
Human face

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 96.1%

AWS Rekognition

Person 94.6%

AWS Rekognition

Person 92.2%

AWS Rekognition

Person 91.7%

AWS Rekognition

Person 89%

AWS Rekognition

Person 85.8%

AWS Rekognition

Person 83.7%

AWS Rekognition

Person 83.3%

AWS Rekognition

Person 82.6%

AWS Rekognition

Person 79.9%

AWS Rekognition

Person 76.9%

AWS Rekognition

Person 76.9%

AWS Rekognition

Person 76.5%

AWS Rekognition

Person 76.3%

AWS Rekognition

Person 75.1%

AWS Rekognition

Person 66.1%

AWS Rekognition

Adult 96.8%

AWS Rekognition

Female 96.8%

AWS Rekognition

Woman 96.8%

Clarifai

Clothing 85.1%

Clarifai

Clothing 84.3%

Clarifai

Clothing 78.2%

Clarifai

Clothing 72.3%

Clarifai

Clothing 59.8%

Clarifai

Clothing 59%

Clarifai

Clothing 51.8%

Clarifai

Clothing 51.3%

Clarifai

Clothing 48.8%

Clarifai

Clothing 48%

Clarifai

Clothing 44.8%

Clarifai

Clothing 42.6%

Clarifai

Clothing 41.2%

Clarifai

Clothing 40.9%

Clarifai

Clothing 39.4%

Clarifai

Clothing 39.4%

Clarifai

Clothing 38.9%

Clarifai

Clothing 38.6%

Clarifai

Clothing 38.3%

Clarifai

Clothing 35.8%

Clarifai

Clothing 35.3%

Clarifai

Clothing 35.2%

Clarifai

Clothing 33.1%

Clarifai

Tree 78.3%

Clarifai

Tree 41.3%

Clarifai

Tree 40%

Clarifai

Tree 35.5%

Clarifai

Footwear 57.2%

Clarifai

Footwear 55.5%

Clarifai

Footwear 53.8%

Clarifai

Footwear 42.4%

Clarifai

Footwear 38.4%

Clarifai

Footwear 38.1%

Clarifai

Footwear 36.9%

Clarifai

Footwear 36.4%

Clarifai

Footwear 33.8%

Clarifai

Human face 44.8%

Clarifai

Human face 37.3%

Categories

Imagga
created on 2023-10-05

interior objects 80.2%
paintings art 13%
text visuals 2.3%
streetview architecture 2%
food drinks 1.3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a group of people dressed in plaidered outfits

Created by general-english-image-caption-blip-2 on 2025-07-06

a group of people in traditional clothing are standing in a field

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-06-23

The response was filtered due to the prompt triggering Azure OpenAI's content management policy. The content filter results follow.

hate: safe
self-harm: safe
sexual: safe
violence: high

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to depict a nighttime scene in a rural or outdoor setting. There is a large group of people gathered, many of whom are wearing traditional or ceremonial-looking garments with striped or patterned designs. The people seem to be engaged in some kind of ritual or ceremony, with some carrying flags or banners. The overall atmosphere is dark and mysterious, with the figures appearing almost ghostly or otherworldly against the shadowy background.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a historical black and white photograph from the Harvard University Art Museums collection. The image shows what appears to be a ritual or ceremonial gathering, with several figures wearing striped garments or robes standing in the foreground. Behind them is a larger crowd of onlookers. The scene appears to be taking place outdoors, possibly at night or in low light conditions. The figures in striped garments seem to be arranged in some sort of formation or pattern, suggesting this might be part of a ceremonial performance or ritual. The photograph has a somewhat grainy, atmospheric quality typical of early photography, and the lighting creates strong contrasts between light and shadow.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-13

The image depicts a black-and-white photograph of a group of people gathered in a field, with some individuals wearing traditional clothing and others holding long sticks or spears.

Foreground:

  • A group of people are standing in a field, facing away from the camera.
  • Some individuals are wearing traditional clothing, including long skirts or sarongs and head coverings.
  • Others are dressed in more modern attire, such as shorts and t-shirts.
  • A few people are holding long sticks or spears, which appear to be made of wood or bamboo.

Background:

  • The background of the image is blurry, but it appears to show a crowd of people standing behind the group in the foreground.
  • There are also some trees and buildings visible in the distance.

Overall:

  • The image suggests that the people in the photo are participating in some kind of cultural or traditional event.
  • The use of traditional clothing and the presence of long sticks or spears may indicate that the event is related to a specific cultural or religious tradition.
  • The image may have been taken at a festival, celebration, or other type of gathering.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-13

The image depicts a group of people gathered in a clearing, with some individuals wearing traditional clothing and others appearing to be in a state of undress. The scene is set against a backdrop of trees, suggesting that the gathering may be taking place outdoors.

Key Features:

  • A group of people are gathered in a clearing.
  • Some individuals are wearing traditional clothing, while others appear to be in a state of undress.
  • The scene is set against a backdrop of trees, suggesting that the gathering may be taking place outdoors.
  • The image is in black and white, which may suggest that it is an older photograph or a reproduction of an older image.

Possible Context:

  • The image may be depicting a cultural or religious ceremony, given the traditional clothing worn by some of the individuals.
  • The presence of trees in the background suggests that the gathering may be taking place in a natural setting, such as a forest or a clearing.
  • The fact that some individuals are in a state of undress may suggest that the gathering is a private or intimate event, rather than a public ceremony.

Conclusion:

The image depicts a group of people gathered in a clearing, with some individuals wearing traditional clothing and others appearing to be in a state of undress. The scene is set against a backdrop of trees, suggesting that the gathering may be taking place outdoors. While the exact context of the image is unclear, it may be depicting a cultural or religious ceremony, or a private gathering of some kind.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people dressed in traditional attire, possibly engaged in a ritual or performance. They are standing in a circle, holding sticks or poles, and some are wearing conical hats. The image has a blurry effect, and the people in the background are indistinct. The image is copyrighted by the President and Fellows of Harvard College (Harvard University Art Museums).

Created by amazon.nova-pro-v1:0 on 2025-06-10

The black-and-white image shows a group of people standing in a field with trees in the background. They are wearing traditional clothing, with some of them wearing hats. Some of them are holding sticks. They are probably performing a ritual or a ceremony. In the distance, there are people standing and watching the group. Some of them are wearing hats and shoes. There are also some trees in the distance.

Google Gemini

Created by gemini-2.0-flash on 2025-06-03

The image is a black and white photograph featuring a group of people in what appears to be a cultural event or performance. In the foreground, several individuals are prominently displayed. They are dressed in traditional attire, including what appear to be long skirts or wraps with a checkered pattern, and some wear dark, conical hats. Their backs are mostly to the viewer.

Behind them is a larger group of people, many of whom are standing and watching. Some individuals in this group appear to be holding long poles or spears. The setting appears to be an outdoor space with trees in the background, and possibly a building or structure visible on the right side of the frame. The overall composition suggests a scene of cultural significance or a traditional ceremony taking place.

Created by gemini-2.0-flash-lite on 2025-06-03

Here's a description of the image:

Overall Impression:

The image is a grayscale photograph depicting a gathering of people, likely in an outdoor setting. The atmosphere feels somewhat formal and possibly ceremonial. The negative effect gives it a vintage, aged look.

Key Elements:

  • Figures in Traditional Attire: The primary focus is on a group of figures wearing what appears to be traditional clothing. They are clad in long skirts/sarongs and jackets. The group seems to be interacting with tall, thin poles or staffs. They also seem to be wearing conical hats.

  • Crowd in the Background: There is a crowd of people in the background, suggesting an audience or spectators. They are less defined in the image, indicating they are not the primary focus.

  • Setting: The setting appears to be outdoors, possibly in a field or grassy area. There are trees and possibly some kind of structures visible in the distance, under what seems to be a shaded area.

  • Composition and Lighting: The composition directs the viewer's eye to the costumed figures in the foreground. The lighting is relatively flat, with the negative effect making it difficult to determine the precise light source.

Overall Tone:

The image evokes a sense of tradition, cultural significance, and perhaps a ritual or performance. The negative effect adds an air of mystery and historical depth.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a traditional cultural scene, likely from Southeast Asia, given the attire and setting. Several individuals are walking in a procession, dressed in traditional clothing. The men are wearing sarongs and head coverings, with some carrying objects on their shoulders. The background shows a crowd of people, some of whom are also dressed in traditional attire, while others appear to be in more modern clothing. The setting appears to be outdoors, possibly during a festival or ceremonial event. The photograph is in black and white, which adds a historical or vintage feel to the scene. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

The image is a black and white photograph depicting a group of individuals dressed in traditional attire, likely participating in a cultural or ceremonial event. They are standing in a line, facing away from the camera, and appear to be engaged in a ritualistic or ceremonial activity involving the use of large, flat objects that resemble shields or ceremonial items. The background shows a group of onlookers, some of whom are also dressed in traditional clothing. The setting appears to be outdoors, possibly under a tent or canopy structure. The photograph is taken at night or in a dimly lit environment, which creates a dramatic and solemn atmosphere. The image is credited to the President and Fellows of Harvard College (Harvard University Art Museums).

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This is a black-and-white photograph depicting a group of people participating in what appears to be a traditional or ceremonial event. The participants are dressed in plaid or checkered clothing, with some wearing pointed hats. They are holding long sticks or spears and appear to be engaged in a dance or ritualistic movement. The setting is outdoors, with trees in the background and a structure that resembles a hut or tent. The scene is illuminated by artificial lighting, highlighting the participants and creating a dramatic effect. The image has a caption from Harvard University Art Museums, indicating its cultural and historical significance.

Text analysis

Amazon

College
Art
and
(Harvard
Fellows
Museums)
of
University
Harvard
© President and Fellows of Harvard College (Harvard University Art Museums)
President
P1970.4544.0006
©

Google

© President and Fellows of Harvard College (Harvard University Art Museums) P1970.4544.0006
©
President
and
Fellows
of
Harvard
College
(
University
Art
Museums
)
P1970.4544.0006