Human Generated Data

Title

Untitled (Horse Dance, Java)

Date

January 26, 1960-February 2, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5084

Human Generated Data

Title

Untitled (Horse Dance, Java)

People

Artist: Ben Shahn, American 1898 - 1969

Date

January 26, 1960-February 2, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5084

Machine Generated Data

Tags

Amazon
created on 2023-10-06

Wedding 98.5
People 97.8
Photography 96.8
Face 96.6
Head 96.6
Portrait 96.6
Clothing 93.6
Hat 93.6
Accessories 93.4
Sunglasses 93.4
Crowd 89.3
Costume 75
Hippie 62.2
Parade 61.9
Dress 57.6
Protest 56.2
Carnival 56
Festival 55.5
Electrical Device 55.4
Microphone 55.4
Performer 55.2

Clarifai
created on 2018-05-10

people 99.9
many 95.8
group 95.6
woman 95.1
crowd 94.5
adult 94.2
child 93.3
audience 89.6
administration 86.7
man 86.1
group together 85.6
music 83.7
wear 82.5
education 76.7
veil 75.7
recreation 73.9
leader 73.2
military 73.1
spectator 72.9
adolescent 70.5

Imagga
created on 2023-10-06

snow 32.8
winter 27.2
people 25.1
person 24.1
cold 20.6
portrait 19.4
world 17.7
man 17.5
black 15.2
fashion 15.1
happy 15
outdoor 14.5
adult 14.3
weather 13.9
dress 13.5
ice 13.5
male 13.5
clothing 13.4
face 12.8
landscape 12.6
hair 11.9
mask 11.6
tree 11.5
human 11.2
negative 11.1
women 11.1
outdoors 10.7
travel 10.6
sun 10.5
forest 10.4
wall 10.4
eyes 10.3
clothes 10.3
model 10.1
film 10.1
active 10
spectator 10
smile 10
old 9.7
fun 9.7
outside 9.4
cute 9.3
holiday 9.3
cheerful 8.9
cool 8.9
costume 8.9
sexy 8.8
together 8.8
scene 8.6
walking 8.5
youth 8.5
head 8.4
pretty 8.4
park 8.3
hat 8.3
blond 8.1
smiling 8
couple 7.8
season 7.8
snowy 7.8
fountain 7.8
men 7.7
attractive 7.7
frost 7.7
art 7.7
sky 7.6
walk 7.6
one 7.5
looking 7.2
trees 7.1
scarf 7.1
day 7.1
happiness 7

Google
created on 2018-05-10

Microsoft
created on 2018-05-10

outdoor 98.5
person 92.8
posing 84.8
group 82.5
people 79.2
standing 79.1
old 68.5
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 4-10
Gender Female, 99.8%
Calm 97.6%
Surprised 6.3%
Fear 5.9%
Sad 2.9%
Confused 0.1%
Disgusted 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 1-7
Gender Male, 84.2%
Calm 72.8%
Sad 30%
Surprised 7.9%
Fear 6.5%
Confused 1.1%
Disgusted 0.4%
Angry 0.3%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Female, 85.4%
Calm 50.1%
Disgusted 20.4%
Surprised 18.3%
Confused 7.1%
Fear 7%
Angry 3%
Sad 2.5%
Happy 1.4%

AWS Rekognition

Age 35-43
Gender Male, 100%
Calm 77.7%
Happy 16.2%
Surprised 7%
Fear 6.1%
Sad 2.7%
Confused 1.6%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 22-30
Gender Female, 99.9%
Calm 55.3%
Sad 42.5%
Fear 16%
Surprised 6.7%
Confused 0.9%
Disgusted 0.8%
Angry 0.6%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Male, 95.5%
Calm 65.3%
Fear 33%
Surprised 6.5%
Sad 3%
Confused 0.4%
Happy 0.2%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 19-27
Gender Female, 99.9%
Calm 52.3%
Surprised 30.6%
Fear 8.2%
Happy 7%
Sad 5.6%
Disgusted 2.8%
Confused 2.5%
Angry 1.1%

AWS Rekognition

Age 27-37
Gender Female, 57.9%
Surprised 98.5%
Calm 7.2%
Fear 7.2%
Happy 5.6%
Sad 2.8%
Disgusted 1.1%
Angry 0.9%
Confused 0.4%

AWS Rekognition

Age 23-33
Gender Female, 88.5%
Calm 63.7%
Sad 14.1%
Surprised 12.2%
Fear 8.4%
Happy 3.1%
Angry 2.3%
Confused 1.3%
Disgusted 1.3%

AWS Rekognition

Age 24-34
Gender Male, 99.1%
Sad 100%
Calm 11.1%
Surprised 6.3%
Fear 5.9%
Happy 0.7%
Confused 0.4%
Disgusted 0.4%
Angry 0.2%

AWS Rekognition

Age 22-30
Gender Male, 68.8%
Sad 97.9%
Calm 20%
Fear 7.2%
Happy 7%
Surprised 6.9%
Confused 6.7%
Disgusted 4.3%
Angry 3.7%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 4
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 45
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Adult
Bride
Female
Person
Woman
Boy
Child
Male

Clarifai

Clothing
Human face
Man
Tree
Footwear
Woman
Human head

AWS Rekognition

Adult 98.5%

AWS Rekognition

Adult 98.1%

AWS Rekognition

Bride 98.5%

AWS Rekognition

Bride 98.1%

AWS Rekognition

Female 98.5%

AWS Rekognition

Female 98.1%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 96.9%

AWS Rekognition

Person 96.5%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 94.6%

AWS Rekognition

Person 93%

AWS Rekognition

Person 92.8%

AWS Rekognition

Person 87.9%

AWS Rekognition

Person 87.6%

AWS Rekognition

Person 83%

AWS Rekognition

Person 82.3%

AWS Rekognition

Person 77.5%

AWS Rekognition

Person 74.4%

AWS Rekognition

Person 71.3%

AWS Rekognition

Person 55.8%

AWS Rekognition

Woman 98.5%

AWS Rekognition

Woman 98.1%

AWS Rekognition

Boy 96.9%

AWS Rekognition

Child 96.9%

AWS Rekognition

Male 96.9%

Clarifai

Clothing 90.2%

Clarifai

Clothing 84.5%

Clarifai

Clothing 83.3%

Clarifai

Clothing 82.2%

Clarifai

Clothing 71.7%

Clarifai

Clothing 71.2%

Clarifai

Clothing 70.5%

Clarifai

Clothing 55.6%

Clarifai

Clothing 51.2%

Clarifai

Clothing 45.1%

Clarifai

Clothing 42.6%

Clarifai

Clothing 41.3%

Clarifai

Clothing 36.4%

Clarifai

Clothing 35.8%

Clarifai

Clothing 33.5%

Clarifai

Human face 87.6%

Clarifai

Human face 81%

Clarifai

Human face 79.2%

Clarifai

Human face 76.8%

Clarifai

Human face 74.9%

Clarifai

Human face 72.5%

Clarifai

Human face 69.3%

Clarifai

Human face 65.6%

Clarifai

Human face 64.5%

Clarifai

Human face 61%

Clarifai

Human face 51.3%

Clarifai

Human face 49.9%

Clarifai

Human face 47.8%

Clarifai

Human face 47.4%

Clarifai

Human face 35.8%

Clarifai

Human face 34%

Clarifai

Human face 33.6%

Clarifai

Human face 33.5%

Clarifai

Man 58.6%

Clarifai

Man 46.4%

Clarifai

Man 37.8%

Clarifai

Man 36.3%

Clarifai

Tree 54.5%

Clarifai

Footwear 40.5%

Clarifai

Woman 34.5%

Clarifai

Human head 33.9%

Clarifai

Human head 33.8%

Categories

Imagga
created on 2023-10-06

streetview architecture 50.7%
nature landscape 29.6%
paintings art 11.2%
pets animals 3.4%
beaches seaside 3%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a woman in a white dress and a man in a hat

Created by general-english-image-caption-blip-2 on 2025-07-04

a black and white photo of a crowd of people

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The black-and-white image depicts a group of people gathered in what appears to be an outdoor setting surrounded by trees. The individuals are clothed in varied attire, including shirts, head coverings, and hats. There is a woman prominently visible in the foreground, wearing a patterned headscarf and traditional clothing. The atmosphere suggests a community event or social gathering in a rural environment.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image depicts a group of people gathered outdoors under a leafy canopy, suggesting a setting with foliage or trees overhead. The scene appears to involve a diverse group, as there are individuals wearing different clothing styles. In the foreground, a person with a distinctive patterned headscarf is visible. Some individuals are wearing shirts while others are dressed in loose garments. Among the crowd, one person is wearing a pith helmet, further indicating a warm or outdoor environment. The scenario might be part of a public event or gathering, judging by the attentive posture of the people. The photo is black and white, giving it a historical or documentary feel.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to depict a traditional cultural festival or celebration in a rural or small-town setting. There is a large crowd of people, many of whom are wearing traditional clothing and costumes. In the center of the image, there is a figure wearing an elaborate, ornate costume with a mask-like face. The figure seems to be the focus of attention, surrounded by the crowd. The overall scene conveys a sense of festivity and community gathering.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This is a black and white photograph that appears to be from an earlier time period. It shows a crowd of people gathered outdoors, with trees or foliage visible in the background. What stands out in the image is what appears to be a traditional puppet or mask figure with distinctive facial features including large eyes, which seems to be part of some kind of cultural performance or celebration. The crowd consists of many people wearing light-colored shirts, and the overall scene suggests this may be documenting a cultural or community event.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-01

The image is a black-and-white photograph of a crowd of people, with two individuals in the foreground wearing masks. The person on the left is wearing a mask that covers their entire head, while the person on the right is wearing a mask that only covers their face. The crowd appears to be watching the two masked individuals, and some people are taking pictures or videos of them.

The background of the image is dark and blurry, but it appears to be a wooded area with trees and foliage. The overall atmosphere of the image suggests that it was taken during some kind of cultural or religious event, possibly a festival or ceremony. The use of masks and the crowd's attention to the two individuals suggest that this may be a performance or ritual of some kind.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-01

The image is a black-and-white photograph of a crowd of people, with a man in the foreground wearing a mask and a woman in traditional clothing standing next to him.

  • The man is wearing a mask that covers his face, and he has a white shirt on.
    • The mask is white with black eyes and eyebrows, and it has a long nose and mouth.
    • The man's hair is dark and short, and he has a beard.
    • He is facing the woman, who is standing next to him.
  • The woman is wearing a traditional outfit, including a long skirt and a blouse with a high neckline.
    • She has a headscarf wrapped around her head, and she is wearing earrings.
    • Her hair is dark and long, and she has a serious expression on her face.
    • She is looking at the man, who is wearing the mask.
  • In the background, there are many people standing in a crowd.
    • Some of them are wearing hats or headscarves, while others have their hair uncovered.
    • They are all looking at the man and the woman, who are standing in the foreground.
    • The background is blurry, but it appears to be a park or outdoor setting with trees and greenery.

Overall, the image suggests that the man and the woman are performing some kind of traditional dance or ritual, and the crowd is watching them with interest.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-31

The black-and-white photo shows a crowd of people standing and watching a performance. The two performers are wearing masks and are probably talking to each other. One of them is wearing a headdress and a bracelet. The other performer is wearing a shawl. In front of them is a person wearing a headdress, holding a stick, and probably talking to the crowd. Behind them are trees and a house.

Created by amazon.nova-lite-v1:0 on 2025-05-31

The image is a black-and-white photograph of a traditional performance or cultural event. It depicts a group of people gathered in an outdoor setting, possibly in a village or town. The central focus is on two individuals wearing elaborate costumes and masks, suggesting they are performing a traditional dance or ritual. The person on the left wears a headdress with intricate designs and a mask that covers their face, while the person on the right wears a mask and a flowing garment. Behind them, a crowd of people, including children, are watching the performance attentively. The background includes trees and a building, indicating an outdoor setting.

Google Gemini

Created by gemini-2.0-flash on 2025-05-28

The black and white photo shows two people in the foreground, in front of a crowd of people. The person on the left is mostly facing away from the camera, and wearing a patterned head covering. They are also wearing glasses, and a white shirt. The person on the right is wearing a mask with a face on it, with a red headscarf over it. The mask has large oval eyes and a slightly pursed mouth. The person is also wearing a patterned dress and a white shirt underneath.
The crowd behind them is made up of people of all ages, mostly children. Some of the people are wearing hats, and one person is wearing what appears to be a military uniform. The background is made up of trees and foliage. The photo is slightly grainy and faded.

Created by gemini-2.0-flash-lite on 2025-05-28

Here's a description of the image:

The image is a black and white photograph depicting a crowd of people, with the focus on two individuals in the foreground. The person in the front has a patterned head wrap, and is either looking at or interacting with the person to the right of them. This person is wearing a white mask with large, round eyes, and is wearing a red head covering. Behind them, a crowd of onlookers is visible, including children. The setting appears to be outdoors, possibly a village, with trees in the background. The scene has a documentary feel, perhaps capturing a cultural performance or a public event.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

This black-and-white photograph captures a cultural or traditional event, possibly a festival or a ceremonial gathering. In the foreground, two individuals are wearing large, elaborately designed masks. The mask on the left appears to be that of a male figure with a beard and a headpiece, while the mask on the right depicts a female figure with a serene expression and a headscarf. Both individuals are dressed in traditional attire, adding to the cultural significance of the scene.

In the background, a group of people, including adults and children, are gathered, watching the event. The crowd seems engaged and interested in the performance or ceremony taking place. The setting appears to be outdoors, with trees and natural surroundings visible. The atmosphere suggests a community event rich in tradition and cultural heritage.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This black-and-white photograph captures a lively scene, likely from a traditional or cultural event. In the foreground, a person is holding a large, intricately designed mask with detailed features and a serene facial expression. The mask appears to be part of a traditional performance or parade. Surrounding the mask holder are several onlookers, including children, who are observing the event attentively. The background is filled with more people, some of whom are dressed in traditional attire, suggesting a communal or festive gathering. The setting appears to be outdoors, possibly in a village or rural area, with trees and foliage visible in the background. The overall atmosphere conveys a sense of cultural richness and community engagement.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph depicts a group of people gathered outdoors, likely in a rural or village setting. In the foreground, a person wearing a traditional headpiece and clothing is interacting with a larger-than-life puppet or marionette. The puppet has a detailed, painted face and is dressed in elaborate traditional attire. The puppet appears to be the focus of attention for the surrounding crowd. The background shows trees and more people, suggesting a social or cultural event. The overall scene conveys a sense of tradition and community.