Human Generated Data

Title

Untitled (studio photograph of three women costumed as clowns and dancers)

Date

c. 1910-1920

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3731

Human Generated Data

Title

Untitled (studio photograph of three women costumed as clowns and dancers)

People

Artist: Durette Studio, American 20th century

Date

c. 1910-1920

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3731

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Dance Pose 98
Leisure Activities 98
Human 96.1
Dance 92.8
Stage 87.3
Mammal 79.8
Animal 79.8
Clothing 65.5
Apparel 65.5
Ballet 59.6
Performer 59.5
Ballerina 56.3

Clarifai
created on 2019-06-01

people 99.7
adult 98.2
wear 96.5
two 96
man 94.9
woman 93.5
one 93.2
outfit 92.2
portrait 87.5
retro 85.9
group 85
leader 84.4
group together 84
administration 83.8
three 83.2
chair 82.1
veil 77
uniform 76.1
vehicle 75.8
child 73.3

Imagga
created on 2019-06-01

astronaut 34.2
automaton 32.8
helmet 21.6
statue 18.4
sculpture 16.8
art 16
city 15.8
tourism 12.4
culture 12
person 11.8
history 11.6
man 11.4
travel 11.3
brass 10.7
costume 10.7
sword 10.4
mask 10.3
monument 10.3
traditional 10
human 9.7
decoration 9.6
celebration 9.6
people 9.5
old 9
religion 9
weapon 8.8
horse 8.5
portrait 8.4
amulet 8.3
football helmet 8.2
knight 7.9
urban 7.9
war 7.7
clothing 7.5
famous 7.4
historic 7.3
protection 7.3
color 7.2
building 7.2
colorful 7.2
adult 7.2
face 7.1
male 7.1
day 7.1
architecture 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

black 88.2
statue 83.7
horse 74.2
person 73.5
old 59.6
clothing 50.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-38
Gender Male, 80.9%
Angry 5.3%
Happy 23.2%
Confused 4.8%
Sad 2.4%
Calm 45.7%
Surprised 11.8%
Disgusted 6.8%

AWS Rekognition

Age 35-52
Gender Male, 52.4%
Surprised 45.1%
Sad 46.7%
Happy 45.4%
Angry 45.1%
Disgusted 45%
Confused 45.2%
Calm 52.4%

Feature analysis

Amazon

Person
Horse

Clarifai

Clothing
Human face
Footwear

AWS Rekognition

Person 95.8%

AWS Rekognition

Person 92.6%

AWS Rekognition

Person 83.3%

AWS Rekognition

Person 82.3%

AWS Rekognition

Horse 79.8%

Clarifai

Clothing 82.3%

Clarifai

Clothing 60.8%

Clarifai

Clothing 43.6%

Clarifai

Clothing 34%

Clarifai

Human face 63.4%

Clarifai

Human face 62.9%

Clarifai

Human face 53.6%

Clarifai

Footwear 62.8%

Clarifai

Footwear 61.1%

Clarifai

Footwear 47.6%

Clarifai

Footwear 45%

Clarifai

Footwear 41.2%

Clarifai

Footwear 38.7%

Categories

Imagga
created on 2019-06-01

interior objects 99.8%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of a bride and groom in traditional dress.

Salesforce

Created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people dressed in costumes and hats

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

This is a black-and-white negative image featuring three individuals dressed in clown or harlequin-inspired costumes seated inside a room with a plain backdrop. The central figure is seated on a chair, wearing a decorated outfit adorned with pom-poms and holding a tambourine. The other two figures stand slightly behind on either side, dressed in similarly theatrical attire featuring pointed hats. All three wear lace-up boots likely corresponding to the period of the image. The composition conveys a whimsical, staged scene of performance or celebration.

Created by gpt-4o-2024-08-06 on 2025-06-12

The image is a photographic negative depicting three individuals dressed in clown costumes. The clown in the center is seated on a chair and wearing a polka-dotted outfit. Their costume is complete with a ruffled collar and lace-up boots. The seated clown also holds a large round object that resembles a plate or a tambourine. Two other clowns stand behind the seated figure, each wearing similar festive costumes with frilly details. Both standing clowns are adorned with tall, pointed hats that are characteristic of traditional clown attire. The overall setting appears to be indoors, with a plain backdrop curtain hanging behind them, creating a simple studio portrait atmosphere.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image shows three people dressed in elaborate, whimsical costumes. They appear to be wearing clown or jester-like outfits with large hats, ruffled collars, and polka dot patterns. The costumes seem to be from a theatrical or performance setting, perhaps for a circus or carnival. The figures are posed together in a studio setting, with a plain backdrop behind them. The overall impression is one of playfulness and theatricality.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This is a vintage black and white photograph showing three people dressed in pierrot or clown-style costumes. They are wearing traditional white clown outfits with polka dots, ruffled collars, and pointed hats. The costumes appear to be from an earlier era, possibly the early 20th century. The figures are standing against a plain wall in what seems to be an indoor setting, and they are wearing what appear to be lace-up boots. The image has the characteristic look of an old photograph, with some fading and imperfections typical of early photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of three individuals dressed as clowns, posing in front of a backdrop. The clown on the left is seated on a stool, while the clown in the middle is standing behind them, with their arm resting on the seated clown's shoulder. The clown on the right is also standing, leaning against the seated clown's back.

All three clowns are wearing identical outfits, consisting of a long-sleeved shirt with large polka dots, a pointed hat, and white boots. The clown in the middle is holding a tambourine in their left hand, which adds to the playful atmosphere of the scene.

The background of the image features a plain white backdrop, with a few wrinkles and creases visible. The overall mood of the image is one of joy and playfulness, capturing the lighthearted and humorous nature of the clowns' poses and expressions.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of three people dressed as clowns. The person in the front is sitting on a chair, wearing a long-sleeved shirt with large polka dots and a matching hat. They are holding a tambourine in their lap. The two people behind them are standing, also wearing long-sleeved shirts and hats. The background appears to be a white curtain or sheet, with a dark floor. The overall atmosphere suggests that the individuals are posing for a photo, possibly for a theatrical performance or event.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image is a black-and-white photograph of three individuals dressed in clown costumes, sitting on chairs in a studio setting. The person in the middle is holding a tambourine, while the person on the left is holding a round object, possibly a prop or a prop. The person on the right is wearing a hat and has their hands on their knees. They are all wearing white face paint and have exaggerated expressions. Behind them is a white curtain, and there is a light source that is casting a shadow on the floor.

Created by amazon.nova-pro-v1:0 on 2025-06-03

The black-and-white photo shows three people in clown costumes, two standing and one sitting on a chair. They are all wearing white costumes with black dots and white shoes. The person sitting on the chair is wearing a necklace and holding a tambourine. The two standing people are wearing hats with a white ball on top. They are standing in front of a white curtain.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

The image is a black and white, slightly grainy, negative image of three people dressed in what appears to be clown costumes or theatrical attire.

Here's a breakdown:

  • Characters:
    • There are three figures. The central figure is seated on a simple wooden chair, holding a tambourine. They are adorned with round embellishments on their clothing. The other two figures stand behind them.
    • All three figures are wearing tall conical hats with a pom-pom at the top.
    • They are all wearing similar outfits with ruffled collars and what appear to be lace-up boots.
    • The figure on the right appears to have a bag of some sort hanging by their side.
  • Setting:
    • They are positioned in front of a plain, light-colored backdrop, perhaps a curtain or sheet.
    • The flooring appears to be a simple surface, casting shadows.

The overall effect is somewhat eerie and theatrical, evoking a sense of mystery due to the unusual costumes and the negative image.

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a black and white negative of a group of three people dressed in clown costumes. They are seated on white chairs in front of what appears to be a backdrop.

The person in the center is seated and holds a tambourine. They are wearing a dress adorned with circles and a headdress of some kind, also with circles. They also wear a necklace.

The other two figures stand behind and on either side of the seated figure. They both wear cone-shaped hats, and their costumes also appear to be clown-like.

All three figures are wearing white laced boots. The room has a simple and possibly staged appearance. There is a stage backdrop in the rear.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image depicts three individuals dressed in elaborate costumes, likely for a theatrical performance or a themed event. The costumes resemble those of traditional Pierrot and Pierrette characters, which are often associated with French pantomime and commedia dell'arte.

  1. Central Figure:

    • The central figure is seated on a chair and is dressed in a Pierrot costume. This includes a loose-fitting white outfit adorned with large black buttons, a white ruffled collar, and a black necktie.
    • The figure is wearing a white conical hat with a black pom-pom on top, which is typical of Pierrot attire.
    • The makeup includes a white face with accentuated black eyebrows and a black teardrop under one eye.
  2. Left Figure:

    • The figure on the left is dressed as a Pierrette, the female counterpart to Pierrot.
    • She is wearing a white dress with a black sash, a white conical hat, and a black shawl draped over her shoulders.
    • Her costume includes a white ruffled collar and cuffs, similar to the central figure.
  3. Right Figure:

    • The figure on the right is also dressed as a Pierrette, mirroring the costume of the left figure.
    • She is wearing a white dress with a black sash, a white conical hat, and a black shawl.
    • Her costume includes a white ruffled collar and cuffs.

The setting appears to be indoors, with a plain backdrop and a wooden floor. The overall atmosphere suggests a staged or posed photograph, possibly for a performance or a costume event. The costumes and makeup are detailed and traditional, indicating a careful attention to the characters' classic representations.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image is a black and white photograph featuring three individuals dressed in elaborate, theatrical costumes. The central figure is seated on a chair and is adorned with a mask that covers the upper part of the face, decorated with what appears to be a beaded or perforated design. This person is also wearing a long, flowing garment that drapes over the chair and extends to the floor, with a patterned design on the bottom portion. They are holding a tambourine.

The two individuals flanking the seated person are dressed in similar styles, with long, flowing garments and headpieces that have decorative elements. They appear to be holding fans or similar props, and their costumes also feature beaded or perforated designs. The setting seems to be indoors, with a plain backdrop and a wooden floor. The lighting creates a dramatic effect, with a spotlight highlighting the seated individual and casting shadows on the others and the background. The overall style of the photograph suggests it might be from an earlier time period, possibly the early to mid-20th century, given the fashion and photographic quality.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black-and-white photograph showing three individuals dressed in elaborate costumes, sitting on a white bench. The central figure is seated in a throne-like chair, wearing a mask with several circular cutouts, a necklace with large beads, and a dress adorned with similar circular designs. The two figures on either side are also wearing masks and costumes with similar circular motifs. They appear to be in a theatrical or performative setting, with a plain backdrop and a curtain visible behind them. The overall appearance suggests a surrealist or avant-garde theme.