Human Generated Data

Title

Untitled (man in blackface, woman in ballgown and man in tux at minstrel show with American flags behind them)

Date

May 27, 1955

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17983

Human Generated Data

Title

Untitled (man in blackface, woman in ballgown and man in tux at minstrel show with American flags behind them)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

May 27, 1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17983

Machine Generated Data

Tags

Amazon
created on 2022-03-04

Clothing 100
Apparel 100
Human 99.4
Suit 99.4
Overcoat 99.4
Coat 99.4
Dress 97.2
Tuxedo 92.3
Female 84.4
Accessories 78.9
Accessory 78.9
Flag 75.3
Symbol 75.3
Sleeve 74.8
Long Sleeve 68.2
Woman 67.8
Portrait 62.8
Photography 62.8
Face 62.8
Photo 62.8
Shirt 62.5
Shorts 60.9
Man 60.6
Costume 59.3
Sailor Suit 59.1
Stage 58.1
Glasses 55.1

Clarifai
created on 2023-10-29

people 100
group 98.9
two 98.8
adult 98.4
wear 98.3
outfit 96.5
woman 96.5
actor 96.4
man 96.3
three 96.3
group together 95.8
actress 95.6
veil 95.3
theater 94.1
dress 93.2
portrait 92.7
four 92.7
facial expression 92.4
music 91.5
menswear 90.8

Imagga
created on 2022-03-04

person 33.9
people 25.7
man 23.5
adult 23.5
clothing 23.1
teacher 21.2
couple 20.9
gown 19.3
bride 19.2
male 18.4
wedding 18.4
groom 17.8
professional 17.6
happy 17.5
portrait 17.5
love 17.4
dress 16.3
happiness 14.9
educator 14.3
bouquet 14.2
fan 14.1
vestment 13.6
two 13.6
fashion 12.1
nurse 12
women 11.9
family 11.6
married 11.5
catholic 11.4
smile 11.4
senior 11.2
black 11
bridal 10.7
hand 10.6
follower 10.6
lady 10.5
attractive 10.5
patient 10.4
men 10.3
pretty 9.8
life 9.8
business 9.7
businessman 9.7
ceremony 9.7
marriage 9.5
lifestyle 9.4
church 9.2
room 9.2
elegance 9.2
old 9.1
new 8.9
wed 8.8
indoors 8.8
standing 8.7
day 8.6
corporate 8.6
face 8.5
clothes 8.4
health 8.3
human 8.2
uniform 8.1
coat 8
looking 8
outerwear 8
hair 7.9
together 7.9
husband 7.9
flowers 7.8
model 7.8
casual 7.6
garment 7.6
traditional 7.5
tradition 7.4
alone 7.3
smiling 7.2
home 7.2
romantic 7.1
to 7.1
performer 7.1
medical 7.1

Google
created on 2022-03-04

Microsoft
created on 2022-03-04

text 98.9
dress 98
clothing 92.7
person 86.7
woman 86.5
standing 80.4
wedding dress 77.8
black 75.9
posing 72.4
footwear 71
white 68.3
old 63
black and white 62.4
bride 61.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-54
Gender Male, 76.4%
Happy 90.9%
Surprised 6.6%
Confused 1.3%
Calm 0.5%
Sad 0.3%
Disgusted 0.3%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Calm 99.8%
Happy 0.1%
Disgusted 0%
Surprised 0%
Fear 0%
Sad 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 54-64
Gender Male, 61%
Sad 44.7%
Happy 40.8%
Fear 6.5%
Angry 2.5%
Confused 2.1%
Surprised 1.5%
Disgusted 1%
Calm 0.9%

Microsoft Cognitive Services

Age 55
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Hat

Clarifai

Man
Dress
Footwear
Woman
Human face
Flag

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 91.7%

AWS Rekognition

Tie 78.9%

AWS Rekognition

Hat 57%

Clarifai

Man 82.3%

Clarifai

Man 75.4%

Clarifai

Dress 79.3%

Clarifai

Footwear 67.3%

Clarifai

Footwear 66.5%

Clarifai

Footwear 63.5%

Clarifai

Footwear 63.5%

Clarifai

Footwear 45.3%

Clarifai

Footwear 42%

Clarifai

Footwear 41.8%

Clarifai

Footwear 34.9%

Clarifai

Footwear 33.9%

Clarifai

Woman 53.3%

Clarifai

Human face 46.7%

Clarifai

Human face 34.4%

Clarifai

Flag 46.5%

Clarifai

Flag 43.8%

Categories

Imagga
created on 2022-03-04

paintings art 71.4%
people portraits 12%
streetview architecture 7.4%
events parties 5.4%
interior objects 2.4%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-10

person and his wife in a photograph by person.

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a man and woman in formal attire standing in a room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

This is a black-and-white negative image featuring three individuals standing on a wooden floor, dressed formally. The man on the left is wearing a top hat, a dark jacket, and patterned plaid pants, holding a cane. The person in the center is wearing an intricate floor-length gown adorned with floral details on the chest. The man on the right is dressed in a light-colored suit with a bow tie and a boutonniere. Two American flags are displayed in the background, along with part of a banner-like decoration. On the right side of the image, a young child is visible wearing a dress and standing near the group.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image shows three individuals standing side by side in a formal setting. The person on the left is dressed in a costume that includes a top hat, a dark jacket, and plaid pants, and they hold a cane. The central figure is wearing a long, elegant dress with a floral design on the bodice. The person on the right is dressed in a white suit with a boutonnière and holds an object, possibly a lighter or cigarette case, in their hands. Behind them are two American flags on poles. Additionally, there is a child to the far right, wearing a dark dress with light shoes. The image is a negative, as indicated by the reversed text reading "KODAK - SAFETY - FILM" at the top.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-21

The image shows three individuals dressed in costume. The person on the left is wearing a top hat, a black coat, and checkered pants. The person in the middle is wearing a long black dress with a floral pattern. The person on the right is wearing a white tuxedo jacket and bowtie. All three individuals are smiling and appear to be posing for a photograph. There are American flags visible in the background, suggesting this may be some kind of patriotic or celebratory event.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-21

This appears to be a vintage black and white photograph showing three people at what seems to be a formal or celebratory event. American flags can be seen in the background. The person on the left is wearing an interesting outfit consisting of checked pants, a dark jacket, and a top hat, holding a cane. In the middle is someone wearing an elegant dark evening gown, and on the right is a person in a white tuxedo or dinner jacket with a bow tie. The image has a theatrical or performative quality to it, possibly from a show or celebration. The setting appears to be indoors on a wooden floor, and there's a partial view of what might be a banner or decoration in the top left corner of the image.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of three individuals, two men and one woman, posing for a picture. The man on the left is dressed in a top hat, a dark suit jacket, and checkered pants, holding a cane in his right hand. The woman in the middle is wearing a dark dress with a feathered brooch and has her arms around both men. The man on the right is wearing a white suit with a black bow tie and a black flower on his lapel.

In the background, there are two American flags, and a child in a dark dress and white shoes can be seen on the right side of the image. The overall atmosphere suggests a celebratory event, possibly a patriotic gathering or a formal occasion. The image appears to be from the early 20th century, based on the clothing and hairstyles of the individuals depicted.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-11

The image is a black-and-white photograph of three people posing for a photo, with two American flags behind them. The man on the left is wearing a top hat, a dark jacket, and plaid pants, and is holding a cane in his right hand. The woman in the middle is wearing a dark dress and has her arms around the shoulders of the two men. The man on the right is wearing a white suit and tie, and has his hands clasped together in front of him.

In the background, there are two American flags hanging from the ceiling, and a banner that appears to be upside down. The overall atmosphere of the image suggests a celebratory or patriotic event, possibly a Fourth of July party or a veterans' gathering.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white image features three people standing together on a stage, probably for a performance. The person on the left is wearing a hat, a bow tie, and holding a cane. The person in the middle is wearing a necklace and a dress, while the person on the right is wearing glasses, a bow tie, and leather shoes. Behind them are two flags hanging on the wall. Another person is standing on the right side.

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring three people standing together in a room. The two individuals in the center are dressed in formal attire. The man is wearing a white suit, a bow tie, and glasses, while the woman is wearing a long black dress with a flower on her chest. They are standing close to each other, with the man's arm around the woman's shoulder. On the left side of the image, there is a person dressed in a costume with a white hat and a cane. Behind them, there is a wall with two hanging American flags and a banner with the text "THE UNITED STATES" on it.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-24

Here's a description of the image:

Overall Impression:

The image is a black and white, possibly vintage, photograph. It appears to be a candid or posed shot of three people, potentially at a social event or performance. The image is a negative, so the colors are inverted.

People:

  • Person 1 (Left): A man dressed in a theatrical or eccentric style. He wears a top hat, a dark jacket, a white shirt with a tie, and checkered pants. He's holding a cane. His face is heavily made-up.
  • Person 2 (Center): A woman in a dark gown. She has her arms around the other two individuals.
  • Person 3 (Right): A man in a white suit, a bow tie, and glasses. He has a small flower pinned to his lapel.

Background and Setting:

  • The backdrop appears to be a plain wall.
  • There are two American flags hanging.
  • In the upper left corner, there's a United States star and a piece of fabric or a banner.
  • In the corner, there appears to be a small child in a dress.
  • The word "KODAK" and other details are printed in reverse at the top.

Atmosphere:

The photograph has a slightly unusual or playful atmosphere, perhaps due to the clothing choices of the people. It hints at an event or performance, and the style of the attire might suggest a specific era.

Created by gemini-2.0-flash on 2025-05-24

Here is a description of the image you provided:

This is a black and white photo showing three people posing in front of a wall decorated with American flags.

On the left is a person wearing a top hat, jacket, checkered pants, and holding a cane. They appear to have painted their face.

In the center is a woman in a dress, with a necklace and a floral arrangement on the bodice.

To the right is a man in a white suit and bow tie, with glasses.

In the background are two American flags. A banner is partially visible at the top left corner of the image. There is also a partial view of a child on the right side of the image.

The photo has a distinct grain and appears to be a negative image.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-07

The image is a black-and-white photograph featuring three individuals dressed in costumes, likely for a performance or themed event. The setting appears to be indoors, possibly on a stage.

  1. Person on the Left:

    • Dressed as Uncle Sam, a well-known symbol of the United States.
    • Wearing a top hat, a dark jacket, and checkered pants.
    • Holding a cane in the left hand.
    • The face is painted white, and the person is smiling.
  2. Person in the Middle:

    • Wearing an elegant, dark, long dress with a fur collar and corsage.
    • The person has a cheerful expression and is smiling broadly.
    • The face is also painted white.
  3. Person on the Right:

    • Dressed in a white suit with a bow tie.
    • Holding two small American flags in each hand.
    • Wearing glasses and has a joyful expression.
    • The face is painted white.

In the background, there is a banner with some text, but it is not fully legible. There is also another individual partially visible on the right side of the image, dressed in a costume that includes a dress and possibly a wig. The overall mood of the image is festive and cheerful.

Qwen

No captions written

Text analysis

Amazon

UNITED
THE
RESEARCH
THE UNITED STATE
FARM
STATE
RESEARCH FARM TRUS
TRUS
MJ17--YT37A°--

Google

MJI7--YT 3RA°2--AGO
MJI7--YT
3RA°2--AGO