Human Generated Data

Title

Untitled (Headdress Ball: man and woman with decorative headdresses)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5649

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Headdress Ball: man and woman with decorative headdresses)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5649

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Clothing 99.3
Apparel 99.3
Human 99
Animal 96.6
Coat 87.2
Overcoat 87.2
Text 61.8
Underwear 60.9
Hat 58.4
Money 57.8
Lingerie 56.7

Clarifai
created on 2023-10-15

wedding 98.3
man 97.2
people 95.7
monochrome 95.4
bride 93.5
groom 93.2
woman 91.9
couple 88.7
indoors 88.2
adult 88.1
love 84.8
veil 84.5
portrait 83.5
art 83.5
square 82.4
fashion 82.2
marriage 82
retro 79.4
dinner jacket 78.9
romance 78.7

Imagga
created on 2021-12-15

shower cap 56.4
cap 43.8
bride 42.3
headdress 34.2
wedding 34
portrait 31.1
love 30.8
groom 30.1
clothing 28.4
dress 28
adult 27.5
person 24.3
attractive 22.4
happy 21.9
people 21.8
smile 21.4
face 21.3
married 21.1
pretty 21
bouquet 20.8
happiness 20.4
sexy 20.1
marriage 20
veil 19.6
male 19.2
bridal 18.5
women 18.2
man 18.2
romance 17.9
couple 17.4
body 16.8
hair 16.7
model 16.3
smiling 15.9
fashion 15.8
flowers 15.7
lady 15.4
human 15
wed 14.7
covering 14.7
gown 14.7
eyes 14.6
flower 14.6
consumer goods 13.9
lifestyle 13.7
looking 13.6
skin 13.6
world 13.1
negative 12.5
health 12.5
life 12.5
bath 12.4
one 12
sensuality 11.8
head 11.8
relaxation 11.7
care 11.5
cute 11.5
water 11.3
celebration 11.2
men 11.2
gorgeous 10.9
clean 10.9
joy 10.9
romantic 10.7
cheerful 10.6
brunette 10.5
pure 10.2
two 10.2
healthy 10.1
husband 10.1
girls 10
film 10
kiss 9.8
black 9.6
wife 9.5
day 9.4
passion 9.4
elegance 9.2
toiletry 9.2
hand 9.1
spa 9
wet 8.9
washing 8.8
ceremony 8.7
bathroom 8.7
sitting 8.6
nice 8.3
makeup 8.2
sensual 8.2
perfume 8
contestant 7.9
elation 7.9
indoors 7.9
engaged 7.9
getting 7.9
decision 7.8
necklace 7.8
summer 7.7
photographic paper 7.7
ready 7.7
expression 7.7
prepared 7.6
studio 7.6
relax 7.6
relationship 7.5
event 7.4
emotion 7.4
handsome 7.1
lovely 7.1
posing 7.1
shower 7.1

Google
created on 2021-12-15

Photograph 94.2
White 92.2
Black 89.8
Black-and-white 87.3
Vision care 87.2
Flash photography 85.8
Gesture 85.3
Tie 84.2
Style 84.2
Monochrome 78.9
Monochrome photography 78.5
Art 76.8
Happy 76.7
Snapshot 74.3
Fashion design 74
Font 73.6
Hat 72.8
Sunglasses 72.6
Formal wear 72.6
Eyewear 70.9

Microsoft
created on 2021-12-15

text 99.7
wedding dress 99
bride 98.1
dress 90.1
fashion accessory 82.2
human face 80.6
person 68.3
wedding 67.2
black and white 66.6
clothing 63.5
woman 57.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-40
Gender Male, 51.8%
Sad 53.3%
Calm 40.9%
Surprised 2.3%
Happy 1.1%
Confused 1%
Fear 0.9%
Angry 0.4%
Disgusted 0%

AWS Rekognition

Age 26-42
Gender Female, 77.8%
Happy 66%
Angry 10.1%
Fear 5.8%
Confused 5.7%
Calm 4.8%
Sad 3%
Disgusted 2.5%
Surprised 2.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Bird
Suit

Clarifai

Man
Human face
Woman
Dress
Fashion accessory
Human arm
Human mouth
Human nose
Suit
Human hair

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.3%

AWS Rekognition

Bird 96.6%

AWS Rekognition

Suit 87.2%

Clarifai

Man 88.6%

Clarifai

Man 38.2%

Clarifai

Human face 84.6%

Clarifai

Human face 79.5%

Clarifai

Human face 45.1%

Clarifai

Woman 84.4%

Clarifai

Dress 64.7%

Clarifai

Dress 53.7%

Clarifai

Fashion accessory 51.1%

Clarifai

Fashion accessory 40.5%

Clarifai

Human arm 37.6%

Clarifai

Human arm 35.1%

Clarifai

Human mouth 35.8%

Clarifai

Human nose 35.2%

Clarifai

Suit 33.7%

Clarifai

Human hair 33.5%

Categories

Imagga
created on 2021-12-15

paintings art 99.7%

Captions

Microsoft
created by unknown on 2021-12-15

an old photo of a person 67.2%
a person wearing a hat 55.2%
an old photo of a person 55.1%

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

a bride and groom holding a bottle of champagne.

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a man and woman in formal attire standing next to each other

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

This is a black-and-white inverted image showing two people dressed in formal attire. The individual on the left is wearing a detailed dress with embellishments and a bracelet, while the person on the right dons a white jacket with a bow tie. The individual on the left appears to be holding up an object, possibly a decorative headpiece, which resembles a crown or similar item. The background contains curtains, suggesting an indoor or staged setting. The text "14530 Morris Dixons" is handwritten at the top.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image appears to be a photographic negative featuring two individuals in formal attire. The figure on the left is wearing a dress with intricate detailing and a necklace. The person on the right is wearing a tuxedo with a bow tie and a white jacket. The person on the left is holding an object above the other person's head, which seems to be a decorative box or package with a bird perched on it. There are visible curtains in the background, suggesting an indoor setting. Handwritten text at the top of the image reads "14530 Morris Dixons."

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to be a black and white photograph of two people in formal attire. The person on the left is a woman wearing a patterned dress and a large, curly hairstyle. The person on the right is a man wearing a tuxedo and a headdress resembling a turban or fez. They seem to be posing together, with the woman reaching up to the man's headdress. The background suggests this may be a stage or performance setting, with curtains or drapes visible behind them.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a vintage black and white photograph from around 1953, based on the notation at the top. The image shows two performers in theatrical costume - one wearing an elaborate curly wig or headpiece and a sequined or sparkly top, while the other wears a white dinner jacket with a bow tie and appears to have some kind of unusual headwear as well. The lighting creates dramatic contrast and the background shows what looks like curtains or drapes, suggesting this may be from a stage performance or theatrical production. The photo has a theatrical, vaudevillian quality typical of entertainment from that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a man and woman posing for the camera. The woman, positioned on the left, wears a dark dress adorned with a floral pattern, complemented by a necklace and a bracelet on her right wrist. Her hair is styled in a short, curly bob.

The man, situated on the right, is dressed in a white suit jacket over a black shirt and bow tie. He sports a distinctive hat featuring a marble design, topped with a large bird perched on it. The background of the image appears to be a room with curtains, although the details are somewhat obscured due to the black-and-white nature of the photograph.

The overall atmosphere of the image suggests a formal or celebratory occasion, possibly from the early 20th century given the clothing and hairstyles. The presence of the bird on the man's hat adds a touch of whimsy and playfulness to the scene.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a black-and-white photograph of a man and woman in formal attire, with the woman holding a bird perched on a box atop the man's head. The woman wears a dark dress and a hat, while the man is dressed in a white suit jacket, black shirt, and bow tie. The background features a curtain, and the overall atmosphere suggests a formal event or performance. The image appears to be a vintage photograph, possibly from the early 20th century, given the style of clothing and the presence of a bird as part of the scene.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-06-05

The image is in black and white and has a vintage filter. It features a man and a woman standing next to each other. The woman is wearing a dress and a necklace, while the man is wearing a suit with a bow tie. The woman is smiling and holding a hat with a bird on top. The man is looking at the woman and is wearing a hat with a bird on top.

Created by amazon.nova-lite-v1:0 on 2025-06-05

This black-and-white image features a man and a woman standing close to each other. The man is wearing a white suit with a bow tie, while the woman is wearing a dress and a hat. The man is holding a bird on his hat, and the woman is holding his hand. The image has a watermark that reads "14530 Morris Dixons" and "14530" at the bottom. The background is blurry, and there is a curtain behind them.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image:

This is a vintage black-and-white negative of a photograph featuring a woman and a man in formal attire. The image appears to be from a period when elaborate hats were in vogue.

The woman, on the left, is wearing an ornate, large hat that covers most of her head. She has her right arm raised, reaching toward the man’s head. She is also wearing a dress with a detailed pattern and a necklace. Her expression is joyful, with a visible smile.

The man, positioned on the right, is wearing a formal suit with a bowtie. On his head, he has a tall, makeshift hat or headdress that seems to be made of some type of material. A stuffed toy, possibly a bird, is perched on top of this peculiar hat. His expression is more serious or neutral, looking directly at the camera.

The background consists of a textured curtain on the left and a doorframe on the right, with a plain surface behind them. The photograph has a distinct vintage aesthetic, which can be seen in the fashion, the style, and the general tone of the image.
The top of the image has writing that reads "14530. MORRIS DIXONS". The bottom of the image has similar writing that says "14530." The right side also has writing, "14530. EASTMAN KODAK".

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

The photograph is a negative print of a vintage portrait. It features a man and a woman, likely in a humorous or playful pose.

The Man:

  • He is wearing a formal suit, with a white jacket, a black shirt, and a bow tie.
  • He has a peculiar "hat" on his head, which appears to be a crude, upright box or container, possibly made of paper or a similar material.
  • Perched on top of the hat is what looks like a stuffed bird, possibly a hawk or an eagle.

The Woman:

  • She is smiling and is wearing a detailed dress or top with straps.
  • She has a large, fluffy, decorative hat on her head.
  • She is holding her arm up, her hand touching the bird on the man's hat.
  • She is also wearing a necklace and a bracelet.

The Setting:

  • The background is somewhat indistinct, but there are hints of drapery or curtains on the left side.
  • The lighting suggests a studio setting.

Overall Impression:

The image has a whimsical and slightly absurd quality. The juxtaposition of the formal attire and the unconventional hats, along with the stuffed bird, creates a lighthearted and memorable visual. The image likely captures a moment of fun and playfulness from the past. The text at the top suggests it might be a studio photograph, possibly taken for amusement or a special occasion.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph featuring two individuals, identified as "Morris Dixons" at the top. The setting appears to be a formal or theatrical event, indicated by the backdrop and the attire of the subjects.

The individual on the left is a woman with a large, voluminous hairstyle. She is wearing a sleeveless, sparkly dress and is smiling. She is holding up a large, ornate hat or headdress that has a bird perched on top. The bird appears to be a dove.

The individual on the right is a man dressed in a formal white suit with a black bow tie. He is looking at the woman and the bird with a neutral expression.

The photograph has markings and numbers, such as "14530," written on it, which might be related to cataloging or archiving purposes. The background consists of draped fabric, suggesting a staged or studio setting. The overall tone of the image is light-hearted and possibly celebratory.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-15

The image is a black-and-white photo featuring two individuals dressed in formal attire. A woman on the left is wearing a dress with a floral design and a large, elaborate hat. She is extending her arm, and perched on her hand is a bird, possibly a parrot, which is sitting on a small, box-like object she is holding. On the right is a man in a white suit with a black bow tie and a similar elaborate hat, also adorned with a box and a bird perched on it. The background appears to be an indoor setting with curtains, and the image is labeled "14530" and "MORRIS DIXONS" at the top, indicating it might be part of a series or collection. The overall scene suggests a vintage or formal event, possibly a costume party or a themed gathering.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-15

This black-and-white photograph captures a playful and staged scene featuring a man and a woman. The man, dressed in a white jacket with a black bow tie, has a small bird perched on a book that he is balancing on his head. The woman, wearing a sleeveless dress with a large, textured hat, is laughing heartily as she reaches out to interact with the bird. The background includes a curtain, suggesting an indoor setting, possibly a photo studio. The image has a caption at the top that reads "14530. MORRIS DIXONS."

Text analysis

Amazon

DIXONS
14530. MORRIS DIXONS
14530.
MORRIS

Google

14530. mORRIS D)XONS T4530. NAGON-YT3RA2-MAMT2A3 • OE5h
14530.
mORRIS
D)XONS
T4530.
NAGON-YT3RA2-MAMT2A3
OE5h