Human Generated Data

Title

Untitled (tall actor in suit and hat talking to short actor in dress on stage)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4847

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (tall actor in suit and hat talking to short actor in dress on stage)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4847

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.6
Apparel 99.6
Human 99.3
Flooring 77.9
Footwear 74.5
Door 71.2
Portrait 61.3
Face 61.3
Photography 61.3
Photo 61.3
Floor 60.5
Female 60.1
Advertisement 58.9
Chair 55.4
Furniture 55.4

Clarifai
created on 2023-10-26

people 99.6
family 97.9
two 96.7
monochrome 96.4
man 96.3
adult 95.5
woman 95
dancing 94.8
couple 94.4
young 94
indoors 92.8
child 91.7
retro 91.7
girl 90.7
love 89
beautiful 89
fun 88.4
dress 86.8
studio 86.2
fashion 85

Imagga
created on 2022-01-23

people 36.3
person 28.8
business 26.1
man 23.7
male 23.4
group 22.6
mug shot 21.1
silhouette 20.7
businessman 20.3
adult 18
photograph 17.3
team 17
human 16.5
corporate 16.3
men 16.3
attractive 15.4
work 14.9
creation 14.7
success 14.5
standing 13.9
representation 13.9
fashion 13.6
casual 13.6
happy 13.2
black 12.8
businesswoman 12.7
portrait 12.3
lady 12.2
teamwork 12.1
art 11.9
women 11.9
suit 11.9
communication 11.8
design 11.3
professional 11.2
looking 11.2
body 11.2
model 10.9
dress 10.8
figure 10.6
pretty 10.5
happiness 10.2
lifestyle 10.1
face 9.9
office 9.7
one 9.7
indoors 9.7
style 9.6
urban 9.6
hands 9.6
walking 9.5
presentation 9.3
company 9.3
holding 9.1
job 8.8
sexy 8.8
couple 8.7
boy 8.7
leader 8.7
crowd 8.6
building 8.6
elegant 8.6
friendship 8.4
reflection 8.3
city 8.3
alone 8.2
indoor 8.2
bust 8.2
symbol 8.1
home 8
conceptual 7.9
child 7.9
employee 7.9
smile 7.8
executive 7.8
room 7.8
youth 7.7
boss 7.6
hand 7.6
businesspeople 7.6
sculpture 7.6
elegance 7.6
leisure 7.5
light 7.4
blond 7.3
cute 7.2
bright 7.1
family 7.1
posing 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.7
clothing 91.3
black and white 90.1
footwear 90
dress 85.6
person 79.5
dance 58.8
woman 57.7
posing 51.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Female, 99.6%
Happy 40.1%
Surprised 30.6%
Calm 12.2%
Angry 4.5%
Fear 3.8%
Disgusted 3.8%
Confused 2.6%
Sad 2.5%

AWS Rekognition

Age 42-50
Gender Female, 78.1%
Calm 99.5%
Surprised 0.3%
Sad 0.1%
Confused 0.1%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Skirt
Shoe

Clarifai

Footwear
Man
Woman
Window
Door
Human face
Dress
Human leg
Human arm
Human hair

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.1%

AWS Rekognition

Skirt 78.8%

AWS Rekognition

Shoe 70.7%

AWS Rekognition

Shoe 50.7%

AWS Rekognition

Shoe 50.3%

Clarifai

Footwear 94.8%

Clarifai

Footwear 91%

Clarifai

Footwear 85.7%

Clarifai

Footwear 83.9%

Clarifai

Footwear 57.8%

Clarifai

Footwear 53.7%

Clarifai

Man 75.3%

Clarifai

Woman 75.2%

Clarifai

Window 72.9%

Clarifai

Door 65.9%

Clarifai

Door 49.8%

Clarifai

Human face 63.3%

Clarifai

Human face 57.2%

Clarifai

Dress 52.7%

Clarifai

Human leg 46.2%

Clarifai

Human leg 44.8%

Clarifai

Human leg 41.1%

Clarifai

Human leg 40.8%

Clarifai

Human leg 40.6%

Clarifai

Human leg 34.9%

Clarifai

Human arm 41.6%

Clarifai

Human arm 33%

Clarifai

Human hair 38.7%

Categories

Imagga
created on 2022-01-23

interior objects 70.3%
paintings art 28.1%
text visuals 1.2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a black and white shot of a couple dancing together in front of a piano.

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a man and woman dancing in a room

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This image, presented as a photographic negative, features two individuals standing in a room with minimal furnishings. The taller figure on the left is dressed in a loose-fitting suit, paired with a hat and patterned socks, giving a stylish and possibly playful impression. The shorter figure on the right appears to be wearing a dress with socks and shoes, standing in a confident pose. The background includes two doors and a window, suggesting an indoor setting with simple architectural details. The overall composition conveys a sense of staged interaction, likely intended for artistic or theatrical purposes.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black and white photo negative featuring two people standing indoors. The person on the left is dressed in a suit with loose-fitting pants, a sport coat, a bow tie, and a fedora-style hat. They are wearing patterned socks and white shoes. The person on the right is wearing a dress and is standing with one foot slightly lifted, suggesting movement or dance. They are wearing ankle socks and shoes with heels. The background includes a room with visible architectural elements such as doors and a window. The setting appears to be well-lit, indicated by the shadows and light distribution visible in the negative.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image shows two people, a man and a woman, dancing together in what appears to be a room or studio setting. The man is wearing a long coat and a hat, while the woman is wearing a short, patterned dress. They both have smiles on their faces and seem to be engaged in a lively dance. The image has a vintage, black and white aesthetic, suggesting it may be from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph from 1855 showing three people jumping or dancing in what appears to be a sunlit room. The subjects are captured mid-jump, creating a dynamic sense of movement and joy. They're wearing casual period clothing - the person on the right appears to be wearing a dress while the others are in looser-fitting attire. The room has tall windows letting in bright light that creates a dramatic atmospheric effect. The lighting and composition give the image an ethereal, almost floating quality as the subjects are suspended in mid-air. It's a remarkably energetic and candid shot for photography from that era, when long exposure times typically required subjects to remain very still.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man and woman dancing in a room. The man, positioned on the left, wears a white hat, a dark suit jacket, dark pants, and white shoes. His left hand is raised to his chin, and he has his right hand in his pocket. The woman, on the right, wears a dark dress with a light-colored top, dark stockings, and white shoes. Her left arm is raised, and her right arm is bent at the elbow.

The room features a door on the left, a window on the right, and a door on the far right. The walls are painted white, and the floor appears to be made of wood. The overall atmosphere of the image suggests a lively and joyful scene, with the couple's dance moves and facial expressions conveying a sense of happiness and playfulness.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a man and woman dancing in a room. The man, positioned on the left, wears a white hat, a light-colored suit jacket, dark pants, and white shoes. He has his right hand raised to his chin, while his left hand is tucked into his pocket. The woman, standing on the right, is dressed in a dark dress with short sleeves, dark stockings, and white shoes. She has her right arm raised, and her left arm is bent at the elbow.

In the background, there are two doors and a window with multiple panes. The overall atmosphere suggests that the couple is engaged in a lively dance, possibly during the 1920s or 1930s, given their attire and the style of the room.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image shows a black-and-white photograph of a scene with two people. The person on the left is a puppet, dressed in a hat, suit, and shoes. The person on the right is a woman, dressed in a dress and shoes. The woman is looking at the puppet and appears to be laughing. The image is taken in a room with a door and a window. The image has a watermark with the text "11855" in the top left corner.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white photo of a man and a woman dancing in a room. The man is wearing a hat and a suit, while the woman is wearing a dress and a bracelet. The man is looking at the woman, who is looking up and seems to be dancing. The woman is wearing socks and shoes. Behind them is a door and a window with a view of the outside.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

This is a black and white photographic negative of two people standing indoors. The image has the number "11855" written in three places, suggesting a film or archival reference number.

A man is standing on the left of the frame. He wears a light-colored suit, a hat, argyle socks, and shoes. He appears to have one hand in his pocket and the other near his face.

On the right of the frame stands a woman in a dress and what looks like socks and shoes. She has her arms up as if she is in motion. She is facing and looking toward the man.

In the background, there is a closed door on the left, a window with multiple panes in the center, and another door on the right. The lighting appears bright, with a somewhat even illumination across the scene.

Created by gemini-2.0-flash-lite on 2025-05-18

Certainly! Here's a description of the image:

Overall Impression

The image appears to be a film negative depicting a scene with two people, a man and a woman, in a brightly lit room. The black and white tones are reversed, and it has a vintage feel.

Key Elements

  • The People:

    • The man is dressed in a suit with baggy pants, argyle socks, and what appears to be white shoes. He is also wearing a white hat. He has a thoughtful expression on his face.
    • The woman is in a knee-length dress. She seems to be in a celebratory pose.
  • Setting:

    • They are in a room with a door and a window. The room appears to be relatively simple, possibly a studio.
    • The space is well-lit, and the background is predominantly white.
  • General Atmosphere:

    • The interaction between the two people has a playful feel.
    • The image has a nostalgic quality.

Possible Interpretation

The image appears to be a posed photograph, possibly from a photoshoot or a performance, given the costumes and the setting. It may be a scene from a play.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph depicting two individuals in a room, appearing to be engaged in a lively dance or playful interaction. The setting is indoors, with a door on the left side and a window with a grid pattern on the right.

The individual on the left is wearing a hat, a long-sleeved shirt, and baggy pants that are cinched at the ankles with patterned fabric. They have one hand on their hip and the other raised, holding what seems to be a small object or a prop.

The individual on the right is wearing a short-sleeved dress with a lace or embroidered design and a belt around the waist. They have one arm raised and the other bent at the elbow, also holding a small object or prop. Both individuals are wearing shoes and socks.

Their expressions and body language suggest they are enjoying themselves, possibly performing or rehearsing a dance routine. The image has a vintage feel, likely from the mid-20th century, indicated by the clothing styles and the overall quality of the photograph.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-14

The image is a black-and-white photograph of two individuals who appear to be dancing in a room with minimal decor. The room has a plain wall, a door, and a window with multiple panes. The individuals are wearing costumes that include hats and patterned socks. The person on the left is wearing a suit with a hat and striped socks, while the person on the right is wearing a dress and has a handbag. Both individuals are smiling and appear to be enjoying themselves, suggesting a playful or lighthearted atmosphere. The image has a timestamp or identification number, "11855," printed across the top and bottom of the photograph. The style of the clothing and the pose suggest that the photograph might have been taken in the mid-20th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-14

This black-and-white image shows two individuals dancing in a room with a minimalist design. The person on the left is wearing a suit with a hat and has argyle-patterned socks. The person on the right is dressed in a short dress and is smiling widely. The room has plain walls, a window with multiple panes, and a door. The image appears to be from an older time period, possibly the mid-20th century. The numbers "11855" are visible in the top left corner and at the bottom of the image.

Text analysis

Amazon

11855.
78:

Google

|1855. T1855.
|1855.
T1855.