Human Generated Data

Title

Untitled (man and woman about to kiss)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8447

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman about to kiss)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8447

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 98.6
Furniture 98.4
Clothing 91.6
Apparel 91.6
Chair 77.9
Indoors 77.1
Room 71.1
Meal 66.1
Food 66.1
Suit 58.7
Coat 58.7
Overcoat 58.7
People 57.3
Dish 56.7

Clarifai
created on 2023-10-26

people 99.5
monochrome 98.1
man 97.6
adult 96.6
indoors 96
sit 95.1
woman 88.9
two 88.5
family 86.4
furniture 86
easy chair 83.5
child 81.9
seat 80.9
chair 80
love 76.5
window 75.8
lid 75.1
sitting 74.8
leader 72.6
facial expression 71.2

Imagga
created on 2022-01-15

person 35.8
man 33.6
people 32.3
adult 28.4
male 27.1
happy 23.2
lifestyle 21.7
portrait 20.1
smiling 18.1
senior 17.8
casual 17.8
computer 17
home 16.7
sitting 16.3
television 15.8
teacher 15.4
business 15.2
women 15
smile 14.2
love 14.2
laptop 14.1
human 13.5
indoors 13.2
education 13
looking 12.8
indoor 12.8
work 12.6
attractive 12.6
telecommunication system 12.4
blackboard 12.2
couple 12.2
chair 12.1
mature 12.1
men 12
one 11.9
grandma 11.8
patient 11.6
elderly 11.5
office 11.4
cheerful 11.4
face 11.4
old 11.1
hair 11.1
room 11
professional 11
holding 10.7
handsome 10.7
interior 10.6
lady 10.5
pretty 10.5
classroom 10.3
happiness 10.2
clothing 10.1
student 10
modern 9.8
businessman 9.7
adults 9.5
expression 9.4
study 9.3
communication 9.2
black 9
sofa 8.9
working 8.8
case 8.8
couch 8.7
class 8.7
exam 8.6
mother 8.6
meeting 8.5
enjoyment 8.4
salon 8.4
house 8.4
hand 8.4
suit 8.3
fun 8.2
worker 8.2
dress 8.1
school 8.1
sick person 7.9
cute 7.9
together 7.9
chalkboard 7.8
model 7.8
retired 7.8
university 7.6
husband 7.6
monitor 7.6
smart 7.5
device 7.4
businesswoman 7.3
family 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 98.3
person 97
man 92.4
black and white 91
clothing 90.9
window 84.1
black 67.6
human face 62
old 44.2
posing 35.8

Color Analysis

Face analysis

Google

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat

Clarifai

Human face
Clothing
Man
Woman
Footwear
Tree
Human head
Human hair
Human nose
Hat
Fashion accessory

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 94.4%

AWS Rekognition

Person 84.7%

AWS Rekognition

Hat 91.6%

Clarifai

Human face 94%

Clarifai

Human face 83.1%

Clarifai

Human face 73%

Clarifai

Human face 71.7%

Clarifai

Clothing 76.7%

Clarifai

Clothing 63%

Clarifai

Clothing 58.8%

Clarifai

Clothing 54.3%

Clarifai

Clothing 51.2%

Clarifai

Clothing 41.4%

Clarifai

Clothing 36.1%

Clarifai

Man 65%

Clarifai

Woman 64.9%

Clarifai

Woman 55.7%

Clarifai

Footwear 47.9%

Clarifai

Tree 45.2%

Clarifai

Human head 41.8%

Clarifai

Human hair 41.6%

Clarifai

Human nose 35.4%

Clarifai

Hat 33.6%

Clarifai

Fashion accessory 33.4%

Categories

Imagga
created on 2022-01-15

streetview architecture 65.6%
nature landscape 20.4%
beaches seaside 4.3%
pets animals 2.1%
paintings art 1.9%
events parties 1.6%
interior objects 1.2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-11

a woman and her daughter look at a cat.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a woman in a hat and a man in a suit and hat

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image appears to be a photographic negative, as the colors are inverted. It depicts a domestic or intimate scene where a man and a woman are leaning in for a kiss or close interaction. The man has white hair, and the woman is wearing a hat with mesh or woven texture. A third figure in the foreground has a patterned outfit and a hat. Behind the main subjects, there's a fourth individual in a wedding veil, suggesting the setting might be related to a wedding or a formal celebration.

The surroundings include home decor elements, such as a circular mirror reflecting the image of a child, a decorative floral arrangement, and wood paneling on the walls. There's a sense of vintage or historical style to the image, possibly dating from the mid-20th century.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image appears to be a black-and-white photographic negative showing a scene in a room. In the center, a man and woman are leaning in towards each other, seemingly about to kiss or engaged in conversation. The man is wearing a suit, while the woman is dressed in a dark outfit and wearing a large, textured hat. Another woman is seen in the foreground, leaning forward while wearing a hat that has a flower decoration and is a wide-brimmed style. Behind them, there is a decorative wall with a large round-framed mirror reflecting a child in a dress, perhaps visible just to the left. To the right, part of a piece of furniture, possibly a radiator cover, can be seen. The walls are adorned with paneling and a decorative window with geometric patterns is visible in the background. There is also a large floral arrangement, likely ferns, situated near the middle left of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows an intimate moment between two people in an elegant, ornate room. The room features decorative architectural details, a large mirror, and a floral arrangement. The two individuals appear to be an older man and woman, both dressed in formal attire. The woman is wearing a polka dot dress and a hat, while the man is wearing a suit. They are embracing and appear to be in a close, affectionate interaction. The overall scene conveys a sense of intimacy and formality within a refined, historic setting.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a vintage black and white photograph taken in what looks like an elegant interior setting. In the scene, several people are gathered, with some wearing fashionable hats typical of the 1930s or 1940s era. The room features refined decorative elements including a large mirror with an ornate frame and what appears to be a floral arrangement with delicate branches or flowers in a vase. The wall has decorative paneling and there's a glimpse of what might be a piece of furniture or fixture in white on the right side of the image. The composition and style of the photograph suggests this was likely a formal or social occasion.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-27

The image is a black-and-white photograph of a man and woman in a room, with a mirror on the wall and a plant in the background.

  • The man has white hair and is wearing a light-colored suit jacket. He is facing the woman and appears to be speaking to her.
    • The man's facial expression is serious, and he is looking directly at the woman.
    • His right hand is raised, as if he is gesturing while speaking.
  • The woman has dark hair and is wearing a dark dress with a patterned blouse. She is facing the man and appears to be listening to him.
    • The woman's facial expression is neutral, and she is looking at the man with a slight smile.
    • Her hands are clasped together in front of her, and she is leaning forward slightly.
  • In the foreground, there is a person wearing a dark hat and a dark coat with a white stripe. They are facing away from the camera and appear to be looking at something on the floor.
    • The person's facial expression is not visible, and they are not interacting with the man and woman.
    • Their body language suggests that they may be looking at something of interest on the floor.
  • In the background, there is a large mirror on the wall with a decorative frame. The mirror reflects the image of the man and woman, as well as the plant in the corner of the room.
    • The mirror adds depth and context to the scene, providing a sense of the room's layout and decor.
    • The reflection in the mirror also helps to create a sense of symmetry and balance in the composition.
  • To the right of the man and woman, there is a white chair with a curved back and arms. The chair is partially obscured by the woman's body.
    • The chair appears to be a decorative piece, adding to the overall aesthetic of the room.
    • Its presence also helps to create a sense of depth and layering in the composition.

Overall, the image captures a moment of interaction between the man and woman, set against the backdrop of a well-appointed room. The use of a mirror and decorative elements adds depth and context to the scene, while the person in the foreground adds a sense of movement and energy to the composition.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-27

This image is a black-and-white photograph of a group of people in a room, with the number "12782" written at the top and bottom. The photo appears to be from the 1930s or 1940s.

In the foreground, there are four people visible, all dressed in formal attire. The man on the left is wearing a white suit jacket and a dark tie, while the woman next to him is wearing a dark dress and a hat. The other two individuals are partially obscured by the couple in front of them.

Behind the group, there is a large mirror hanging on the wall, reflecting the image of a woman who is not visible in the main part of the photo. To the right of the mirror, there is a vase with flowers on a mantlepiece, and a doorway leading to another room.

The overall atmosphere of the image suggests that it was taken at a social gathering or party, possibly in a wealthy household. The formal attire and the luxurious decor of the room suggest a high level of sophistication and elegance.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The black-and-white photo features four people, three of whom are women, standing in a room. The women are wearing hats, while the man is wearing a white coat. One of the women is bending down, while the other two are standing. The man is kissing the woman on the right. Behind them is a wall with a picture frame and a vase with flowers. On the right is a shelf with some items.

Created by amazon.nova-lite-v1:0 on 2025-05-26

The black-and-white photo shows a group of people in a room. The woman in the middle is wearing a hat and gloves and is looking at the woman on the right, who is wearing a necklace. The woman on the left is wearing a hat and a dress, and the man on the right is wearing a suit. There is a mirror on the wall with a reflection of a woman and a plant.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-30

Here is a description of the image:

The image is a black and white negative of a candid indoor scene. The focus is on a group of people in a room, likely a social gathering.

Foreground:

  • The most prominent figures are two women, one wearing a dark, dotted patterned top and hat. The second woman is wearing a large black hat.

Midground:

  • A couple, with a man kissing a woman. The man appears to be wearing a suit or blazer with a light-colored jacket. The woman wears a hat and dark clothing.
  • Behind the man are parts of two other people, one with a hat, and another wearing a hat.

Background:

  • The room appears to be elegantly decorated. There's a large, ornate oval mirror on the wall with an image reflected in it.
  • In front of the mirror is a large vase with branches.
  • In the background, there is a door with decorative elements and a wall sconce.

Overall Impression:
The image captures a moment of intimacy and social interaction in a sophisticated setting. The style of clothing and the decor suggest a scene from the mid-20th century. The negative format gives it an interesting and slightly surreal quality.

Created by gemini-2.0-flash on 2025-04-30

Here is a description of the image:

This appears to be a black and white negative image of a social gathering, possibly at a wedding or other formal event. The scene is set indoors, with architectural details like paneling and a decorative door visible in the background.

In the center of the frame, a man and a woman are shown in an intimate moment, seemingly about to kiss or whispering to each other. The man is wearing a light-colored suit with a dark tie, and his hair is light or possibly gray. The woman is wearing a hat, and her attire seems to be of a mid-20th century style.

In the foreground, there are other figures, partially obscured, but wearing hats and clothing that suggest a formal occasion. To the left, there's a wall or ledge, and above it, a large oval mirror in an ornate frame is visible, reflecting the image of a young girl. To the right, some decorative objects and what appears to be a coat stand can be seen.

The overall composition of the photo suggests a candid or informal capturing of a special occasion, with elements of portraiture and social documentation. The image is somewhat grainy, typical for older photographs.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting two women in an indoor setting, likely a room in a home or a dressing area. The woman on the left is wearing a light-colored blouse with a dark tie and a hat, and she is holding another hat in her hand. The woman on the right is wearing a dark dress and a hat with a leopard-print pattern. Both women appear to be engaged in a conversation or possibly discussing the hats.

In the background, there is a large oval mirror with an ornate frame, reflecting the image of the woman on the left. The mirror is placed on a mantelpiece adorned with a vase of flowers. The room has a classic, possibly vintage decor, with a wall-mounted radiator visible on the right side and a door with a decorative panel in the background. The overall ambiance suggests a setting from an earlier era, possibly the mid-20th century.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

The image is a black-and-white photograph that appears to be from a historical context, possibly the early to mid-20th century. It depicts a domestic or formal indoor setting. In the foreground, a group of women is gathered closely together, seemingly engaged in conversation or a shared activity. They are dressed in formal attire, including hats and dresses, which suggests a social gathering or a formal event. One woman is adjusting or holding a hat, indicating a possible preparation or adjustment process.

In the background, there is a large mirror with a decorative frame, reflecting part of the scene and adding depth to the image. The mirror shows a reflection of a woman and some foliage, which adds to the ornate and elegant atmosphere. To the right, there is a glimpse of what looks like a baby's crib, suggesting that the setting might also have a family-oriented purpose. The lighting is soft, and the overall mood of the photograph is serene and intimate. The number "12782" is visible at the top and bottom of the photograph, which might be a catalog or identification number for the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This is a black-and-white photograph depicting a group of elegantly dressed individuals in a formal setting. The image appears to capture a moment of interaction among the people, with one man in a light suit and bow tie leaning forward as if speaking or addressing the others. The women are wearing hats and formal attire, suggesting a social or ceremonial occasion. The background features ornate architectural details, including a decorative wall with a circular design and a floral motif, as well as a door with a decorative window. The overall ambiance suggests a refined and sophisticated environment.

Text analysis

Amazon

12782
2782
B

Google

12782 782 .
12782
782
.