Human Generated Data

Title

Untitled (two formally dressed couples in front of a living room fireplace)

Date

1937

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12064

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two formally dressed couples in front of a living room fireplace)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12064

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Furniture 100
Dining Table 99.1
Table 99.1
Person 98.9
Human 98.9
Chair 98.9
Person 98.8
Tabletop 97
Home Decor 96.8
Restaurant 96.6
Dining Room 96.5
Room 96.5
Indoors 96.5
Interior Design 93.1
Meal 89.6
Food 89.6
Person 89.2
Cafe 83.1
Living Room 81.5
Couch 77.2
Clothing 76.8
Apparel 76.8
Dish 74.3
Flooring 73.4
Shelter 72
Nature 72
Outdoors 72
Countryside 72
Building 72
Rural 72
Female 70.7
People 70.2
Sitting 67.9
Dress 66.3
Tie 64
Accessories 64
Accessory 64
Kid 63.2
Child 63.2
Face 62.2
Person 61.9
Girl 61.8
Suit 59.9
Coat 59.9
Overcoat 59.9
Cafeteria 59.3
Plant 58.4
Linen 57.8
Food Court 56.8
Flower 55.9
Blossom 55.9
Floor 55.4

Clarifai
created on 2023-10-26

people 99.9
group 97.6
adult 97.3
chair 97.3
woman 96.6
man 95.4
furniture 94.8
group together 93
room 92.5
administration 91.5
two 89.8
sit 88.5
leader 87.9
several 87.8
four 87.4
seat 86.9
home 86.8
wedding 86.6
three 86.2
indoors 85.9

Imagga
created on 2022-01-15

kin 44.2
man 36.3
male 29.1
people 28.4
person 27.9
nurse 26.4
adult 25
happy 21.9
smiling 21
patient 20.6
sitting 19.8
family 17.8
men 17.2
senior 16.9
couple 16.5
business 16.4
mother 16.3
hospital 16.1
home 15.2
women 15
indoors 14.9
portrait 14.9
room 14.8
cheerful 14.6
30s 14.4
businessman 14.1
old 13.9
two 13.5
mature 13
lifestyle 13
smile 12.8
father 12.6
happiness 12.5
medical 12.4
child 12.1
casual 11.9
elderly 11.5
shop 11.4
sick person 11.4
case 11.2
love 11
20s 11
team 10.7
colleagues 10.7
mid adult 10.6
husband 10.6
boy 10.4
life 10.3
aged 10
40s 9.7
interior 9.7
thirties 9.7
together 9.6
education 9.5
table 9.5
dad 9.4
groom 9.3
holiday 9.3
indoor 9.1
classroom 9
grandfather 8.8
parent 8.8
retired 8.7
day 8.6
married 8.6
four 8.6
wife 8.5
face 8.5
chair 8.4
blackboard 8.4
camera 8.3
occupation 8.2
working 8
color 7.8
two people 7.8
gift 7.7
retirement 7.7
bride 7.7
twenties 7.6
businesspeople 7.6
seller 7.5
barbershop 7.4
school 7.2
teacher 7.1
job 7.1
pensioner 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 95.7
wedding dress 89.9
furniture 88.8
dress 86.1
clothing 84.9
bride 83.8
black and white 83.7
table 81.6
woman 80
chair 75.6
person 74.8
vase 71.3
flower 66.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 81.3%
Calm 99.9%
Surprised 0%
Happy 0%
Confused 0%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 65.2%
Calm 99.6%
Sad 0.2%
Happy 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 7-17
Gender Female, 70.6%
Calm 71.5%
Sad 24.9%
Disgusted 1.5%
Happy 0.6%
Confused 0.6%
Fear 0.4%
Angry 0.3%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Tie
Person 98.9%
Person 98.8%
Person 89.2%
Person 61.9%
Chair 98.9%
Tie 64%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a man in a tuxedo suit and a woman in a tuxedo -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image depicts a formal indoor setting with elegant furniture and decor. A group of individuals are dressed in formal evening attire. Visible elements in the room include a fireplace with detailed mantel decorations, an ornate mirror, a floral arrangement on a pedestal table, upholstered chairs, and a wooden table with books neatly arranged on it. The overall atmosphere suggests a sophisticated or possibly celebratory gathering in a richly furnished room.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image shows an elegant, formal interior setting with ornate furnishings. There are two individuals visible in the foreground, seated, wearing formal evening attire—possibly a tuxedo and an evening dress. The room features a fireplace with decorative details, flanked by lit lamps, and a large, ornate wall mirror above it. The furniture includes a table adorned with a bouquet of flowers and a group of books, as well as comfortable armchairs and a sofa. The room is richly decorated, evident from the curtains and rug, suggesting a luxurious, sophisticated atmosphere.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image depicts a formal, elegant interior setting, likely from the early to mid-20th century. It shows several well-dressed individuals, including a man in a tuxedo and a woman in an ornate, sequined dress, standing together in what appears to be a living room or parlor. There are also two other individuals, an older man and woman, seated in chairs. The room is decorated with ornate furnishings, artwork, and other decorative elements, creating an atmosphere of wealth and high society.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be from an elegant social gathering, likely from the early-to-mid 20th century. The setting is a luxurious interior room decorated with ornate furniture, a decorative mirror on the wall, floral arrangements, and detailed moldings. In the scene, there are several people dressed formally - the men are wearing white dinner jackets with black bow ties, and the women are wearing what appear to be sequined or beaded evening gowns. The room's decor includes period furniture like carved chairs and side tables, and there appears to be a lamp and some books visible in the background. The overall atmosphere suggests this is from a high-society event or gathering in someone's well-appointed home.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people in formal attire gathered in a luxurious room.

The room is decorated with ornate furniture, including a large mirror, a fireplace, and several tables. The walls are dark-colored and feature intricate molding. A large window on the right side of the room allows natural light to enter.

In the center of the room, a woman sits in a chair, wearing a long dress with a floral pattern. She has her legs crossed and appears to be engaged in conversation with the man standing next to her, who is dressed in a white suit and bow tie. To the left of the woman, another man stands, also wearing a white suit and bow tie. He is positioned near a table with a vase of flowers on it.

The overall atmosphere of the image suggests a formal gathering or event, possibly a party or reception. The luxurious decor and the formal attire of the individuals in the photo contribute to this impression.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a formal gathering in a luxurious room. The room features a fireplace with a large mirror above it, and the walls are adorned with various decorative items. A table with a vase of flowers sits to the left of the fireplace, while a lamp and chair are positioned to the right.

In the center of the room, a man stands wearing a white suit, black shirt, and bow tie, with his hands gestured as if he is speaking or performing. To his left, a woman is dressed in a long, patterned dress, and to his right, another man sits in a chair, also wearing a white suit, black shirt, and bow tie. The atmosphere appears to be one of elegance and sophistication, with the formal attire and luxurious surroundings suggesting a high-end social event or gathering.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a formal gathering in a room with a vintage aesthetic. There are several people in the room, dressed in formal attire. In the foreground, a woman is seated on a chair, facing the camera, while a man stands behind her, looking down at her. Another woman stands next to the man, and there is a man standing near the fireplace. The room is decorated with various items, including a mirror, a lamp, a vase, and a picture frame on the wall. The photograph has a slightly blurry effect, giving it an old-fashioned look.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white image features a group of people inside a room. The room has a carpeted floor, a fireplace, a table with a vase and a lamp, and a window with curtains. The people are wearing formal attire. Two men are standing, while the woman is sitting on a chair. The man on the right is sitting on a chair with a pillow. There are potted plants on the fireplace.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression:

The image is a negative print depicting a gathering in a luxurious, likely upscale, living room or parlor. It evokes a sense of formality and classic elegance. The composition suggests a posed photograph, possibly from a social event or a portrait session.

People:

  • Group: There are five people in the scene.
  • Dress: The men are dressed in white suits or tuxedos and bow ties. The women are wearing long, patterned dresses. They appear to be wearing their hair styled.
  • Activities: The people appear to be interacting in some way. One man is gesturing while speaking. One woman is seated in a chair, and another standing woman looking at them.

Setting and Details:

  • Room: The room is richly decorated. It appears to be a very traditional living room with a large fireplace, ornate mirror, and a patterned rug.
  • Furnishings: There is a small round table with a vase of flowers. Elegant chairs, a desk with books, and other decorative items (urns, lamps) are scattered throughout.
  • Lighting: The scene is lit in a way which suggests soft indoor lighting, perhaps through a window that is visible.

Atmosphere:

The image conveys an aura of wealth, sophistication, and leisure. It likely captures a moment from a social gathering of affluent people.

Created by gemini-2.0-flash on 2025-05-04

Here is a description of the image:

The image depicts a formal interior setting with four people. The scene is reminiscent of the 1930s or 1940s. A man in a white suit with a black bow tie stands towards the center of the image, gesturing with his hand as if in conversation. To his left, a woman in a patterned dress stands, looking towards the man.

To the right of the first man, another man is seated at a desk, also wearing a white suit with a black bow tie. A woman sits in a chair facing away from the viewer, wearing a similar patterned dress.

The room is richly decorated with a large fireplace in the background, adorned with floral arrangements. There is a painting above the mantel. A decorative mirror hangs on the wall. Elegant furniture, including tables with floral arrangements, and a desk with books and decorative objects, completes the scene. A patterned rug covers the floor, and draperies hang by a window.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image appears to be a black-and-white photograph of a formal gathering in an elegantly furnished room. The room is richly decorated with ornate furniture, including a large desk, chairs, and a small round table with a floral arrangement. The walls are adorned with paintings and mirrors, and there is a fireplace with decorative items on the mantel.

Four individuals are present in the room. Two men are dressed in formal attire, including white dinner jackets and bow ties. One of the men is standing and appears to be engaged in conversation with a woman who is seated. The woman is wearing a long, sequined dress and has a sophisticated hairstyle. Another woman, also dressed elegantly, is standing near the fireplace, seemingly engaged in conversation with the other man.

The overall atmosphere suggests a sophisticated social event or gathering, possibly from an earlier era given the style of clothing and the black-and-white nature of the photograph. The room's decor and the attire of the individuals indicate a setting of wealth and refinement.

Text analysis

Amazon

5387
over
PELEMOEN 206 over
206
PELEMOEN

Google

5397
5397