Human Generated Data

Title

Untitled (man and woman at dining room table/house keeper turned towards wall)

Date

1937

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5246

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man and woman at dining room table/house keeper turned towards wall)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5246

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.2
Clothing 94.3
Apparel 94.3
Flower 82.3
Blossom 82.3
Plant 82.3
Furniture 72.3
Flower Arrangement 71.3
Clinic 70
Coat 65.8
Portrait 61.8
Face 61.8
Photography 61.8
Photo 61.8
Flower Bouquet 59.9
Hospital 59.3
Table 57.7

Clarifai
created on 2023-10-26

people 99.1
wedding 96.6
adult 96.1
woman 94.9
man 94.5
veil 91.5
two 91.2
bride 90.4
group 89.1
chair 87.5
groom 87.4
indoors 84.9
furniture 79.2
sit 78.8
monochrome 78.4
ceremony 77.1
couple 77
table 76.1
hotel 72.9
room 71.3

Imagga
created on 2022-01-22

man 37.6
lab coat 36.6
male 35.5
professional 34.8
people 34
person 33.7
coat 33.4
nurse 31.3
adult 27.7
doctor 25.4
medical 22.1
couple 21.8
happy 21.3
business 20.7
hospital 19.9
clothing 19.6
job 19.5
businessman 19.4
office 18.6
worker 18.5
smiling 18.1
men 18
clinic 18
health 17.4
work 17.3
smile 17.1
teacher 16.9
indoors 16.7
lifestyle 16.6
women 16.6
corporate 16.3
desk 16.1
happiness 15.7
life 15.6
portrait 15.5
two 15.2
garment 15.2
day 14.9
mature 14.9
group 14.5
working 14.1
medicine 14.1
room 14
colleagues 13.6
casual 13.6
team 13.4
attractive 13.3
businesspeople 13.3
patient 13.3
waiter 12.8
indoor 12.8
modern 12.6
care 12.3
home 12
occupation 11.9
businesswoman 11.8
educator 11.5
bright 11.4
looking 11.2
sitting 11.2
teamwork 11.1
color 11.1
associates 10.8
black 10.8
uniform 10.6
elderly 10.5
computer 10.4
senior 10.3
camera 10.2
stethoscope 10
employee 9.8
old 9.8
human 9.7
30s 9.6
profession 9.6
dining-room attendant 9.5
talking 9.5
treatment 9.2
suit 9
cheerful 8.9
family 8.9
success 8.9
doctors 8.8
building 8.8
together 8.8
laboratory 8.7
partnership 8.6
practitioner 8.6
face 8.5
adults 8.5
meeting 8.5
clothes 8.4
20s 8.2
lady 8.1
interior 8
love 7.9
coworkers 7.9
standing 7.8
40s 7.8
lab 7.8
workers 7.8
partner 7.7
mid adult 7.7
pretty 7.7
diversity 7.7
shop 7.7
ethnic 7.6
career 7.6
house 7.5
technology 7.4
focus 7.4
light 7.4
domestic 7.2
student 7.1
look 7

Google
created on 2022-01-22

Photograph 94.2
Hat 86
Window 85.3
Black-and-white 85.2
Style 83.9
Plant 83.4
Monochrome photography 75.9
Cooking 75.6
Snapshot 74.3
Fashion design 74.1
Monochrome 73.6
Art 72.6
Event 70.5
Service 69.1
Vintage clothing 66.9
Room 66.5
Stock photography 64.5
Chef 61.8
Door 60.5
Uniform 55.4

Microsoft
created on 2022-01-22

person 97.9
text 96.6
clothing 94
man 93.7
dress 92
woman 88.5
wedding dress 86.2
window 84.1
bride 65.6
posing 57.8
old 49.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-24
Gender Female, 64.7%
Calm 89.1%
Sad 10.2%
Angry 0.2%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Female, 92.6%
Calm 99.7%
Sad 0.2%
Confused 0.1%
Happy 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 25-35
Gender Female, 68.9%
Calm 97.8%
Surprised 1%
Sad 0.8%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair

Clarifai

No features identified

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.3%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 78.5%

AWS Rekognition

Person 70.3%

AWS Rekognition

Chair 52.9%

Categories

Imagga
created on 2022-01-22

paintings art 79.8%
people portraits 16.9%
interior objects 1.9%

Captions

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and woman in white dresses and hats

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-12

The image depicts a formal dining room scene with vintage decor. On the table in the foreground, there is a floral centerpiece and dining ware, including plates and glasses. Behind the seated figure, a sideboard with ornate candlesticks and decorative items is visible. A person in uniform appears to be serving at the back of the room, near a cabinet displaying china or other dishware. The setting has an elegant ambiance, with patterned wallpaper and artwork displayed on the wall.

Created by gpt-4o-2024-08-06 on 2025-06-12

In this image, a dining room is set for a meal with a table that has a floral centerpiece and tableware arranged neatly. The room is elegantly decorated with patterned wallpaper and features a sideboard adorned with candlesticks. A person is seated at the dining table, looking up towards another individual standing close by, who is dressed in a suit. In the background, another person, possibly a servant, is standing and wearing an apron. A doorway and shelves holding decorative items can also be seen in the scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to depict a formal, ceremonial scene taking place in an ornate, historical-looking interior. There are several individuals dressed in white robes or garments, suggesting a religious or ritual context. The room is decorated with elaborate wallpaper, candles, and floral arrangements, creating an atmosphere of solemnity and reverence. The individuals seem to be engaged in some kind of ritual or ceremony, though the specific nature of the event is not entirely clear from the image alone.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a black and white photograph from what seems to be a formal dining setting. The image shows wait staff dressed in crisp white uniforms with black accents. In the foreground, there's an elegantly set dining table with a floral centerpiece and formal place settings. The room appears to be well-appointed with decorative wallpaper and candlesticks visible in the background. One server is standing near the table while another is in the background near what appears to be a doorway. The setting suggests this may be from an upscale restaurant or private residence, likely from an earlier era given the formal service style and black and white photography.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image is a black-and-white photograph of a man and woman in a dining room, with a table set for dinner.

The table is covered with a dark tablecloth and has a centerpiece of flowers. There are two place settings on the table, each with a plate, glass, and silverware. A man in a white suit and hat is standing next to the table, holding a record player. A woman in a white dress and apron is standing in front of him, looking at the record player.

In the background, there is a doorway leading to another room, and a mirror hanging on the wall. The walls of the room are covered in a floral patterned wallpaper, and there is a candelabra on a sideboard against one wall. The overall atmosphere of the image suggests a formal dinner party or special occasion.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

The image depicts a black-and-white photograph of a formal dining room scene. In the foreground, a man and woman are seated at a table, with the man standing behind the woman's chair. The woman is wearing a white dress and has her hair styled in an updo, while the man is dressed in a white suit and tie.

On the table, there are several items, including a vase of flowers, plates, glasses, and silverware. A dark-colored table runner runs down the center of the table, adding a touch of elegance to the setting.

In the background, another woman can be seen standing in front of a mirror, wearing a white dress with a black apron. The room is decorated with ornate wallpaper and features a large mirror on the wall, which reflects the image of the man and woman at the table.

Overall, the image conveys a sense of sophistication and refinement, suggesting that it may have been taken in the early 20th century. The formal attire and elegant decor suggest that the occasion may have been a special event or celebration.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-04

A black-and-white photograph shows a dining room with a table set for a meal. The table has a tablecloth, a flower vase, a candle holder, and plates. A woman in a white apron is standing behind the table, possibly a maid, and another woman is sitting on a chair. A man is standing behind the woman, possibly a waiter. There is a cabinet with shelves and a picture frame on the wall.

Created by amazon.nova-pro-v1:0 on 2025-06-04

The black-and-white photo shows three people in a dining room. The woman in the middle is sitting on a chair and looking at something on the table. The table has a flower vase, glasses, and plates. The man on the right is standing behind the woman. He is looking at something on the table. The woman on the left is standing near the door. She is wearing an apron.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The image captures a scene with an indoor setting, presenting a sense of elegance and vintage charm.

Setting and Composition:

  • The image appears to be a photograph taken indoors, likely within a dining room or similar space. The perspective suggests a medium shot, with the camera capturing the full scene, including the table setting, people, and some architectural details.

People:

  • There are at least three people in the scene. One of the people is a woman, she is sitting at the table.
  • Another person is also a woman, but she is in the background with her back to the camera, appearing to be serving or preparing something. She is dressed in a white garment with a black sash.
  • A man stands behind her, possibly engaging in a conversation. He is dressed in white.

Table and Setting:

  • A table is the central focus of the scene. It is adorned with a long, dark-colored runner, suggesting a formal dining setup.
  • The table is set with plates, glasses, and silverware, indicating a prepared meal.
  • A floral arrangement placed in a decorative vessel sits at the center, adding to the decor.

Architectural Details:

  • The background reveals an open doorway, suggesting a connection to another room.
  • A large painting or portrait is visible on the wall in the background.
  • Other decorative elements like candlesticks and a sideboard contribute to the overall style and the vintage aesthetic of the setting.

Overall Impression:

  • The image evokes a sense of a formal, possibly domestic setting, and an event like a dining or reception. The combination of people, setting, and decor hints at an air of luxury and perhaps a bygone era.

Created by gemini-2.0-flash on 2025-05-17

This black and white photo shows three people in a formal setting.

In the foreground, a dining table is decorated with a dark runner, glassware, ornate place settings, and a floral arrangement in an oval container. Two ornate chairs flank the table.

A woman sits at the table, looking upwards. She is dressed in a light-colored outfit with a V-neck. Behind her stands a man in a light-colored suit. They both stand near a console table, which is decorated with tall candlesticks and sits beneath a framed portrait of a man in a formal coat.

To the left, a maid stands in a doorway wearing a white dress and bonnet, with a dark sash tied around her waist. Behind her is a display cabinet with dishes and decorative objects. The walls are adorned with patterned wallpaper.

The number "5920" is written on the left side of the photo.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black-and-white photograph depicting a formal dining scene. The setting appears to be an elegantly decorated room with patterned wallpaper, a large mirror, and a fireplace. The table is set with fine china, silverware, and glassware, and there is a floral centerpiece.

Three people are present in the scene:

  1. A woman seated at the table, wearing a formal dress and gloves, looking up at a man standing beside her.
  2. A man standing next to the seated woman, dressed in a white suit and bow tie, leaning over slightly as if engaging in conversation with her.
  3. Another woman standing in the background near the fireplace, wearing a long dress with a dark sash, facing away from the camera.

The room is well-lit, with natural light coming from an open door or window on the left side of the image. The overall atmosphere suggests a sophisticated and formal gathering or event.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-30

The black-and-white photograph depicts a formal indoor scene. There are two individuals in the foreground, both dressed in white attire, standing near a table. The person on the left appears to be adjusting or holding something near the other person's hands, which are positioned on an object on the table.

The table in the foreground is set with elegant tableware, including a central floral centerpiece, goblets, and other decorative items. The background features a reflective surface, possibly a large mirror or glass partition, which shows a reflection of the room and adds depth to the image. The room has a classic design with patterned wallpaper and a door on the left side of the frame. The overall setting suggests a formal or ceremonial event, such as a wedding or a special occasion, given the attire and decor.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-30

This black-and-white photograph captures a staged scene with a mysterious and slightly surreal atmosphere. In the foreground, a woman with short hair, wearing a white shirt, is seated at a table. She appears to be in a trance-like state, with her eyes closed and her head tilted back. Surrounding her are various objects on the table, including a flower arrangement, a small statue, and some other decorative items.

To her left, a man in a white lab coat is leaning over her, holding an object that resembles a book or a tablet. His expression is serious, and he seems to be focused on the woman.

In the background, another woman in a white dress is standing near a table with a mirror, looking at herself or the objects on the table. The room has ornate wallpaper and a large mirror on the wall, which reflects parts of the scene, adding to the surreal feel.

The overall composition and the expressions of the people suggest a scene of experimentation or some kind of ritual. The image has a vintage quality, likely from the early to mid-20th century, given the style of clothing and the black-and-white format.

Text analysis

Amazon

5920
3083330

Google

5920
5920