Human Generated Data

Title

Untitled (waiter taking the order of two women at table in restaurant)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4914

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waiter taking the order of two women at table in restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4914

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.4
Restaurant 92.8
Meal 71.2
Food 71.2
Cafeteria 61.9
People 61.5
Cafe 59.3

Clarifai
created on 2023-10-26

people 99.9
woman 98.5
group 98.1
adult 97.4
child 97
man 94.8
education 92.3
sit 90.2
group together 89.7
monochrome 89.3
furniture 89.1
teacher 89
indoors 83.1
nostalgia 82.6
boy 82
several 81.9
chair 81.5
elderly 81.4
room 81.2
retro 80.6

Imagga
created on 2022-01-23

barbershop 100
shop 100
mercantile establishment 96.1
place of business 64.1
establishment 32
people 21.7
man 18.8
old 18.1
architecture 15.6
building 14.9
history 13.4
indoors 13.2
business 12.1
male 12.1
person 11.6
room 11.4
window 11
businessman 10.6
home 10.4
men 10.3
vintage 9.9
couple 9.6
love 9.5
sitting 9.4
inside 9.2
historic 9.2
office 9.1
adult 9.1
black 9
family 8.9
happy 8.8
restaurant 8.7
ancient 8.6
god 8.6
two 8.5
historical 8.5
salon 8.5
travel 8.4
chair 8.4
city 8.3
religion 8.1
team 8.1
medical 7.9
color 7.8
clinic 7.7
professional 7.7
church 7.4
retro 7.4
aged 7.2
smiling 7.2
art 7.2
interior 7.1
medicine 7
together 7

Google
created on 2022-01-23

Shirt 94.4
Photograph 94.2
Table 90.4
Black 90
Picture frame 89.7
Black-and-white 86.9
Style 84.1
Hat 78.3
People 78
Jacket 77.7
Monochrome 76.9
Barware 76.8
Art 76.8
Monochrome photography 76.4
T-shirt 76.3
Snapshot 74.3
Vintage clothing 71.6
Event 71.5
Room 70.4
Stock photography 66.2

Microsoft
created on 2022-01-23

text 98.4
clothing 94.1
person 90.8
man 87.2
drawing 78
posing 36.5
shop 9.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 81.6%
Calm 31.8%
Happy 23.1%
Surprised 22.4%
Disgusted 7.3%
Fear 5.9%
Angry 4.1%
Confused 3.1%
Sad 2.5%

AWS Rekognition

Age 35-43
Gender Male, 87.9%
Calm 99.9%
Happy 0.1%
Sad 0%
Angry 0%
Disgusted 0%
Confused 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Female, 81.9%
Calm 67.2%
Happy 10.6%
Disgusted 5.3%
Surprised 5.1%
Confused 4.2%
Angry 4.2%
Sad 2.5%
Fear 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Clothing
Table
Man
Human face
Human hair
Chair

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.1%

AWS Rekognition

Person 99%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 77.4%

Clarifai

Clothing 94%

Clarifai

Clothing 90.4%

Clarifai

Clothing 89.8%

Clarifai

Clothing 83%

Clarifai

Clothing 52.3%

Clarifai

Clothing 43.9%

Clarifai

Clothing 43.5%

Clarifai

Table 85.1%

Clarifai

Man 69.6%

Clarifai

Man 69.5%

Clarifai

Man 58%

Clarifai

Man 33.1%

Clarifai

Human face 68.8%

Clarifai

Human face 62.5%

Clarifai

Human face 60.2%

Clarifai

Human hair 39.7%

Clarifai

Human hair 36.3%

Clarifai

Human hair 34.2%

Clarifai

Chair 36%

Categories

Imagga
created on 2022-01-23

paintings art 58.3%
people portraits 36%
interior objects 3.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

photograph of a family sitting in a dining room.

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people sitting at a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-17

This is a black-and-white negative image depicting a social scene inside a restaurant or cafe. A group of individuals is seated at a table covered with a tablecloth, which has items like bottles, condiments, and a menu or booklet placed on it. The wall behind them is heavily decorated with various framed pictures and posters, including one notable sign advertising "Schrafft's 65 Years" and a business location at 125 Walnut St. The overall setting suggests a casual gathering in a vintage dining establishment.

Created by gpt-4o-2024-08-06 on 2025-06-17

The image is a black and white photograph with a negative effect. It shows a restaurant or cafe setting where a group of people are seated at a table. There are two women in hats and a man at the table with various items, including bottled condiments. One woman is wearing a light-colored, long-sleeved outfit, and the other has curly hair. The wall behind them is decorated with various framed pictures and posters. A notable poster reads "Goldmaden's 65 Years" and mentions an address "125 Walnut St." The table is covered with a tablecloth and has condiments like ketchup and what appears to be a bottle of another sauce. The scene captures a moment of social interaction in a vintage setting.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to be a black and white photograph depicting the interior of a shop or store. The walls are covered with various framed items, including what seem to be posters, signs, and other decorative elements. In the foreground, there are several people visible, including a person standing and holding what appears to be a book or document, as well as several seated individuals. There are also various objects and items visible on a table or counter in the center of the image.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a vintage black and white photograph taken in what looks like a restaurant or bar setting. The walls are covered with various signs, posters, and decorations, including what appears to be a "65 YEARS" sign and a "WALNUT ST." sign. Several people dressed in white uniforms or clothing are gathered around what appears to be a table or counter. The lighting in the image creates strong contrasts between light and shadow. The setting has a nostalgic, mid-20th century feel to it, with the decorative elements and style of the interior suggesting this might be from the 1940s or 1950s. There appear to be some bottles on the table, suggesting this might be a bar or restaurant setting.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-31

The image is a black-and-white photograph of a restaurant scene, with a waiter serving customers at a table. The waiter, dressed in a white suit and tie, stands on the left side of the image, holding a tray with a bottle of ketchup and a menu. He appears to be taking an order from the customers.

In the foreground, a table is set with a black tablecloth, featuring a bottle of ketchup, a glass jar of pickles, and a menu. Two customers sit at the table, both wearing hats. One customer wears a white hat and a white shirt, while the other wears a white hat and a light-colored shirt.

The background of the image features a wall adorned with various framed pictures and posters, including one that reads "SCHLITZ" and another that says "65 YEARS." The overall atmosphere of the image suggests a casual dining setting, possibly during the daytime.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-31

The image depicts a black-and-white photograph of a group of people gathered around a table in a restaurant or diner. The scene is set in the 1930s, as indicated by the clothing and decor.

  • Table Setting:
    • A table is set with a dark tablecloth, and various items are placed on it, including:
      • A bottle of beer
      • A glass
      • A menu
      • A salt and pepper shaker
  • People:
    • A group of five people are seated around the table, facing each other.
    • They are all dressed in casual attire, with the men wearing suits and ties, and the women wearing dresses and hats.
    • The people appear to be engaged in conversation, with some of them gesturing or pointing at something.
  • Background:
    • The background of the image shows a wall covered in various items, including:
      • Posters
      • Pictures
      • Signs
      • Decorations
  • Overall:
    • The image captures a moment of social interaction and leisure in the 1930s, with people gathered around a table to eat and drink.

In summary, the image shows a group of people enjoying a meal together in a restaurant or diner, surrounded by decorations and signs that reflect the style and culture of the 1930s.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

The image is a black-and-white photograph of a restaurant scene from the 1930s or 1940s. The image shows a group of people seated at a table in a restaurant, with a waiter attending to them. The waiter is dressed in a white uniform and is standing behind the table, holding a menu. The people at the table are dressed in period clothing, with the women wearing hats and dresses and the men wearing suits and ties.

The restaurant has a rustic, old-fashioned decor, with wooden walls and a variety of framed pictures and posters on the wall. The table is covered with a black tablecloth and has a variety of bottles, glasses, and other items on it. The image has a slightly blurry quality, suggesting that it was taken with a camera that was not very advanced at the time.

The image appears to be a staged photograph, as the people in the image are posing for the camera. The photographer may have been hired by the restaurant to create promotional images for advertising or other purposes. The image captures a moment in time and provides a glimpse into the restaurant scene of the past.

Created by amazon.nova-pro-v1:0 on 2025-05-29

The image is in black and white. It depicts a group of people in a restaurant. A man is standing and holding a menu in his left hand, and he seems to be giving it to a woman sitting at the table. A woman sitting in front of him is holding a glass, and another woman sitting on the right side is holding a cup in her hand. A few bottles are placed on the table. The wall is decorated with various frames.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

Here is a description of the image:

The image captures a scene inside a restaurant, likely in the mid-20th century. The focus is on a waiter taking an order from a group of patrons seated around a table.

Key Elements:

  • Waiter: A man in a white suit jacket and dark shirt is standing at the edge of the table, holding a notepad and pen, appearing to take an order.
  • Patrons: Three people are seated at the table. Two are women wearing hats, and another man is seated in the background.
  • Table Setting: The table is covered with a dark tablecloth. Condiments (Heinz ketchup and chili sauce, shakers) are placed on the table, along with glasses.
  • Restaurant Interior: The walls are decorated with various framed pictures, plaques, and what appears to be a large clock-like mechanism, giving the restaurant a classic, slightly cluttered ambiance. A poster advertising Bookbinder's restaurant for 65 years located on Walnut Street is visible.
  • Composition: The photograph is well-composed, with the waiter as the central figure and the patrons as secondary focal points. The background details add context to the scene.

Overall Impression:

The photograph conveys a sense of a bygone era. It's a snapshot of a restaurant experience, possibly a common scene in the mid-20th century. The overall atmosphere is a mix of formality (the waiter's attire) and a relaxed dining experience.

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image shows a monochrome, medium-shot photograph of a restaurant scene. A waiter, dressed in a light-colored suit, stands to the left side of the frame and appears to be taking an order. He holds a notepad and pen in his hands.

At the table, there are three patrons. Two women in hats are seated, one facing the viewer and the other with her back to the camera. A man with a bald head is also at the table, partially obscured by the waiter.

The table is covered with a dark cloth. On the table, there are condiments, including bottles of Heinz tomato ketchup and chili sauce, along with shakers and a decorative glass container. A menu is also visible on the table.

The wall behind the table is heavily decorated with various pictures, signs, and decorative elements. One sign advertises "Bookbinder's" and mentions "65 years" and "steaks" at "125 Walnut St". The wall itself has a unique, textured appearance. The overall setting seems to be an old-fashioned or vintage-style restaurant. The image appears to be a negative, with colors inverted.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph depicting a scene from what appears to be an exhibition or trade show. The setting features a booth decorated with various framed pictures and posters on the back wall. The posters include advertisements for products such as "Walnut" and "Boulder's."

In the foreground, a table is set up with several items on display, including bottles of beverages and a bowl of what appears to be grapes. There are also some promotional materials or brochures on the table.

Four individuals are present in the scene:

  1. A person standing on the left side, dressed in a suit or formal attire, possibly interacting with the items on the table.
  2. A person seated behind the table, wearing a white outfit and a hat, seemingly engaged in conversation with the person standing.
  3. Another person seated to the right, also dressed in white and wearing a hat, participating in the conversation.
  4. A person standing in the background, partially obscured, wearing a light-colored outfit.

The overall atmosphere suggests a promotional or sales event, with the individuals likely discussing the products or services being showcased. The decorations and attire hint at a historical or themed context, possibly from the early to mid-20th century.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph depicting a scene inside a restaurant. The setting appears to be from a bygone era, likely mid-20th century, judging by the style of dress and decor. The restaurant has a vintage ambiance, with the walls adorned with various framed pictures, decorations, and a large sign that reads "Red Book Barbers," indicating a dual functionality of the space as a barbershop and a restaurant.

In the foreground, there is a table with several items on it, including what looks like a menu, two water bottles, and a glass bowl, possibly containing fruit. A waiter in a suit is standing at the table, appearing to take an order or interact with the diners.

The diners at the table include both men and women. Two women are seated on one side of the table, wearing hats and formal attire, indicative of the fashion of the time. The men are seated on the other side, also dressed formally. The overall atmosphere suggests a casual yet elegant dining experience, characteristic of mid-20th-century restaurants.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white photograph depicts a lively scene from a restaurant. The setting appears to be from a past era, possibly the mid-20th century, given the style of clothing and decor.

In the foreground, a group of people is seated around a table, enjoying their meal. The table is set with various condiments, glasses, and a newspaper. One man, wearing a hat and a mask, is engaged in conversation with a woman seated next to him. Another woman, also wearing a hat, is seated at the table, facing away from the camera.

A waiter in a suit is taking an order from the group. He is holding a notepad and a pen, and appears to be focused on writing down the order.

The walls of the restaurant are adorned with numerous framed pictures and decorations, adding to the ambiance of the place. A prominent sign on the wall advertises "Woodchopper's" restaurant, highlighting its long history of 65 years at the same address on Walnut Street.

The overall atmosphere of the image suggests a casual and friendly dining experience, with a touch of nostalgia.

Text analysis

Amazon

65
WALNUT
YEARS
OTHER
SAME
ADDRESS
ADDRESS FOR
FOR
BEST YEARS OF
ONE
OF
ONLY
AT
125
BEST
ST
BRANCHES
в OTHER ADDRESS
119317
SAUCE
-
NO BRANCHES
- sick
SAUCE ONE
LIEbll
в
HUM
STATE
NO
sick
RETORIA

Google

l19317. TEW'S 65 SAME ADORESS FOR YEARS ST OF STEAK WALNUT ST NO OTMER ADORESE ANCHES 19317.
l19317.
TEW'S
65
SAME
ADORESS
FOR
YEARS
ST
OF
STEAK
WALNUT
NO
OTMER
ADORESE
ANCHES
19317.