Human Generated Data

Title

Untitled (waitress serving a man at the counter of a Heinz restaurant)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11961

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress serving a man at the counter of a Heinz restaurant)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11961

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.1
Shop 78.1
Shelf 76.7
Clothing 68.9
Apparel 68.9
Chef 58.8

Clarifai
created on 2023-10-25

people 99.9
adult 98.7
monochrome 97.3
group 96.8
two 95.8
man 95.5
group together 93.7
several 93.3
military 92.4
wear 92.4
three 91.7
woman 91.3
four 89.3
one 88.9
furniture 83.9
war 83.7
administration 83.5
indoors 82.1
room 81.6
employee 81.3

Imagga
created on 2022-01-15

seller 43.8
man 33.6
people 29.6
clinic 29.2
shop 27.9
person 27.1
male 26.9
medical 24.7
professional 24.2
doctor 22.5
coat 19.9
patient 19.8
mercantile establishment 19.7
work 19.7
lab coat 19.3
adult 18.4
men 18
pharmacist 16.8
medicine 15.8
worker 15.7
hospital 15.4
newspaper 14.7
health 14.6
laboratory 14.5
bakery 14.1
occupation 13.7
scientist 13.7
lab 13.6
job 13.3
place of business 13.1
business 12.7
chemistry 12.6
old 12.5
smiling 12.3
health professional 12
room 12
happy 11.9
nurse 11.6
exam 11.5
illness 11.4
research 11.4
education 11.2
senior 11.2
office 11.2
sitting 11.2
product 10.8
surgeon 10.7
care 10.7
science 10.7
businessman 10.6
human 10.5
biology 10.4
portrait 10.4
two 10.2
tobacco shop 10.1
student 10
indoors 9.7
test 9.6
black 9.6
couple 9.6
ancient 9.5
clothing 9.4
smile 9.3
hand 9.1
team 9
technology 8.9
women 8.7
table 8.7
serious 8.6
study 8.4
20s 8.2
cheerful 8.1
looking 8
to 8
interior 8
lifestyle 7.9
surgery 7.8
face 7.8
chemical 7.7
profession 7.7
creation 7.6
casual 7.6
instrument 7.4
holding 7.4
teamwork 7.4
group 7.2
restaurant 7.2
home 7.2
employee 7.1
family 7.1
waiter 7
architecture 7
modern 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99.6
clothing 93.3
person 87.5
man 84.1
black and white 67.8
bottle 52.6
preparing 44.7
shop 32.2
cooking 28.4

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 30-40
Gender Female, 89.7%
Calm 99.5%
Happy 0.2%
Sad 0.2%
Disgusted 0%
Confused 0%
Fear 0%
Surprised 0%
Angry 0%

Feature analysis

Amazon

Person

Clarifai

Man
Clothing
Human face
Human hair
Table
Human arm

AWS Rekognition

Person 99.1%

Categories

Imagga
created on 2022-01-15

streetview architecture 46.6%
events parties 23.2%
people portraits 18%
paintings art 3.6%
text visuals 3.5%
food drinks 2.9%
interior objects 1.2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

a photograph of a chess game.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a man and woman in uniform standing in a bar

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image depicts a vintage diner or soda fountain interior, with two individuals seated at the counter while a worker serves them. Visible are classic Coca-Cola branding elements, including signage, advertisements, storage containers, and a dispenser labeled "Ice Cold Coca-Cola." Shelves behind the counter are stocked with various canned goods, bottled sauces, and spices. The countertop features dishes, cups, and a serving bowl marked "Baked Beans." The surroundings have a nostalgic aesthetic with period details like marble-pattern counters and old-fashioned stools.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a black-and-white negative photograph depicting an interior scene at a soda fountain or diner. The setting shows several individuals seated at a marble countertop, with one person dressed in a uniform that resembles a police officer's attire. The scene features vintage memorabilia and advertisements promoting Coca-Cola, including a large wall sign with distinct Coca-Cola branding and logos. Several shelves in the background are stocked with various products, such as jars, containers, and possibly canned goods. The counter has several cups and a napkin dispenser, and near the left side, there's a refrigerated unit with the Coca-Cola logo labeled "ICE COLD." A hat rests on a stool in the foreground. Overall, the image captures a classic mid-20th-century social scene within a commercial establishment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image depicts an interior of a diner or cafe from an earlier era. The scene shows a counter with stools, where two customers are seated and being served by two staff members, one of whom is wearing a chef's uniform. The walls are decorated with Coca-Cola branding and other vintage-style signage. The overall atmosphere suggests a typical American diner or cafe setting from the mid-20th century.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This is a black and white historical photograph showing the interior of what appears to be a diner or lunch counter. The scene includes prominent Coca-Cola advertising, including winged logos on the wall and an "ICE COLD" cooler. The counter appears to be marble or stone-patterned, and there are various items displayed on shelves behind it, including bottles and containers. A staff member in a white uniform with a cap is standing behind the counter, and there's a customer in a suit jacket seated at the counter. The setting appears to be from around the mid-20th century, based on the style and decor. The photograph captures a typical American dining establishment of that era, complete with the characteristic counter service and soda fountain setup.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

This image is a black-and-white photograph of a diner scene, with a man sitting at the counter and two individuals standing behind it. The man on the left wears a suit and hat, while the person in the middle appears to be a woman with blonde hair, wearing a white uniform. The individual on the right is a man in a white uniform and hat.

The counter features a marble-like surface and is equipped with various items, including plates, cups, and utensils. A large glass jar labeled "BAKED BEANS" sits prominently on the counter. Behind the counter, there are shelves stocked with bottles and cans, as well as a sign that reads "Coca-Cola." The wall above the counter displays additional signs and advertisements.

The overall atmosphere of the image suggests a casual, everyday setting, possibly during the mid-20th century given the style of clothing and decor.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image depicts a black-and-white photograph of a man sitting at a counter in a restaurant, with two individuals standing behind the counter. The man is wearing a light-colored suit and has his hands clasped together in front of him. He is seated on a stool, facing the counter.

Behind the counter, there are various items such as plates, cups, and a cash register. A sign above the counter reads "Coca-Cola" in bold letters. On the left side of the counter, there is a small refrigerator with an "ICE COLD" sign on it. To the right of the refrigerator, there is a stack of plates and a bowl.

The two individuals standing behind the counter are both wearing white uniforms. The person on the left is wearing a hat and has a name tag on their uniform. The person on the right is also wearing a hat and has a name tag on their uniform.

In the background, there are shelves stocked with various items such as food, drinks, and utensils. The walls of the restaurant are adorned with decorations, including a large mural on the back wall.

Overall, the image appears to be a vintage photograph of a diner or restaurant, possibly taken in the mid-20th century. The atmosphere seems to be casual and friendly, with the man at the counter looking relaxed and the staff members behind the counter appearing welcoming.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The image is in black and white. It depicts a restaurant with three people inside. The man on the left is sitting on a stool, facing the two men standing behind the counter. The man on the right is wearing a cap and a white uniform, while the man in the middle is wearing a white chef's uniform. The counter has a glass display case with canned goods, bottles, and other items.

Created by amazon.nova-lite-v1:0 on 2025-05-24

This black-and-white photograph depicts a scene inside a soda fountain or a similar establishment. The image shows three individuals in the foreground. One person is seated at the counter, wearing a suit and holding a cup or glass. Another person, standing behind the counter, appears to be a server or bartender, dressed in a white uniform and hat. The third person is also standing behind the counter, possibly another server or staff member. The counter is stocked with various items, including bottles, cups, and a Coca-Cola ice-cold machine. On the wall, there are signs and advertisements for Coca-Cola, Pepsi, and other products. The overall atmosphere suggests a nostalgic and vintage setting, possibly from the mid-20th century.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-04-29

Here's a description of the image:

Overall Scene:

The image captures the interior of a vintage diner, likely from the mid-20th century. It's a black and white photograph, and the details suggest a focus on daily life and social interaction within the establishment.

People and Interaction:

  • Customer: A man is seated at the counter, facing the viewer and eating. He is dressed in a suit or jacket and appears to be enjoying his meal.
  • Server: A person is behind the counter, seemingly attending to the customer.
  • Another man: dressed in a white uniform, standing by the counter and interacting with the server.

Setting and Details:

  • Counter and Seating: The diner features a marble-topped counter with stools for seating.
  • Food and Beverages: There's a display of menu items, including "PEP PEP PEP," and a sign advertising Heinz Baked Beans, suggesting the type of food served. A Coca-Cola cooler is prominently displayed.
  • Coca-Cola Advertising: Coca-Cola signage and advertising are strategically placed throughout the diner.
  • Atmosphere: The scene is lit with some fluorescent lights above the counter, and the atmosphere seems casual and inviting.
  • Style: The photograph is in a style consistent with documentary or candid photography, likely from the mid-20th century, reflecting the era's aesthetic and social context.

Overall Impression:

The photograph evokes a sense of nostalgia, capturing a snapshot of a typical diner experience from the past. The image is full of detail, reflecting the business of the time.

Created by gemini-2.0-flash on 2025-04-29

The image is a black and white photo of a diner scene. A man in a suit is sitting at the counter, eating a meal. Across the counter, a female diner employee wearing a white uniform stands behind the counter, smiling. A man in a police uniform is standing next to her, with his back to the viewer.

The diner has a classic look, with a marble-topped counter and spinning stools. Various food items are displayed behind the counter, including jars of Heinz Baked Beans, and shelves of condiments and spices. There are also Coca-Cola advertisements displayed throughout the diner. A menu on the wall lists various ice cream flavors.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

This black-and-white photograph depicts a scene inside a vintage soda fountain or diner. The setting appears to be from the mid-20th century, judging by the attire and the decor.

In the foreground, there is a counter with a marble top, behind which two employees are standing. They are both dressed in white uniforms, which include white caps and jackets with black buttons. The employee on the left is leaning on the counter, while the one on the right is standing upright.

On the other side of the counter, a customer is seated, facing the employees. The customer is wearing a coat and appears to be engaged in conversation with the employee on the left.

The background features various vintage advertisements and signs, including a prominent Coca-Cola sign and another for Pepsi-Cola. There are also shelves stocked with bottles and cans of different beverages, and a menu board displaying food items such as sandwiches, sodas, and ice cream.

Additionally, there is a vintage soda fountain machine behind the counter, and a glass display case with baked goods labeled "Home Made Baked Beans." The overall ambiance suggests a nostalgic, old-fashioned eatery.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This black-and-white photograph depicts a scene from what appears to be a diner or café. The focal point is a counter where a customer is seated, engaged in conversation with a server wearing a white uniform and hat, who is standing behind the counter. The customer, dressed in a jacket, is holding a drink and appears to be listening to the server.

The counter is well-stocked with dishes and cups, suggesting it is a place where food and beverages are served. A large "Baked Potato" container is prominently displayed on the counter. Above the counter, there are shelves with various items such as packaged goods, and signage advertising products like Coca-Cola and Pepsi. The background features a banner with the Coca-Cola logo and a decorative element, enhancing the vintage diner vibe.

The overall atmosphere of the image suggests a casual, possibly mid-20th-century setting, with the monochrome style giving it a nostalgic feel.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph captures a lively scene inside a vintage soda shop or diner. The setting appears to be from the mid-20th century, likely the 1940s or 1950s, based on the style of clothing and the design of the equipment.

In the foreground, a man is seated at the counter, drinking from a glass. He is wearing a suit jacket and appears to be enjoying his beverage. Behind the counter, two individuals are working. One is a woman wearing a white chef's uniform, smiling and engaged in conversation with the customer. The other is a man also dressed in a white chef's uniform, attending to a customer on the right side of the counter.

The background is filled with various food and drink items, including bottles of Coca-Cola, a display of cakes, and other condiments. The Coca-Cola branding is prominent, with signs and logos visible throughout the scene. There are also signs for PEP (a soda brand) and other products, adding to the nostalgic atmosphere of the diner. The overall mood of the image is cheerful and bustling, capturing a moment of everyday life in a classic American diner.

Text analysis

Amazon

ICE
ICE COLD
COLD
PEP
FOR
1579
15793
Chocolate
as
SOUPS
BAKED
Coca-Cola
CREAM
KEINZ
1579 3
DELICIOUS
SHARPLESS
5
BEANS
Serving
3
COFFEE
Malted
PEP EF PEP PEP
308
PEP PEE
BLACKSTONE
Chocolate Malted We
DE CREAM
-
PEE
MADE
STRAWBERRY
Borden's
EF
PECAN
AND
FOR GALIS AND EO DRIVE
DE
any Borden's
EO
FUOGE
We
VANIKIC
DRIVE
any
SKINA
LE
GALIS

Google

15793- CocaCola Coca-Cola ESTRAW PEP EP PEP PEP FOR GELP AD EO DR Chocolate Maed M AN a Bendenis KEINZ SOUPS PEP PERICE SHARPLESS CREAM EE OWL 154 CocaCola ICE COLD BAKED BEANS 15793
15793-
CocaCola
Coca-Cola
ESTRAW
PEP
EP
FOR
GELP
AD
EO
DR
Chocolate
Maed
M
AN
a
Bendenis
KEINZ
SOUPS
PERICE
SHARPLESS
CREAM
EE
OWL
154
ICE
COLD
BAKED
BEANS
15793