Human Generated Data

Title

Untitled (women working behind counter of restaurant with Heinz products)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11972

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (women working behind counter of restaurant with Heinz products)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11972

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.5
Restaurant 98.8
Cafeteria 89.7
Cafe 89.5
Clothing 89.1
Apparel 89.1
Meal 78.8
Food 78.8
Shop 60.6
Food Court 60
Chair 58.8
Furniture 58.8
Workshop 57.9
Shorts 55.4
Urban 55.2

Clarifai
created on 2023-10-25

people 99.8
monochrome 99.3
group 96.9
adult 96.1
man 96.1
barber 95.7
woman 95.4
commerce 93.9
group together 90.9
street 89.7
child 89.1
employee 85.5
several 83.9
two 82.4
sit 82
three 82
many 81
education 81
recreation 80.9
vehicle 80.2

Imagga
created on 2022-01-15

newspaper 89.3
product 67
creation 52
man 32.2
business 31.6
office 31.5
people 30.1
male 29.1
businessman 27.4
room 27.3
computer 24.9
classroom 24.7
work 23.5
person 23.4
shop 21.9
job 19.5
adult 18.2
technology 17.8
men 17.2
indoors 16.7
laptop 16.6
barbershop 16.4
working 15.9
occupation 15.6
daily 15.3
looking 15.2
manager 14.9
sitting 14.6
mercantile establishment 14.6
group 13.7
indoor 13.7
building 13.5
desk 13.5
modern 13.3
corporate 12.9
education 12.1
casual 11.9
horizontal 11.7
class 11.6
worker 11.6
happy 11.3
screen 11.2
teamwork 11.1
executive 11
professional 10.7
center 10.6
success 10.5
old 10.4
senior 10.3
mature 10.2
black 10.2
lifestyle 10.1
businesswoman 10
team 9.9
table 9.7
portrait 9.7
place of business 9.7
together 9.6
monitor 9.6
couple 9.6
meeting 9.4
writing 9.4
smiling 9.4
architecture 9.4
communication 9.2
phone 9.2
back 9.2
hand 9.1
holding 9.1
teacher 9
home 8.8
studying 8.6
chart 8.6
one person 8.5
finance 8.4
house 8.4
board 8.1
handsome 8
financial 8
chair 8
women 7.9
circuit 7.8
engineer 7.8
face 7.8
30s 7.7
project 7.7
industry 7.7
employee 7.6
customer 7.6
two 7.6
college 7.6
businesspeople 7.6
restaurant 7.5
student 7.4
school 7.3
counter 7.2
to 7.1
day 7.1

Google
created on 2022-01-15

Photograph 94.3
Black 89.8
Black-and-white 87.2
Style 84
Chair 82
Table 81.8
Picture frame 75.8
Monochrome 75.4
Font 75.3
Monochrome photography 75.3
Beauty 74.9
Snapshot 74.3
Art 71
Customer 70.9
Room 70.4
Design 68.6
Event 67.8
T-shirt 64.8
Stock photography 64
Job 63.3

Microsoft
created on 2022-01-15

text 99.8
clothing 97.8
person 95.2
man 87.1
people 82
woman 78.5
newspaper 67.9
street 62.5
black and white 53.4
store 47.8
shop 15.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 97.2%
Calm 91.9%
Sad 5.1%
Happy 1.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.3%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Hat

Clarifai

No features identified

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 76.4%

AWS Rekognition

Person 47.7%

AWS Rekognition

Hat 76.7%

Categories

Imagga
created on 2022-01-15

streetview architecture 87.4%
beaches seaside 5.7%
paintings art 2.4%
text visuals 1.3%

Captions

Salesforce

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image depicts a vintage diner or cafe setting with customers seated at the counter and servers behind it. The counter displays various food items, beverages, and advertisements, such as signs for Heinz soups and ice cream flavors. Shelves are stocked with products, jars, and equipment. The scene emanates a classic mid-century atmosphere, featuring neatly dressed servers interacting with patrons, suggesting a bustling yet orderly dining environment.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a vintage diner or soda fountain scene. There are three customers seated at the counter, a man and two women. The woman closest to the foreground is wearing a hat with a veil. Behind the counter, there is an assortment of items, including stacked dishes, Heinz soup containers, and an ice cream menu advertising flavors such as vanilla, chocolate, pineapple, and more, priced at 15 cents. Two workers are present behind the counter, both in classic diner uniforms, engaged in serving or preparing food and drinks. Various equipment and products, such as a coffee maker and a dispenser, are visible, indicating a busy and well-stocked establishment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to be a black and white photograph of the interior of an ice cream parlor or similar establishment. The scene shows several people, including a woman standing behind the counter, who appears to be serving or assisting customers. The counter is filled with various ice cream and dessert items, as well as other products for sale. The overall atmosphere suggests a bustling, lively environment, with people engaged in various activities within the store.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be from a diner or lunch counter, likely from the 1950s. The image shows the interior of what looks like a typical American diner, with customers seated at the counter and staff behind it. The counter display features Heinz soups advertisements and various products on shelves. The setup appears to be a typical mid-century American dining establishment with its characteristic counter service style. The staff are wearing typical diner uniforms of the era with aprons, and customers are seated on counter stools. The decor and equipment visible in the image, including what appears to be drink dispensers and food service items, are characteristic of the time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a 1940s-style ice cream parlor, featuring a counter with two women in aprons serving customers. The counter is well-lit and has a variety of items on display, including ice cream flavors, soups, and other treats.

  • Counter and Customers
    • The counter is the central focus of the image, with two women in aprons standing behind it.
    • The women are dressed in 1940s-style uniforms, complete with aprons and hairnets.
    • The counter is well-lit, with a warm glow emanating from the lights above.
    • There are several customers seated at the counter, all facing away from the camera.
  • Ice Cream Flavors
    • The ice cream flavors are displayed on a sign above the counter, with a variety of options available.
    • The flavors include classic choices like vanilla, chocolate, and strawberry, as well as more unique options like pineapple and orange.
    • The sign also features a picture of an ice cream cone, adding to the nostalgic feel of the image.
  • Soups
    • The soups are displayed on a separate sign, with a variety of options available.
    • The soups include classic choices like chicken noodle and vegetable soup, as well as more unique options like clam chowder and tomato soup.
    • The sign also features a picture of a bowl of soup, adding to the cozy atmosphere of the image.
  • Other Treats
    • The counter also features a variety of other treats, including cakes, pies, and cookies.
    • The treats are displayed on a tray or in a glass case, adding to the sense of abundance and variety.
    • The treats are all neatly arranged and look delicious, making the viewer's mouth water.

Overall, the image is a charming and nostalgic portrayal of a 1940s-style ice cream parlor. The use of black and white photography adds to the retro feel of the image, while the well-lit counter and variety of treats on display create a sense of warmth and hospitality.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a diner, with two waitresses serving customers at the counter. The waitresses are dressed in uniforms, consisting of dark tops and white aprons, and have their hair styled in a curly fashion. One waitress is handing a tray to a customer, while the other is preparing drinks behind the counter.

In the foreground, three customers are seated at the counter, facing away from the camera. The customer on the left is wearing a light-colored shirt, while the middle customer is dressed in a checkered shirt and a hat. The customer on the right is wearing a dark shirt and a hat.

Behind the counter, various items are displayed, including a sign that reads "Heinz Soups" and lists different flavors, such as vanilla, coffee, chocolate, pineapple, orange ice, strawberry, and pecan. There are also several glass jars filled with ingredients, a coffee machine, and a cash register. The background of the image features a wall with a wood paneling design, adding to the nostalgic atmosphere of the diner.

Overall, the image captures a moment in time at a classic American diner, showcasing the friendly service and welcoming atmosphere that was characteristic of these establishments during their heyday.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image shows a black-and-white photograph of a restaurant or diner. The photo depicts a group of people sitting at a counter, with a waitress standing behind the counter. The waitress is wearing a uniform and a hat, and she appears to be serving food or drinks to the customers. There are various items on display behind the waitress, including bottles, cups, and a menu board. The image has a nostalgic and vintage feel, with a slightly blurry and grainy quality.

Created by amazon.nova-pro-v1:0 on 2025-06-06

A black-and-white photo of a counter in a restaurant with customers and waitresses. The counter has several items, including bottles, bowls, and cups. The waitresses are standing behind the counter, and one of them is holding a tray with a cup and saucer. The customers are sitting on the chairs in front of the counter. The photo has a watermark with the text "15807" on the bottom right.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

Here is a description of the image:

The image is a black and white photograph of a diner or soda fountain from what appears to be the mid-20th century. The scene is well-lit and captures a moment of everyday life.

Here's a breakdown of the elements:

  • Setting: The primary focus is on the counter of the diner. There's a long, mirrored surface, and patrons are seated on stools. Behind the counter, there are several service stations, likely for ice cream, drinks, and other food preparations.
  • People: There are several individuals in the image:
    • Two waitresses, dressed in uniforms, serve customers.
    • Three customers are seated at the counter. One woman is wearing a decorative head covering.
  • Details:
    • Signs for "Heinz Soups" advertising flavors at 15 cents.
    • A sign for "Ice Cream Flavors" listing various flavors.
    • Various glassware and equipment, including what looks like a cash register, dispensers, and coffee urns.
    • Shelves with decorations.
  • Overall Impression: The photograph evokes a sense of nostalgia. The composition, lighting, and subject matter contribute to a classic American scene.

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

This appears to be a black and white photograph, likely taken in a diner or soda shop, based on the setup and decor. The photo seems to be a negative image, with colors inverted.

Here are the key elements:

People:
-There are at least two customers seated at the counter. One is wearing a hat.
-There are two waitresses behind the counter.

Counter and Display:
-There is a prominent counter made of a decorative surface.
-Behind the counter, there are menus advertising "Heinz Soups" and "Ice Cream Flavors."
-There are rows of canned goods.

General Atmosphere:
-The setting appears to be from the mid-20th century, judging by the clothing and decor.
-The photo is clear and well-composed, capturing a typical scene from the era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a vintage soda fountain or lunch counter, likely from the mid-20th century. The setting appears to be inside a store or a diner, characterized by its classic design elements.

Key details include:

  1. Counter and Seating: Several people are seated at a counter, with stools visible. The counter is where food and beverages are being served.

  2. Staff: Two women, dressed in uniforms typical of the era (including aprons and possibly caps), are working behind the counter. One is interacting with a customer, while the other appears to be preparing something.

  3. Menu and Advertisements: There are signs advertising Heinz soups and various ice cream flavors such as vanilla, coffee, chocolate, pineapple, pecan, strawberry, and tutti-frutti. The prices are listed as 15 cents, indicating the time period.

  4. Decor and Ambiance: The decor includes various items on the counter and shelves, such as glass jars, containers, and possibly some decorative elements. The overall ambiance suggests a nostalgic, retro feel.

  5. Customers: The customers include a mix of individuals, some wearing hats, which was common attire for the time. They are engaged in ordering or eating.

The image captures a moment in time, reflecting the social and cultural aspects of dining out in a bygone era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

The image appears to be a black-and-white photograph depicting a scene from a diner or a similar food service establishment. The setting is indoors, with a counter where customers are seated. There are two women behind the counter, one of whom is serving food or drinks to the customers. The counter is stocked with various food items, including Heinz soups displayed on shelves, and an ice cream flavor sign is visible in the background. The customers are seated at the counter, and there are plates and cutlery visible in front of them. The overall atmosphere suggests a casual dining experience, typical of mid-20th century establishments. The image number "15807" is visible in the corners, indicating it is likely from a historical collection.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This black-and-white image depicts a bustling scene at a diner or a small restaurant, likely from the mid-20th century. The setting is characterized by a counter where patrons are seated, and staff members are serving them. The counter is lined with various items, including shelves stocked with Heinz soups and other canned goods, as well as a display of ice cream flavors such as pineapple, coffee, strawberries, pecan, orange, and pudding.

A woman behind the counter, wearing a light-colored dress and a white hair covering, is serving a customer. Another woman, standing further back, is also engaged in serving customers. She is wearing a dark dress and a light-colored apron. The customers at the counter are dressed in a mix of casual and work attire, suggesting a diverse clientele.

The overall atmosphere of the image conveys a sense of community and everyday life in a small-town setting. The presence of the Heinz soup advertisements and the ice cream flavors suggests that the diner is well-stocked with popular food items of the time. The image captures a moment of interaction between the staff and the customers, highlighting the social and economic aspects of daily life in this period.

Text analysis

Amazon

SOUPS
HEINZ
HEINZ SOUPS
15
CREAM
FLAVORS
Hot
15807
CHOCOLATE
CHICKEN
TOMATO
IDE CREAM FLAVORS
STRAWBERRY
Het
Large
-
CLAM
FASHIONED
COFFEE
Papiers Het
COUNTRY
IDE
Papiers
MUSHROOM
TRANSE
Large Boul
CREAM - MUSHROOM
Lange Baul 15
PECAN
ТЭТ
CHICKEN NOODLE
VEGETARIA
- CREAM und -
STALE CHICKEN
15c
Baul
BEAN
CLAM CHOWSER
CLUB FASHIONED BEAN
CREAM mL
CREAM CHICKEN - NOODS PM
Lange
TRANSE -
PHEAPPLE
CARAM d' TOMATO
Boul
Piping -2 Hot
Parksay
GROUP - -
FEE - CHOWLAN -
PM
A VEGETANI TOMATO - NORE
und
STALE
NOODLE
d'
VEGETARIE
Piping
GROUP
fair
ME
FEE
CARAM
SURTA
NOODS
Parkuray
NORE
Parking
GENUNE SURTA
VEGETANI
Parking THERE
CHOWSER
CLUB
mL
THERE
A
CHOWLAN
-2
GENUNE

Google

15807. HEINZ SOUPS HEINZ SOUPS ICE CREAM FLAVORS ALLA STRAE PAPPLE RAE CRAN OF MU oOM couNTRY STYLE CRCE CRRAM OF M PECAN VEGASABLE SMEF ran NS 15 807. •L08 5 HAGON-YT33A2-NAMTZA3
15807.
HEINZ
SOUPS
ICE
CREAM
FLAVORS
ALLA
STRAE
PAPPLE
RAE
CRAN
OF
MU
oOM
couNTRY
STYLE
CRCE
CRRAM
M
PECAN
VEGASABLE
SMEF
ran
NS
15
807.
•L08
5
HAGON-YT33A2-NAMTZA3