Human Generated Data

Title

Untitled (couple seated at counter of Heinz Company Restaurant, PA)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11769

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated at counter of Heinz Company Restaurant, PA)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11769

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.5
Indoors 83.2
Shelf 68.8
Clothing 67.7
Apparel 67.7
Sink 57.2

Clarifai
created on 2023-10-26

people 98.8
furniture 97.2
room 97
adult 96.1
indoors 95.8
monochrome 95.7
man 95.4
chair 94.5
scientist 94.3
woman 94.2
desk 92.6
group 92.1
two 88.4
seat 88.3
one 85.9
sit 85.7
science 84.5
education 83.2
technology 83.1
hospital 82

Imagga
created on 2022-01-15

table 44.8
office 39.1
desk 38.4
interior 32.7
room 30.1
computer 29.7
work 28.3
business 28
indoors 26.4
furniture 25.4
man 24.2
people 23.4
working 23
home 22.3
professional 19.8
modern 19.6
counter 19
person 18.8
laptop 18.1
restaurant 18.1
adult 17.7
technology 16.3
happy 16.3
meeting 16
smiling 15.9
house 15.9
chair 15.7
male 15.6
kitchen 15.1
communication 15.1
education 14.7
worker 14.2
job 14.2
monitor 14.1
businessman 14.1
corporate 13.8
lifestyle 13.7
shop 13.5
sitting 12.9
occupation 12.8
businesswoman 12.7
equipment 12.6
salon 12.1
case 12.1
executive 12
inside 12
indoor 11.9
smile 11.4
keyboard 11.4
design 11.3
floor 11.2
screen 10.8
building 10.6
workplace 10.5
group 10.5
businesspeople 10.4
men 10.3
center 10.1
light 10
television 10
suit 9.9
furnishing 9.9
decor 9.7
comfortable 9.6
elegance 9.2
confident 9.1
success 8.9
women 8.7
structure 8.7
notebook 8.6
glass 8.6
hospital 8.4
hand 8.4
coffee 8.3
luxury 7.7
college 7.6
presentation 7.4
style 7.4
teamwork 7.4
classroom 7.4
phone 7.4
food 7.3
barbershop 7.3
student 7.2
decoration 7.2
teacher 7.2
school 7.2
team 7.2
handsome 7.1
information 7.1
appliance 7.1
seat 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99
wall 98.9
indoor 96.7
black and white 94.9
person 62.7
white 62
computer 58.7
table 30.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 11-19
Gender Male, 97.2%
Calm 66.4%
Sad 28.1%
Angry 2.9%
Disgusted 1.3%
Happy 0.4%
Confused 0.4%
Surprised 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person
Hat

Clarifai

No features identified

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 82.1%

AWS Rekognition

Hat 67.7%

Categories

Imagga
created on 2022-01-15

interior objects 88.4%
pets animals 4.9%
people portraits 1.9%
paintings art 1.5%
streetview architecture 1.5%
food drinks 1.1%

Captions

Microsoft
created by unknown on 2022-01-15

a person sitting on a kitchen counter 44.6%
a person sitting on a counter 44.5%
a person standing in a kitchen 44.4%

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a man and woman in a restaurant

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts a black and white negative photograph of a retro diner or lunch counter scene. A man dressed in a suit and hat is standing next to a woman with curled hair, who appears to be wearing a blouse. On the counter, there are bowls, possibly containing food or soup, along with an assortment of utensils and condiments, such as Heinz ketchup bottles. A menu display featuring various Heinz soups is prominently visible, listing options such as vegetable, cream of mushroom, and clam chowder. The background includes a booth area with customers seated, enhancing the vintage diner atmosphere. Several reflective elements, like coffee pots and glass panes, add detail to the setting.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image shows a man and a woman standing at a counter in a diner or a café. The man is wearing a suit and hat, and the woman is wearing a blouse or a dress with curly hair. They appear to be having a conversation while holding bowls. On the counter, there are Heinz condiments such as ketchup bottles and jars of mustard, along with a soda fountain spigot. In the background, there is a display of Heinz soups with a sign listing various soup flavors, including vegetable, chicken noodle, cream of mushroom, and clam chowder. The setting appears to be vintage, likely from the mid-20th century, based on the clothing and décor. Mirrors on the walls reflect the room, adding depth to the scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image shows the interior of what appears to be a diner or restaurant. There are two people visible - a man wearing a hat and suit, and a woman with curly hair. They are standing behind a counter, which has various food items and condiments displayed on it. The background includes shelves and other restaurant equipment. The overall scene suggests this is a typical diner or cafe setting from an earlier time period, likely the mid-20th century based on the style and attire of the individuals.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-16

The black and white image shows two people in a 1930s era diner or soda fountain. The man, wearing a white coat and hat, appears to be the soda jerk or server behind the counter. He is interacting with a female customer sitting at the counter. The counter has various items on display, including jars and a menu board listing vegetable, corn chowder, and cream of tomato soups. The decor and setup is typical of an American diner from that time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This is a black and white historical photograph showing a Heinz soup counter or display. Two customers are seated at what appears to be a diner or lunch counter, with a display of Heinz products visible on the left side, including what looks like stacked cans or containers. The man is wearing a light-colored suit and hat, and is seated next to a woman in darker clothing. There's a menu board visible that lists various Heinz soups including "Vegetable" and other varieties. The setting appears to be from perhaps the 1930s or 1940s based on the style and composition of the photograph. The counter setup and product display suggests this might be a promotional or demonstration area for Heinz products in a store or restaurant setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a man and woman standing behind a counter in a restaurant. The man is wearing a white suit jacket and a fedora hat, while the woman has short blonde hair and is wearing a dark-colored blouse. They are both looking down at the counter, where there are several bowls and cups.

To the left of the counter, there is a sign that reads "Heinz Soups" and lists various soup options. There are also several cans of soup on the counter, as well as a coffee maker and other kitchen utensils. In the background, there are tables and chairs set up for dining, as well as a few people sitting at the tables.

The overall atmosphere of the image suggests that it was taken in the 1940s or 1950s, based on the clothing and hairstyles of the people in the photo. The image appears to be a promotional photograph for Heinz Soups, showcasing the variety of soups available and the friendly service of the restaurant staff.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

The image depicts a black-and-white photograph of a man and woman sitting at a counter in a diner. The man is dressed in a suit, tie, and fedora, while the woman wears a dark blouse. They are seated on stools, facing each other, with the counter between them. On the counter, there are two bowls, a bottle of ketchup, and a salt shaker.

Behind the counter, a sign displays the menu, which includes soups such as vegetable, corn chowder, chicken noodle, cream of mushroom, old-fashioned bean, vegetable beef, genuine turtle, clam chowder, and cream of pea. To the left of the sign, a display case showcases various Heinz products, including soups and condiments.

In the background, the diner's interior is visible, featuring tables and booths. The overall atmosphere suggests a casual dining setting, likely during the mid-20th century.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The image is a black-and-white photograph of a man and a woman standing at a counter in what appears to be a restaurant or a soup kitchen. The man is wearing a hat and a white suit, while the woman is wearing a long-sleeved blouse. They are both looking at something on the counter, possibly a menu or a food item. Behind them, there is a shelf with canned goods and a sign that reads "Heinz Soups."

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image shows a black-and-white photograph of a man and a woman standing behind a counter in a restaurant. The man is wearing a hat and a suit, while the woman is wearing a dress. They are both looking at the camera and smiling. On the counter, there are various items, including a bowl, a bottle, a cup, and a can. Behind them, there is a shelf with canned goods, and on the wall, there is a sign with the text "Heinz Soups."

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a vintage black and white photograph depicting a couple seated at a lunch counter in what appears to be a diner or soda fountain. The man is dressed in a suit with a hat, while the woman is wearing a jacket and has a short, curly hairstyle. They are both looking at something on the counter in front of them.

Behind the counter, there's a display featuring cans of Heinz soups, indicating the establishment serves soup. The menu above the soup cans lists various flavors, including vegetable, corn chowder, chicken noodle, and cream of mushroom. There are also vintage soda fountain fixtures visible, like a tall drink dispenser and various condiments.

The overall setting suggests a scene from the mid-20th century, capturing a moment of everyday life in a classic American diner setting. The contrast and lighting give the photograph a distinct vintage feel.

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

Overall Scene: The photograph captures a scene inside a vintage diner or restaurant. The lighting is a bit unusual, as the image seems to be a negative. The central focus is on a couple, a man and a woman, seated at a counter.

Key Elements:

  • Couple: The man, wearing a fedora and a light-colored suit, is looking down at something, possibly a menu or his plate. The woman, with wavy hair, faces the man, and appears to be engaged in conversation.
  • Counter: They're seated at a counter that extends across the frame. On the counter, there are bowls (likely for soup), condiment bottles (Heinz ketchup and potentially others), and a small glass dispenser.
  • Soup Display: Behind the counter is a display case or shelf featuring cans of Heinz soup. A sign above lists the soup varieties available, including "Vegetable," "Corn Chowder," "Chicken Noodle," "Cream of Tomato," "Cream of Mushroom," and more.
  • Background: In the background, there is a service area or possibly another dining area. There is also a small sink and some additional details like a small glass dispenser.
  • Reflections/Mirrors: There are reflections in the background that seem to depict more images of customers.

Atmosphere: The photograph has a retro feel. It suggests a simple and classic diner setting, possibly from the mid-20th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image is a black-and-white photograph depicting a scene that appears to be a promotional or demonstration setup for Heinz Soups. Two individuals, a man and a woman, are seated at a counter in what looks like a kitchen or a small dining area. The man is wearing a suit and a hat, while the woman is dressed in a coat or jacket. They are both engaged in eating soup from bowls.

Behind them, there is a display of Heinz Soup cans arranged on a shelf, along with a signboard listing various types of soups available, such as Vegetable, Cream of Tomato, Chicken Noodle, Cream of Celery, Cream of Mushroom, Oxtail, Vegetable Beef, Clam Chowder, and Mock Turtle. The counter has several items on it, including a pitcher, a bottle of Heinz Worcestershire Sauce, and other utensils. The setting suggests a promotional event or a demonstration for Heinz products, likely from the mid-20th century based on the clothing and style of the photograph.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-04

This is a black-and-white photograph of a vintage scene set in what appears to be a diner or a casual eatery. The image shows two individuals seated at a counter. The man, wearing a suit and hat, is holding a saucer and seems to be engaged in a conversation with the woman seated across from him. The woman, dressed in a dark jacket, is also holding a saucer and appears to be looking at the man, possibly listening to him.

The counter is equipped with various condiments and dining utensils, including bottles of ketchup and mustard, and there are several bowls and plates on the counter. Behind the counter, there is a display of Heinz soup cans and a small refrigerator stocked with more cans. The background includes a menu board listing different Heinz soup flavors and a mirror reflecting part of the scene. The overall atmosphere is casual and suggests a mid-20th-century setting, given the attire and the style of the photograph.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-04

This black-and-white image depicts a vintage diner or lunch counter scene, likely from the mid-20th century. A man in a white suit and hat is seated at the counter, engaged in conversation with a woman who has short, wavy hair and is wearing a dark jacket. The counter is equipped with various condiments and a menu board displaying "Heinz Soups" with a list of soup options. Behind the counter, there is a sink and a faucet. The background shows framed pictures on the wall and a mirror reflecting part of the diner. The overall atmosphere suggests a casual, social setting typical of mid-20th century American diners.

Text analysis

Amazon

HEINZ
OLD
CLAM
TURTLE
NOODLE
PS
CHICKEN NOODLE
PEA
CREAM
CHICKEN
OLD FASHIONED BEAN
119351.
SOL PS
FASHIONED
TWO
SOL
BEAN
TOMATO
VEGETABLE
GENUINE
OF
CLAM CHOWDER
CHOWDER
MUSHROOM
CORN CHOWDER
BEEF
CH
CORN
CREAM CH
OMATO
CREAM OF MUSHROOM
NAMTSAT
ETCHUP
PLAY

Google

11935 1. HEINZ SOLPS TWO G VEGETONLE CORN CHOWDER CHICKEN NOODLE CREAM OF TOMATO CREAM OF MUSHROCM OLD FASHIONED BEAN VEGETABLE BEEF GENUINE TURTLE CLAM CHOWDER CREAM OF PEA MEIN? MA 119 351.
11935
1.
HEINZ
SOLPS
TWO
G
VEGETONLE
CORN
CHOWDER
CHICKEN
NOODLE
CREAM
OF
TOMATO
MUSHROCM
OLD
FASHIONED
BEAN
VEGETABLE
BEEF
GENUINE
TURTLE
CLAM
PEA
MEIN?
MA
119
351.