Human Generated Data

Title

Untitled (waitress holding Heinz products behind diner counter)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4890

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress holding Heinz products behind diner counter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4890

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.8
Human 99.8
Person 99.8
Person 99.6
Person 99.6
Person 97.7
Person 88.7
Restaurant 84.6
Interior Design 84.5
Indoors 84.5
Chair 82.1
Furniture 82.1
Room 81.5
Shop 78.4
Bakery 71.7
Meal 71
Food 71
Workshop 67.9
Cafeteria 63.7
Cafe 58

Clarifai
created on 2023-10-26

people 99.7
adult 98.6
monochrome 98.6
woman 98.3
man 95.9
indoors 95
sit 93.9
child 90.2
horizontal 85.8
chair 85.6
education 83.9
furniture 81.6
group 78.1
sewing machine 74.9
department store 73.6
administration 73.4
teacher 73
concentration 72.6
room 72.4
barber 72.1

Imagga
created on 2022-01-23

man 41
people 37.4
male 35.5
office 32.3
person 30.5
businessman 29.1
room 28.8
business 28.6
meeting 27.3
clinic 27.3
table 27
adult 26.7
professional 26.6
work 25.9
team 25.1
working 23.9
indoors 23.7
businesswoman 23.6
shop 23.6
men 23.2
group 22.6
happy 22.6
teamwork 21.3
computer 20.8
restaurant 20.7
colleagues 20.4
smiling 20.3
desk 20.1
businesspeople 19
sitting 18.9
job 18.6
salon 18.2
women 18.2
hospital 16.9
worker 16.7
occupation 16.5
patient 16.3
counter 16.2
nurse 16.2
smile 15.7
corporate 15.5
suit 15.3
executive 15
mercantile establishment 14.8
casual 14.4
communication 14.3
interior 14.2
together 14
education 13.9
lifestyle 13.7
laptop 13.7
40s 13.6
discussion 13.6
classroom 13.6
modern 13.3
talking 13.3
medical 13.2
cheerful 13
portrait 12.9
indoor 12.8
doctor 12.2
couple 12.2
manager 12.1
mature 12.1
technology 11.9
conference 11.7
success 11.3
chair 11.2
barbershop 11.2
day 11
hall 10.6
four 10.5
home 10.4
employee 10.1
20s 10.1
color 10
place of business 9.8
mid adult 9.6
adults 9.5
presentation 9.3
horizontal 9.2
building 9.1
health 9
discussing 8.8
teacher 8.8
30s 8.7
senior 8.4
attractive 8.4
board 8.1
light 8
looking 8
coworkers 7.9
workers 7.8
bakery 7.7
life 7.7
ethnic 7.6
inside 7.4
equipment 7.4
waiter 7.2
to 7.1
medicine 7

Google
created on 2022-01-23

Outerwear 95.1
Shirt 94.9
Photograph 94.3
Black 89.7
Black-and-white 84.9
Style 83.8
T-shirt 79
Font 77.6
Monochrome photography 75.4
Snapshot 74.3
Monochrome 74.1
Cooking 73
Art 72.2
Service 71.2
Chair 70.3
Table 69.7
Machine 68
Job 67.8
Room 64.6
Stock photography 64.4

Microsoft
created on 2022-01-23

text 99.6
indoor 98.4
person 95.2
kitchen 94.9
clothing 91.5
fast food 73.6
food 70
table 67.8
woman 58.7
black and white 53.4
preparing 42

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 98.1%
Calm 87.4%
Surprised 9.7%
Confused 0.9%
Angry 0.7%
Happy 0.6%
Disgusted 0.4%
Fear 0.2%
Sad 0.2%

AWS Rekognition

Age 34-42
Gender Female, 89.1%
Happy 98.4%
Calm 1.4%
Surprised 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Sad 0%
Fear 0%

AWS Rekognition

Age 50-58
Gender Female, 96.7%
Calm 98.1%
Happy 1%
Angry 0.3%
Disgusted 0.1%
Sad 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Male, 94.1%
Calm 46.7%
Sad 21.1%
Confused 19.1%
Angry 4.4%
Surprised 3.7%
Happy 2.6%
Disgusted 1.5%
Fear 0.8%

AWS Rekognition

Age 30-40
Gender Female, 52%
Happy 87.4%
Calm 4.3%
Confused 2.7%
Sad 2.5%
Surprised 1%
Angry 0.9%
Disgusted 0.6%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99.8%
Person 99.8%
Person 99.6%
Person 99.6%
Person 97.7%
Person 88.7%
Chair 82.1%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-18

a photograph of a woman in a uniform is standing in a restaurant -100%

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a black and white negative print of a vintage photograph, likely from the mid-20th century, depicting a scene inside a diner or lunch counter.

A waitress wearing a uniform and nurse hat stands behind the counter holding up two jars, possibly condiments or sauces. Behind her, there is a display of various products, including Heinz condiments, arranged on shelves. A sign advertises "Heinz Baked Beans," "Frankfurters," "Relish," and "Coffee" for 25 cents.

To the right of the waitress, there is a counter with several people seated and eating. The food appears to be pies, soup, and perhaps sandwiches. Behind the counter, there is an employee in a white uniform. A display case holds pies or pastries.

The overall impression is that of a busy but well-maintained diner, capturing a moment in time with its distinct style and offerings.

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

The image is a black and white negative, depicting a scene inside what appears to be a small diner or lunch counter.

Here's a breakdown:

  • Scene: A waitress in a uniform and a cap stands in front of the counter. She's holding items, possibly for a customer. A man is standing in front of the counter, looking towards the waitress. In the foreground, two people are seated at a small table, eating. The counter features shelves with condiments (Heinz bottles are visible).
  • Context: Signage indicates that the establishment serves "Heinz" soups, "baked beans" "frankfurters" and "relish coffee".
  • Details: The backdrop is an art deco interior with a service counter. The scene has an atmosphere of mid-20th-century.
  • Overall Impression: The photograph captures a snapshot of everyday life.

Text analysis

Amazon

SOUPS
HEINZ
RELISH
RELISH COFFEE
COFFEE
BEANS
HEINZ BAKED BEANS
BAKED
FRANKFURTERS
CREAM
-
25c
H 16002 .
COUNTIY -
H16002
CENTINE CREAM TERTIE
ORSAN
COUNTIY
BOOKLE
CENTINE
MUSICA BOOKLE
CHUCHEN
BK
TERTIE
MUSICA
wowan

Google

HI6002. HEINZ SOUPS D FA A ate RAKED BEANS FRANKFURTERS RELISH COFFEE HT6002.
HI6002.
HEINZ
SOUPS
D
FA
A
ate
RAKED
BEANS
FRANKFURTERS
RELISH
COFFEE
HT6002.