Human Generated Data

Title

Untitled (waitress taking the order of three women in a booth at a diner)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4891

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (waitress taking the order of three women in a booth at a diner)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4891

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.4
Person 99.4
Person 99.2
Person 99.1
Interior Design 92.7
Indoors 92.7
Crowd 68.7
Art 68.5
People 63.3
Restaurant 57.9
Clothing 56
Apparel 56
Dating 55.1

Clarifai
created on 2023-10-26

people 99.8
group 98.3
adult 96.6
woman 96.5
man 94.1
monochrome 93.4
group together 93.2
recreation 92.6
child 91.8
music 89.8
administration 89.6
many 89.2
war 88.5
boy 86.5
several 82.4
military 81.7
leader 81.1
vehicle 80.1
wear 80
sit 77.9

Imagga
created on 2022-01-23

musical instrument 39.7
wind instrument 34.2
sax 33.3
stage 29.9
man 29.6
person 25
accordion 23.6
male 23.4
people 21.2
adult 19.9
keyboard instrument 19.7
platform 18.7
businessman 18.5
business 18.2
group 16.9
musician 15.2
job 14.2
silhouette 14.1
teacher 13.8
classroom 13
music 12.7
black 12.6
rock 12.2
blackboard 11.9
laptop 11.8
education 11.3
men 11.2
student 10.9
sky 10.8
singer 10.8
team 10.7
concert 10.7
professional 10.6
class 10.6
chair 10.6
computer 10.4
youth 10.2
work 10.2
brass 10.1
school 9.9
modern 9.8
success 9.7
musical 9.6
room 9.2
board 9
oboe 9
performer 8.9
technology 8.9
bass 8.8
working 8.8
device 8.8
symbol 8.8
guitar 8.6
player 8.6
life 8.2
executive 7.9
boy 7.8
students 7.8
portrait 7.8
sitting 7.7
performance 7.7
studio 7.6
sign 7.5
happy 7.5
style 7.4
office 7.2
lifestyle 7.2
copy space 7.2
art 7.2
women 7.1
night 7.1
cornet 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.2
person 93
clothing 89.1
drawing 87.9
old 79.4
black and white 79.3
man 71.2
cartoon 70.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 98.5%
Happy 76.3%
Surprised 11.8%
Fear 3.4%
Disgusted 2.8%
Confused 2.5%
Sad 1.1%
Calm 1%
Angry 0.9%

AWS Rekognition

Age 28-38
Gender Male, 97.1%
Surprised 88.3%
Calm 7.6%
Fear 1.7%
Disgusted 0.8%
Angry 0.7%
Confused 0.4%
Happy 0.4%
Sad 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Calm 99%
Surprised 0.5%
Sad 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.5%
Person 99.4%
Person 99.4%
Person 99.2%
Person 99.1%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-18

a photograph of a woman in a hat and a woman in a dress -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a diner scene, featuring a waitress and four customers.

In the foreground, the waitress stands on the left side of the image, wearing a white dress with a dark apron and a hat. She holds a tray with a glass and a bottle on it. The four customers sit at a table to the right, facing the waitress. They are all dressed in casual attire, with the two women in the center wearing dresses and the two men on the right wearing shirts and pants. The table is set with glasses, plates, and silverware.

In the background, there is a mural on the wall depicting a landscape with cows and mountains. The atmosphere appears to be lively and social, with the customers engaged in conversation and the waitress attending to their needs. The overall mood of the image is one of warmth and hospitality, capturing a moment of everyday life in a diner during the mid-20th century.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of four women in a diner. The woman on the left is wearing a waitress uniform and holding a menu. She has blonde hair styled in an updo with a headband. The three women on the right are seated at a table, all with blonde hair. The woman in the middle is wearing a white shirt, the woman on the right is wearing a dark top, and the woman partially visible behind them is wearing a dark dress.

The table has various items on it, including bottles, cups, and plates. In the background, there is a mural on the wall depicting horses in a field. The overall atmosphere suggests a casual gathering or social event.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-05

The image is a black-and-white photograph that appears to be from the mid-20th century. The scene is set in a restaurant or dining area, with a large mural on the wall behind the diners. The mural depicts a pastoral landscape with cows grazing and a serene countryside. The photo captures a moment of interaction among the diners, with a woman standing at a table holding a menu or a piece of paper, likely explaining the menu to the seated customers. The seated customers are engaged in conversation, with one woman looking directly at the standing woman. The atmosphere is casual and friendly, suggesting a relaxed dining experience.

Created by amazon.nova-pro-v1:0 on 2025-06-05

The black-and-white image shows a group of people in a restaurant. The woman in the middle is standing, wearing a uniform and an apron, and seems to be talking to the people sitting on the chairs. The people sitting on the chairs are listening to her, and they seem to be looking at her. There are bottles and glasses on the table. Behind them is a wall with a painting of cows.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

Overall Scene: The photograph captures a scene inside a diner or restaurant, likely from the mid-20th century, given the style and atmosphere. The image is a negative, which means light and dark values are inverted.

Main Elements:

  • Server: A female server, wearing a uniform with an apron and a cap, is the central figure. She appears to be taking an order, holding a pad and pen. She has a friendly expression, and there is a small floral arrangement pinned to her uniform.
  • Customers: Three female customers are seated at a table. They are interacting with the server. They are also looking forward to the waitress and talking to her.
  • Table Setting: The table is set with glasses, plates, and bottles, suggesting a casual dining experience.
  • Background: The backdrop is a mural painted on the wall. It depicts a pastoral scene with cows.
  • Booth: A classic booth with a white seat is visible on the right side.
  • Other Details: A coat rack is visible above the server.

Atmosphere: The scene suggests a convivial and social atmosphere, typical of a diner or restaurant. The image appears to be a candid shot. The overall mood evokes a sense of nostalgia.

Created by gemini-2.0-flash on 2025-05-18

The black-and-white photograph shows a waitress taking orders in what appears to be a restaurant. The waitress is standing to the left of a table where four women are sitting. She is smiling and writing on a notepad. The women at the table are looking at her, and there is a bottle of Heinz ketchup on the table in front of them. Behind the table, there is a mural on the wall depicting cows in a pasture. The lighting in the photo is soft and diffused, creating a nostalgic and pleasant atmosphere. The image is from what looks like a negative, so the colors are inverted.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-31

The image is a black-and-white photograph depicting a group of women in a dining or social setting. The scene appears to be inside a train car, as suggested by the design and layout. The interior features a mural on the wall depicting a landscape with animals, including what appear to be deer or antelope.

In the foreground, a woman in a uniform, possibly a waitress or attendant, is holding a small wooden chair and seems to be interacting with the other women seated at a table. The table is set with various items, including bottles and glasses, suggesting they might be enjoying a meal or drinks.

The women at the table are dressed in fashionable attire of the time, with styled hair and accessories such as necklaces and earrings. They appear to be engaged in conversation or reacting to the waitress's actions. The overall atmosphere seems lively and social.

The photograph has a vintage feel, likely from the mid-20th century, given the style of clothing and the black-and-white format. The image number "H16008" is visible at the top and bottom, indicating it might be part of an archived collection.

Text analysis

Amazon

H16008.
H16008
form

Google

HI6008. H16008.
HI6008.
H16008.