Human Generated Data

Title

Untitled (men in officer force restaurant, Federal Shipbuilding Corp., Kearny, NJ)

Date

1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12052

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men in officer force restaurant, Federal Shipbuilding Corp., Kearny, NJ)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12052

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Restaurant 100
Cafe 96.4
Cafeteria 96.2
Human 95.2
Food Court 93.5
Food 93.5
Furniture 92
Meal 86.9
Table 61
Dining Table 58.1

Clarifai
created on 2023-10-26

monochrome 99.3
people 98.7
indoors 96.4
chair 96.3
man 95.5
adult 94.5
furniture 94.3
restaurant 93.7
woman 92.1
table 89.5
sit 86.6
room 84.1
group 83.7
diner 82.9
group together 82.3
dining 81.9
luxury 80.9
no person 79.1
seat 78.7
dining room 77.3

Imagga
created on 2022-01-15

restaurant 48.7
interior 39.8
counter 39.5
cafeteria 32
chair 26.7
barroom 26.6
table 26.2
modern 24.5
building 23.7
furniture 23.2
glass 22.7
room 22.6
kitchen 19
house 18.4
design 18
dining 17.1
decor 16.8
indoors 15.8
structure 15.8
inside 15.6
light 15.4
dinner 15.1
percussion instrument 14.7
indoor 14.6
architecture 14.1
floor 13.9
home 13.6
comfortable 13.4
wood 13.3
shop 12.9
bar 12.9
party 12.9
luxury 12.9
people 12.8
stove 12.8
chairs 12.7
public house 12.6
drink 12.5
musical instrument 12.5
food 12.1
elegant 12
bartender 11.7
expensive 11.5
urban 11.4
case 11.1
decoration 10.8
oven 10.8
steel 10.6
tile 10.5
contemporary 10.3
business 10.3
equipment 10.1
empty 9.4
alcohol 9.3
reflection 8.9
meal 8.9
window 8.9
hall 8.9
night 8.9
tables 8.9
life 8.6
hotel 8.6
lamp 8.6
wine 8.4
service 8.3
city 8.3
marimba 8.2
wooden 7.9
cabinet 7.9
work 7.8
eat 7.5
clean 7.5
new 7.3
steel drum 7.3
stylish 7.2
women 7.1

Google
created on 2022-01-15

Photograph 94.2
White 92.2
Black 89.7
Black-and-white 86.2
Style 84
Line 81.7
Font 77
Building 77
Monochrome photography 76.3
Beauty 75.4
Monochrome 75.4
Snapshot 74.3
Room 69.6
Retail 69.5
Stock photography 63.3
Barware 60.8
Street 56.3
Machine 55.8
Metal 52.9

Microsoft
created on 2022-01-15

text 99.4
table 94.5
indoor 93.1
furniture 91.2
black and white 88.6
person 81.6
window 81.5
restaurant 78.2
clothing 77.3
cafe 64.7
building 52.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 83.3%
Calm 96%
Disgusted 2.1%
Sad 0.5%
Confused 0.3%
Angry 0.3%
Surprised 0.3%
Happy 0.3%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Female, 75.6%
Happy 43.4%
Calm 16%
Sad 14.9%
Fear 11.9%
Angry 4.2%
Surprised 3.7%
Disgusted 3.1%
Confused 2.8%

AWS Rekognition

Age 30-40
Gender Female, 76.4%
Calm 70.1%
Sad 21.7%
Happy 4%
Surprised 1%
Fear 0.9%
Confused 0.8%
Disgusted 0.7%
Angry 0.7%

AWS Rekognition

Age 21-29
Gender Male, 95.6%
Calm 90.9%
Fear 4%
Sad 1.7%
Surprised 1.7%
Disgusted 0.6%
Confused 0.6%
Angry 0.3%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Chair

Clarifai

Building
Clothing
Table
Chair
Person
Human face
Tableware

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 95.2%

AWS Rekognition

Person 94.8%

AWS Rekognition

Person 94.5%

AWS Rekognition

Person 92.1%

AWS Rekognition

Person 90.8%

AWS Rekognition

Person 89.3%

AWS Rekognition

Person 89.2%

AWS Rekognition

Person 85.6%

AWS Rekognition

Person 83.5%

AWS Rekognition

Person 83.1%

AWS Rekognition

Person 73.3%

AWS Rekognition

Person 71%

AWS Rekognition

Person 60.4%

AWS Rekognition

Person 42.3%

AWS Rekognition

Chair 92%

AWS Rekognition

Chair 87.4%

AWS Rekognition

Chair 55.2%

AWS Rekognition

Chair 50.4%

AWS Rekognition

Chair 50.2%

Clarifai

Building 83.6%

Clarifai

Clothing 78.1%

Clarifai

Clothing 77.8%

Clarifai

Clothing 74.2%

Clarifai

Clothing 73.9%

Clarifai

Clothing 71.1%

Clarifai

Clothing 69.4%

Clarifai

Clothing 60.8%

Clarifai

Clothing 58.2%

Clarifai

Clothing 54.5%

Clarifai

Clothing 50.9%

Clarifai

Clothing 50.6%

Clarifai

Clothing 46.4%

Clarifai

Clothing 46.2%

Clarifai

Clothing 42.1%

Clarifai

Table 75.6%

Clarifai

Table 72.4%

Clarifai

Table 72.1%

Clarifai

Table 66.2%

Clarifai

Table 66.2%

Clarifai

Table 65.7%

Clarifai

Table 63%

Clarifai

Table 61.8%

Clarifai

Table 58.3%

Clarifai

Table 51.9%

Clarifai

Table 48.1%

Clarifai

Table 43.9%

Clarifai

Table 40.2%

Clarifai

Table 39.4%

Clarifai

Table 39.1%

Clarifai

Table 37%

Clarifai

Table 36.9%

Clarifai

Table 36.1%

Clarifai

Table 35.5%

Clarifai

Table 35.5%

Clarifai

Table 34.1%

Clarifai

Table 34.1%

Clarifai

Table 33.5%

Clarifai

Table 33.1%

Clarifai

Chair 74%

Clarifai

Chair 68.2%

Clarifai

Chair 65.5%

Clarifai

Chair 57.8%

Clarifai

Chair 53.9%

Clarifai

Chair 46.2%

Clarifai

Chair 42.9%

Clarifai

Chair 38.8%

Clarifai

Chair 38.6%

Clarifai

Chair 34.4%

Clarifai

Person 67.8%

Clarifai

Person 59.9%

Clarifai

Person 50.2%

Clarifai

Person 37.6%

Clarifai

Person 35.5%

Clarifai

Human face 45.3%

Clarifai

Human face 45.2%

Clarifai

Human face 41%

Clarifai

Human face 34.3%

Clarifai

Human face 33.5%

Clarifai

Tableware 43.7%

Categories

Imagga
created on 2022-01-15

paintings art 55.8%
interior objects 27.1%
cars vehicles 6.4%
text visuals 5.5%
streetview architecture 3.5%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

the restaurant in the late afternoon.

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of people in a room with many chairs

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

This image appears to be a reversed or negative version of a photograph depicting a dining or cafeteria scene. The image shows several men sitting at wooden tables, possibly enjoying a meal or coffee. In the background, a group of people, likely cafeteria staff, are working near a service counter or buffet area. The staff are wearing white uniforms, suggesting a professional or institutional setting such as a hospital, office, or community center. The space has a clean and organized appearance, with simple decor and neatly arranged tables and chairs.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image shows an inverted negative photograph of a dining area, possibly a cafeteria or restaurant. In the foreground, there are tables with chairs. Some tables have items on them, such as salt and pepper shakers, a plate, and a teapot. The chairs and tables appear to be made of wood.

In the middle ground, there are people sitting at some of the tables. They are dressed in what appears to be formal attire. Several individuals are seated, engaged in conversation or dining.

Towards the background, there are people dressed as chefs or kitchen staff standing behind a counter or buffet area. They appear to be serving food or arranging items on the counter. They are all wearing white uniforms and chef hats.

The setting has a number of columns and a high ceiling with lighting fixtures. The image is marked with handwritten notes at the top, suggesting it is a dated photograph with some form of archival notation.

Overall, the image conveys a snapshot of a bustling dining environment with patrons and staff going about their activities.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image shows the interior of what appears to be a restaurant or dining establishment. There are several people seated at tables, as well as a group of individuals standing in the background, likely staff or kitchen workers. The room has a vintage or historical feel, with wooden furniture, ceiling fixtures, and a generally dimly lit atmosphere. The overall scene suggests a bustling, active kitchen and dining area from an earlier time period.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white photograph from 1932 (based on the date notation visible at the top) showing what looks like a cafeteria or dining facility. In the background, there are several people in white uniforms, likely kitchen staff or cooks, working behind what appears to be a serving counter. The foreground shows multiple wooden chairs and tables arranged in rows in the dining area. The space appears to be institutional in nature, with a utilitarian design including exposed pipes or ductwork visible on the ceiling. The lighting in the photograph creates an interesting contrast between the brightly lit kitchen area and the darker dining space.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a cafeteria or dining area, with a large room filled with tables and chairs. The room is well-lit, with natural light coming in through the windows on the left side of the image. The walls are painted a light color, and the floor is made of tile.

There are several tables and chairs scattered throughout the room, with some people sitting at them. Some of the people are wearing white uniforms, while others are dressed in casual clothing. In the background, there is a counter with a cash register and a few people standing behind it. There are also some shelves and cabinets along the back wall, stocked with food and supplies.

The overall atmosphere of the image suggests a busy and bustling cafeteria or dining area, possibly in a hospital, school, or office building. The people in the image appear to be engaged in conversation and activity, and the room is filled with the sounds of clinking dishes and murmured conversations.

The image is likely a historical photograph, taken during a specific time period when cafeterias or dining areas were a common feature of public buildings. The presence of white uniforms and the formal attire of some individuals suggests that the image may have been taken in the mid-20th century, possibly during the 1950s or 1960s.

Overall, the image provides a glimpse into the daily life and activities of people in a specific setting, and offers a fascinating look at the past.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a restaurant or cafeteria, with several tables and chairs arranged in rows. The tables are rectangular and have a dark surface, while the chairs are made of wood and have a simple design. In the background, there is a counter or bar area where people are standing and sitting, possibly waiting to be served or ordering food. The atmosphere appears to be casual and relaxed, with some individuals engaged in conversation or reading newspapers.

The overall aesthetic of the image suggests that it was taken in the early 20th century, likely during the 1920s or 1930s. The style of the furniture, clothing, and decor all point to this time period. The photograph may have been taken for promotional or documentary purposes, such as to showcase the restaurant's amenities or to capture a moment in time.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image shows a monochrome photograph of a restaurant with a few people sitting on chairs. The restaurant has a long counter with several people standing behind it, possibly chefs or kitchen staff. The image has a watermark with the text "D.O.D. 25th Infantry Division" and a date "8-31-38." The restaurant has a simple design with wooden chairs and tables, and the ceiling has hanging lamps.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white photo depicts a dining area with a long table, chairs, and people in white uniforms. The table is filled with condiments, plates, and bowls. The chairs are arranged in rows, and some of them are occupied by people sitting on them. The ceiling has hanging lamps and pipes. The photo has a watermark on the right side with the number "22" and the words "22-1939."

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image presents the interior of what appears to be a cafeteria or large dining room, taken in a black and white negative format. The room is populated with tables and chairs arranged in rows.

In the background, a long counter is visible, behind which stand several individuals in what look like uniforms or white coats, suggesting they are staff members. A few other individuals are seated at tables, either eating or engaged in conversation.

The lighting is provided by hanging fixtures. The overall scene evokes a sense of bustling activity, possibly during a meal service period. The photograph captures a moment in time within a communal dining space.

Created by gemini-2.0-flash-lite on 2025-05-18

Here is a description of the image:

This black and white image captures the interior of what appears to be a bustling restaurant or cafeteria. The perspective is taken from a low angle, looking across a series of tables toward the back where the food preparation area is situated.

Key elements of the scene include:

  • Tables and Chairs: Rows of square tables are positioned throughout the foreground and mid-ground, suggesting ample seating. The chairs are simple, wooden, and appear to have a classic design.
  • Patrons: Several people are seated at the tables, some appearing to be dining, while others seem to be engaged in conversation. Other figures, presumably staff members, can be seen working in the food preparation area.
  • Kitchen/Counter Area: In the background, a long counter or kitchen area is visible. People in white uniforms are standing there, likely the kitchen staff, preparing or serving food.
  • Architectural Details: The architecture includes brick walls, supporting columns, and lighting fixtures, which suggest a simple and functional interior.
  • Overall Ambiance: The image conveys an atmosphere of daily life, possibly taken during a mealtime. The lighting is mostly diffused, creating a soft overall tone.

Other details

  • The photograph is a negative image, so the colors are reversed.
  • The date "3-31-32" is visible on the top.
  • The words "Service Force" are written on the top.

The scene is a snapshot of everyday life in a public eating area, offering insight into the social environment of the time.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a historical photograph of a cafeteria or mess hall, likely from a military or institutional setting, given the uniformed personnel and the date noted at the top (March 31, 1938). The scene is captured in black and white.

In the foreground, there are several long tables with benches or chairs where people are seated and eating. The tables are set with various items such as plates, cups, and condiments.

In the background, more individuals are visible, some standing and others seated at tables. The people in the image are wearing uniforms, suggesting they are part of a military or similar organization. The uniforms appear to be light-colored, possibly white or light gray.

The room has a simple, functional design with high ceilings and large windows allowing natural light to enter. The walls are adorned with a few decorations, and there are hanging lights from the ceiling. The overall atmosphere seems orderly and communal, typical of a dining facility in an institutional setting.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image depicts a vintage restaurant interior, seemingly from the early 20th century, judging by the attire of the people and the style of the furniture and decor. The room has a long, narrow layout with rows of wooden tables and chairs. Some tables appear to have plates, salt and pepper shakers, and other dining essentials, suggesting that the restaurant is either open for business or has recently served customers.

Several individuals are seated at the tables, engaged in conversation or eating. Others are standing, possibly waiting for a table or serving food. The background shows a kitchen area with people in white aprons, likely chefs or waitstaff, working behind the counter. The kitchen has various equipment and utensils, indicating a bustling environment.

The overall atmosphere appears busy yet organized, typical of a restaurant from that era. The black-and-white photography adds to the historical feel of the scene.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This black-and-white photograph captures a bustling mid-20th-century restaurant or diner setting. The image offers a view through a window, showcasing the interior and its activities. The foreground features empty tables and chairs, with some table settings, including plates, salt shakers, and condiments, hinting at the restaurant's readiness for diners. In the background, a group of individuals is seated at a table, engaged in conversation, while others stand near the counter, possibly waiting for food or interacting with the staff. The staff members are dressed in white uniforms, suggesting a professional and organized atmosphere. The room is well-lit, with overhead lights and a fan visible on the ceiling. The overall scene conveys a sense of activity and social interaction within a public dining space.

Text analysis

Amazon

ال
M 113
d2
d2.
LONCE
3-31-32
d2. OC DICE LONCE
M 113 BI33A2 A7DA
A7DA
BI33A2
OC DICE
fic

Google

ebice Eok CE ৪-३।-३९
ebice
Eok
CE
৪-३।-३९