Human Generated Data

Title

Untitled (Harbor Inn dining room, Punta Gorda, FL)

Date

c. 1965

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11414

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Harbor Inn dining room, Punta Gorda, FL)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1965

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11414

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Restaurant 100
Furniture 99.8
Cafeteria 98.2
Human 98
Cafe 93.6
Food Court 86.7
Food 86.7
Meal 75.3

Clarifai
created on 2023-10-25

people 99.7
furniture 98.9
monochrome 97.9
group together 97.9
restaurant 96.8
adult 96.6
indoors 96.5
group 96
woman 95.7
chair 95.6
table 95.3
man 95.3
dining 94.2
canteen 92.8
dining room 92.8
seat 91.7
room 91.6
cafeteria 91.6
many 91.3
diner 91.3

Imagga
created on 2022-01-14

restaurant 70.5
interior 59.3
barbershop 52.4
cafeteria 51.2
shop 46.8
chair 46.6
room 44.8
table 44.4
building 39.4
furniture 35
mercantile establishment 32.7
modern 31.6
salon 30.5
structure 27.9
house 25.9
design 25.9
dining 24.8
office 24.4
wood 24.2
indoors 23.7
floor 23.3
home 23.1
kitchen 22.5
decor 22.1
place of business 22
inside 21.2
counter 21.1
glass 21
indoor 20.1
empty 19.8
contemporary 19.8
style 19.3
seat 18.7
luxury 18
light 17.4
food 16.9
dinner 16.9
decoration 15.9
nobody 15.6
drink 15.1
bar 14.8
chairs 14.7
classroom 13.8
comfortable 13.4
service 13
drawer 12.9
stove 12.8
business 12.8
work 12.6
architecture 12.5
desk 12.5
computer 12
establishment 12
stool 11.9
oven 11.8
hotel 11.5
lamp 11.4
people 11.2
window 11
eat 10.9
stylish 10.9
tables 10.8
residential 10.5
decorate 10.5
plant 10.5
elegant 10.3
meal 9.7
lunch 9.7
education 9.5
party 9.5
lifestyle 9.4
plate 9.3
coffee 9.3
elegance 9.2
cook 9.2
cabinets 8.9
upscale 8.9
success 8.9
wooden 8.8
man 8.7
place 8.4
equipment 8.2
refrigerator 7.9
urban 7.9
person 7.9
napkin 7.8
3d 7.7
class 7.7
wall 7.7
professional 7.7
apartment 7.7
relax 7.6
living 7.6
lights 7.4
occupation 7.3
island 7.3
group 7.3
steel 7.1
working 7.1

Google
created on 2022-01-14

Black 89.5
Table 86.9
Black-and-white 86.4
Style 84
Chair 83
Monochrome photography 76
Plant 74.7
Monochrome 74.7
Art 72.5
T-shirt 70.2
Machine 68.3
Room 67.4
Building 66.9
Sitting 64.8
Stock photography 62.4
Cooking 60.2
Photographic paper 55.5
Font 55.2
Street 54
Shelf 53

Microsoft
created on 2022-01-14

text 98.5
table 98.3
furniture 96
person 94.9
indoor 94.8
chair 85.5
black and white 77.6
building 76.5
people 69.7
kitchen & dining room table 65.6
group 56.6
vase 53.2
tableware 52.7
working 51
cluttered 19.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 95.1%
Calm 74.3%
Sad 14.1%
Confused 8.3%
Angry 0.9%
Disgusted 0.9%
Surprised 0.7%
Happy 0.5%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 75.6%
Sad 18.2%
Disgusted 1.7%
Angry 1.3%
Confused 1.2%
Happy 1%
Surprised 0.8%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 86.1%
Calm 56.6%
Angry 11.7%
Happy 9.6%
Disgusted 9.5%
Sad 9.1%
Confused 2.1%
Surprised 0.7%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair
Person

Clarifai

No features identified

AWS Rekognition

Chair 99.8%

AWS Rekognition

Chair 98%

AWS Rekognition

Chair 97.9%

AWS Rekognition

Chair 90.4%

AWS Rekognition

Chair 65.7%

AWS Rekognition

Person 98%

AWS Rekognition

Person 97.6%

AWS Rekognition

Person 96.6%

AWS Rekognition

Person 96.6%

AWS Rekognition

Person 96.1%

AWS Rekognition

Person 95%

AWS Rekognition

Person 92.1%

AWS Rekognition

Person 84.2%

AWS Rekognition

Person 83.3%

AWS Rekognition

Person 61.3%

Categories

Imagga
created on 2022-01-14

interior objects 99.9%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of people sitting at tables in a restaurant

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-15

The image is a negative photograph of a dining area, depicting people seated at tables enjoying a meal or drinks. The space has a casual and social ambiance, with curved-back chairs and tables arranged neatly. The environment includes large windows, through which outdoor plants and a pool area can be seen. A staircase with a modern design is visible in the background, adding to the architectural interest of the space. The scene features a waiter serving one of the tables, adding a sense of service and hospitality. The decor and layout suggest a mid-century modern style.

Created by gpt-4o-2024-08-06 on 2025-06-15

The image appears to be a photographic negative of a restaurant or café scene. It shows several tables with people sitting and engaging in conversation or dining. There are various people seated at the tables, wearing what seems to be formal or semi-formal clothing. The room has large windows in the background, indicating a bright atmosphere outside. The furniture includes chairs with curved backs and tables set with dishes and cutlery, giving it a classic or vintage feel. A waiter or server stands beside one of the tables, possibly taking an order or serving, adding to the dining atmosphere. The setting appears to be indoors, with furnishings and décor reflecting a mid-20th-century style.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-19

The image appears to be a black and white photograph of the interior of a restaurant or cafe. The scene shows a group of people seated at tables, engaged in conversation and enjoying their meals. The space has a mid-century modern aesthetic, with sleek furniture, large windows, and decorative elements like palm fronds. The overall atmosphere seems relaxed and convivial, with the patrons appearing to be having a pleasant dining experience.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-19

This appears to be a black and white photograph of what looks like a restaurant or dining area, likely from the mid-20th century. The space has a nautical theme, evidenced by a ship's wheel decoration visible on the wall. The room features several black tables with white chairs, and there are multiple patrons seated throughout the space. The interior has a clean, modern (for its time) design with a dropped ceiling and what appears to be decorative dividers or screens. There's also some tropical foliage visible through windows or openings on the right side of the image, suggesting this might be a restaurant in a warm climate location. The overall aesthetic is characteristic of mid-century American restaurant design.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-25

The image depicts a black-and-white photograph of a restaurant or café, where several patrons are seated at tables. The interior features a staircase on the left side, a window with a view of palm trees on the right side, and a counter with a plant in the background. The atmosphere appears to be casual and relaxed, with the patrons engaged in conversation or enjoying their meals. The overall ambiance suggests a pleasant dining experience.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-25

The image depicts a black-and-white photograph of a restaurant interior, with a group of people seated at tables. The scene is set in a dining area with a staircase leading to an upper level on the left side. The room features a large window on the right side, offering a view of the exterior.

In the foreground, several tables are arranged, each accompanied by chairs. The tables are adorned with place settings, including plates, cups, and silverware. A waiter is visible, standing near one of the tables and attending to the patrons.

The atmosphere appears to be casual and relaxed, with the diners engaged in conversation. The overall ambiance suggests a comfortable and inviting dining environment.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-25

The black-and-white image shows a dining area with several people sitting on chairs around the tables. The tables have cups, plates, and bottles on top. A man is standing near the table, and it seems like he is serving the food. A cabinet is on the left, and a potted plant is on top. A spiral staircase is on the left, and a ceiling fan is above it.

Created by amazon.nova-lite-v1:0 on 2025-05-25

The image is a black-and-white photograph of an indoor restaurant. The image features a group of people sitting at tables, possibly engaged in a meal. The tables are arranged in a spacious layout, with chairs surrounding them. The restaurant has a modern design, with clean lines and minimalistic decor. The image captures a moment of casual dining, with people interacting and enjoying their meals. The atmosphere is relaxed and comfortable, with a sense of warmth and hospitality.

Google Gemini

Created by gemini-2.0-flash on 2025-05-17

The monochrome image depicts a dining area filled with patrons, likely a restaurant or café. In the foreground, a seated man in a light-colored shirt is seen enjoying a meal at a table set for two, facing another seated woman in a sleeveless patterned dress. The table is laid with plates, cups, and cutlery.

In the center of the room, a waiter, dressed in a dark shirt and light pants, is attending to a table occupied by a woman, possibly taking or delivering an order. Several other diners can be seen in the background, seated at various tables throughout the room.

Architectural details such as a spiral staircase, decorative plants, and large windows offering a view of palm trees are visible. The overall scene suggests a relaxed dining atmosphere during daytime, with natural light streaming in from the windows.

Created by gemini-2.0-flash-lite on 2025-05-17

This image appears to be a negative of a photograph taken inside a restaurant. Several people are seated at tables, eating and conversing. The scene is well-lit, with a sense of leisure and social interaction. The furniture, including the chairs and tables, suggests a vintage aesthetic. The decor includes a spiral staircase and a nautical symbol on the wall, providing some character to the space. Large windows are visible, and in the background, palm trees can be seen, adding to the overall ambiance. A waiter is present, attending to the diners.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image depicts a group of people dining in a restaurant. The setting appears to be indoors, with a modern and somewhat formal ambiance. The tables are arranged in a line, and the chairs are white with cushioned seats. The tables are set with various items, including plates, glasses, and utensils.

The diners are engaged in conversation and appear to be enjoying their meals. The restaurant has a clean and well-lit interior, with decorative elements such as plants and possibly some artwork on the walls. The overall atmosphere seems relaxed and social, with people dressed in casual to semi-formal attire. The image is in black and white, which gives it a timeless feel.

Qwen

No captions written

Text analysis

Amazon

DP
REGOR
MJIF--YT3RA°2