Human Generated Data

Title

Untitled (two sailors and two women sitting at restaurant table)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4998

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two sailors and two women sitting at restaurant table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4998

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.8
Human 99.8
Restaurant 99.8
Person 99.6
Person 99.5
Person 99.3
Person 98.7
Cafe 95
Cafeteria 86.6
Meal 85
Food 85
Sitting 77.1
Food Court 76.5
Bar Counter 62.3
Pub 62.3
Crowd 59.1
Shop 55.8

Clarifai
created on 2023-10-26

people 99.5
monochrome 98.6
woman 97.9
man 97.5
adult 96.6
sit 93.1
indoors 90
desk 89.9
group 88.6
group together 87.2
child 82.5
chair 79.8
communication 78.2
sitting 75.1
furniture 74.4
table 71.4
many 71.2
street 66
newspaper 65.1
transportation system 63.5

Imagga
created on 2022-01-22

businessman 34.4
business 34
male 32.6
man 28.9
office 24.8
people 24.5
person 22.5
stall 20.2
businesswoman 20
meeting 19.8
work 19.6
newspaper 19.6
adult 19.2
job 18.6
group 18.5
laptop 18.2
corporate 18
businesspeople 18
room 17.1
computer 16.8
men 16.3
happy 16.3
colleagues 15.5
team 15.2
desk 14.9
manager 14.9
teamwork 14.8
casual 14.4
looking 14.4
product 14.3
building 13.8
smiling 13.7
success 13.7
classroom 13.6
indoors 13.2
table 12.7
finance 12.7
technology 12.6
executive 12.3
together 12.3
successful 11.9
old 11.8
lifestyle 11.5
working 11.5
plan 11.3
new 11.3
professional 11.2
senior 11.2
modern 11.2
creation 11.1
design 10.7
engineer 10.6
hand 10.6
busy 10.6
daily 10.6
color 10.6
company 10.2
day 10.2
horizontal 10
indoor 10
clothing 9.8
associates 9.8
coworkers 9.8
discussion 9.7
copy 9.7
portrait 9.7
architect 9.6
chart 9.5
females 9.4
paper 9.4
happiness 9.4
worker 9.2
camera 9.2
confident 9.1
suit 9
cheerful 8.9
conference 8.8
40s 8.7
couple 8.7
women 8.7
cooperation 8.7
mid adult 8.7
30s 8.6
architecture 8.6
customer 8.6
face 8.5
money 8.5
writing 8.5
communication 8.4
brass 8.1
wind instrument 7.9
client 7.8
designer 7.7
sitting 7.7
construction 7.7
project 7.7
architectural 7.7
center 7.6
workplace 7.6
engineering 7.6
talking 7.6
adults 7.6
speedway 7.5
holding 7.4
20s 7.3
hall 7.1

Google
created on 2022-01-22

Photograph 94.2
Black 89.8
Table 88.2
Black-and-white 87.9
Style 84.1
Line 81.7
Monochrome 80.2
Suit 79.5
Font 79.3
Monochrome photography 79.3
Eyewear 76.3
Snapshot 74.3
Event 74
Art 73.5
Automotive design 72.3
Customer 71.7
T-shirt 71.2
Publication 70
Job 66
Room 65.8

Microsoft
created on 2022-01-22

text 99.5
person 93
man 93
clothing 90.5
human face 68.3
menu 54

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Surprised 32.3%
Calm 28.2%
Happy 20%
Fear 6.9%
Sad 5.2%
Confused 4.1%
Disgusted 2.2%
Angry 1.2%

AWS Rekognition

Age 29-39
Gender Female, 91.4%
Calm 95.5%
Sad 3.7%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 71.1%
Calm 99.9%
Sad 0%
Happy 0%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 42-50
Gender Female, 84.5%
Calm 49.6%
Happy 21.6%
Surprised 9.3%
Sad 5.9%
Disgusted 5.2%
Confused 4%
Angry 3.2%
Fear 1.2%

AWS Rekognition

Age 20-28
Gender Male, 68.4%
Calm 89.8%
Happy 4.4%
Disgusted 2.1%
Sad 2%
Confused 0.6%
Angry 0.5%
Fear 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.8%
Person 99.6%
Person 99.5%
Person 99.3%
Person 98.7%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-22

a photograph of a group of people sitting at a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-16

The image depicts a negative of a group of people seated at a table in what appears to be a diner or café. The table holds bowls, cups, and a glass ketchup bottle. Behind the group is a counter area with shelves displaying various items, including tins, bottles, and a menu or promotional signs on the wall. The scene suggests a casual meal setting, with a variety of objects and decor in the background contributing to the establishment's atmosphere.

Created by gpt-4o-2024-08-06 on 2025-06-16

The image is a negative photograph showing a group of people seated at a table in a diner or café setting. They are enjoying a meal, evidenced by the presence of bowls, cups, and a bottle on the table. Behind them, a long counter is visible, stocked with various items including jars, cans, and boxes. Several advertisements and product displays are visible on the wall behind the counter. The atmosphere suggests a casual dining experience. The negative format of the image casts light tones as dark and vice versa, giving an inverted appearance to the scene.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph of the interior of a diner or restaurant. The scene depicts several people seated at a counter or bar, with shelves and displays of various items visible in the background. The individuals appear to be engaged in conversation or dining. The overall atmosphere suggests a mid-20th century setting, with the style of clothing and furnishings visible in the image.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This is a black and white photograph from 1936 showing several people seated at what appears to be a diner or soda fountain counter. The customers are sitting on stools at the counter, and there appears to be a server or soda jerk standing behind it. The wall behind the counter is decorated with various signs and advertisements typical of the era. The patrons appear to be enjoying drinks or sodas, and there's a casual, social atmosphere captured in the scene. The image provides a wonderful glimpse into everyday American life during the 1930s, particularly the social culture around soda fountains which were popular gathering places during that time period.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a group of people in a diner or restaurant setting, with a man standing behind the counter and four individuals seated at a table. The scene is set in a diner or restaurant, with the man standing behind the counter, likely serving or preparing food. The four individuals seated at the table appear to be enjoying their meal or conversation.

  • Man Standing Behind the Counter
    • He is wearing a dark-colored shirt and has short hair.
    • He is holding a cup or glass in his hand.
    • He is standing behind the counter, which is stocked with various items such as cups, glasses, and condiments.
  • Four Individuals Seated at the Table
    • They are all wearing casual clothing, with two women and two men.
    • They are seated at a table with a glass top and metal legs.
    • There are several items on the table, including cups, glasses, and bottles.
  • Background
    • The background of the image shows a wall with various posters and advertisements.
    • There are also some shelves and cabinets along the wall, stocked with various items.
    • The overall atmosphere of the image suggests a casual, relaxed setting, possibly a diner or restaurant.

In summary, the image shows a group of people in a diner or restaurant setting, with a man standing behind the counter and four individuals seated at a table. The scene is set in a casual, relaxed environment, with the man serving or preparing food and the individuals enjoying their meal or conversation.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a group of people gathered around a table in a diner or restaurant setting. The scene is set against the backdrop of a counter with shelves stocked with various items, including bottles and cans.

In the foreground, four individuals are seated at a table, each engaged in their own activity. Two women sit on one side of the table, while two men occupy the other side. One of the men stands behind the table, adding to the lively atmosphere. The table itself is adorned with an assortment of items, including bottles, cups, and other objects that contribute to the sense of a bustling eatery.

The overall ambiance of the image suggests a casual, social gathering, with the group enjoying each other's company in a relaxed setting. The presence of food and drink items on the table reinforces this interpretation, implying that the individuals are sharing a meal or snack together.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-09

The black-and-white photograph shows a group of people sitting around a table in a restaurant. The woman on the left is holding a cup, and the man on the right is holding a spoon. The man in the middle is holding a bottle, and the man on the right is wearing a military uniform. Behind them, there is a shelf with various items on it, including bottles and cans.

Created by amazon.nova-pro-v1:0 on 2025-06-09

A black-and-white image of a group of people sitting around a table in a restaurant. The group consists of four men and two women. The men are wearing uniforms, while the women are wearing dresses. The man standing behind the counter is wearing a long-sleeve shirt and pants. The counter has a shelf with various items on display, including bottles and cans. The photo has a watermark with the number "16436" in the middle.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The image appears to be a black and white, negative photograph. It depicts a scene inside a diner or soda fountain. A group of five people are seated around a table. A man in a uniform is seated on the right, eating from a bowl. Two women are seated to his left, each with a cup in their hands. Another man, standing behind the counter, seems to be serving them. A fourth person, a man, is seated at the table as well. The setting includes a counter with shelves stocked with various items (possibly drinks and snacks). There's also a sign promoting "REAL PHOTOGRAPHY." The overall atmosphere suggests an image from the mid-20th century.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image.

The black-and-white image presents a group of five individuals in what appears to be a diner or lunch counter setting. The overall style suggests a time period in the mid-20th century.

In the foreground, a woman with an elaborate hairstyle is seated at a table and holding a glass. Next to her is a woman in a dress, and further down the table, a man is seated, a bottle of what looks like ketchup is on the table in front of him. Further to the right, a man in what looks like a military uniform is seated at the table and holds a spoon.

Behind the seated individuals, a waiter is seen holding a glass.

The counter behind them features a variety of jars, cans, and other items typically found in a diner or similar establishment. There is also a sign for "REAL PHOTOGRAPHS."

The image is bordered in white, with a number, "16436," visible at the top and bottom of the photo.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image depicts a group of six individuals, likely military personnel, gathered around a table in what appears to be a bar or a lounge area. The setting is indoors, and the background shows a variety of items, including bottles, posters, and possibly some memorabilia or advertisements.

The individuals are dressed in uniforms, suggesting they are part of a military or naval service. The table is cluttered with various items, including bottles of beverages, glasses, and possibly some snacks. The group appears to be engaged in conversation or enjoying a social gathering.

The atmosphere seems casual and relaxed, with some individuals smiling and others looking more serious. The image has a vintage feel, possibly from the mid-20th century, given the style of the uniforms and the overall setting. The number "16436" is visible at the top and bottom of the image, which might be an identification or cataloging number.

Text analysis

Amazon

REAL
16436.
REAL PHOTOGRAPHS
PHOTOGRAPHS

Google

16436. REAL PHOTOCAA nsENTO 16 43 6.
16436.
REAL
PHOTOCAA
nsENTO
16
43
6.