Human Generated Data

Title

Untitled (people seated at tables under awnings)

Date

c. 1945

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7662

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (people seated at tables under awnings)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7662

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.4
Crowd 94.6
Audience 90.2
People 77.4
Cafeteria 67.7
Restaurant 67.7
Photography 64.2
Photo 64.2
Sitting 62.7
Suit 62.4
Clothing 62.4
Coat 62.4
Overcoat 62.4
Apparel 62.4
Meal 59
Food 59
Indoors 57.8
Face 55.8
Funeral 55.2

Clarifai
created on 2023-10-25

people 99.9
many 99.8
group 99.5
group together 98.1
man 97
woman 96.9
administration 96.4
adult 96.2
crowd 94.7
child 92.9
audience 92.7
leader 91
war 91
music 89.9
recreation 89.3
furniture 82
boy 81.7
spectator 81.4
chair 79.2
family 76.3

Imagga
created on 2022-01-08

people 31.8
man 30.9
male 28.3
person 23.5
senior 22.5
couple 21.8
group 19.3
happy 18.2
old 17.4
men 17.2
business 15.2
room 15
adult 14.5
school 13.9
photographer 13.7
businessman 13.2
smiling 13
student 12.4
classroom 12.4
together 12.3
home 11.2
teacher 11.1
women 11.1
portrait 11
building 10.3
silhouette 9.9
hand 9.9
team 9.8
success 9.6
life 9.6
musical instrument 9.6
elderly 9.6
spectator 9.5
love 9.5
meeting 9.4
happiness 9.4
aged 9
black 9
looking 8.8
retired 8.7
professional 8.7
busy 8.7
education 8.7
sitting 8.6
cheerful 8.1
handsome 8
family 8
child 7.8
work 7.8
crowd 7.7
brass 7.6
two 7.6
kin 7.6
city 7.5
mature 7.4
indoor 7.3
entrepreneur 7.3
blackboard 7.2
job 7.1
indoors 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

person 99
text 95.7
black and white 78.5
group 73.9
clothing 71.4
man 70.7
people 58.2
crowd 4.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 96.7%
Calm 99.2%
Sad 0.6%
Happy 0%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%
Surprised 0%

AWS Rekognition

Age 23-33
Gender Male, 93.4%
Calm 88.8%
Sad 6.4%
Happy 2.4%
Confused 0.8%
Surprised 0.6%
Disgusted 0.5%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 64.6%
Calm 64.1%
Sad 32.4%
Disgusted 1.1%
Confused 0.8%
Happy 0.7%
Surprised 0.5%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 90.3%
Happy 98.1%
Calm 1.2%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 64.4%
Calm 98.4%
Sad 0.9%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Male, 96.6%
Calm 85.4%
Sad 11.6%
Angry 0.8%
Surprised 0.7%
Disgusted 0.4%
Happy 0.4%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 19-27
Gender Female, 97.8%
Calm 44.9%
Sad 35.3%
Happy 17.3%
Fear 0.7%
Confused 0.6%
Disgusted 0.5%
Angry 0.4%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person

Clarifai

Man
Human face
Clothing
Woman
Human hair
Human head

AWS Rekognition

Person 98.4%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 97%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 95.4%

AWS Rekognition

Person 95.1%

AWS Rekognition

Person 93%

AWS Rekognition

Person 91.9%

AWS Rekognition

Person 89.5%

AWS Rekognition

Person 89.2%

AWS Rekognition

Person 84.1%

AWS Rekognition

Person 71.2%

AWS Rekognition

Person 70.4%

AWS Rekognition

Person 65.9%

AWS Rekognition

Person 65.2%

AWS Rekognition

Person 65.1%

AWS Rekognition

Person 56.4%

Clarifai

Man 89.8%

Clarifai

Man 86.7%

Clarifai

Man 84.7%

Clarifai

Man 83.6%

Clarifai

Man 83.5%

Clarifai

Man 80%

Clarifai

Man 77.7%

Clarifai

Man 73.2%

Clarifai

Man 72.7%

Clarifai

Man 70.5%

Clarifai

Man 68.2%

Clarifai

Man 62.9%

Clarifai

Man 57.3%

Clarifai

Man 52.1%

Clarifai

Man 51.3%

Clarifai

Man 50%

Clarifai

Man 46.6%

Clarifai

Man 43.9%

Clarifai

Man 40.7%

Clarifai

Man 39%

Clarifai

Man 38.1%

Clarifai

Man 36.8%

Clarifai

Man 36.2%

Clarifai

Man 36%

Clarifai

Man 35.6%

Clarifai

Man 35.5%

Clarifai

Human face 83.3%

Clarifai

Human face 83.3%

Clarifai

Human face 77.2%

Clarifai

Human face 74.6%

Clarifai

Human face 72.8%

Clarifai

Human face 70.1%

Clarifai

Human face 69.1%

Clarifai

Human face 66.3%

Clarifai

Human face 65.7%

Clarifai

Human face 64.1%

Clarifai

Human face 62.2%

Clarifai

Human face 61.3%

Clarifai

Human face 61.1%

Clarifai

Human face 56%

Clarifai

Human face 50.2%

Clarifai

Human face 44.9%

Clarifai

Human face 37.4%

Clarifai

Clothing 79.2%

Clarifai

Clothing 58.4%

Clarifai

Clothing 50.7%

Clarifai

Clothing 39.5%

Clarifai

Clothing 37.5%

Clarifai

Clothing 36.9%

Clarifai

Clothing 34.5%

Clarifai

Clothing 33.7%

Clarifai

Woman 78.8%

Clarifai

Woman 41.9%

Clarifai

Human hair 43.3%

Clarifai

Human hair 38.5%

Clarifai

Human head 41%

Categories

Imagga
created on 2022-01-08

streetview architecture 76.2%
people portraits 10.9%
paintings art 7.6%
beaches seaside 2.7%
nature landscape 1.3%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of a wedding ceremony.

Salesforce

Created by general-english-image-caption-blip on 2025-05-18

a photograph of a group of people standing around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image shows a group of formally dressed individuals gathered at an outdoor event, seated around tables. The setting includes chairs, tables adorned with dishes and drinks, and a striped canopy providing shade. The backdrop consists of stone walls and an open doorway. People appear engaged in conversation and dining.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image is a photographic negative depicting a gathering of people, likely at a social event or party. The setting appears to be an outdoor patio or veranda, partially covered by a striped canopy. Several tables are arranged with people seated around them, engaging in conversation and dining. The guests are dressed formally, with men in suits or tuxedos and women in elegant attire. The ambiance suggests a gathering of well-dressed individuals enjoying a meal and each other's company in a relaxed outdoor setting. The background shows a stone wall and windows, indicating it might be part of a larger building or establishment.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-18

The image appears to depict a formal social gathering or event, possibly a dinner party or banquet. There are numerous people seated at tables, dressed in formal attire such as suits and dresses. The setting seems to be an indoor space with decorative elements like curtains and a floral centerpiece on the table. The overall atmosphere suggests a gathering of well-dressed individuals engaged in conversation and dining.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-18

This appears to be a black and white photograph of what looks like a formal dinner or social gathering, likely from many decades ago. The setting appears to be on a covered porch or veranda of a stone building. There are multiple people seated at tables, many wearing formal attire including white jackets or shirts. The tables appear to be set for a meal with various dishes and table settings visible. There's an awning or covering visible at the top of the image providing shade for the diners. The photograph has a vintage quality typical of early-to-mid 20th century photography. The scene suggests this was likely a special occasion or formal event of some kind.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a gathering of people seated at tables, likely taken in the early 20th century. The scene is set outdoors, with a stone building on the left and a striped awning above the tables.

Key Features:

  • Setting: The photograph appears to be taken in a courtyard or patio area, possibly at a private residence or a public venue.
  • People: The majority of the individuals are seated at tables, with some standing and mingling. They are dressed in formal attire, suggesting a special occasion or event.
  • Tables: The tables are arranged in a circular pattern, with each table set with plates, glasses, and silverware. There are also several potted plants and other decorative elements on the tables.
  • Background: The stone building on the left side of the image features a window and a door, while the striped awning above the tables adds a pop of color to the scene.
  • Atmosphere: The overall atmosphere of the image is one of elegance and sophistication, suggesting a high-society gathering or a formal event.

Possible Context:

  • Event: The photograph may have been taken at a wedding reception, a dinner party, or another type of social gathering.
  • Time Period: Based on the clothing and hairstyles, it is likely that the photograph was taken in the early 20th century, possibly in the 1920s or 1930s.
  • Location: The location of the photograph is not specified, but it could be a private residence, a public venue, or a historic site.

Conclusion:

The image provides a glimpse into a bygone era, capturing a moment of elegance and sophistication in a formal outdoor setting. The photograph's details, including the clothing, hairstyles, and setting, suggest a specific time and place, inviting the viewer to imagine the story behind the image.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a gathering of people, likely at a social event or party. The scene is set outdoors, with a stone building visible on the left side of the image. A striped awning provides shade for the guests, who are seated at tables and engaged in conversation.

The attendees are dressed in formal attire, with men wearing suits and ties, while women wear dresses. Some individuals are holding glasses, suggesting that they may be enjoying beverages. The atmosphere appears to be lively and convivial, with people laughing and chatting with one another.

In the foreground, a table is set with flowers and other decorations, adding to the festive ambiance. The overall mood of the image is one of joy and celebration, capturing a moment of social interaction and community among the gathered individuals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-06

The image is a black-and-white photograph featuring a group of people gathered in a room. The setting appears to be a formal event, possibly a wedding or a party, as indicated by the presence of a table with a floral centerpiece and the attire of the attendees. The photograph is framed with a white border, and there are numbers and text on the top and bottom of the image. The group of people is seated around a table, with some standing and others sitting in chairs. The individuals are dressed in formal attire, with men wearing suits and ties and women wearing dresses. The image captures a moment of interaction and conversation among the attendees, with some people engaged in conversation while others are looking at the camera. The overall atmosphere of the photograph is one of celebration and social gathering.

Created by amazon.nova-pro-v1:0 on 2025-06-06

The black-and-white photo has a white border, and it features a group of people gathered together in an outdoor area. Some of them are standing, while others are sitting. They are wearing formal attire, and some of them are wearing hats. Some of them are holding glasses, while others are holding cigarettes. Some of them are looking at something on the table. Behind them, there is a building with a stone wall and a window.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-16

This black and white photograph captures a gathering of people, likely at an outdoor event. The scene is set beneath a canopy, and the composition is organized around several round tables.

Here's a breakdown:

  • Setting: The background includes a stone wall with a window, a dark awning with a wavy design, and open doorways. This suggests the event is held at a restaurant or a similar venue.
  • People: Numerous individuals are present, both men and women. They are engaged in various activities, like conversing, eating, or smoking. The individuals at the tables appear to be the main focus, while there are figures standing around and in the background as well.
  • Atmosphere: The overall mood seems relaxed. Some individuals appear to be smoking, indicating a casual and social setting. The presence of food and drink on the tables supports the idea of a gathering, possibly a luncheon or dinner.
  • Style: The photo is a negative, and the image has a vintage feel. The lighting is diffuse, the details are visible, and it indicates an older period.

Created by gemini-2.0-flash on 2025-05-16

Here is a description of the image.

The image appears to be an inverted black and white photograph of a group of people gathered for an outdoor event. There are several tables set with what looks like food or decorative arrangements. Many of the individuals are seated and appear to be engaged in conversation or eating. Some are dressed in suits or formal wear.

In the background, there is an awning or canopy that suggests the event is taking place outdoors. The building behind the gathering seems to be made of stone. Some windows are visible in the stone building.

The overall composition suggests a social gathering or a celebration, possibly a wedding reception or a formal luncheon. The inverted color scheme provides the image with an eerie or surreal quality, but the subject matter remains recognizable.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image depicts a formal gathering or event, likely a banquet or a ceremonial dinner, held outdoors. The setting appears to be under a canopy or tent with striped fabric, providing shade. The attendees are dressed formally, with the men in suits and bow ties and the women in elegant dresses and hats, suggesting a significant occasion.

The photograph is in black and white, indicating it was taken in an earlier era, possibly the mid-20th century. The guests are seated at tables adorned with flowers and tablecloths. Some individuals are standing and engaging in conversation, while others are seated and appear to be eating or talking. The atmosphere seems lively and social.

The background shows a stone or brick building, adding to the formal and possibly historic ambiance of the event. The overall scene conveys a sense of celebration and community among the attendees.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-10

This image appears to be a black-and-white photograph of a group of people gathered in what seems to be an outdoor setting, possibly at a social event or a celebration. The individuals are seated at a long table, which is decorated with floral arrangements and serves as the focal point of the gathering. The table is set with various items, including what looks like food and drink.

The group is diverse in age, with both adults and children present. Some individuals are wearing formal attire, suggesting a special occasion, while others are dressed more casually. The setting includes a building with stone walls and a window in the background, and there is a striped canopy or awning providing shade. The atmosphere appears to be convivial, with people engaged in conversation and enjoying the event. The photograph has a vintage feel, indicated by the style of clothing and the overall tone of the image.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-10

This black-and-white photograph captures a lively gathering, likely a celebration or banquet, with a group of people seated around tables. The setting appears to be outdoors, possibly a patio or courtyard, with a stone wall and a striped awning in the background. The attendees are dressed in formal attire, suggesting a special occasion. Some individuals are standing and appear to be engaged in conversation or taking photographs, while others are seated and seem to be enjoying a meal or socializing. The atmosphere is festive and convivial.

Text analysis

Amazon

19160.
17160
17160.
NACOX

Google

O ררנ 160.
O
ררנ
160.