Human Generated Data

Title

Untitled (standing couple talking to group seated at table)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5329

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (standing couple talking to group seated at table)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5329

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.5
Clothing 94.3
Apparel 94.3
Crowd 80.9
People 79.8
Face 79.4
Female 65.7
Girl 60.2
Suit 57.3
Coat 57.3
Overcoat 57.3

Clarifai
created on 2023-10-26

people 99.9
group 99.6
many 99.5
adult 98.4
man 97.8
woman 97.5
group together 97.3
leader 96.9
administration 96.3
crowd 94.5
music 89.9
war 87.4
audience 87.1
several 87
child 86.5
dancing 85.6
wear 82.7
musician 81.9
handshake 81.1
party 80.4

Imagga
created on 2022-01-22

people 31.8
male 29.8
man 26.9
person 26.9
team 23.3
businessman 22.9
group 22.5
business 20.6
men 20.6
work 19.6
adult 17.7
women 16.6
professional 16.1
teamwork 15.7
businesswoman 14.5
happy 13.8
worker 13.7
stage 13.5
portrait 12.9
kin 12.8
black 12.6
job 12.4
office 12
corporate 12
suit 11.7
life 11.6
together 11.4
couple 11.3
human 11.2
student 11
world 10.6
room 10.6
success 10.5
nurse 10.2
modern 9.8
working 9.7
medical 9.7
education 9.5
meeting 9.4
instrument 9.4
manager 9.3
successful 9.1
teacher 9
new 8.9
brass 8.8
looking 8.8
lab 8.7
chemistry 8.7
clothing 8.5
senior 8.4
company 8.4
silhouette 8.3
photographer 8
building 8
home 8
smiling 8
laboratory 7.7
musical instrument 7.7
wind instrument 7.7
two 7.6
ethnic 7.6
hand 7.6
plan 7.6
uniform 7.2
color 7.2
lifestyle 7.2
coat 7.2
science 7.1
medicine 7
indoors 7

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 99.3
text 99.2
clothing 94.9
outdoor 93.1
man 84
black and white 69.4
group 66.5
people 66.4
old 44.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 51.1%
Calm 77.1%
Sad 10.1%
Happy 6.4%
Surprised 2.4%
Confused 1.7%
Disgusted 1.2%
Angry 1%
Fear 0.2%

AWS Rekognition

Age 51-59
Gender Male, 99.9%
Calm 99.8%
Confused 0.1%
Angry 0%
Sad 0%
Disgusted 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Male, 88.4%
Calm 97%
Happy 1.8%
Sad 0.6%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%
Surprised 0.1%
Confused 0.1%

AWS Rekognition

Age 54-62
Gender Male, 97.1%
Sad 58.5%
Confused 18.2%
Calm 12.5%
Surprised 4.1%
Fear 3.2%
Happy 1.3%
Angry 1.1%
Disgusted 1.1%

AWS Rekognition

Age 27-37
Gender Female, 88.5%
Calm 83.5%
Sad 8.5%
Happy 4.4%
Angry 1.6%
Confused 0.9%
Disgusted 0.5%
Surprised 0.4%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Man
Clothing
Woman
Human face
Human hair
Table
Drink

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 99.3%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.7%

AWS Rekognition

Person 98.5%

AWS Rekognition

Person 98.2%

AWS Rekognition

Person 97.8%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 97%

AWS Rekognition

Person 95.5%

AWS Rekognition

Person 89.8%

AWS Rekognition

Person 71.8%

AWS Rekognition

Person 65.6%

AWS Rekognition

Person 63.8%

Clarifai

Man 87%

Clarifai

Man 80.5%

Clarifai

Man 80.2%

Clarifai

Man 71.7%

Clarifai

Man 69.1%

Clarifai

Man 68.2%

Clarifai

Man 61%

Clarifai

Man 43.9%

Clarifai

Man 41.6%

Clarifai

Clothing 86.8%

Clarifai

Clothing 84.9%

Clarifai

Clothing 84.1%

Clarifai

Clothing 80.6%

Clarifai

Clothing 78%

Clarifai

Clothing 69.3%

Clarifai

Clothing 59.7%

Clarifai

Clothing 59.4%

Clarifai

Clothing 36.9%

Clarifai

Clothing 34.2%

Clarifai

Woman 81.3%

Clarifai

Human face 71.2%

Clarifai

Human face 70.6%

Clarifai

Human face 66.1%

Clarifai

Human face 63.5%

Clarifai

Human face 61.6%

Clarifai

Human face 60.3%

Clarifai

Human face 59.5%

Clarifai

Human face 57.3%

Clarifai

Human face 53%

Clarifai

Human face 52.7%

Clarifai

Human face 48%

Clarifai

Human face 42.6%

Clarifai

Human face 41%

Clarifai

Human face 36.9%

Clarifai

Human hair 42.4%

Clarifai

Human hair 40.9%

Clarifai

Human hair 35.2%

Clarifai

Human hair 33.9%

Clarifai

Human hair 33.1%

Clarifai

Table 38.1%

Clarifai

Drink 35.4%

Categories

Imagga
created on 2022-01-22

paintings art 99.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

photograph of a crowd of people.

Salesforce

Created by general-english-image-caption-blip on 2025-05-17

a photograph of a group of people standing around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-18

The image captures a social gathering, possibly a formal or semi-formal outdoor event, featuring a group of individuals seated and conversing around tables. Various beverages and food items are visible on the tables, along with glasses and other dining items. The setting includes chairs and a canopy, suggesting an outdoor event such as a garden party or reception. The clothing of the individuals appears to be mid-20th-century attire, with dresses and suits noted. The mood appears to be lively and interactive, as people are engaged in conversations or leaning towards each other. The image is presented as a negative, giving it a distinctive inverted color effect.

Created by gpt-4o-2024-08-06 on 2025-06-18

The image appears to show a group of people gathered at a social event or gathering, likely a meal or banquet, given the presence of a table set with dishes, glasses, and bottles. The photo is a negative, so the colors are inverted. There are several individuals sitting around the table engaged in conversation, with one man and woman standing, possibly interacting with those seated. The seated individuals are dressed in what appears to be formal or semi-formal attire, consistent with a mid-20th-century style. The setting seems to be outdoors, possibly under a tent or canopy, as suggested by the tent-like outline in the background. The overall atmosphere appears to be lively and sociable.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to depict a social gathering or event. There are several people gathered around a table, some standing and some seated. The table is covered with various items, including bottles, glasses, and what looks like food. The people in the image are dressed in formal attire, suggesting this may be a formal event or celebration. The overall scene conveys a sense of sociability and interaction among the individuals present.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a black and white historical photograph from what looks like a social gathering or dinner event. The image shows a group of people seated at what appears to be a dining table with plates, cups, and other dining items visible. The photo has a somewhat overexposed or high-contrast quality typical of photographs from an earlier era, possibly the 1930s or 1940s based on the image number "17539" visible in the corner. The lighting creates an interesting effect where some areas are quite bright while others fall into shadow, giving the image a distinctive vintage quality. The scene appears to capture a moment of social interaction, with people engaged in what seems to be conversation or dining together.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-04

The image is a black-and-white photograph of a group of people gathered around a table, likely at a social event or party.

  • People:
    • There are approximately 15 people in the image.
    • They are all dressed in formal attire, with men wearing suits and women wearing dresses.
    • Some of the individuals are standing, while others are seated at the table.
  • Table:
    • The table is covered with a dark-colored tablecloth.
    • There are several glasses, bottles, and plates on the table.
    • A few people are holding glasses or bottles.
  • Background:
    • The background of the image is out of focus, but it appears to be a room with white walls and a high ceiling.
    • There are some people standing in the background, but they are not clearly visible.
  • Overall:
    • The atmosphere of the image suggests a formal or semi-formal gathering, possibly a party or celebration.
    • The people in the image appear to be enjoying themselves, laughing and chatting with one another.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-04

This image depicts a black-and-white photograph of a group of people gathered around a table, with a man and woman standing in the center. The man is dressed in a white suit jacket, while the woman wears a dark dress. They are surrounded by several other individuals, some of whom are seated at the table, which is set with glasses, plates, and a bottle.

The atmosphere appears to be one of celebration or social gathering, possibly a party or special event. The image has a vintage feel, suggesting that it may have been taken in the mid-20th century. The overall mood is lively and convivial, with the people in the image seeming to enjoy each other's company.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

The image appears to be a black-and-white photograph of a social gathering or event. The people in the image are dressed in formal attire, with some wearing suits and ties and others wearing dresses and skirts. The gathering appears to be taking place outdoors, as there are trees and other greenery visible in the background. The people are seated at tables and standing around, and some are engaged in conversation or other activities. The image has a slightly blurry effect, which may be due to the age of the photograph or the quality of the reproduction.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A black-and-white image of a group of people gathered together, probably for a party or a celebration. Some of them are standing, while others are sitting on chairs. They are all dressed in formal attire. There are glasses, plates, and bottles on the table in front of them. There are also blurry people standing behind them. There are also some numbers and letters written on the image.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

The image is a black and white negative photograph, likely taken in the mid-20th century. It depicts a group of people, seemingly at an outdoor gathering, possibly a luncheon or garden party.

Key elements and observations:

  • Setting: The scene appears to be under a canopy or awning, and the bright background suggests an outdoor environment.
  • People: There are numerous individuals present, both men and women. Some are seated around a table, while others are standing and interacting. The individuals are dressed in clothing typical of the mid-century era.
  • Table and Food: A table is prominently featured, laden with glasses, bottles, and what appears to be food. This suggests a social occasion with refreshments.
  • Interaction: Some individuals are engaged in conversation or gestures, conveying a sense of social interaction.
  • Formal Attire: The presence of suits and dresses implies a degree of formality to the event.
  • Style: The negative format provides a distinct aesthetic, with inverted colors and tones.

Overall, the photograph captures a moment of social interaction and celebration, offering a glimpse into the lifestyle of the period.

Created by gemini-2.0-flash on 2025-05-17

Certainly! Here's a description of the image:

Overall Impression:

The image shows a group of people gathered around tables, likely at an outdoor social event or gathering. The style of clothing suggests it's a historical photograph, likely from the mid-20th century. The image is inverted, and the lighting is peculiar, which may be due to the negative format.

Key Elements:

  • People: Several individuals are present, both standing and seated. Their attire indicates a formal or semi-formal occasion.
  • Tables: Tables are set with glasses, bottles, and plates of food.
  • Setting: The presence of some kind of canopy suggests that the event is likely outdoors, possibly in a garden or similar area.
  • Interaction: There is some interaction between the attendees, with people talking, looking at each other, and gesturing.

Composition and Style:

  • Group Dynamic: The composition suggests a convivial atmosphere, with people engaged in conversation and enjoying each other's company.
  • Period Details: The clothing, hairstyles, and overall ambiance evoke a sense of a bygone era.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

This black-and-white photograph appears to be from a social gathering or event. The image captures a group of people, both men and women, in what seems to be a festive or celebratory setting. Here are some detailed observations:

  1. People and Attire:

    • The individuals are dressed in formal or semi-formal attire, indicative of a special occasion.
    • The men are wearing suits or jackets, while the women are in dresses or skirts with blouses.
  2. Setting:

    • The event seems to be taking place outdoors, under a canopy or tent, as suggested by the visible awning at the top of the image.
    • There are tables with food and drinks, suggesting a meal or refreshments are being served.
  3. Activities:

    • Some people are standing and engaged in conversation, while others are seated.
    • One man in the center is holding a cigarette, which was common in social settings during certain historical periods.
    • A woman in a patterned dress is smiling and appears to be interacting with the man holding the cigarette.
  4. Atmosphere:

    • The overall mood seems jovial and relaxed, with people enjoying each other's company.
    • The presence of food, drinks, and the casual interactions suggest a friendly and social atmosphere.
  5. Photographic Details:

    • The image has a number "17539" printed at the top and bottom, which might be a reference or catalog number.
    • The photograph has some visible damage or wear, indicating it might be an old print.

This image likely captures a moment from a mid-20th-century social event, reflecting the fashion, social norms, and atmosphere of that era.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-08

This is a black-and-white photograph depicting a social gathering, likely a formal event or dinner party. The image shows a group of people seated at a long table, which is set with plates, glasses, bottles, and what appears to be food. The individuals are dressed in formal or semi-formal attire, suggesting a special occasion. One man in a suit is interacting with a woman at the table, possibly serving her food or engaging in conversation. In the background, other guests are standing and seated, creating a lively atmosphere. The setting appears to be outdoors or in a well-lit area, given the bright lighting and shadows visible in the photo. The overall mood seems convivial and social.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-08

This is a black-and-white photograph depicting a group of people gathered around a table, seemingly engaged in a social event or gathering. The people are dressed in formal or semi-formal attire. The table is set with various items including glasses, bottles, and what appears to be a bowl of nuts or snacks. The background suggests an outdoor setting, possibly under a tent or canopy, with additional people and chairs visible. The image has a vintage feel, indicated by the clothing styles and the black-and-white format. The numbers "17539" are printed at the top and bottom of the image.

Text analysis

Amazon

17539.

Google

."3 5 ר( ב 5 ד = eaדAe-MANMב
."3
5
ר(
ב
ד
=
eaדAe-MANMב