Human Generated Data

Title

Untitled (group of formally dressed men and a woman posed in a kitchen)

Date

c. 1945

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11660

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (group of formally dressed men and a woman posed in a kitchen)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11660

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 99.4
Clothing 98.4
Apparel 98.4
Clinic 88.5
Coat 76.8
People 73.7
Face 67
Doctor 66.8
Lab Coat 65.1
Scientist 64.9
Portrait 60.6
Photography 60.6
Photo 60.6
Shelter 59.2
Nature 59.2
Outdoors 59.2
Countryside 59.2
Building 59.2
Rural 59.2
Hospital 57.2
Suit 57.1
Overcoat 57.1

Clarifai
created on 2023-10-25

people 99.6
group 99.6
adult 98
man 96.6
medical practitioner 94.9
many 94.4
woman 94.2
group together 93
uniform 89.9
healthcare 87.7
monochrome 84.2
outerwear 83.5
education 82.9
wear 81.3
coat 80.7
several 80.2
science 75.3
medicine 73.3
portrait 72.7
hospital 71.4

Imagga
created on 2022-01-15

nurse 100
doctor 49.8
medical 45.9
hospital 42.7
man 39.7
person 38.4
coat 36.2
professional 35.6
medicine 35.2
male 33.3
care 32.1
happy 31.3
health 31.3
team 30.5
clinic 30
stethoscope 29
lab coat 28.7
adult 28.1
people 27.9
doctors 25.6
uniform 23.8
patient 23.5
smiling 23.1
smile 22.1
practitioner 21.9
looking 21.6
men 21.5
occupation 21.1
worker 20.7
mature 20.5
job 20.4
group 20.2
portrait 20.1
business 20
surgeon 19.5
work 18.8
clinical 18.6
standing 18.3
staff 18.2
businessman 17.7
confident 17.3
teamwork 16.7
specialist 16.6
camera 15.7
happiness 15.7
friendly 15.6
elderly 15.3
profession 15.3
colleagues 14.6
lifestyle 14.5
handsome 14.3
golfer 14.3
indoors 14.1
casual 13.6
women 13.4
student 13.4
working 13.3
senior 13.1
two 12.7
physician 12.7
expertise 12.6
case 12.5
30s 12.5
day 11.8
consultant 11.7
laboratory 11.6
player 11.6
cheerful 11.4
healthy 11.3
couple 11.3
success 11.3
old 11.1
indoor 11
bright 10.7
face 10.7
partnership 10.6
illness 10.5
sick person 9.8
good mood 9.8
attractive 9.8
assistant 9.7
mid adult 9.6
office 9.6
teacher 9.6
confidence 9.6
color 9.5
clothing 9.4
successful 9.2
contestant 9.1
human 9
clinician 8.9
general practitioner 8.9
surgical 8.9
expert 8.9
coworkers 8.8
heal 8.8
healing 8.8
40s 8.8
ill 8.8
health care 8.7
older 8.7
building 8.7
practice 8.7
chart 8.6
corporate 8.6
black 8.4
treatment 8.3
aged 8.1
interior 8
gray hair 7.9
associates 7.9
lab 7.8
sick 7.7
diversity 7.7
hand 7.6
businesspeople 7.6
positive 7.4
businesswoman 7.3
home 7.2
hair 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

person 97
posing 91.8
text 86.9
standing 81
clothing 70.6
group 68.8
wedding dress 68.7
black and white 63.4
old 55.4
dressed 28.6
clothes 15.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 52.6%
Happy 59%
Confused 11.2%
Sad 7.8%
Surprised 6.5%
Disgusted 6.5%
Calm 4%
Fear 3.4%
Angry 1.6%

AWS Rekognition

Age 48-54
Gender Male, 97.1%
Happy 71.5%
Surprised 15.2%
Calm 5.6%
Sad 2.4%
Confused 1.6%
Fear 1.5%
Disgusted 1.1%
Angry 1%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Happy 79.5%
Surprised 13.4%
Confused 3.4%
Angry 1.5%
Disgusted 1%
Fear 0.6%
Sad 0.5%
Calm 0.1%

AWS Rekognition

Age 37-45
Gender Male, 89.8%
Happy 44.4%
Calm 41.3%
Surprised 8.7%
Sad 2.1%
Confused 1.2%
Disgusted 1%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 45-53
Gender Male, 99.2%
Happy 56.6%
Calm 37.8%
Surprised 1.8%
Sad 1.3%
Confused 0.8%
Fear 0.6%
Disgusted 0.6%
Angry 0.6%

AWS Rekognition

Age 30-40
Gender Female, 80.9%
Happy 64.7%
Fear 21.8%
Surprised 6.4%
Calm 4.4%
Disgusted 1.1%
Confused 0.7%
Sad 0.5%
Angry 0.5%

AWS Rekognition

Age 31-41
Gender Male, 98.6%
Calm 98.1%
Sad 0.5%
Surprised 0.4%
Happy 0.3%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helmet

Clarifai

Man
Woman
Clothing
Human face

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97%

AWS Rekognition

Person 93.8%

AWS Rekognition

Person 74.7%

AWS Rekognition

Person 63.5%

AWS Rekognition

Helmet 87.7%

Clarifai

Man 86.4%

Clarifai

Man 80.5%

Clarifai

Man 79.5%

Clarifai

Man 78.2%

Clarifai

Man 61.6%

Clarifai

Man 61.4%

Clarifai

Man 53.1%

Clarifai

Man 43.3%

Clarifai

Man 41.5%

Clarifai

Man 40%

Clarifai

Man 39%

Clarifai

Woman 75.7%

Clarifai

Woman 43.3%

Clarifai

Woman 40.2%

Clarifai

Clothing 71.2%

Clarifai

Clothing 65.6%

Clarifai

Clothing 60.5%

Clarifai

Clothing 60.2%

Clarifai

Human face 47.8%

Clarifai

Human face 42.6%

Clarifai

Human face 39.2%

Clarifai

Human face 39.1%

Clarifai

Human face 38.7%

Clarifai

Human face 38.3%

Clarifai

Human face 37.6%

Clarifai

Human face 36.4%

Clarifai

Human face 34.2%

Categories

Imagga
created on 2022-01-15

people portraits 65.9%
streetview architecture 24.6%
events parties 3.7%
beaches seaside 2.7%
paintings art 1.1%
nature landscape 1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

the wedding party in the wedding dress.

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a group of people standing around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image depicts a group of people dressed in formal attire, with suits, ties, and dresses, posing together in a festive or celebratory atmosphere. The negative format adds an inverted visual effect, making light areas appear dark and vice versa. The setting appears to be indoors, possibly a kitchen or similar room with cabinets and curtains visible in the background. Some individuals are gesturing cheerfully, and there is a table in the foreground with various objects, including a pitcher and cups.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image appears to be a negative photograph of a group of individuals in a room, likely taken at an event or gathering. The group consists of people dressed in formal attire, with men wearing suits and ties, and at least one woman in a dress. Several individuals are holding drinks or glasses, suggesting a celebratory occasion. The room features paneled walls and cabinets, and there is a table in the foreground with a pitcher and glasses on it. The attire and setting suggest a vintage or historic feel to the gathering.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image shows a group of people dressed in white medical or laboratory attire, posing together in what appears to be a medical or scientific setting. The individuals are wearing white coats, hats, and masks, and they are holding various medical or scientific instruments. The image has a black and white, vintage aesthetic, suggesting it was taken some time in the past. The people in the image seem to be engaged in some kind of group activity or event, though the specific context is not clear from the image alone.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This appears to be a vintage black and white photograph, likely from the early-to-mid 20th century. The image shows a group of people at what seems to be a social gathering or party. The subjects are dressed formally - most of the men are wearing white suits with ties, and there's a woman in a dress on the left. They appear to be in a celebratory mood, holding drinks and smiling. The setting looks like it could be a club, party room, or social hall, with wooden paneled walls and cabinets visible in the background. The photo has a distinctive negative number "9354" written at the top. The image has that characteristic high-contrast look common to flash photography of that era.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of a group of people in a room, likely taken in the early 20th century. The photo is marked with the number "9354" in the top-left corner and has a white border around it.

  • Group of People:
    • There are approximately 12 people in the photo.
    • They are all dressed in formal attire, with the men wearing suits and hats, and the women wearing dresses.
    • Some of the individuals are holding objects, such as a glass or a pipe.
  • Room:
    • The room appears to be a large, dimly lit space with a high ceiling.
    • There are several pieces of furniture, including a table and chairs, as well as a curtain or drapes in the background.
    • The walls are made of wood paneling, and there are several doors visible in the background.
  • Lighting:
    • The lighting in the photo is dim, with the only light source coming from a single overhead light fixture.
    • The shadows cast by the people and objects in the photo are deep and pronounced.
  • Overall:
    • The photo has a nostalgic feel to it, evoking a sense of a bygone era.
    • The formal attire and the setting suggest that the photo may have been taken at a special event or occasion.

In summary, the image is a black-and-white photograph of a group of people in a formal setting, likely taken in the early 20th century. The photo is marked with the number "9354" and has a white border around it. The group is dressed in formal attire, and the room is dimly lit with a single overhead light fixture. The photo has a nostalgic feel to it, evoking a sense of a bygone era.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-29

The image is a black-and-white photograph of a group of people in a kitchen, with the majority of them holding drinks and cigarettes. The group consists of 12 individuals, all dressed in formal attire, including suits, ties, and hats for the men, and a dress for the woman on the left. They are standing around a table with various items on it, such as glasses, bottles, and a pitcher.

The background of the image shows a kitchen with dark wood cabinets and a countertop. The overall atmosphere of the image suggests a celebratory or social gathering, possibly a party or special occasion. The formal attire and the presence of drinks and cigarettes suggest that the event may have been a sophisticated or upscale affair.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-29

The image is a black-and-white photograph featuring a group of people dressed in white coats and hats, reminiscent of a scientific or medical setting. The individuals are gathered around a table in a room that appears to be a laboratory. The table is cluttered with various items, including a jug, a cup, and a glass, suggesting an ongoing activity or experiment. The people are engaged in what appears to be a celebratory or festive atmosphere, with some holding glasses and others smiling. The background includes cabinets and a window, contributing to the laboratory ambiance. The image is bordered with numbers, possibly indicating a catalog or reference system.

Created by amazon.nova-pro-v1:0 on 2025-05-29

The black-and-white image is a photo of a group of people wearing white clothes and hats. They are standing in a room, smiling, and posing for a photo. Some of them are holding glasses, and one is holding a cigarette. They are gathered around a table with a jug, a cup, and a bottle on top. Behind them, there is a cabinet with drawers and a door.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-01

Certainly! Here's a description of the image:

Overall Impression:

The image appears to be a vintage negative, showing a group of people in what seems to be a celebration or party scene. The subjects are clustered together, and the atmosphere seems convivial.

Specific Details:

  • The Subjects: There are about a dozen people in the image. They seem to be dressed in a mix of formal and casual attire. Some men are wearing white jackets and suits, and some have hats. One woman is wearing a formal dress and a crown. Most of the people appear to be smiling and engaged in the activity.
  • Setting: The scene takes place indoors, likely in a kitchen or a room with kitchen cabinets and a long table.
  • Objects: On the table are glasses and a pitcher, suggesting the presence of drinks. Some people are holding glasses and cigars.
  • Mood: The overall mood is one of revelry, celebration, or possibly a gathering of friends or colleagues. The smiles and gestures of the people create a sense of camaraderie.

Additional Notes:

  • The presence of the negative suggests that this is an older photograph, likely from the early to mid-20th century.
  • The image has been inverted, so the colors are not represented normally. The light areas are dark and vice versa.

Created by gemini-2.0-flash on 2025-05-01

Here is a description of the image:

The image appears to be a black and white negative photograph of a group of people, likely taken in the early 20th century, based on the clothing styles. The group is gathered indoors, possibly in a kitchen or dining area, as suggested by the presence of cabinets in the background and a table in the foreground.

There are approximately nine individuals in the frame. Several of them are men wearing suits or jackets, some with ties and hats, while at least one woman is wearing a dress. The table in the foreground has glasses and a pitcher on it, and some people in the group are holding glasses, suggesting a gathering or celebration.

The image is numbered "9354" at both the top and bottom left corners. There is also some text or notation on the right side of the image, running vertically. The composition of the photo indicates that the group is posing or has been arranged for the shot, given their proximity to one another and their apparent focus on the camera. The room behind them has a light fixture hanging from the ceiling, and the cabinets appear to have simple, possibly wooden doors.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-02

The image depicts a group of people dressed in various costumes, likely participating in a themed event or party. The setting appears to be indoors, possibly in a room with lockers in the background, suggesting a locker room or similar space.

Key details include:

  1. Costumes and Props:

    • Several individuals are wearing white lab coats, suggesting a medical or scientific theme.
    • A few people are dressed in more formal attire, such as dresses and suits.
    • Some individuals are holding props, including glasses and a pitcher.
    • One person is wearing a hat with the number "48" on it.
  2. Facial Features:

    • The faces of the individuals are painted black, which is indicative of blackface, a historically racist practice used in minstrel shows and other forms of entertainment. This aspect of the image is highly problematic and offensive by modern standards.
  3. Setting:

    • The room has a utilitarian appearance with lockers and a simple curtain in the background.
    • There is a table in the foreground with various items on it, including glasses and a pitcher.
  4. Mood and Expression:

    • The individuals appear to be in a jovial mood, smiling and posing for the camera.

Overall, the image captures a moment from a themed event with costumes and props, but it also includes a highly offensive element with the use of blackface.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-11

This image appears to be a black-and-white photograph taken in a formal setting, possibly a private club or party. The scene is lively, with a group of people dressed in formal attire, including white suits and ties, as well as a woman in a dress. The individuals are gathered around a table with drinks, including a pitcher and glasses, suggesting a celebratory or social occasion. The background features a patterned wall and a light fixture, adding to the ambiance of the setting. The photograph has a vintage quality, indicated by the style of clothing and the overall aesthetic. The number "9354" is prominently displayed in the corner, possibly indicating a catalog or reference number.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-11

This black-and-white photograph depicts a group of people dressed in white formal attire, seemingly from a past era, possibly the early to mid-20th century. They are gathered around a table with a pitcher and glasses, suggesting a celebratory or social occasion. The individuals are posing playfully, with exaggerated facial expressions and body language. Some are holding drinks, while others have their hands raised or are playfully interacting with each other. The setting appears to be indoors, possibly a backstage area or a dressing room, given the presence of wardrobes in the background. The image has a vintage feel, with the people's attire and the overall composition giving it a historical context. The number "9354" is visible in the top left corner of the photograph, likely indicating a catalog or archive number.

Text analysis

Amazon

9354
9354.
A72A
MJI7
MJI7 УТЭРАЗ A72A
УТЭРАЗ

Google

9354. 9354.
9354.