Human Generated Data

Title

Untitled (crowd of people gathered around table in courtyard)

Date

1942

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10546

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (crowd of people gathered around table in courtyard)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10546

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.2
Human 99.2
Person 99.2
Person 99
Person 98.9
Chair 98.7
Furniture 98.7
Person 98.6
Person 98.6
Audience 96.8
Crowd 96.8
Person 96.8
Clothing 95.4
Apparel 95.4
Sitting 92.2
Person 89.5
Person 89
Person 86
Person 85.6
Person 84.2
Person 83.6
Suit 81.1
Coat 81.1
Overcoat 81.1
Person 79.9
People 78.6
Person 76.4
Indoors 72.9
Room 70.4
Classroom 69.2
School 69.2
Photography 66
Photo 66
Portrait 63.5
Face 63.5
Leisure Activities 62.8
Cafeteria 61.6
Restaurant 61.6
Female 60.8
Pants 59.4
Tuxedo 59
Cafe 57.3
Speech 57.1

Clarifai
created on 2023-10-25

people 99.9
many 98.6
group 98
group together 97.5
woman 97.3
man 97.2
adult 96.6
education 93.6
administration 92.9
crowd 89.4
music 89.3
child 88.7
audience 87.9
recreation 87.3
school 86.9
leader 81.6
chair 81.1
boy 78.9
adolescent 78
furniture 77.9

Imagga
created on 2022-01-09

photographer 50.5
group 29.8
people 29
male 24.8
room 23.4
classroom 23.4
silhouette 22.3
man 22.2
person 21.7
business 21.2
men 20.6
businessman 20.3
meeting 16
office 14.7
work 14.1
team 13.4
building 13
hall 12.4
corporate 12
spectator 11.9
city 11.6
crowd 11.5
table 11.2
women 11.1
businesswoman 10.9
sky 10.8
happy 10.6
job 10.6
together 10.5
boy 10.4
manager 10.2
chair 9.9
sunset 9.9
travel 9.9
executive 9.7
urban 9.6
education 9.5
adult 9.5
teamwork 9.3
teacher 9.2
musical instrument 9.2
wind instrument 9.1
tourism 9.1
brass 8.9
architecture 8.6
sitting 8.6
beach 8.4
communication 8.4
vacation 8.2
board 8.1
success 8
lifestyle 7.9
professional 7.9
couple 7.8
conference 7.8
school 7.8
blackboard 7.8
stage 7.7
modern 7.7
diversity 7.7
boss 7.6
center 7.6
relax 7.6
desk 7.6
active 7.5
water 7.3
worker 7.1
night 7.1
interior 7.1
working 7.1
sea 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

building 99.4
person 98.2
text 92.9
clothing 90.5
man 89.1
black and white 78.4
people 55.4
crowd 1.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 72.6%
Happy 58.2%
Calm 20%
Sad 6.4%
Surprised 6.4%
Confused 3.7%
Angry 2.7%
Disgusted 1.7%
Fear 1%

AWS Rekognition

Age 33-41
Gender Female, 89.1%
Calm 86%
Happy 6.8%
Sad 5.8%
Confused 0.5%
Surprised 0.4%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Male, 89.3%
Calm 42.7%
Sad 40.6%
Happy 8%
Confused 3.2%
Angry 2.5%
Disgusted 1.6%
Surprised 1%
Fear 0.5%

AWS Rekognition

Age 33-41
Gender Male, 99.5%
Calm 98.9%
Sad 0.6%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 38-46
Gender Male, 87.4%
Calm 96.7%
Happy 1.7%
Sad 1.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 40-48
Gender Male, 99.9%
Calm 85.7%
Happy 5.1%
Sad 4.2%
Surprised 2.6%
Disgusted 0.7%
Angry 0.7%
Confused 0.7%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Female, 97.8%
Calm 58.4%
Happy 32.7%
Sad 5%
Confused 1.1%
Surprised 0.9%
Disgusted 0.8%
Fear 0.6%
Angry 0.5%

AWS Rekognition

Age 29-39
Gender Male, 61.4%
Calm 76.8%
Sad 13.2%
Happy 5.6%
Confused 3.1%
Disgusted 0.5%
Angry 0.4%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 38-46
Gender Male, 93.4%
Calm 64.9%
Happy 31%
Sad 1.5%
Surprised 0.9%
Confused 0.8%
Disgusted 0.5%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Female, 68.9%
Surprised 62.5%
Calm 28%
Sad 5%
Fear 1.8%
Confused 1.3%
Disgusted 0.6%
Angry 0.4%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Male, 98.4%
Calm 99.1%
Happy 0.3%
Sad 0.2%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Chair
Person 99.2%
Person 99.2%
Person 99%
Person 98.9%
Person 98.6%
Person 98.6%
Person 96.8%
Person 89.5%
Person 89%
Person 86%
Person 85.6%
Person 84.2%
Person 83.6%
Person 79.9%
Person 76.4%
Chair 98.7%

Categories

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a group of people sitting around a table -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image shows a group of people gathered together in an indoor setting with a brick wall and paned window in the background. They appear to be seated and standing around a small table with floral arrangements. The individuals are dressed in formal or semi-formal attire, such as suits, dresses, and patterned clothing. The gathering looks like a social, celebratory, or family event. A man in uniform stands prominently in the center, suggesting his role may be significant within the group. The setting includes chairs and tiled flooring, indicating a comfortable indoor environment.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a black-and-white photograph featuring a group of people gathered together in what appears to be a social setting. The individuals are seated and standing around a table with flowers on it. The setting gives the impression of being indoors with brick walls and windows in the background. The group is diverse in terms of attire, with some individuals dressed in suits and others in various styles of dresses. The mood appears to be lively and pleasant, suggesting a friendly gathering or celebration. The numbers "20304" are handwritten on the top and side borders of the image.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to be a black and white photograph of a group of people gathered together in what seems to be a social or celebratory event. The group includes both men and women of various ages, dressed in formal attire. They are seated and standing around a table, with some individuals holding flowers or other decorative items. The background shows a brick wall, suggesting an indoor setting. The overall scene conveys a sense of community and togetherness.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white historical photograph that appears to be from the mid-20th century. It shows a group of elderly people gathered together in what looks like a community or social setting. The room has a brick wall visible in the background and some windows with curtains. The people are seated in chairs and appear to be at some kind of organized gathering or event. Many of the women are wearing dresses with polka dots or floral patterns typical of the era, while some of the men are wearing suits. The image has numbers written on the edge, suggesting it may be from an archive or photo collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people gathered in a room, likely taken in the mid-20th century. The scene appears to be a social gathering or celebration, with the individuals dressed in formal attire.

  • Group of People:
    • There are approximately 15 people in the photo, all of whom are dressed in formal clothing.
    • The majority of the individuals are seated, while a few are standing behind them.
    • The group consists of both men and women, with some wearing suits and ties, while others wear dresses and skirts.
  • Setting:
    • The background of the photo features a brick wall with a window on the left side.
    • The floor is made of tile, and there are several chairs and tables scattered throughout the room.
    • The atmosphere of the photo suggests a formal event or celebration, possibly a wedding or anniversary party.
  • Additional Details:
    • The photo has a handwritten note in the top-left corner that reads "2034."
    • The note is written in black ink and appears to be a date or label of some kind.
    • The photo itself is mounted on a piece of paper or cardboard, which has a rough texture and a slight crease in the top-left corner.

Overall, the image provides a glimpse into a social gathering from the past, showcasing the formal attire and traditional setting of the time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image appears to be a black-and-white photograph of a group of people gathered in a room. The individuals are dressed in formal attire, with the men wearing suits and ties, while the women wear dresses. They are seated on chairs or standing, with some holding glasses that may contain drinks.

In the background, there is a brick wall and a window with a black frame. The overall atmosphere suggests a social gathering or celebration, possibly a party or special event. The image has a vintage feel to it, with the black-and-white tone and the style of clothing worn by the individuals.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-07

The image is a black-and-white photograph of a group of people gathered in a room. They are seated and standing, with some individuals sitting on chairs and others standing behind them. The people in the foreground are wearing black face paint, which is a common practice in minstrel shows. The photograph has a vintage look, with a watermark in the top left corner that reads "20304" and "20304-1" in the bottom left corner. The image captures a moment of performance or entertainment, with the people in the room likely participating in a minstrel show or similar event.

Created by amazon.nova-pro-v1:0 on 2025-06-07

A black-and-white photograph shows a group of people gathered in a room with brick walls. The group consists of men and women, some of whom are wearing formal attire. Some of them are sitting on a chair, while others are standing. Some of them are wearing black paint on their faces, while others are not. The group seems to be posing for a photograph.

Google Gemini

Created by gemini-2.0-flash on 2025-05-04

Here's a description of the image:

This is a black and white photographic negative featuring a group of people in what appears to be an outdoor gathering or party. The environment includes a brick wall and a window with multiple panes.

In the foreground, there's a person holding a glass. Several people are seated in chairs or on benches, while others are standing. One man is in what looks like a military uniform.

The photograph has a reversed tonal range due to it being a negative, meaning bright areas appear dark and vice-versa. There are handwritten numbers "20304" visible at the top and on the left side of the frame, possibly related to archival or cataloging information.

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

Overall Impression: The image appears to be a somewhat aged photograph or a negative, given its tonality and the presence of the numbers "20304" and a "6" on the left side. It depicts a gathering of people, possibly a social event or party, indoors with a brick wall as a backdrop.

Key Elements:

  • Group of People: There's a crowd of men and women of varying ages. They are dressed in what appears to be vintage clothing, suggesting a time period perhaps of the mid-20th century.
  • Setting: The scene takes place in a room that has a brick wall, and a window. There are chairs present, suggesting a space designed for sitting or lounging.
  • Interactions: Some people are looking at the camera or appear to be interacting with each other. A few are raising glasses or gesturing, indicating the celebratory nature of the gathering.
  • Tone: The atmosphere seems social and friendly.
  • Style: The photograph is a negative, giving the image an inverted color scheme.

Overall, the image captures a snapshot of a group of people at a social gathering. The presence of the brick wall, the vintage attire, and the atmosphere suggest it could be a historical photograph.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-05

The image is a black-and-white photograph featuring a group of people gathered in what appears to be an indoor setting, possibly a social event or gathering. The group consists of men and women, with most individuals dressed in formal attire, including suits, dresses, and hats. The setting is indoors with brick walls and a tiled floor, and there is a window with curtains on the left side.

Several people are seated on chairs, while others are standing or kneeling in the foreground. The expressions on their faces are mostly neutral or serious, which is typical for older photographs. Some individuals are holding flowers, suggesting that this might be a special occasion or celebration. The overall atmosphere appears to be formal and somewhat somber. The photograph has markings in the top corners, indicating it might be part of a larger collection or archive.

Text analysis

Amazon

9
20304.

Google

203애. 2030니.
203
.
2030