Human Generated Data

Title

Untitled (Baldwin School alumni gathered in large room)

Date

1937

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8449

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Baldwin School alumni gathered in large room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8449

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Human 98.9
Clothing 98.5
Apparel 98.5
Crowd 83.6
People 69
Robe 66.5
Fashion 66.5
Gown 65
Indoors 64.8
Wedding 62.9
Room 62.5
Dance Pose 60.5
Leisure Activities 60.5
Dress 60.3
Portrait 59.4
Face 59.4
Photography 59.4
Photo 59.4
Female 57.2
Wedding Gown 56.6

Clarifai
created on 2023-10-26

people 99.7
music 98.2
group 97.5
monochrome 96.8
adult 96.7
many 96.5
group together 95.9
man 95
woman 94.7
dancing 93.8
musician 93.6
wear 90.3
child 90.2
recreation 86.9
several 85.9
crowd 85.4
street 81.3
audience 80.9
singer 80.9
education 80.3

Imagga
created on 2022-01-15

teacher 28.2
people 27.9
man 26.2
person 26.1
silhouette 25.6
adult 20.8
educator 20
male 19.1
sport 16.7
professional 16.2
men 15.5
group 15.3
business 15.2
dance 15.1
black 15
businessman 15
dancer 14.3
life 13.5
sunset 13.5
performer 12.8
team 11.6
summer 11.6
success 11.3
beach 11
active 10.9
water 10.7
walking 10.4
player 10.3
women 10.3
motion 10.3
art 10.2
happy 10
outdoor 9.9
human 9.7
run 9.6
sky 9.6
boy 9.6
world 9.4
grunge 9.4
travel 9.1
leisure 9.1
portrait 9.1
pose 9.1
style 8.9
couple 8.7
clothing 8.7
meeting 8.5
action 8.3
teamwork 8.3
lady 8.1
recreation 8.1
design 7.9
sand 7.9
silhouettes 7.8
play 7.8
crowd 7.7
move 7.7
casual 7.6
musical instrument 7.6
dark 7.5
athlete 7.4
light 7.4
suit 7.3
exercise 7.3
dirty 7.2
lifestyle 7.2
ball 7.2
body 7.2
activity 7.2
sea 7.1
family 7.1
work 7.1
modern 7

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

text 99
outdoor 92.3
person 92
dance 89.1
sport 85
wedding dress 74.1
clothing 73.8
group 62
woman 60
man 51.9
bride 51
clothes 17.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 83.2%
Sad 65.2%
Fear 14.7%
Happy 8.1%
Calm 5.4%
Confused 3.4%
Angry 1.3%
Disgusted 1.1%
Surprised 0.9%

AWS Rekognition

Age 27-37
Gender Male, 79.4%
Calm 77.3%
Fear 7.8%
Happy 6%
Sad 3.5%
Confused 2%
Disgusted 1.7%
Angry 1.1%
Surprised 0.6%

AWS Rekognition

Age 21-29
Gender Male, 86.5%
Calm 74.9%
Sad 9.3%
Confused 3.7%
Surprised 3.6%
Happy 2.7%
Fear 2.4%
Disgusted 2.3%
Angry 1.2%

AWS Rekognition

Age 19-27
Gender Male, 81.6%
Calm 63.3%
Sad 22.6%
Happy 6%
Confused 4.2%
Angry 1.2%
Disgusted 1.1%
Fear 0.8%
Surprised 0.7%

AWS Rekognition

Age 45-51
Gender Female, 63.7%
Sad 95%
Happy 1.3%
Calm 1.1%
Surprised 1%
Fear 0.7%
Disgusted 0.4%
Confused 0.3%
Angry 0.2%

AWS Rekognition

Age 20-28
Gender Male, 78.5%
Happy 45.6%
Sad 27.4%
Calm 15.6%
Confused 4.3%
Fear 3.4%
Angry 1.7%
Disgusted 1.2%
Surprised 0.8%

AWS Rekognition

Age 18-24
Gender Female, 88.2%
Calm 88.7%
Sad 3.4%
Happy 2%
Angry 1.6%
Fear 1.4%
Confused 1.1%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Female, 99.1%
Calm 59.7%
Happy 20.3%
Sad 8.3%
Fear 6.6%
Surprised 2.2%
Confused 1.4%
Disgusted 0.8%
Angry 0.7%

AWS Rekognition

Age 11-19
Gender Female, 99.6%
Calm 71.1%
Happy 19.4%
Sad 6.4%
Disgusted 0.9%
Fear 0.8%
Confused 0.6%
Angry 0.5%
Surprised 0.3%

AWS Rekognition

Age 18-24
Gender Male, 61%
Calm 96.6%
Happy 1.9%
Sad 0.7%
Angry 0.2%
Confused 0.2%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 14-22
Gender Female, 98.7%
Calm 77.4%
Happy 16.2%
Sad 3.8%
Confused 0.9%
Angry 0.7%
Fear 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 18-24
Gender Female, 73.5%
Calm 88.4%
Sad 7.9%
Happy 1.6%
Angry 0.8%
Confused 0.6%
Disgusted 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 20-28
Gender Male, 67.6%
Calm 99.6%
Sad 0.1%
Happy 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 97.9%
Happy 82.5%
Calm 8.7%
Sad 3.4%
Confused 2.5%
Fear 0.9%
Surprised 0.7%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 6-12
Gender Male, 94.3%
Calm 63%
Happy 20.9%
Sad 4.4%
Angry 3.3%
Confused 2.7%
Surprised 2.2%
Disgusted 1.9%
Fear 1.6%

AWS Rekognition

Age 23-31
Gender Female, 83.6%
Calm 80.1%
Angry 6.7%
Disgusted 4.3%
Sad 3.5%
Surprised 2.4%
Happy 1.5%
Confused 0.9%
Fear 0.8%

AWS Rekognition

Age 23-31
Gender Male, 74.5%
Calm 98.8%
Sad 0.8%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%
Surprised 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Female, 91.4%
Sad 63.7%
Calm 20.6%
Confused 13.7%
Happy 0.7%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 18-26
Gender Female, 99.4%
Calm 62.1%
Fear 12.8%
Disgusted 8.9%
Happy 8.3%
Sad 3.3%
Angry 2%
Confused 1.6%
Surprised 1.1%

AWS Rekognition

Age 18-24
Gender Female, 93.7%
Calm 68.9%
Happy 22.6%
Sad 4.6%
Angry 1.3%
Fear 0.8%
Confused 0.7%
Disgusted 0.7%
Surprised 0.4%

AWS Rekognition

Age 19-27
Gender Female, 95.6%
Calm 77.6%
Happy 10.5%
Sad 7.7%
Angry 1.2%
Disgusted 1.1%
Confused 0.8%
Fear 0.7%
Surprised 0.5%

AWS Rekognition

Age 20-28
Gender Male, 79.2%
Calm 98.5%
Sad 0.5%
Happy 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 56.5%
Calm 67%
Happy 18.7%
Sad 5.5%
Angry 4.9%
Fear 1.4%
Disgusted 0.9%
Surprised 0.9%
Confused 0.7%

AWS Rekognition

Age 20-28
Gender Male, 71.1%
Calm 74.5%
Happy 16%
Sad 5.1%
Angry 1.3%
Confused 1.3%
Surprised 0.6%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 12-20
Gender Female, 88.2%
Calm 84.8%
Angry 4.2%
Sad 3.8%
Confused 3%
Happy 2.1%
Fear 0.8%
Surprised 0.7%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person

Clarifai

Clothing
Footwear
Woman
Man
Human face

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 92.6%

AWS Rekognition

Person 92%

AWS Rekognition

Person 88.9%

AWS Rekognition

Person 82.9%

AWS Rekognition

Person 78%

AWS Rekognition

Person 61.7%

AWS Rekognition

Person 61.1%

AWS Rekognition

Person 49.7%

AWS Rekognition

Person 47.9%

Clarifai

Clothing 74.1%

Clarifai

Clothing 71.7%

Clarifai

Clothing 66.5%

Clarifai

Clothing 65.2%

Clarifai

Clothing 61.8%

Clarifai

Clothing 61.6%

Clarifai

Clothing 55%

Clarifai

Clothing 54.7%

Clarifai

Clothing 50.3%

Clarifai

Clothing 47%

Clarifai

Clothing 45.7%

Clarifai

Clothing 40.7%

Clarifai

Clothing 39.7%

Clarifai

Clothing 39.2%

Clarifai

Clothing 38.6%

Clarifai

Clothing 37.4%

Clarifai

Clothing 36.2%

Clarifai

Clothing 35.2%

Clarifai

Clothing 34.6%

Clarifai

Clothing 34%

Clarifai

Clothing 33.9%

Clarifai

Clothing 33.5%

Clarifai

Clothing 33.5%

Clarifai

Clothing 33.3%

Clarifai

Clothing 33.2%

Clarifai

Footwear 69%

Clarifai

Footwear 62.7%

Clarifai

Footwear 60.9%

Clarifai

Footwear 60.1%

Clarifai

Footwear 58.6%

Clarifai

Footwear 54.5%

Clarifai

Footwear 53.8%

Clarifai

Footwear 48.6%

Clarifai

Footwear 42.8%

Clarifai

Footwear 36.2%

Clarifai

Footwear 33.1%

Clarifai

Woman 61.4%

Clarifai

Woman 51.5%

Clarifai

Woman 47.3%

Clarifai

Woman 47.1%

Clarifai

Woman 46.3%

Clarifai

Woman 45.3%

Clarifai

Woman 43%

Clarifai

Woman 42%

Clarifai

Woman 35.4%

Clarifai

Woman 35%

Clarifai

Woman 34.3%

Clarifai

Man 52.1%

Clarifai

Man 48.5%

Clarifai

Man 40.6%

Clarifai

Man 34.9%

Clarifai

Human face 47%

Clarifai

Human face 39.1%

Clarifai

Human face 38.9%

Clarifai

Human face 35%

Clarifai

Human face 34.3%

Clarifai

Human face 33.9%

Categories

Imagga
created on 2022-01-15

interior objects 90.1%
paintings art 3.5%
food drinks 1.7%
people portraits 1%
events parties 1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-14

dancers perform during a performance.

Salesforce

Created by general-english-image-caption-blip on 2025-05-21

a photograph of a group of people in white dresses and hats

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

The image appears to be a photographic negative of a formal event or gathering. In the foreground, there are several individuals seated on chairs, possibly wearing robes or dresses, surrounding a central figure who is also seated. Another individual is standing beside or addressing the seated group.

The setting is an indoor space with a sizable audience seated on chairs, visible in the background. The people in the audience are dressed in what seems like semi-formal attire, and the room has high ceilings with multiple light fixtures hanging. Windows and doors are visible, letting in natural light, and the flooring appears to be smooth, likely wooden.

Details such as patterns on a rug in the center, the positioning of chairs, and the overall ambiance suggest the occasion might be ceremonial or educational.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image is a black and white negative photograph of a formal gathering, possibly a graduation or a ceremony involving diplomas. The composition features a large room filled with people, with seating arranged in rows, and individuals of varying appearances seated.

In the foreground, several individuals, likely women, are sitting and dressed in what appear to be robes or formal attire. Another person stands in front of them, also dressed in a robe, suggesting they might be presenting or addressing the seated group. The room is quite spacious, with windows visible in the background, allowing for natural light. A patterned rug or carpet is laid on the floor in the central area.

The audience in the room is sizable, with a mix of individuals watching the event, and their attire appears to be formal, with dresses and suits being common. The room has a high ceiling, and multiple ceiling fans or lights are visible.

The film edges and numbers are visible, indicating the image is an original photographic negative.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to depict a large gathering or event taking place in an indoor setting. There is a crowd of people, mostly women, seated in chairs arranged in rows. Some individuals are standing and appear to be participating in some kind of performance or activity. The scene suggests a formal or ceremonial occasion, with decorations and lighting visible in the background. Overall, the image conveys a sense of a significant social gathering or event unfolding.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This is a black and white photograph that appears to be from a religious or ceremonial gathering. The image shows a large room filled with people dressed in white robes or gowns. There's a patterned rug or carpet visible on the floor in the center of the image. The room appears to be well-lit with pendant lights hanging from the ceiling. The attendees are seated in what look like folding chairs arranged in rows. The photograph has a formal, ceremonial quality to it, and based on the style and composition, it appears to be from an earlier historical period, possibly mid-20th century. The image has a negative number or date visible at the bottom, suggesting it may be from an archive or historical collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image depicts a black-and-white photograph of a group of women gathered in a large room, likely a community center or event space. The women are seated in rows of folding chairs, with some standing and others sitting on the floor. They appear to be engaged in a discussion or presentation, with one woman at the front of the room holding a microphone and speaking to the group.

In the foreground, there is a small table with a floral patterned tablecloth, and a few women are standing around it, possibly participating in a demonstration or activity. The background of the image shows a large room with high ceilings, windows, and doors, as well as a few decorative elements such as chandeliers and a Christmas tree in the corner.

The overall atmosphere of the image suggests a sense of community and engagement among the women, who seem to be enjoying themselves and participating in a lively discussion or activity. The image appears to be a candid shot, taken during a moment of conversation or interaction among the women.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people, mostly women, gathered in a large room. The room has a high ceiling and is well-lit, with several windows along the back wall. The women are seated in chairs arranged in rows, facing the front of the room. Some of them are holding books or papers, while others have their hands clasped together in their laps.

In the foreground, there is a small table or platform with a rug on it, where a few women are standing. One of them appears to be speaking or leading the group in some way. The atmosphere seems to be one of reverence or solemnity, as the women are all dressed in formal attire and are paying close attention to the speaker.

Overall, the image suggests that this is a religious or spiritual gathering of some kind, possibly a church service or a meeting of a women's organization. The formal dress and serious demeanor of the women suggest that this is an important event, and the speaker's presence at the front of the room implies that she is a leader or authority figure within the group.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a large gathering of people in a hall, possibly for a religious ceremony or service. The people are seated in rows, and some are standing, while others are holding books or other items. The image has a watermark in the top left corner and a date stamp in the bottom right corner. The people in the image are dressed in white robes, and some are wearing hats. The image also shows a table with a cloth and a book on it.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white image shows a group of people in a hall. The people are wearing white robes, and some of them are sitting on chairs while others are standing. There are some people standing in front of the people sitting on chairs, and some of them are holding books. The floor is shiny, and there is a carpet on the floor. There are lamps hanging from the ceiling.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-18

This is a black and white image taken from an older film negative. It captures a large gathering, most likely a religious or civic event, held indoors. The focus is on a group of women, likely attending a gathering.

Here's a breakdown:

  • Setting: The scene takes place indoors, possibly in a large hall. The room features columns, rows of hanging lights, and windows or doorways in the background.
  • Participants: A sizable crowd of people, predominantly women, fills the space. Most are seated in folding chairs, indicating a formal or organized event. A group of several women stand in the front on a decorated rug, and one woman is standing and facing the group.
  • Attire: The attendees are dressed in modest attire, including long white robes. The woman standing in front has a lighter color robe and a different hairstyle from the rest.
  • Activity: The individuals appear to be reading from books or pamphlets. This suggests a religious or literary context, possibly a meeting, a service, or a lecture.
  • Overall Impression: The image evokes a sense of solemnity, community, and formality. The older film negative format adds a historical and nostalgic touch.

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

This black and white negative shows a large group of people, primarily women, gathered in what appears to be an auditorium or large hall. The room has high ceilings with visible structural beams and hanging light fixtures. Tall windows are set into the back wall.

In the foreground, several women are seated in folding chairs, wearing what seems to be white robes or gowns. One woman is standing, facing away from the camera, also in a white robe. There are open books or papers in the laps of some of the seated women. In front of these women is a small decorative rug on the floor.

Behind the seated women, a larger group of people are seated in rows of chairs. Their faces are somewhat blurry and difficult to make out, but it appears to be a mixed-age group of primarily women.

The image has an aged quality due to its being a negative. There is also some text and markings visible on the margins of the photograph, likely related to the original cataloging or printing process.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image depicts a fashion show taking place in a large room filled with an audience. The audience, primarily women, is seated in rows of chairs facing the runway where models are showcasing various outfits. The models are dressed in a mix of formal and casual attire, with some wearing coats, dresses, and hats. The room has a classic architectural style with high ceilings and large windows, and it is decorated with hanging lights. The audience members are attentively watching the models as they walk down the runway, displaying the latest fashion trends. The atmosphere appears to be formal and elegant, typical of a high-end fashion event.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-07

The image is a black-and-white photograph depicting a group of people in a formal setting, likely a social or community gathering. The room is spacious with a wooden floor, and there are multiple rows of seated individuals in the background, suggesting an audience or spectators. In the foreground, a group of people dressed in formal attire are standing in a line, facing the audience. They appear to be performing or presenting, as some are holding small objects or props. The setting suggests a formal event, possibly a concert, play, or a public speaking event. The audience is dressed in elegant clothing, indicating the formal nature of the event. The photograph has a vintage quality, with a caption and number in the bottom right corner that reads "3013-2-I-2."

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-07

This is a black-and-white photograph of a formal event, possibly a fashion show or a cultural presentation, taking place in a spacious hall. The audience is seated on folding chairs, dressed in formal attire. In the center of the image, three individuals are on a small stage or platform, wearing what appear to be traditional or ceremonial costumes. The person on the left is wearing a mask, and the other two are dressed in flowing garments. The overall atmosphere suggests a cultural or artistic performance being observed by an attentive audience. The image has a vintage feel, indicated by the style of clothing, the black-and-white format, and the handwriting at the bottom of the photograph.

Text analysis

Amazon

DELENDER
3013
.EIOE
DELENDER SVEETA BVZ
-EIOE
SVEETA
inmuls numbles .EIOE
inmuls
BVZ
numbles
ج٢٤٠٦٠

Google

POLPY
POLPY