Human Generated Data

Title

Untitled (birds eye view of debutante reception)

Date

1941

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8434

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (birds eye view of debutante reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8434

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 98.9
Clothing 95.5
Apparel 95.5
Collage 86.9
Advertisement 86.9
Poster 86.9
Outdoors 85.7
Nature 82.1
Chair 78
Furniture 78
Female 70.9
People 68.8
Crowd 68.7
Shorts 65.8
Face 65.6
Girl 62.1
Table 57
Art 56.4
Paper 55.7
Sand 55.2

Clarifai
created on 2023-10-25

people 99.7
many 99.5
group 98.7
crowd 96.9
group together 96.8
man 95.7
adult 94.4
war 94.1
woman 92.8
administration 87.6
wear 87.4
military 86.9
monochrome 83
vehicle 81.3
street 78.3
leader 77.6
outfit 75.4
recreation 74.8
desktop 74.3
audience 74.3

Imagga
created on 2022-01-09

people 25.1
male 20.6
group 20.1
person 18.9
silhouette 18.2
sport 17.5
man 17.5
photographer 16.4
men 15.4
black 15.1
world 13.8
sexy 13.6
adult 12.5
player 12.4
fashion 12
girls 11.8
stage 11.6
party 11.2
women 11.1
city 10.8
team 10.7
athlete 10.7
crowd 10.6
style 10.4
portrait 10.3
clothing 10.3
art 10.2
music 9.9
business 9.7
happy 9.4
model 9.3
street 9.2
teen 9.2
teenager 9.1
attractive 9.1
pose 9
fun 9
posing 8.9
businessman 8.8
light 8.7
active 8.6
youth 8.5
dance 8.5
event 8.3
leisure 8.3
spectator 8
night 8
lifestyle 7.9
child 7.9
boy 7.8
play 7.7
travel 7.7
performance 7.6
studio 7.6
dark 7.5
friendship 7.5
toyshop 7.3
paint 7.2
color 7.2
body 7.2
sunset 7.2
musician 7.2
love 7.1
ball 7.1
together 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 97.9
outdoor 97
posing 92.8
person 92.2
black and white 80.1
group 77.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 54-64
Gender Male, 92.5%
Happy 93.5%
Sad 4%
Confused 0.8%
Calm 0.7%
Fear 0.3%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 35-43
Gender Male, 86.2%
Sad 37.6%
Calm 22%
Happy 19.7%
Angry 6.5%
Fear 5.9%
Confused 4.8%
Surprised 1.8%
Disgusted 1.6%

AWS Rekognition

Age 40-48
Gender Male, 97.4%
Calm 48.6%
Sad 26.6%
Surprised 9%
Happy 6.2%
Angry 4.1%
Confused 2%
Disgusted 2%
Fear 1.5%

AWS Rekognition

Age 28-38
Gender Male, 53.3%
Happy 83.3%
Calm 7.5%
Sad 4.4%
Confused 2.7%
Surprised 0.8%
Fear 0.5%
Angry 0.4%
Disgusted 0.4%

AWS Rekognition

Age 34-42
Gender Male, 91.8%
Sad 38.9%
Calm 26.2%
Happy 25.3%
Confused 3.6%
Fear 3%
Disgusted 1.7%
Angry 0.8%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Painting

Clarifai

Clothing
Human face
Footwear
Person
Man
Tree

AWS Rekognition

Person 98.9%

AWS Rekognition

Person 97.4%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 92.1%

AWS Rekognition

Person 65.5%

AWS Rekognition

Person 60.8%

AWS Rekognition

Person 48.3%

AWS Rekognition

Painting 56.4%

Clarifai

Clothing 69%

Clarifai

Clothing 67%

Clarifai

Clothing 65.2%

Clarifai

Clothing 58%

Clarifai

Clothing 55.3%

Clarifai

Clothing 49.4%

Clarifai

Clothing 49.3%

Clarifai

Clothing 46.7%

Clarifai

Clothing 45.6%

Clarifai

Clothing 41.5%

Clarifai

Clothing 40.7%

Clarifai

Clothing 39.6%

Clarifai

Clothing 38%

Clarifai

Clothing 37.7%

Clarifai

Clothing 37.7%

Clarifai

Clothing 37.6%

Clarifai

Clothing 37%

Clarifai

Clothing 36.1%

Clarifai

Clothing 35.2%

Clarifai

Clothing 34.5%

Clarifai

Clothing 33.6%

Clarifai

Human face 61.7%

Clarifai

Human face 55%

Clarifai

Human face 53.6%

Clarifai

Human face 50.2%

Clarifai

Human face 50.2%

Clarifai

Human face 48%

Clarifai

Human face 47%

Clarifai

Human face 44.7%

Clarifai

Human face 43.1%

Clarifai

Human face 42.8%

Clarifai

Human face 41%

Clarifai

Human face 40.3%

Clarifai

Human face 37.8%

Clarifai

Human face 34.2%

Clarifai

Human face 34.2%

Clarifai

Footwear 60.7%

Clarifai

Footwear 57.5%

Clarifai

Footwear 56.5%

Clarifai

Footwear 55.2%

Clarifai

Footwear 54.3%

Clarifai

Footwear 44.5%

Clarifai

Footwear 42.6%

Clarifai

Footwear 41.2%

Clarifai

Footwear 34.3%

Clarifai

Person 56.4%

Clarifai

Person 50.3%

Clarifai

Man 54.9%

Clarifai

Man 48.1%

Clarifai

Man 47.4%

Clarifai

Man 36.5%

Clarifai

Tree 37%

Categories

Imagga
created on 2022-01-09

paintings art 70.9%
people portraits 12%
streetview architecture 9.7%
interior objects 2.2%
beaches seaside 2.1%
pets animals 1.5%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-15

the crowd gathered around the bar.

Salesforce

Created by general-english-image-caption-blip on 2025-05-19

a photograph of a group of people standing around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

This image appears to be a photographic negative, showing a social gathering in an outdoor setting. People are seated at small tables, engaging in conversation and dressed in formal or semi-formal attire, including suits, dresses, and hats. Some individuals are standing and interacting around the tables. The environment includes trees and natural scenery in the background, with what seems to be a patio or terrace area. Decoration can be observed in the image, such as a floral arrangement. Overall, the image depicts a lively social event, though the details are inverted in typical negative format, making bright areas appear dark and vice versa.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a photographic negative depicting a social gathering. It shows a group of people dressed in formal attire, possibly from the mid-20th century, gathered in an outdoor or semi-outdoor setting. The attendees seem to be enjoying themselves, sitting around small tables and engaging in conversation. The attire includes suits for men and dresses with hats for women, indicative of a formal or semi-formal event. The arrangement suggests the setting might be a patio or terrace, with trees or plants visible in the background. The negative film marks are present, indicating it is an unprocessed film negative.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-12

The image appears to be a black and white photograph of a crowded indoor scene. It shows a large group of people, both men and women, gathered together in what looks like some kind of social or formal event. The people are dressed in a variety of formal attire, including suits, dresses, and hats. Some individuals are standing together in small groups, while others are seated at tables or standing near the edges of the frame. The overall atmosphere seems to be one of a lively social gathering or celebration.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-12

This appears to be a black and white historical photograph from what looks like the 1930s (based on the number 77033 visible in the corner). The image shows a large crowd of people gathered together, with some wearing white coats or uniforms while others are in darker clothing. The photo appears to be taken from an elevated angle looking down at the group. The image quality and style is characteristic of photography from that era, with some graininess and wear visible in the photograph. The crowd seems to be formally arranged, possibly for an institutional or professional group photo.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-24

This image is a black-and-white photograph of a gathering of people, possibly at an event or party. The scene is set in a room with a high ceiling, and the attendees are dressed in formal attire, with men wearing suits and women wearing dresses and hats.

The room appears to be decorated with tables and chairs, and there may be some sort of stage or platform in the background. The atmosphere seems to be lively and celebratory, with people mingling and socializing.

The image has a vintage feel to it, suggesting that it may have been taken in the mid-20th century. Overall, the photograph captures a moment of joy and community among the people gathered in the room.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-24

The image is a black-and-white photograph of a group of people gathered in a large outdoor space, possibly a patio or courtyard. The image appears to be an old photograph, with visible signs of aging such as scratches, fading, and a worn-out appearance.

Here are the key elements in the image:

  • Group of People
    • There are approximately 20-25 people in the image, all dressed in formal attire.
    • They are standing or sitting in a large outdoor space, possibly a patio or courtyard.
    • The group appears to be diverse, with people of different ages, genders, and ethnicities.
  • Outdoor Space
    • The outdoor space is large and open, with no visible walls or structures.
    • There are several tables and chairs scattered throughout the space, suggesting that it may be a dining area or event space.
    • The floor is made of concrete or stone, and there are some plants and trees visible in the background.
  • Formal Attire
    • All of the people in the image are dressed in formal attire, including suits, dresses, and hats.
    • The men are wearing suits and ties, while the women are wearing dresses and hats.
    • The formal attire suggests that the event or occasion being photographed is a formal one, such as a wedding or a business conference.
  • Background
    • The background of the image is blurry and out of focus, but it appears to be a natural setting, possibly a park or garden.
    • There are some trees and plants visible in the background, and the sky is visible through the gaps between the buildings.
    • The background is not the main focus of the image, which is the group of people gathered in the foreground.

Overall, the image suggests that it was taken at a formal event or occasion, possibly a wedding or a business conference. The group of people gathered in the image are all dressed in formal attire, and the outdoor space they are in appears to be a large and open area.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-24

The black-and-white image features a group of people gathered in an outdoor setting, possibly for a party or event. The group is gathered in a square-shaped area with a few tables and chairs. Some people are standing, while others are seated. The people are dressed in formal attire, and some are wearing hats. The area is surrounded by a fence, and there are trees and other vegetation in the background.

Created by amazon.nova-lite-v1:0 on 2025-05-24

The image is a black-and-white photograph of a gathering of people in an outdoor setting. The photograph appears to be from the 1930s or 1940s, based on the style of clothing and the overall composition. The people in the image are dressed in formal attire, with men wearing suits and ties and women wearing dresses and hats. Some of the women are also wearing gloves. The gathering appears to be a social event, possibly a party or a formal dinner. The people are standing and sitting in groups, with some individuals standing near the edges of the photograph. The image has a slightly blurry quality, which adds to the nostalgic feel of the photograph. The photograph also has a watermark in the top right corner, which reads "170 33."

Google Gemini

Created by gemini-2.0-flash on 2025-04-29

Here's a description of the image:

This black and white negative shows a group of people gathered at what appears to be an outdoor event or party. The scene is from an elevated perspective, looking down on the group.

Several round tables are scattered throughout the area, with some people seated and others standing around them. Many of the people are wearing hats. A notable detail is the presence of two men in the foreground, standing side by side. One is wearing a dark suit, and the other is in a light-colored suit.

In the background, there's a fountain and some foliage, suggesting the gathering is taking place in a garden or park-like setting. The negative has "EASTMAN SAFETY KODAK" printed along the right side, and a number "17033" at the bottom.

Created by gemini-2.0-flash-lite on 2025-04-29

Here is a description of the image:

The image is a negative black and white photograph of a social gathering, likely outdoors. It appears to be a party or event, with people seated at tables and standing around.

Here's a breakdown of the scene:

  • People: There's a large number of people in the image, dressed in attire that suggests an older era. Many women are wearing hats, and some people are in suits.
  • Setting: The setting appears to be a patio or outdoor space. There are tables with chairs set up. The background has a blurred effect, suggesting trees or foliage.
  • Composition: The photo is taken from a high angle, looking down on the scene. The composition is somewhat crowded, with many people and tables filling the frame.
  • Other elements: The photo appears to be a film negative, and the edges of the film strip are visible. There are numbers at the bottom.

Overall, the image gives a sense of a formal gathering or social event from the past.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-25

The image appears to be a black-and-white photograph taken from an elevated angle, capturing a formal social event. The scene is set outdoors, possibly in a garden or courtyard area.

Key details include:

  1. Attendees: The event is attended by a group of people, both men and women, dressed in formal attire. Men are wearing suits, while women are in dresses and hats, indicating a formal or semi-formal occasion.

  2. Seating Arrangement: There are several round tables with chairs arranged around them, suggesting a sit-down event. Some tables have tablecloths, and there are floral centerpieces on a few tables.

  3. Activity: People are engaged in conversation, some standing and others seated. A few individuals appear to be moving around or interacting with others.

  4. Setting: The event is taking place in an outdoor area with visible greenery and trees in the background. There is a pathway or walkway adjacent to the seating area.

  5. Photographic Style: The photograph has a vintage feel, possibly from the mid-20th century, given the style of clothing and the black-and-white format.

  6. Additional Elements: There are a few waiters or staff members in white jackets, indicating that the event is catered.

Overall, the image captures a moment from a formal outdoor gathering, with attendees dressed elegantly and engaged in social interactions.

Qwen

No captions written

Text analysis

Amazon

33
170. 33
170.
0

Google

77033
77033