Human Generated Data

Title

Untitled (woman surrounded by men in tuxes, Mask and Wig: University of Pennsylvania, Philadelphia, Pennsylvania)

Date

1937, printed later

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.299

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman surrounded by men in tuxes, Mask and Wig: University of Pennsylvania, Philadelphia, Pennsylvania)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.299

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 98.2
Person 98.1
Person 97.6
Person 97.4
Person 97.1
Person 96.4
Crowd 96.3
Person 96.2
Person 95.5
Person 95.2
Person 93.6
Person 93.1
Person 91.6
People 86.7
Suit 78.1
Clothing 78.1
Apparel 78.1
Coat 78.1
Overcoat 78.1
Audience 69.3
Suit 67.4
Suit 65.3
Press Conference 62.3
Jury 57.9

Clarifai
created on 2023-10-25

group 100
people 100
group together 99.7
adult 98.8
man 98
portrait 97
many 96.4
leader 96.3
woman 94.3
actor 92.9
several 89.1
four 88.2
collage 87.3
league 87.2
administration 87
facial expression 83.9
five 83.1
partnership 81.9
wedding 80.7
unify 78.5

Imagga
created on 2022-01-08

groom 77.4
businessman 56.5
business 49.8
man 44.4
team 43
corporate 43
meeting 41.5
office 40.2
teamwork 39.9
people 39.6
businesswoman 39.1
male 39
group 37.1
businesspeople 37
professional 33.5
person 33.4
colleagues 32.1
men 30.1
executive 28.9
happy 28.8
work 28.3
suit 27.1
adult 26.5
success 25.8
job 25.7
smile 24.2
communication 23.5
manager 22.4
successful 22
kin 21.6
together 21
working 20.3
smiling 20.3
staff 20.1
businessmen 19.5
confident 19.1
women 19
coworkers 18.7
company 18.6
laptop 18.2
worker 18.1
handsome 17.8
career 17
attractive 16.8
discussing 16.7
partner 16.4
corporation 16.4
partnership 16.3
sitting 15.5
workplace 15.3
couple 14.8
associates 14.8
diverse 14.7
cooperation 14.5
busy 14.5
diversity 14.4
leadership 14.4
boss 14.4
talking 14.3
portrait 14.2
happiness 14.1
computer 13.6
workers 13.6
employee 13
table 13
discussion 12.7
partners 12.6
30s 12.5
desk 12.3
standing 12.2
presentation 12.1
modern 11.9
businesswomen 11.8
conference 11.7
lifestyle 11.6
holding 11.6
ethnic 11.4
cheerful 11.4
looking 11.2
pretty 11.2
building 11.1
20s 11
indoor 11
planning 10.6
indoors 10.5
formal 10.5
black 10
mid adult 9.7
four 9.6
student 8.9
crew 8.9
handshake 8.8
brass 8.7
tie 8.5
room 8.5
finance 8.5
entrepreneur 8.4
interaction 7.9
30 35 years 7.9
well dressed 7.8
businessperson 7.8
leader 7.7
expression 7.7
hand 7.6
females 7.6
wind instrument 7.5
mature 7.4
friendly 7.3
lady 7.3

Google
created on 2022-01-08

Coat 87.8
Collar 83.5
Suit 79.4
Blazer 77.7
Formal wear 77.6
Font 74
White-collar worker 74
Crew 73.6
Event 73.5
Vintage clothing 71.1
Team 69.7
Art 64.5
Classic 63.7
Stock photography 63.5
History 60.1
Uniform 58.9
Monochrome 55.5
Retro style 52.9
Family reunion 52.5
Sitting 52.4

Microsoft
created on 2022-01-08

person 100
posing 99.3
clothing 96.9
text 95.5
man 94.7
group 90.8
smile 84.4
standing 79.4
old 75
suit 71.1
black 67.7
dressed 35
clothes 19
crowd 0.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 99.4%
Happy 95.9%
Angry 2%
Confused 0.7%
Surprised 0.5%
Calm 0.4%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.5%
Happy 99.4%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Calm 0.1%
Sad 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Sad 21.5%
Calm 20.2%
Fear 18%
Disgusted 14.3%
Happy 10.9%
Confused 5.3%
Surprised 5.2%
Angry 4.7%

AWS Rekognition

Age 12-20
Gender Female, 99.9%
Happy 98%
Angry 0.5%
Calm 0.3%
Surprised 0.3%
Confused 0.3%
Disgusted 0.3%
Sad 0.2%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Female, 96.8%
Calm 96.9%
Happy 1.9%
Sad 0.6%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Happy 87.1%
Calm 10.2%
Confused 0.6%
Surprised 0.6%
Angry 0.5%
Disgusted 0.3%
Fear 0.3%
Sad 0.3%

AWS Rekognition

Age 20-28
Gender Male, 97.2%
Calm 94.5%
Sad 2.8%
Confused 1.5%
Fear 0.3%
Surprised 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.6%
Calm 56.4%
Happy 25.4%
Surprised 5.9%
Confused 3.6%
Angry 3.2%
Disgusted 2.2%
Fear 1.6%
Sad 1.6%

AWS Rekognition

Age 22-30
Gender Male, 97.5%
Calm 85.8%
Surprised 4.2%
Sad 2.9%
Happy 2.5%
Confused 1.4%
Angry 1.3%
Fear 1%
Disgusted 0.8%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 51.1%
Angry 13.3%
Confused 11.2%
Surprised 7%
Sad 6.8%
Disgusted 5.3%
Fear 3.5%
Happy 1.8%

AWS Rekognition

Age 20-28
Gender Female, 71.9%
Calm 42.3%
Sad 34.3%
Surprised 6.9%
Disgusted 4.3%
Fear 3.9%
Angry 2.9%
Happy 2.8%
Confused 2.7%

AWS Rekognition

Age 21-29
Gender Female, 94.7%
Sad 78.8%
Fear 13.7%
Calm 2.8%
Confused 2.4%
Disgusted 0.8%
Angry 0.7%
Surprised 0.5%
Happy 0.4%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 11
Gender Female

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Person 98.1%
Person 97.6%
Person 97.4%
Person 97.1%
Person 96.4%
Person 96.2%
Person 95.5%
Person 95.2%
Person 93.6%
Person 93.1%
Person 91.6%
Suit 78.1%
Suit 67.4%
Suit 65.3%

Categories

Imagga

people portraits 97.7%
paintings art 1.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-02

a photograph of a group of people posing for a photo -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-11

The image shows a vintage black-and-white photograph of a formal gathering or party. Several individuals are dressed in elegant attire, predominantly tuxedos, indicative of a formal event or high society function. The woman in the center is wearing an evening gown, with floral adornments visible on her dress. The group appears seated and gathered closely together in an opulent setting, featuring fabric curtains and ornate decor, suggesting a luxurious environment. The overall mood is lively and social.

Created by gpt-4o-2024-08-06 on 2025-06-11

The image shows a black-and-white photograph of a group of people dressed in formal attire. Most of the individuals are wearing tuxedos, suggesting the setting might be a formal event or party. The people are positioned casually around a woman in an elegant dress, who is seated in the center. Some individuals are seated on the floor, while others are sitting on a couch or standing behind it. The room has a patterned carpet and curtains with a wavy texture. One person standing at the back holds a drink in his hand. The overall atmosphere suggests a light-hearted and sociable gathering.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-09

The image is a black-and-white photograph of a group of people in formal attire, likely taken in the 1920s or 1930s. The scene appears to be a social gathering, possibly at a party or nightclub.

  • A group of people:
    • There are approximately 12 individuals in the photo.
    • They are all dressed in formal attire, with men wearing tuxedos and women wearing evening gowns.
    • The group is diverse in terms of age and gender.
  • A woman in a dress:
    • One woman stands out from the rest, wearing a sleeveless evening gown with a halter neck and a long skirt.
    • She has blonde hair styled in an updo and is wearing high heels.
    • She is surrounded by several men, who are all looking at her with interest.
  • A man with a drink:
    • One man is holding a glass in his hand, which appears to contain a dark liquid.
    • He is standing to the right of the woman in the dress and is looking at her with a smile.
    • His attire is similar to the other men in the group, with a tuxedo and bow tie.
  • A man with his arm around a woman:
    • Another man has his arm around the woman in the dress, pulling her close to him.
    • He is looking at her with a romantic gaze, and she seems to be enjoying his attention.
    • His attire is also formal, with a tuxedo and bow tie.

Overall, the image captures a lively and intimate moment between the group of people, with the woman in the dress being the central figure. The formal attire and the setting suggest that this is a special occasion, possibly a wedding or a formal ball.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-09

This image is a black and white photograph of a group of men in tuxedos surrounding a woman in a formal dress. The woman, positioned in the center, wears a dark-colored dress with a halter top and has a white flower in her hair. She is seated on the lap of one of the men, who is also wearing a tuxedo.

The men are all dressed in formal attire, consisting of black jackets, white shirts, and bow ties. They are arranged around the woman, with some standing and others sitting or kneeling. The background of the image features a wall with a window covered by a white curtain, as well as a patterned carpet on the floor.

The overall atmosphere of the image suggests a formal event or gathering, possibly a party or celebration. The presence of the woman in the center, surrounded by the men, implies that she may be the focus of attention or the guest of honor.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image is a black-and-white photograph of a group of men and a woman dressed in formal attire. They are gathered together, possibly at a formal event or social gathering. The men are wearing tuxedos with bow ties, while the woman is wearing a sleeveless dress with a flower on her head. The group is arranged in a semi-circle, with the woman sitting in the center and the men surrounding her. The man on the right side of the image is holding a glass in his hand.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photo shows a group of people wearing formal attire. The group consists of men and a woman. The woman is sitting in the middle, wearing a black dress and a flower in her hair. The men are wearing tuxedos, bow ties, and white shirts. Some of them are sitting, while others are standing. Two of them are holding a glass of wine. Behind them is a white curtain and a window.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here's a description of the image:

This black and white photograph shows a group of young people formally dressed. Most of the individuals are young men in tuxedos with bow ties. A single woman is seated prominently in the center of the group; she is wearing a dark-colored dress. She has fair skin and wavy blond hair adorned with a floral or lacy hairpiece.

The group is positioned in what seems to be an indoor setting, with draped curtains visible in the background, likely indicating a formal event like a party or gathering. Some of the men are seated on a couch, while others stand or kneel around them. There's interaction and conversation happening within the group, as some individuals are looking at each other and engaged in discussion. One man near the back is standing and holding a glass. The overall mood of the photograph suggests a social event taking place, possibly a prom, debutante ball, or similar formal affair.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

Overall Impression:

The image is a black and white photograph of a group of well-dressed people, likely from the mid-20th century. The setting appears to be an indoor event, possibly a formal gathering or party. The mood is one of camaraderie and elegance.

People and Appearance:

  • There are about a dozen people in the frame, mostly young men in formal attire.
  • The men are wearing tuxedos with bow ties, suggesting a high level of formality.
  • One woman is present, seated among the men. She is also formally dressed, wearing a dark halter-neck gown.
  • Many of the men are looking at the camera and smiling.
  • Some are gesturing or interacting with each other, suggesting conversation and social engagement.

Setting and Composition:

  • The photograph appears to be taken indoors.
  • The background includes ornate curtains, indicating a potentially opulent setting.
  • The composition is well-balanced, with the group arranged in a way that makes the woman seated among the men the focal point.
  • The black and white tonality adds to the classic feel of the image.

Possible Context:

The image likely captures a social gathering from a specific era, such as a formal dance, a debutante ball, or a similar event. The attire and overall atmosphere suggest a sense of status and formality.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-01

The image is a black and white photograph depicting a group of people, mostly men, dressed in formal attire, including tuxedos and bow ties. The setting appears to be an elegant, possibly vintage, room with decorative elements like draped curtains and a mantelpiece in the background.

In the center of the image, a woman is seated, wearing a formal gown and a flower in her hair. She seems to be the focal point of the gathering, as the men around her are engaged in conversation and interactions with her. Some of the men are standing, while others are seated or crouching, creating a dynamic and lively composition. The expressions on their faces vary, with some smiling and others appearing more serious or contemplative.

The overall atmosphere suggests a formal event or gathering, possibly a party or a social function from a bygone era, given the style of clothing and the monochrome nature of the photograph.