Human Generated Data

Title

Untitled (wedding guests seated on folding chairs; men standing in background)

Date

1942

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10681

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (wedding guests seated on folding chairs; men standing in background)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10681

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Clothing 99.9
Apparel 99.9
Human 99.5
Robe 94.6
Fashion 94.6
Gown 94.1
Accessories 93.4
Accessory 93.4
Female 90.2
Overcoat 90.1
Coat 90.1
Wedding 88.7
Bridegroom 81.2
Bride 80.9
Wedding Gown 80.9
Face 78.7
Woman 77
Photography 64.1
Photo 64.1
Portrait 63.1
Furniture 57
People 56.9
Tuxedo 56.3
Girl 55.4
Flower 55.3
Plant 55.3
Blossom 55.3

Clarifai
created on 2023-10-26

people 99.5
woman 98.5
adult 98.2
group 97.8
man 97.6
monochrome 90
wedding 89.4
three 89.2
facial expression 88.5
group together 88.2
medical practitioner 87.2
wear 86.9
indoors 84.3
four 82.7
sit 82.2
two 81.1
chair 80.9
outerwear 79.9
five 77.1
healthcare 76

Imagga
created on 2022-01-15

nurse 60.4
person 40.7
patient 35.7
people 35.7
man 35.6
male 31.9
adult 26.8
couple 22.7
senior 22.5
indoors 22
groom 21.8
smiling 20.3
professional 19.9
men 19.8
happy 19.4
home 19.1
sitting 18.9
business 17.6
sick person 17.4
case 17.1
businessman 16.8
medical 15.9
life 15.8
room 15.6
office 15.4
women 15
hospital 15
mature 14.9
colleagues 14.6
lifestyle 14.5
worker 14.3
specialist 14.2
happiness 14.1
together 14
cheerful 13.8
salon 13.7
hairdresser 13.6
casual 13.6
two 13.6
work 13.3
businesspeople 13.3
health 13.2
doctor 13.2
group 12.9
indoor 12.8
job 12.4
meeting 12.2
teacher 12.2
occupation 11.9
color 11.7
two people 11.7
30s 11.5
illness 11.4
talking 11.4
table 11.3
love 11
portrait 11
clinic 10.9
businesswoman 10.9
team 10.8
care 10.7
smile 10.7
husband 10.6
working 10.6
coat 10.5
elderly 10.5
old 10.5
wife 10.4
teamwork 10.2
inside 10.1
face 9.9
hand 9.9
coworkers 9.8
40s 9.7
to 9.7
mid adult 9.7
bride 9.6
desk 9.4
horizontal 9.2
modern 9.1
family 8.9
interior 8.8
computer 8.8
retired 8.7
retirement 8.6
married 8.6
educator 8.5
wedding 8.3
holding 8.3
new 8.1
looking 8
medicine 7.9
70s 7.9
associates 7.9
day 7.8
corporate 7.7
sick 7.7
marriage 7.6
20s 7.3
lady 7.3
student 7.3
dress 7.2

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

person 99.2
text 83.1
clothing 82
human face 73.4
woman 66.2
black and white 64.1
posing 43

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 99.4%
Surprised 51.4%
Sad 34.5%
Calm 9.2%
Fear 1.3%
Angry 1.3%
Confused 1.1%
Disgusted 0.7%
Happy 0.5%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Sad 87.2%
Calm 5.8%
Happy 1.8%
Angry 1.5%
Confused 1.3%
Fear 1%
Disgusted 0.8%
Surprised 0.7%

AWS Rekognition

Age 34-42
Gender Male, 98.7%
Sad 90.7%
Angry 3.8%
Happy 2.1%
Disgusted 1.3%
Surprised 1.3%
Confused 0.4%
Fear 0.3%
Calm 0.1%

AWS Rekognition

Age 51-59
Gender Female, 83.9%
Happy 56.8%
Surprised 26.2%
Calm 8.4%
Confused 4.9%
Disgusted 1.5%
Sad 1.1%
Angry 0.6%
Fear 0.6%

AWS Rekognition

Age 41-49
Gender Male, 100%
Angry 86.4%
Calm 5.9%
Surprised 3.4%
Sad 1.6%
Disgusted 1.5%
Fear 0.5%
Happy 0.4%
Confused 0.3%

AWS Rekognition

Age 45-53
Gender Male, 96.8%
Calm 89.8%
Surprised 4.8%
Sad 2.8%
Disgusted 0.6%
Confused 0.6%
Fear 0.6%
Angry 0.5%
Happy 0.3%

AWS Rekognition

Age 29-39
Gender Male, 68.6%
Calm 73.5%
Sad 17.6%
Happy 2.8%
Surprised 2.7%
Disgusted 1.1%
Angry 1%
Confused 0.6%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit

Clarifai

Man
Woman
Human face
Clothing
Chair
Human arm

AWS Rekognition

Person 99.5%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97.7%

AWS Rekognition

Person 97%

AWS Rekognition

Person 96.7%

AWS Rekognition

Person 95.9%

AWS Rekognition

Person 82.3%

AWS Rekognition

Tie 93.4%

AWS Rekognition

Suit 90.1%

Clarifai

Man 93.6%

Clarifai

Man 89.7%

Clarifai

Man 86.9%

Clarifai

Man 81.6%

Clarifai

Man 58.2%

Clarifai

Man 55.3%

Clarifai

Woman 90.6%

Clarifai

Woman 82.6%

Clarifai

Woman 73.3%

Clarifai

Woman 50.3%

Clarifai

Human face 62.5%

Clarifai

Human face 58.6%

Clarifai

Human face 58%

Clarifai

Human face 58%

Clarifai

Human face 53.8%

Clarifai

Human face 53.4%

Clarifai

Human face 48.5%

Clarifai

Human face 43.2%

Clarifai

Human face 37.7%

Clarifai

Clothing 47.6%

Clarifai

Chair 41.7%

Clarifai

Human arm 36.3%

Categories

Imagga
created on 2022-01-15

people portraits 83.4%
paintings art 6.7%
streetview architecture 3.1%
interior objects 2.3%
events parties 2.2%
pets animals 1.1%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

wedding photography of the bride and groom.

Salesforce

Created by general-english-image-caption-blip on 2025-05-23

a photograph of a group of people standing around a table

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

The image depicts a group of individuals dressed formally, suggesting a special occasion or event. The figures in the foreground include individuals sitting on chairs, with elaborate detailing on their clothing, such as floral embroidery and lace patterns. The individuals standing in the background are wearing tuxedos, which further signifies a formal gathering. The setting appears indoors, with visible wooden paneling, a bookshelf, and a wall-mounted light fixture contributing to a sophisticated atmosphere. Additionally, a large decorative vase or urn is visible in the back right.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image appears to be a black-and-white photograph with a negative effect applied. It shows a group of individuals dressed in formal attire, likely attending an event such as a wedding or party. Many of the figures are wearing suits, with bow ties, and some individuals have corsages pinned to their clothing. There are both seated and standing individuals, and seating includes chairs. In the background, there is wooden paneling, bookshelves, and a decorative wall lamp. The position of individuals suggests a social gathering or formal occasion.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-20

The image appears to be a black and white photograph of a group of people dressed in formal attire, likely attending some kind of formal event or gathering. The group includes several individuals wearing tuxedos and formal dresses, and they appear to be posing together in what seems to be a room or setting with ornate furnishings and decor. The overall scene suggests a formal social occasion or celebration of some kind.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-20

This appears to be a formal black and white photograph, likely from a special event or celebration. In the image, there are several people dressed elegantly - some in white dinner jackets with bow ties, while others are wearing formal dresses. The photograph appears to be a negative or inverted image, which creates an interesting visual effect where the tones are reversed from what would normally be seen. The composition shows some people standing while others are seated in what appear to be ornate chairs. The setting looks quite formal, possibly in a banquet hall or similar venue, with architectural details visible in the background. The image has numbers written on it, suggesting it might be from an archive or photo collection.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image is a black-and-white photograph of a group of people in formal attire, likely taken at an event or gathering.

Foreground:

  • A woman with curly hair and a floral dress sits on a chair, facing the camera.
  • Another woman with short, curly hair and a white dress sits on a chair, facing the woman with curly hair.
  • A man in a white suit and black shirt stands behind the women, looking at the camera.

Background:

  • Several other men and women are visible in the background, all dressed in formal attire.
  • The room appears to be decorated with bookshelves, a chandelier, and a large piece of artwork or sculpture.

Overall:

  • The atmosphere of the image suggests a formal event or gathering, possibly a wedding or party.
  • The formal attire and decorations suggest a sense of elegance and sophistication.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

This image is a black-and-white photograph of a group of older individuals, likely from the early 20th century. The photo appears to be a negative, with the subjects and background rendered in a reversed tone.

In the foreground, three women are seated on chairs, while four men stand behind them. The women wear formal attire, including dresses and hats, while the men are dressed in suits and ties. The background features a room with bookshelves, a door, and a window, suggesting a domestic or institutional setting.

The overall atmosphere of the image is one of formality and elegance, with the subjects posing for the camera in a dignified manner. The use of a negative tone adds a sense of nostalgia and historical significance to the image, evoking a bygone era of refinement and sophistication.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image depicts a monochromatic photograph of a group of people, possibly a family, gathered together in a room. The individuals in the image are dressed in formal attire, with the men wearing tuxedos and bow ties, and the women wearing elegant dresses. The woman sitting in the center of the group is holding a book, and the other individuals are looking at her or engaging in conversation. The image has a vintage feel, with the use of black and white photography and the dated appearance of the clothing and setting.

Created by amazon.nova-pro-v1:0 on 2025-06-08

The black-and-white photograph shows a group of people in formal attire. Four men are standing, and three women are sitting. The women are wearing white dresses, and one of them is wearing a necklace. The men are wearing white suits with bow ties. They are standing in front of a wooden cabinet with a lamp mounted on the wall. There is a flower vase on the right side.

Google Gemini

Created by gemini-2.0-flash on 2025-05-18

Here is a description of the image:

The image is a black and white photograph featuring a group of people. In the front row, three women are seated. The woman on the left wears a light-colored dress with an ornate, dark pattern around the neckline. The woman in the center wears a lighter top with a dark, possibly floral, decoration on the chest. The woman on the right has curly hair adorned with a decorative piece and wears a light-colored, lace-sleeved top and a skirt. She is seated on a chair with a light-colored, looped back.

Behind the women, there are several men in formal attire. Four men wear light-colored suits with dark bow ties. The man farthest to the right is balding and wears glasses. A tuba is visible behind him.

The background includes a bookshelf and a chandelier. The image has a vintage feel, possibly taken at a formal event like a wedding or special occasion.

Created by gemini-2.0-flash-lite on 2025-05-18

Here's a description of the image:

Overall Impression:

The image is a negative, resulting in a grayscale photo with reversed colors. It depicts a group of people, likely from an older generation, gathered indoors. They appear to be dressed formally, perhaps for a special event.

People:

  • There are both men and women in the picture.
  • The men are primarily wearing white suits, tuxedos, and bow ties, suggesting a formal occasion.
  • The women are wearing dresses and appear to have flowers pinned to their clothing.
  • Some people are seated, while others are standing.

Setting:

  • The background suggests an indoor setting, possibly a home or a room with formal decor.
  • We see a hint of bookshelves in the background, indicating a room with a library or study.
  • There's a brass instrument (likely a tuba) visible on the right side of the image.
  • A decorative sconce is mounted on the wall.

Possible Event:

Given the formal attire and setting, it's probable that the people are attending a celebration, wedding, or other special event.

Additional Notes:

  • The "21 319" inscription suggests a photographic reference number.
  • The negative appearance gives the image a vintage, historical feel.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-03

The image is a black-and-white photograph depicting a group of individuals in what appears to be a theatrical or performance setting. The scene seems to be from a play or a comedic skit, given the exaggerated costumes and makeup.

Here's a detailed breakdown:

  1. Setting: The setting appears to be indoors, possibly a stage or a room decorated for a performance. There are curtains, a chandelier, and a few pieces of furniture, including chairs and a table with a flower arrangement.

  2. Characters:

    • Men in Tuxedos: Several men are dressed in formal attire, including tuxedos and bow ties. They are standing in the background, some with their mouths open as if singing or speaking.
    • Women in Costumes: Three women are seated in the foreground. They are wearing elaborate costumes and heavy makeup, which includes darkened faces, possibly indicating a theatrical or comedic portrayal.
      • The woman on the left is wearing a white dress with intricate embroidery and a white hat.
      • The woman in the middle is dressed in a white outfit with a black necklace and a corsage.
      • The woman on the right is wearing a patterned dress and a wig with curly hair.
  3. Expressions and Poses: The individuals are posed in a way that suggests they are in the middle of a performance. Their expressions are exaggerated, adding to the theatrical nature of the scene.

  4. Props and Decor: The room is decorated with items that enhance the theatrical atmosphere, such as the flower arrangement on the table and the chandelier hanging from the ceiling.

Overall, the image captures a moment from a theatrical performance, with actors in costume and makeup, engaged in a lively and expressive scene.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

The image appears to be a black and white photograph depicting a scene with two groups of people.

In the foreground, there are two women sitting on chairs. They are dressed in formal attire, and their clothing includes intricate patterns and roses pinned to their clothing. One of the women is leaning forward, gesturing with her hands, while the other is seated upright and looking to her side. Both women have styled hair and appear to be engaging in a conversation or activity.

In the background, there are four men standing. They are also dressed in formal attire, with white shirts, black vests, and bow ties. Two of them are wearing black suits, and the other two are wearing white suits. The men are standing close to each other, and their expressions are neutral to slightly engaged.

The setting appears to be indoors, with a light-colored wall and a window in the background. The lighting suggests a well-lit room, possibly during the daytime. The overall atmosphere of the image seems to be formal or ceremonial, given the attire and the positioning of the individuals.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white image appears to be a staged photograph featuring individuals in formal attire. The men are dressed in white tuxedos with bow ties, while the women are wearing elegant dresses with decorative patterns. The setting seems to be indoors, possibly a dining room or a formal gathering place, with visible elements such as a chandelier, a table with a tablecloth, and a curtain in the background. The image has a somewhat humorous and surreal quality, as the individuals are posed in a way that suggests they are not alive but rather mannequins or wax figures. There are numbers and markings on the image, indicating it might be part of a catalog or collection.

Text analysis

Amazon

319
319.
21 319
21
21319.
21 319.
9

Google

319. 21319.
319.
21319.