Human Generated Data

Title

Untitled (man giving a toast)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.27

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man giving a toast)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.27

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Human 99.5
Person 99.5
Person 99.3
Plant 99.2
Person 98
Person 97.7
Person 97.6
Blossom 97.5
Flower 97.5
Person 97
Flower Arrangement 95.8
Person 95.4
Flower Bouquet 94.6
Person 94.3
Apparel 93.3
Clothing 93.3
Person 92.5
Person 86.4
Person 84
Person 80.7
Person 71.5
Fashion 71.3
Gown 71.3
Person 70
Coat 69
Overcoat 69
Robe 66.5
People 62.8
Photography 59.9
Photo 59.9
Suit 59
Wedding 58.1
Pattern 56.6
Art 56.6
Floral Design 56.6
Graphics 56.6
Accessory 56.2
Accessories 56.2
Tie 56.2
Wedding Gown 55.8

Clarifai
created on 2019-03-25

people 99.9
group 99.3
adult 98.6
group together 98.2
many 98.2
administration 97.4
leader 97.3
furniture 96.6
woman 96.3
man 96.1
several 93
room 92.7
child 89.3
war 89.2
wear 87.8
chair 87.3
home 87.1
four 86.3
five 84.6
military 84.5

Imagga
created on 2019-03-25

kin 79.8
man 30.2
groom 29.6
male 28.3
people 25.1
couple 23.5
person 20
happy 19.4
adult 18.9
bride 17.4
women 17.4
happiness 17.2
dress 17.1
portrait 16.8
love 15.8
two 15.2
family 15.1
fashion 14.3
room 13.7
home 13.5
men 12.9
wedding 12.9
business 12.7
child 12.7
black 12
smiling 11.6
businessman 11.5
youth 11.1
interior 10.6
marriage 10.4
mother 10.2
teacher 10.2
romantic 9.8
old 9.7
standing 9.6
bouquet 9.4
day 9.4
smile 9.3
indoor 9.1
pretty 9.1
cheerful 8.9
shop 8.9
office 8.8
indoors 8.8
together 8.8
boy 8.7
sitting 8.6
husband 8.6
face 8.5
future 8.4
fun 8.2
outdoors 8.2
sexy 8
lifestyle 7.9
outdoor 7.6
adults 7.6
joy 7.5
relationship 7.5
vintage 7.4
style 7.4
lady 7.3
new 7.3
building 7.3
life 7.2
holiday 7.2
hair 7.1
professional 7

Google
created on 2019-03-25

Microsoft
created on 2019-03-25

person 99.6
wall 96.9
group 95.3
indoor 89.1
people 85.7
black 72.4
posing 51.9
old 43.7
room 43.4
family 25.6
dining room 9.8
dining table 7.5
crowd 0.5
child 0.1
wedding 0.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Male, 54.7%
Surprised 45.5%
Confused 45.4%
Calm 49.6%
Disgusted 45.2%
Angry 45.7%
Happy 46.8%
Sad 46.8%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Happy 50.3%
Disgusted 45.2%
Confused 45.3%
Surprised 45.3%
Calm 46%
Sad 47.4%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Happy 50.5%
Disgusted 45.2%
Calm 46.5%
Sad 46.8%
Surprised 45.5%
Confused 45.2%
Angry 45.4%

AWS Rekognition

Age 19-36
Gender Male, 54.5%
Happy 45.2%
Calm 50.9%
Angry 45.6%
Disgusted 45.2%
Confused 45.4%
Surprised 45.7%
Sad 46.9%

AWS Rekognition

Age 35-52
Gender Female, 52.5%
Happy 46.3%
Surprised 45.4%
Sad 45.8%
Confused 45.2%
Angry 45.4%
Disgusted 45.8%
Calm 51%

AWS Rekognition

Age 27-44
Gender Male, 54.7%
Calm 45.1%
Surprised 45.1%
Confused 45%
Sad 45.1%
Angry 45.1%
Happy 54.5%
Disgusted 45.1%

AWS Rekognition

Age 15-25
Gender Female, 50.7%
Surprised 47.1%
Disgusted 45.5%
Calm 45.6%
Sad 45.7%
Confused 45.4%
Happy 50.1%
Angry 45.7%

AWS Rekognition

Age 20-38
Gender Female, 50%
Happy 45%
Confused 45.4%
Disgusted 45.1%
Angry 45.2%
Calm 45.6%
Surprised 45.3%
Sad 53.4%

AWS Rekognition

Age 26-43
Gender Male, 54.3%
Happy 45.2%
Calm 47.6%
Sad 50.7%
Angry 45.7%
Confused 45.3%
Surprised 45.2%
Disgusted 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Angry 47.5%
Happy 45.1%
Sad 49.5%
Confused 45.2%
Disgusted 45.1%
Calm 47.5%
Surprised 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Sad 45.8%
Surprised 46.3%
Calm 47.6%
Confused 47.1%
Happy 45.6%
Disgusted 46.3%
Angry 46.4%

AWS Rekognition

Age 17-27
Gender Male, 54.1%
Confused 45.7%
Happy 45.3%
Surprised 45.6%
Disgusted 45.5%
Calm 49.4%
Angry 47.6%
Sad 45.9%

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Tie
Person 99.5%
Person 99.3%
Person 98%
Person 97.7%
Person 97.6%
Person 97%
Person 95.4%
Person 94.3%
Person 92.5%
Person 86.4%
Person 84%
Person 80.7%
Person 71.5%
Person 70%
Suit 59%
Tie 56.2%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-16

a photograph of a group of people sitting around a table -100%

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-26

The image depicts a formal dinner party in a dining room, with a long table set for guests. The table is adorned with white tablecloths, flowers, and candles, and is surrounded by several people dressed in formal attire. In the background, there is a mirror on the wall, reflecting the scene, and a doorway leading to another room. The atmosphere appears to be elegant and sophisticated, suggesting a special occasion or celebration.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-26

This image depicts a formal dinner party, with a man standing at the head of the table, holding a glass in his right hand. The table is adorned with a white tablecloth, flowers, and candles, while the guests are dressed in formal attire. The room's decor features a mirror on the wall behind the standing man, sconces on either side of the mirror, and a doorway to the left. The atmosphere appears to be one of celebration or special occasion, possibly a wedding or anniversary.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-26

The black-and-white photo shows a group of people inside a room, probably celebrating a wedding. They are sitting at a table, and some are standing. The table is adorned with flowers, candles, and wine glasses. A man in the middle is holding a wine glass and looking at the woman next to him. Behind them is a mirror on the wall with a reflection of people. On the left side are picture frames and a door.

Created by amazon.nova-lite-v1:0 on 2025-05-26

An old photo of a party. It seems like a wedding party. The people are sitting on the chairs around the table. The table is covered with a white cloth and decorated with flowers. A few candles are placed on the table. A mirror is mounted on the wall behind the table. A lamp is mounted on the wall on either side of the mirror. A frame is mounted on the wall on either side of the mirror.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-17

Here's a description of the image:

Overall Impression:

The image is a black and white photograph depicting a formal dinner party. It appears to be a vintage photograph, likely from the mid-20th century, judging by the fashion and style.

Setting and Atmosphere:

The party takes place in a well-appointed dining room. The walls are decorated with a tapestry or large artwork. The room has a formal, elegant feel, indicated by the table setting, the dress of the guests, and the presence of candles.

People:

  • The main focus seems to be on a man in a tuxedo raising a glass, possibly giving a toast. He has a smile on his face and appears to be the center of attention.
  • Other guests are seated around a long table, presumably enjoying the dinner. They are all dressed in formal attire, including suits, ties, and evening gowns.
  • The expressions on the guests' faces suggest they are enjoying the event.

Table and Decorations:

  • The table is lavishly decorated with floral arrangements.
  • Tall, lit candles are placed along the center of the table, enhancing the atmosphere.
  • There are numerous glasses and possibly plates with food.

Additional Details:

  • A large mirror on the wall reflects other figures, including more people, adding to the sense of a gathering.
  • The lighting is likely artificial, casting shadows and creating contrast.
  • The image has a soft, slightly grainy quality characteristic of older photographs.

In summary, this is a snapshot of a formal and festive dinner party from a bygone era, with a focus on a celebratory moment.

Created by gemini-2.0-flash on 2025-05-17

Here is a description of the image:

This black and white photograph captures a formal event, likely a wedding reception or a high-society dinner, with several people seated around a long, elegantly decorated table. The setting appears to be an indoor dining room with classical wall decor.

The table is laden with flowers, including what look like roses, interspersed with tall, slender candles. Each place setting has multiple glasses, hinting at a multi-course meal or celebratory occasion.

On the left of the frame, we see several attendees in formal attire. The women are wearing dresses with hats or headpieces, while the men are dressed in tuxedos with bow ties. To the right of the table, one man is standing, holding a glass in his hand, presumably giving a toast. He is smiling and has a flower pinned to his lapel. A woman next to him, also dressed formally, looks up at him, smiling.

Behind the man giving the toast is a mirror reflecting the gathering and adding depth to the image. The walls of the room are adorned with sconces and artwork, including a tapestry or large painting on the left and another tapestry with floral or foliage motifs on the right. A doorway is visible on the left side of the frame. Another man in a tuxedo stands near the doorway.

The atmosphere of the photo is formal, elegant, and festive, capturing a moment of celebration among a group of well-dressed individuals.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-27

The image depicts a formal dinner party from what appears to be the mid-20th century. The setting is an elegantly decorated dining room, with a long table adorned with a white tablecloth, elaborate floral centerpieces, and tall candles in ornate candelabras. The guests, dressed in formal attire, are seated around the table, engaged in conversation and enjoying the event.

The men are wearing tuxedos with bow ties, while the women are in elegant dresses, some with decorative hats. The atmosphere seems lively and convivial. In the background, there is a large mirror reflecting part of the room and some of the guests. The room features classic decor, including wall sconces, framed artwork, and a door leading to another part of the house. The overall ambiance suggests a sophisticated and celebratory occasion, possibly a special event or a holiday gathering.