Human Generated Data

Title

Untitled (group of six in party hats raising a toast)

Date

c. 1933

People

Artist: Hamblin Studio, American active 1930s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2112

Human Generated Data

Title

Untitled (group of six in party hats raising a toast)

People

Artist: Hamblin Studio, American active 1930s

Date

c. 1933

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2112

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Meal 99.2
Food 99.2
Human 98.8
Restaurant 93.9
Accessories 92.4
Accessory 92.4
Cafeteria 89.2
Buffet 88.5
Clothing 84.2
Apparel 84.2
Dish 83.4
Table 72.9
Furniture 72.9
Tablecloth 70.1
Icing 69.9
Dessert 69.9
Cake 69.9
Cream 69.9
Creme 69.9
People 69.2
Art 63.8
Portrait 62.2
Photography 62.2
Face 62.2
Photo 62.2
Home Decor 59.1
Dining Table 56
Sleeve 55.5

Clarifai
created on 2023-10-15

people 99.8
group 98.8
adult 98.1
woman 96.6
man 95.8
group together 94.8
many 93.4
monochrome 91.4
uniform 90.8
wedding 90.6
leader 88.7
wear 87.1
several 86.5
chair 86.2
furniture 84.5
military 84.5
veil 82.8
administration 82.5
actor 78.9
actress 78.1

Imagga
created on 2021-12-14

people 37.4
person 30.5
couple 29.6
male 29.1
adult 28.8
man 28.2
groom 28.1
happy 25.1
nurse 24.2
women 23.7
men 23.2
room 21.1
professional 20.9
teacher 19.2
happiness 18.8
bride 18.7
indoors 18.5
together 18.4
smiling 18.1
businessman 17.7
home 17.5
love 17.4
two 16.9
sitting 16.3
life 16.3
office 15.3
business 15.2
lab coat 15
day 14.9
wedding 14.7
table 14.7
cheerful 14.6
clothing 14.5
dress 14.5
lifestyle 14.5
coat 14.2
bouquet 14.1
worker 13.9
group 13.7
businesswoman 13.6
educator 13.6
celebration 13.6
husband 13.5
holding 13.2
smile 12.8
ceremony 12.6
family 12.5
wife 12.3
flowers 12.2
corporate 12
waiter 11.9
portrait 11.6
job 11.5
marriage 11.4
businesspeople 11.4
new 11.3
meeting 11.3
senior 11.2
modern 11.2
mature 11.2
suit 10.8
team 10.7
romantic 10.7
interior 10.6
old 10.5
work 10.2
casual 10.2
indoor 10
patient 9.9
colleagues 9.7
medical 9.7
married 9.6
talking 9.5
color 9.5
teamwork 9.3
employee 9
human 9
romance 8.9
executive 8.9
standing 8.7
grandma 8.6
adults 8.5
doctor 8.5
attractive 8.4
decoration 8.4
hospital 8.4
drink 8.4
tradition 8.3
fashion 8.3
successful 8.2
girls 8.2
matrimony 7.9
hands 7.8
conference 7.8
party 7.7
pretty 7.7
elderly 7.7
enjoying 7.6
desk 7.6
horizontal 7.5
relationship 7.5
clothes 7.5
20s 7.3
lady 7.3
laptop 7.3
success 7.2
dining-room attendant 7.2

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

table 92.4
text 91.5
candle 89.6
wedding 82.9
clothing 82.7
vase 82
wedding cake 78.5
person 76
woman 73.7
wedding dress 71.7
birthday cake 69.6
clothes 24.6
several 11.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-47
Gender Female, 51.4%
Sad 51.2%
Calm 42.5%
Fear 4%
Happy 0.9%
Angry 0.6%
Surprised 0.5%
Confused 0.3%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 57.7%
Surprised 53.4%
Calm 16.1%
Happy 13.4%
Sad 7%
Confused 5.3%
Fear 3.2%
Angry 1%
Disgusted 0.5%

AWS Rekognition

Age 8-18
Gender Male, 80.3%
Happy 56.3%
Calm 39.1%
Confused 2%
Sad 0.9%
Surprised 0.8%
Angry 0.4%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Female, 78.5%
Sad 82.6%
Calm 11.3%
Surprised 1.4%
Fear 1.2%
Confused 1.2%
Angry 1.1%
Disgusted 0.9%
Happy 0.4%

AWS Rekognition

Age 22-34
Gender Male, 97.2%
Sad 44.9%
Calm 24.5%
Happy 14.3%
Disgusted 5.6%
Angry 4.5%
Confused 3.7%
Fear 1.7%
Surprised 0.9%

AWS Rekognition

Age 22-34
Gender Male, 68.5%
Happy 90.1%
Calm 6.6%
Sad 1.8%
Surprised 0.6%
Confused 0.5%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-35
Gender Male, 74.4%
Angry 68.2%
Calm 18.8%
Happy 3.7%
Surprised 3.4%
Fear 2.7%
Sad 2.1%
Confused 0.8%
Disgusted 0.3%

AWS Rekognition

Age 24-38
Gender Female, 91.5%
Calm 53.1%
Happy 41.6%
Sad 3.8%
Angry 0.6%
Confused 0.3%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie

Clarifai

Table
Clothing
Picture frame
Human face
Footwear
Human arm

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.1%

AWS Rekognition

Person 97%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 96.4%

AWS Rekognition

Person 94.9%

AWS Rekognition

Person 66%

AWS Rekognition

Person 63.7%

AWS Rekognition

Tie 92.4%

Clarifai

Table 84.4%

Clarifai

Clothing 83%

Clarifai

Clothing 78.1%

Clarifai

Clothing 76%

Clarifai

Clothing 75.1%

Clarifai

Clothing 72.4%

Clarifai

Clothing 70.5%

Clarifai

Clothing 66.6%

Clarifai

Clothing 63.1%

Clarifai

Clothing 61.7%

Clarifai

Clothing 42.8%

Clarifai

Clothing 33.1%

Clarifai

Picture frame 62.7%

Clarifai

Human face 59.2%

Clarifai

Human face 56.3%

Clarifai

Human face 55.4%

Clarifai

Human face 52.1%

Clarifai

Human face 51.4%

Clarifai

Human face 50%

Clarifai

Human face 47.9%

Clarifai

Human face 43.5%

Clarifai

Footwear 34.3%

Clarifai

Human arm 33.5%

Categories

Imagga
created on 2021-12-14

interior objects 86.6%
paintings art 9.5%
people portraits 2.8%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-13

photograph of the wedding party.

Salesforce

Created by general-english-image-caption-blip on 2025-05-15

a photograph of a group of people standing around a table with a table cloth

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-14

This is a black-and-white negative image of a group gathering in a formal setting. Several people are dressed in festive or formal attire, with some wearing party hats or decorative headpieces. They are standing around a dining table filled with plates, glasses, and various food items, appearing to toast or celebrate. The room has framed artwork and portraits on the walls, along with a patterned rug and tall windows that allow light to filter in. The atmosphere suggests a special occasion or celebratory event.

Created by gpt-4o-2024-08-06 on 2025-06-14

The image appears to be a color inverted photograph showing a group of people standing around a table filled with various food items and drinks. The people are dressed in formal clothing, possibly suits and dresses. They are holding drinks and appear to be celebrating or having a party. The atmosphere in the room is lively, with decorations such as paintings on the walls and patterned curtains. The table is covered with a cloth and has glassware and dishes on it, indicating a formal dining or celebration setup.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-16

The image appears to depict a formal social gathering or event, likely from an earlier era based on the vintage style of dress and decor. There is a group of people gathered around a table laden with food and drinks, dressed in formal attire such as suits, dresses, and hats. The room is decorated with framed artwork and other ornate furnishings, creating an elegant and sophisticated atmosphere. The overall scene suggests a celebratory or social occasion, though without being able to identify any specific individuals, I can only describe the general setting and details I observe in the image.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-16

The black and white photograph depicts a group of well-dressed individuals, likely at a formal event or celebration. They are gathered around a table set with glasses, plates and decorative items. The people are posing together, some holding up glasses or other objects, and seem to be in good spirits based on their facial expressions and body language. The room has ornate framed portraits or mirrors hanging on the walls, adding to the formal atmosphere. Overall, the image captures what appears to be a festive social gathering or toast among this group during an earlier era, judging by their style of dress and the vintage look of the photograph.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-16

This appears to be a vintage black and white photograph showing a group of people dressed in white uniforms or jackets standing in a line next to what appears to be a banquet or buffet table covered with a dark tablecloth. The setting looks to be indoors, with framed pictures visible on the wall behind them. The image has the formal, posed quality typical of photographs from the early-to-mid 20th century. The lighting and composition create interesting shadows and highlights across the white uniforms, giving the photograph a distinctive period look.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-23

The image depicts a group of people gathered around a table, dressed in formal attire, likely from the 1920s or 1930s. The scene appears to be set in a room with a dark-colored wall and a large portrait hanging on it. The table is covered with a black cloth and features an assortment of dishes, glasses, and silverware.

The group consists of six individuals, all wearing white suits or dresses, with some adorned with hats or headpieces. They are standing around the table, engaged in conversation or possibly celebrating an event. The atmosphere seems festive, with the presence of champagne flutes and other drinks on the table.

In the background, there are several pieces of artwork on the wall, including a large portrait of a woman in a dress. The overall ambiance suggests a sophisticated and elegant gathering, possibly a party or a formal event. The image provides a glimpse into the fashion and social norms of the time period, showcasing the opulence and refinement of the era.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-23

The image depicts a black-and-white photograph of a group of people gathered around a table, dressed in formal attire and party hats. The scene appears to be set in a room with dark walls and a large window on the right side, which allows natural light to enter.

In the foreground, the group is standing behind a long table covered with a black tablecloth, adorned with various dishes, glasses, and other items. The individuals are all wearing white suits or dresses, except for one person who is dressed in dark attire. They are all holding glasses and appear to be celebrating an occasion.

Behind the group, there are several framed pictures hanging on the wall, adding to the festive atmosphere. The overall mood of the image suggests a joyful and celebratory gathering, possibly a birthday party or another special event.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-23

The image is a black-and-white photograph of seven people in a room. They are dressed in white outfits and are wearing hats. The person in the middle is holding a bouquet of flowers. In front of them is a table covered with a black cloth. On top of the table are cups, plates, and wine glasses. There are two picture frames hanging on the wall. The room has curtains and a carpeted floor.

Created by amazon.nova-lite-v1:0 on 2025-05-23

The image is a black-and-white photograph of a group of people dressed in white outfits and hats, standing around a table covered with a black cloth. The table is laden with various items, including wine glasses, plates, and other objects. The group appears to be posing for a photograph, and they are all wearing masks that cover their faces. The room has wooden walls and a ceiling, and there are several picture frames hanging on the wall.

Google Gemini

Created by gemini-2.0-flash on 2025-05-16

Here's a description of the image:

This appears to be a historical black and white photograph of a group of people posing in what looks like a formal gathering. They are standing behind a table laden with food and drinks, suggesting a reception or party. The individuals are dressed in suits and dresses, some with decorative hats, indicating that it may be a themed event or costume party. They are holding up glasses, possibly toasting or celebrating.

The setting seems to be indoors, with artwork hanging on the walls, contributing to the formal atmosphere. The image has a vintage feel, likely taken sometime in the early to mid-20th century.

Created by gemini-2.0-flash-lite on 2025-05-16

Here's a description of the image:

The image is a black and white negative, showing a group of people in what appears to be an indoor setting, possibly a room. The scene is centered around a table laden with food and drink. Let's break down the details:

Setting & Composition:

  • Room: The room has vertical paneling or wallpaper. There are framed pictures hanging on the wall.
  • Table: A long table is covered with a dark tablecloth. It is set with teacups, saucers, plates, and what appears to be a spread of food.
  • People: There are seven people in the image. They are dressed in a mix of formal and festive attire. Many are holding glasses or drinks, suggesting a celebration or gathering. They appear to be in a state of toasting or drinking. Some are wearing decorative headwear.

People & Their Attire (Based on clues and what's discernible from the negative):

  • The man in the foreground on the left is wearing a white suit, bowtie.
  • Others are wearing white suits, some with unusual headwear, and one woman in a decorative dress.

Overall Impression:

The image has a formal, almost historical feel. The focus on the people around the table, combined with the setting and attire, suggests a social event. The negative processing creates a stark and somewhat ethereal quality to the scene.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-24

The image appears to be a vintage photograph featuring a group of people gathered around a table, possibly at a party or social event. Here are some detailed observations:

  1. Setting: The scene is indoors, likely in a decorated room with framed portraits and decorations on the walls.
  2. Participants: There are seven individuals in the image. They are dressed in various costumes, suggesting a themed event or masquerade party.
    • Two individuals on the left are wearing white costumes with bow ties, resembling formal attire.
    • The other participants are wearing more elaborate and varied costumes, including headpieces, masks, and accessories.
  3. Table: The table in the center is covered with a dark tablecloth and is laden with various items, including dishes, cups, and possibly decorative objects or food.
  4. Atmosphere: The overall mood seems festive and celebratory, with the participants posing for the photograph, some holding up items or gesturing.

The image has a historical or retro feel, possibly from the early to mid-20th century, given the style of clothing and the quality of the photograph. The costumes and setting suggest a special occasion or themed gathering.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph that appears to depict a group of individuals dressed in formal attire, likely from the early 20th century, gathered around a table set for tea or a similar event. The setting seems to be indoors, possibly a banquet hall or a private home, as suggested by the elegant decor and the portraits on the wall.

The individuals are dressed in white suits, some with ties and others in more elaborate costumes, including what appear to be aprons, suggesting a theme or a humorous take on different professions or characters. One person on the right is wearing a turban. There are hats with feathers and other accessories, adding to the festive and possibly theatrical atmosphere.

The table in front of them is set with what looks like tea cups, saucers, and decorative items. The lighting is somewhat dramatic, with a strong light source from the left side casting shadows, which enhances the visual contrast in the photograph.

Overall, the image conveys a sense of celebration or a themed event, with the individuals posing in a playful manner, possibly for a fun or satirical photo shoot.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This black-and-white image appears to depict a group of people dressed in formal attire, standing in front of a table set with various dishes and glasses. The individuals are wearing unusual headpieces and masks, suggesting a costume party or theatrical performance. The background includes framed portraits and framed mirrors, adding to the formal and possibly staged atmosphere of the scene. The overall style and elements suggest a vintage or early 20th-century setting.