Human Generated Data

Title

Untitled (group portrait at dinner party)

Date

c. 1940

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1524

Human Generated Data

Title

Untitled (group portrait at dinner party)

People

Artist: John Deusing, American active 1940s

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1524

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.7
Apparel 99.7
Human 99
Face 98.3
Smile 95.3
Female 87.5
Suit 82.7
Overcoat 82.7
Coat 82.7
People 80.3
Furniture 80.3
Indoors 77.4
Collage 77.2
Advertisement 77.2
Poster 77.2
Accessories 74
Accessory 74
Photography 73
Photo 73
Portrait 72.1
Girl 71.7
Dress 70.6
Woman 68.5
Plant 67
Table 66.4
Kid 66
Child 66
Gown 65.3
Fashion 65.3
Room 64.7
Meal 64
Food 64
Shirt 63.9
Flower 60.3
Blossom 60.3
Living Room 59.7
Robe 58.7
Man 58.4
Head 57.6
Pet 56.2
Animal 56.2
Laughing 56
Wedding 55.1

Clarifai
created on 2023-10-15

people 99.9
group 99.4
adult 97.3
man 97.2
woman 96.6
many 96.5
medical practitioner 93.2
group together 86.4
wear 85.7
healthcare 84.8
uniform 84.5
several 84.1
retro 82.9
leader 82.2
education 80.9
portrait 80.2
child 76.8
outfit 76
five 72
illustration 71.1

Imagga
created on 2021-12-14

lab coat 28.8
man 26.9
people 25.6
coat 25.5
male 24.1
person 23.8
doctor 18.8
adult 18.5
businessman 17.6
happy 16.3
nurse 15.6
business 15.2
professional 14.8
smiling 13.7
clothing 13.6
team 13.4
two 12.7
medical 12.3
medicine 12.3
men 12
work 11.8
health 11.8
blackboard 11.3
looking 11.2
happiness 11
face 10.6
job 10.6
together 10.5
group 10.5
couple 10.4
old 10.4
room 10.3
garment 10.3
day 10.2
specialist 10.2
aged 9.9
spectator 9.9
hand 9.9
cheerful 9.7
fun 9.7
portrait 9.7
hospital 9.7
technology 9.6
education 9.5
patient 9.3
smile 9.3
student 9.1
care 9
groom 9
office 8.8
indoors 8.8
women 8.7
light 8.7
clinic 8.7
bride 8.6
casual 8.5
senior 8.4
color 8.3
holding 8.2
life 8.2
fan 7.9
hands 7.8
world 7.7
exam 7.7
uniform 7.6
wife 7.6
horizontal 7.5
human 7.5
teamwork 7.4
bar 7.4
wedding 7.4
occupation 7.3
indoor 7.3
teacher 7.3
dress 7.2
worker 7.2
black 7.2
suit 7.2
seller 7.2
home 7.2
bright 7.1

Google
created on 2021-12-14

Photograph 94.1
Black 89.8
Style 84
Vintage clothing 76.4
Suit 76.2
Font 75
Snapshot 74.3
Monochrome 74.3
Monochrome photography 74.2
Event 71.7
Art 71.6
Classic 70.5
Stock photography 66.2
History 62.8
Room 62.3
Team 60
Pattern 58.2
Illustration 57.2
Visual arts 56.2
Collection 52.6

Microsoft
created on 2021-12-14

text 99.4
person 99.2
posing 94
drawing 76.8
clothing 73.6
group 68.8
man 63.5
old 53.8

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 35-51
Gender Male, 95.5%
Calm 57.7%
Happy 19.9%
Sad 11%
Surprised 5%
Fear 3.2%
Confused 1.3%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 23-35
Gender Male, 58.9%
Calm 91.9%
Sad 7.6%
Happy 0.2%
Confused 0.1%
Angry 0.1%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-35
Gender Male, 95%
Calm 34%
Happy 28.9%
Surprised 26.9%
Sad 4.4%
Fear 3.6%
Angry 1.1%
Confused 1%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Female, 91.4%
Happy 47.8%
Calm 28.1%
Sad 18.2%
Surprised 2.2%
Angry 1.5%
Confused 1.1%
Fear 0.8%
Disgusted 0.3%

AWS Rekognition

Age 23-37
Gender Female, 59.1%
Calm 82.6%
Surprised 7.3%
Happy 4.4%
Sad 3.1%
Confused 1%
Angry 0.9%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 16-28
Gender Female, 94.2%
Calm 66.7%
Sad 16.7%
Surprised 6.6%
Happy 4.7%
Confused 2.9%
Angry 1.6%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 27-43
Gender Female, 92.9%
Sad 44.8%
Angry 30.8%
Calm 12.1%
Fear 10%
Happy 1.2%
Surprised 0.9%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 25-39
Gender Female, 58.8%
Surprised 61.9%
Calm 29.5%
Sad 4%
Angry 2.4%
Confused 1.2%
Happy 0.5%
Fear 0.3%
Disgusted 0.2%

AWS Rekognition

Age 26-42
Gender Female, 99.3%
Happy 79.6%
Surprised 13.6%
Calm 5%
Fear 0.9%
Sad 0.3%
Angry 0.2%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 73.8%
Calm 85.2%
Sad 7.5%
Angry 3.9%
Surprised 1%
Fear 0.9%
Happy 0.8%
Confused 0.4%
Disgusted 0.4%

AWS Rekognition

Age 28-44
Gender Female, 71.1%
Calm 78.4%
Surprised 11.3%
Happy 4.3%
Angry 3.3%
Sad 1.3%
Confused 0.9%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 36-52
Gender Female, 85.7%
Calm 80.4%
Happy 12.3%
Sad 2%
Surprised 2%
Confused 1.2%
Angry 0.8%
Fear 0.8%
Disgusted 0.5%

AWS Rekognition

Age 24-38
Gender Female, 68.2%
Calm 81.2%
Sad 15.6%
Confused 1.2%
Surprised 0.9%
Angry 0.8%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 36-54
Gender Male, 85.2%
Calm 69.7%
Surprised 21.5%
Sad 4.3%
Fear 1.9%
Confused 1.1%
Angry 0.6%
Happy 0.6%
Disgusted 0.3%

AWS Rekognition

Age 37-55
Gender Male, 65.9%
Calm 97.1%
Sad 1.8%
Happy 0.3%
Surprised 0.3%
Angry 0.2%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 26-42
Gender Female, 71.5%
Sad 41.2%
Calm 21.2%
Angry 15.1%
Happy 14.5%
Surprised 4.8%
Confused 1.2%
Fear 1.1%
Disgusted 0.8%

AWS Rekognition

Age 28-44
Gender Female, 63.3%
Calm 56.9%
Happy 33.8%
Surprised 3.6%
Sad 2.8%
Angry 1.2%
Confused 0.9%
Fear 0.6%
Disgusted 0.3%

AWS Rekognition

Age 26-40
Gender Male, 85.7%
Calm 66.7%
Confused 16.4%
Sad 8.2%
Surprised 7%
Happy 0.9%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 33-49
Gender Female, 67.5%
Calm 81.5%
Sad 7.5%
Surprised 4.7%
Happy 3.9%
Confused 1.3%
Angry 0.6%
Fear 0.4%
Disgusted 0.1%

AWS Rekognition

Age 19-31
Gender Male, 73.4%
Calm 74.7%
Happy 14.7%
Angry 4.3%
Surprised 3.3%
Confused 1.3%
Sad 1%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 27-43
Gender Female, 66.9%
Sad 92.4%
Calm 4.9%
Happy 1.4%
Fear 0.5%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Tie

Clarifai

Man
Clothing
Woman
Human face
Fashion accessory
Human hair
Footwear
Flower

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.8%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 97.1%

AWS Rekognition

Person 96.8%

AWS Rekognition

Person 96.6%

AWS Rekognition

Person 95.3%

AWS Rekognition

Person 94.8%

AWS Rekognition

Person 94.3%

AWS Rekognition

Person 92.7%

AWS Rekognition

Person 91.4%

AWS Rekognition

Person 86.8%

AWS Rekognition

Person 86.7%

AWS Rekognition

Person 84.9%

AWS Rekognition

Person 78.8%

AWS Rekognition

Person 77.8%

AWS Rekognition

Person 67.5%

AWS Rekognition

Person 65.7%

AWS Rekognition

Person 58.5%

AWS Rekognition

Tie 74%

Clarifai

Man 80%

Clarifai

Man 79.2%

Clarifai

Man 51.5%

Clarifai

Clothing 78.6%

Clarifai

Clothing 76.1%

Clarifai

Clothing 75.3%

Clarifai

Clothing 65%

Clarifai

Clothing 62.2%

Clarifai

Clothing 57%

Clarifai

Clothing 49.1%

Clarifai

Clothing 46.8%

Clarifai

Clothing 42.7%

Clarifai

Clothing 35.6%

Clarifai

Clothing 34.8%

Clarifai

Woman 75.6%

Clarifai

Woman 73.5%

Clarifai

Woman 73.1%

Clarifai

Woman 70.1%

Clarifai

Woman 69.1%

Clarifai

Woman 68.3%

Clarifai

Woman 66.3%

Clarifai

Woman 64.1%

Clarifai

Woman 60.6%

Clarifai

Woman 55.6%

Clarifai

Woman 37.2%

Clarifai

Human face 74.1%

Clarifai

Human face 72.4%

Clarifai

Human face 71.2%

Clarifai

Human face 70.3%

Clarifai

Human face 70.2%

Clarifai

Human face 68.4%

Clarifai

Human face 67.2%

Clarifai

Human face 66.1%

Clarifai

Human face 65.6%

Clarifai

Human face 64.3%

Clarifai

Human face 63%

Clarifai

Human face 62.5%

Clarifai

Human face 60.8%

Clarifai

Human face 60.3%

Clarifai

Human face 59.9%

Clarifai

Human face 57.5%

Clarifai

Human face 56%

Clarifai

Human face 54.3%

Clarifai

Human face 52.9%

Clarifai

Human face 52.6%

Clarifai

Human face 42.2%

Clarifai

Human face 40%

Clarifai

Human face 38.1%

Clarifai

Human face 33.3%

Clarifai

Fashion accessory 41.2%

Clarifai

Human hair 37%

Clarifai

Human hair 35.5%

Clarifai

Human hair 35.4%

Clarifai

Human hair 34.1%

Clarifai

Footwear 35.9%

Clarifai

Footwear 35%

Clarifai

Flower 33.2%

Categories

Imagga
created on 2021-12-14

streetview architecture 91.7%
beaches seaside 3.8%
people portraits 1.7%
nature landscape 1.2%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

a group of people in a white room.

Salesforce

Created by general-english-image-caption-blip on 2025-05-03

a photograph of a group of people standing around a table with a cake

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-08

The image is a group photo of people gathered indoors, suggesting a social or family event. It appears to be a negative version of the photograph, where the colors are inverted. There is a table in the foreground set with decorations, candles, and dishes, indicating a celebration or meal. The room is decorated with patterned wallpaper and streamers, enhancing the festive environment. A chandelier hangs from the ceiling, adding to the vintage or formal setting.

Created by gpt-4o-2024-08-06 on 2025-06-08

The image is a black and white negative depicting a group of people gathered around a table, suggesting a family gathering or celebration. The room is decorated with patterned wallpaper and streamers hung across the ceiling, indicating a festive occasion. A table is set with candles and cups, and several children and adults are standing and sitting close together. The chandelier hanging above the people contributes to the vintage atmosphere of the photograph. The attire of the individuals suggests a formal or semi-formal event, typical of mid-20th-century fashion.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-13

The image appears to be a black and white photograph depicting a large group of people, primarily adults but also some children, gathered together in what seems to be a festive or celebratory setting. The group is posed in front of a patterned wallpaper backdrop, with a chandelier visible overhead. The people in the image are all wearing formal or semi-formal attire, suggesting this may be some kind of special occasion or event. The overall composition and style of the photograph indicates it was likely taken in the mid-20th century.

Created by us.anthropic.claude-3-opus-20240229-v1:0 on 2025-06-13

The black and white photograph depicts a large gathering of people, who appear to be a family based on the range of ages present, from young children to elderly individuals. They are seated around a elegantly set dining table with a patterned tablecloth, candles, and floral centerpieces. The room has patterned wallpaper and curtains hanging from the ceiling, giving it a festive atmosphere. The people are dressed formally in light-colored clothing appropriate for a special occasion or holiday meal. While their faces are visible, I will refrain from identifying or naming any of the individuals out of respect for privacy. Overall, the image captures a joyful family celebration.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-13

This appears to be a vintage black and white photograph that has been converted to a negative image, causing the tones to be reversed. The photo shows a group of people gathered around what appears to be a dining table with candles and decorations. The background features floral wallpaper and there's a window with blinds visible. The image appears to be from a family gathering or celebration. Due to the negative effect, all the people appear with darkened faces and light/white hair, creating a striking visual contrast. The subjects are wearing various outfits, with several in white clothing that appears dark in this negative format. The composition suggests this was likely taken at a special occasion or holiday gathering in what appears to be a dining room setting.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-28

The image is a black-and-white photograph of a large group of people, including children and adults, gathered around a table in a dining room. The group appears to be celebrating a special occasion, possibly a birthday or holiday.

The table is set with various dishes, glasses, and silverware, and there are several candles and a centerpiece on the table. The background of the image shows a wall with floral wallpaper and a window with blinds. There is also a chandelier hanging from the ceiling.

The overall atmosphere of the image is one of joy and celebration, with the group of people smiling and laughing together. The image appears to be a happy and festive moment, captured in time.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-28

This image depicts a family gathering, with a large group of people posing for a photograph in a dining room. The scene is set against a backdrop of a table adorned with various items, including glasses, plates, and a centerpiece. The room's decor features a floral wallpaper and a chandelier hanging from the ceiling.

The family members are dressed in formal attire, with the men wearing suits and ties, while the women wear dresses. The children are also dressed in their Sunday best, adding to the overall sense of occasion. The atmosphere appears to be one of celebration and joy, as the family comes together to mark a special event.

The image is rendered in a striking black-and-white format, which adds to its nostalgic and timeless quality. The overall effect is one of warmth and intimacy, capturing a moment in time that is both personal and universal.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-05-27

The image shows a monochromatic photo of a group of people gathered around a table, likely for a celebration. The people are dressed in formal attire, and some of them are wearing ties. The table is covered with a white cloth and has several cups, a bottle, and a flower arrangement. The room has a chandelier hanging from the ceiling, and the walls are decorated with wallpaper featuring floral designs. The image has a vintage or old-fashioned feel to it.

Created by amazon.nova-pro-v1:0 on 2025-05-27

A black-and-white photo shows a group of people standing around a table, probably inside a house. The table is covered with a cloth, and a cake with lit candles is placed on it. Some of the people are wearing ties, and some of them are children. There is a chandelier hanging from the ceiling. The wall is decorated with a floral design, and there are some banners hanging on it.

Google Gemini

Created by gemini-2.0-flash on 2025-04-30

Here is a description of the image:

The image is a black and white negative of what appears to be a family gathered around a table. The room is decorated with patterned wallpaper, and there's a decorative chandelier hanging from the ceiling. A light-colored banner or garland is strung across the upper part of the room.

A group of people, including children and adults, stand and sit around the table, which is covered with a patterned tablecloth. There are cups, candles, and what might be flowers on the table, suggesting a celebration or gathering.

The individuals in the photo are dressed in a range of attire, from dresses to suits. The photo has a vintage feel, possibly indicating it was taken some time ago.

Created by gemini-2.0-flash-lite on 2025-04-30

Here's a description of the image:

Overall Impression:

This is a family portrait, likely taken in the mid-20th century, given the style of clothing and the decor. The image is a negative, so the colors are inverted, but the composition and the groupings of people are clear. It has a slightly formal, posed feel.

Setting:

The photo appears to be taken indoors, likely in a dining room or a similar space.

  • The background features wallpaper with a floral pattern.
  • There is a chandelier or a ceiling fixture visible at the top, and a window is present in the background.
  • There is a table set for a celebration, potentially a birthday, as there might be candles present.

People:

The photograph includes a group of about 20 people, from different age groups:

  • There are men in suits and ties, some appearing to be older adults or patriarchs.
  • Women are dressed in dresses, blouses, and likely skirts.
  • Children are present, in varying age groups.
  • Everyone is positioned closely together, with some people at the table, and others standing behind.

Composition:

  • The composition is somewhat formal.
  • The group is generally arranged in a balanced way.
  • The table and its contents draw focus towards the middle of the picture.

Overall Mood:

The image evokes a sense of nostalgia, tradition, and family togetherness. Despite the negative format, it suggests a happy occasion and a moment of shared experience.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-29

The image depicts a group of people gathered indoors, posing for a photograph. The setting appears to be a dining room or a party room, decorated with floral wallpaper and a chandelier hanging from the ceiling. The room is adorned with draped fabric, adding to the festive atmosphere.

The individuals in the photo are wearing costumes and face paint, which appears to be blackface. This practice is historically associated with minstrel shows and is widely considered offensive and racist today. The costumes include wigs, dresses, and other accessories that seem to mimic stereotypical attire.

The group is arranged in rows, with some people standing and others seated or kneeling in front. There is a table in the foreground with candles, decorations, and what looks like a cake or a centerpiece. The overall mood of the image seems celebratory, but the use of blackface is highly problematic and inappropriate by contemporary standards.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-05

This is a black-and-white photograph of a group of people gathered around a table, seemingly in a celebratory or social setting. The individuals appear to be dressed in formal or semi-formal attire, suggesting the event might be a formal gathering or a special occasion. The room is decorated with floral wallpaper and a chandelier, adding to the elegant ambiance. The table in front of the group is set with what looks like food, drinks, and other items, indicating a meal or feast. The overall composition of the image suggests a candid moment captured during the event.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-05

This is a black and white photograph of a group of people gathered around a dining table. The individuals are dressed in formal attire, with the men wearing white shirts and the women in dresses. The table is set with various items, including cups, saucers, and a cake with candles. The room is decorated with floral wallpaper and a chandelier hangs from the ceiling. The overall atmosphere suggests a formal gathering or celebration.

Text analysis

Amazon

KUD