Human Generated Data

Title

Untitled (family portrait, "Mr. and Mrs. Dick Karstens)

Date

1970s

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1363

Human Generated Data

Title

Untitled (family portrait, "Mr. and Mrs. Dick Karstens)

People

Artist: Ken Whitmire Associates, American

Date

1970s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1363

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.1
Human 99.1
Person 99.1
Person 98.8
Person 98.7
People 98.5
Family 98.5
Person 97.4
Person 96.9
Tie 93.2
Accessories 93.2
Accessory 93.2
Clothing 87.7
Apparel 87.7
Evening Dress 87.1
Fashion 87.1
Robe 87.1
Gown 87.1
Suit 79.2
Coat 79.2
Overcoat 79.2
Shoe 77.6
Footwear 77.6
Shoe 65.5
Wedding Gown 60.8
Wedding 60.8
Tie 60
Female 55.7

Clarifai
created on 2023-10-26

group 99.9
people 99.7
four 99.3
child 99.2
group together 99
son 98.7
offspring 98.3
three 98.3
family 98
portrait 97.4
woman 97
man 97
adult 96.9
wedding 96.5
sibling 95.4
girl 93.2
five 90.7
indoors 90.4
room 90.4
wear 89.4

Imagga
created on 2022-01-22

groom 100
couple 45.3
man 43.7
people 35.7
male 34.8
happy 33.9
bride 33.6
wedding 30.4
dress 29.8
love 27.6
smiling 27.5
adult 27.2
happiness 25.9
marriage 25.7
person 25
smile 24.3
together 23.7
group 23.4
businessman 23
men 22.3
meeting 21.7
suit 21.6
business 21.3
bouquet 20.8
professional 20
office 19.3
women 19
team 18.8
businesswoman 18.2
teamwork 17.6
lifestyle 17.4
husband 16.9
corporate 16.3
married 16.3
family 16
celebration 16
sitting 15.5
two 15.3
wife 15.2
home 15.2
executive 15
portrait 14.9
attractive 14.7
businesspeople 14.2
cheerful 13.8
gown 13.8
communication 13.4
standing 13
pretty 12.6
work 12.6
day 12.6
diversity 12.5
handsome 12.5
flower 12.3
indoors 12.3
success 12.1
veil 11.8
colleagues 11.7
ceremony 11.7
romance 11.6
working 11.5
new 11.3
flowers 11.3
tuxedo 10.9
father 10.7
fun 10.5
relationship 10.3
successful 10.1
indoor 10.1
worker 10
mother 9.9
fashion 9.8
interior 9.7
outdoors 9.7
engagement 9.7
tie 9.5
manager 9.3
company 9.3
mature 9.3
event 9.3
hand 9.1
holding 9.1
romantic 8.9
daughter 8.8
wed 8.8
30s 8.7
staff 8.6
workplace 8.6
senior 8.4
lady 8.1
building 7.9
holiday 7.9
commitment 7.9
party 7.7
kin 7.7
partner 7.7
partnership 7.7
formal 7.6
ethnic 7.6
togetherness 7.6
joy 7.5
church 7.4
confident 7.3
summer 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

person 100
dress 96.3
clothing 95.5
smile 94.5
wedding dress 93.7
posing 91.9
woman 89.6
bride 89.5
people 84.3
group 76.9
wedding 75.2
suit 73.2
man 55.2
dressed 27.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-36
Gender Female, 100%
Happy 65.2%
Surprised 31.2%
Fear 2%
Confused 0.8%
Angry 0.4%
Calm 0.2%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 31-41
Gender Male, 100%
Happy 99.3%
Confused 0.3%
Calm 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Sad 0%
Fear 0%

AWS Rekognition

Age 2-10
Gender Female, 100%
Angry 66.9%
Calm 27.1%
Sad 3%
Disgusted 1.3%
Fear 0.5%
Confused 0.5%
Surprised 0.4%
Happy 0.4%

AWS Rekognition

Age 6-16
Gender Male, 100%
Happy 98.3%
Calm 0.4%
Surprised 0.4%
Angry 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.9%
Happy 99.1%
Confused 0.2%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Calm 0.1%

AWS Rekognition

Age 1-7
Gender Female, 100%
Calm 51.3%
Happy 42.9%
Surprised 1.3%
Confused 1.2%
Angry 1.1%
Disgusted 0.8%
Fear 0.7%
Sad 0.6%

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 9
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Suit
Shoe
Wedding Gown
Person 99.1%
Person 99.1%
Person 98.8%
Person 98.7%
Person 97.4%
Person 96.9%
Tie 93.2%
Tie 60%
Suit 79.2%
Shoe 77.6%
Shoe 65.5%
Wedding Gown 60.8%

Categories

Imagga

people portraits 100%

Captions

Clarifai
created by general-english-image-caption-blip on 2025-05-04

a photograph of a family portrait of a man and two children -100%

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-10

This image shows a family portrait with two adults seated in the center and four children surrounding them. The adults are dressed formally; the woman wears an elegant white lace gown, while the man is in a dark suit with a patterned tie. The children are dressed in formal clothing, with three girls wearing light pink dresses and a boy in a brown suit. The background features a room setting with a bamboo plant, curtains, and furnishings.

Created by gpt-4o-2024-08-06 on 2025-06-10

The image depicts a family portrait taken in an interior setting. In the center, there is a couple holding hands, with the woman wearing a white dress with lace detailing and the man dressed in a formal brown suit with a patterned tie. A young boy is seated in front of them wearing a brown suit and tie. Surrounding the couple are three young girls wearing matching pale pink dresses with short puffed sleeves and eyelet detailing. The setting includes a curtain on the left, a potted bamboo plant, and a wallpapered wall in the background, creating a formal and composed atmosphere typical of a family portrait from past decades.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-15

The image appears to be a family portrait. It shows a group of people, including a man and woman in formal attire, seated together with four children. The adults are smiling and the children have a mix of serious and happy expressions. The setting appears to be indoors, with plants and a lamp visible in the background. The people in the image are dressed in clothing typical of a formal family portrait from an earlier era.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-15

This appears to be a formal family portrait from around the 1970s, based on the styling and fashion. The family consists of parents and four children, all dressed in formal attire. The girls are wearing white and pink lace dresses with puff sleeves, while the males are wearing dark suits with ties. The photograph has that distinctive color quality typical of photos from that era. The setting appears to be indoors with some decorative elements like wallpaper and plants visible in the background. The composition is traditional for a formal family portrait of this time period, with family members arranged in a balanced way with both seated and standing poses.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-10

The image shows a family of six posing for a photograph in a living room.

The family consists of two adults and four children. The woman is wearing a long white dress with lace sleeves, and the man is wearing a dark suit with a brown tie. The children are dressed in various outfits, including dresses and suits.

The background of the image features a living room with a couch, curtains, and a plant. The walls are covered in a floral patterned wallpaper, and the floor is covered in a brown carpet. The overall atmosphere of the image is one of warmth and happiness, suggesting that the family is enjoying a special moment together.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-10

The image is a vintage photograph of a family of seven, comprising a man, a woman, and five children. The family is dressed in formal attire, with the adults seated on a black leather couch and the children standing or sitting around them.

Family Members:

  • Man: Seated on the right side of the couch, wearing a dark suit, white shirt, and brown tie.
  • Woman: Seated on the left side of the couch, wearing a long white dress with lace details.
  • Children:
    • Girl 1: Standing behind the woman, wearing a white dress.
    • Boy 1: Sitting on the floor in front of the man, wearing a brown suit, white shirt, and tie.
    • Girl 2: Standing behind the man, wearing a white dress.
    • Girl 3: Standing on the right side of the man, wearing a white dress.
    • Girl 4: Standing on the left side of the woman, wearing a white dress.

Background:

  • The background features a room with a brown carpet, a large plant, and a lamp on the wall.
  • The walls are covered in a floral patterned wallpaper.
  • A bed is visible in the background, suggesting that the photo was taken in a bedroom or living room.

Overall:

  • The image appears to be a formal family portrait, possibly taken for a special occasion or milestone event.
  • The vintage style and clothing suggest that the photo was taken in the mid-20th century.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-08

The image appears to be a family portrait taken in the 1970s. The family consists of a man, a woman, and four children. The man is wearing a suit and tie, and the woman is wearing a dress. The children are wearing dresses and are standing in front of the man and woman. The family is posing for the camera, and the man is smiling. The background of the image is blurry, and there is a lamp on the wall.

Created by amazon.nova-pro-v1:0 on 2025-06-08

A family of six, consisting of four kids and two adults, is posing for a photograph. The adults are sitting on a couch, while the kids are standing next to them. The man is wearing a suit, while the woman is wearing a dress. The kids are wearing dresses and suits. The woman is smiling, while the man is looking at the camera. The kids are looking at the camera, and some of them are smiling.

Google Gemini

Created by gemini-2.0-flash on 2025-05-04

Here is a description of the image:

This is a vintage family portrait. A man and woman are seated, presumably the parents. The woman is in the center, wearing a long-sleeved, high-necked lace top and long white skirt. The man sits to her right, wearing a dark brown suit with a patterned tie. He is holding the woman's hand.

Four children are positioned around the parents. A young boy sits on a suitcase in front of the woman, wearing a brown suit and patterned tie. Three girls flank the parents. Two of the girls are wearing matching light pink dresses with eyelet details. One stands on the man's right and the other sits on the woman's left. A fourth girl stands behind the parents, wearing a white dress. She has blonde hair and glasses, with a red hair tie.

The background includes a window with curtains on the left, and a plant behind the woman and man. There is patterned wall paper behind the man and one of the girls, with a lamp visible as well.

The photo has a warm, slightly faded tone, characteristic of older color photographs.

Created by gemini-2.0-flash-lite on 2025-05-04

Here's a description of the image:

This is a family portrait from the 1970s, showing a well-dressed family in a formal setting.

People:

  • Parents: The father is wearing a dark brown suit with a patterned tie. The mother is elegantly dressed in a cream-colored lace dress.
  • Children: There are three daughters, all wearing similar pink dresses, and a young son wearing a brown suit. One of the daughters is wearing glasses.

Setting:

  • The photo appears to be taken indoors, possibly in a living room. There's a neutral-toned patterned wallpaper in the background, a dark drape to the left, and a green plant behind them.
  • The family is seated, with the father and mother in the center, and the children arranged around them. The son is seated on a black case in front of the parents.

Overall Impression:

The image gives a sense of formality and the fashion of the era. The lighting suggests it was taken with a flash. The family appears to be posing for a special occasion, and the portrait exudes a feeling of tradition and togetherness. The picture is well-preserved and has retained its colors.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a vintage family portrait, likely taken in the 1970s based on the clothing and hairstyles. The family consists of five members: two adults and three children.

  1. Parents:

    • The mother is seated in the center, wearing a formal, elegant dress with lace details and short sleeves. She has a curly hairstyle and is smiling.
    • The father is standing behind the mother, wearing a dark suit with a white shirt and a patterned tie. He is also smiling and has one hand resting on the shoulder of one of the children.
  2. Children:

    • There are three children, two girls and one boy.
    • The boy is seated in front of the mother, wearing a brown suit with a white shirt and a tie. He is smiling and has his hands resting on his knees.
    • The two girls are standing on either side of the parents. They are both wearing matching pink dresses with lace details and short sleeves. One girl has her hands clasped in front of her, and the other has one hand resting on the father's arm.
  3. Setting:

    • The background appears to be a living room with a stone wall, a plant, and curtains. The family is posed in front of a couch or chair.
    • The overall atmosphere of the image is formal and posed, typical of studio or professional family portraits from that era.

The image captures a moment of togetherness and formality, reflecting the fashion and photography styles of the time.