Human Generated Data

Title

Untitled (family of five with three dogs at fireplace)

Date

c. 1970

People

Artist: Ken Whitmire Associates, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1371

Human Generated Data

Title

Untitled (family of five with three dogs at fireplace)

People

Artist: Ken Whitmire Associates, American

Date

c. 1970

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1371

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.4
Clothing 98.9
Apparel 98.9
People 97.9
Family 96.4
Female 96
Mammal 95.4
Canine 95.4
Animal 95.4
Pet 95.4
Accessories 93.5
Accessory 93.5
Woman 86.6
Evening Dress 77.6
Gown 77.6
Fashion 77.6
Robe 77.6
Dress 77.4
Portrait 66.8
Photography 66.8
Face 66.8
Photo 66.8
Girl 64.4
Art 61.7
Sitting 61.6
Couch 57.1
Furniture 57.1
Sari 56.8
Silk 56.8

Clarifai
created on 2023-10-26

group 99.7
people 99.7
four 98.9
woman 98.8
adult 98.7
friendship 97.7
man 97.6
three 97.6
portrait 97.1
dog 96.8
wear 96.4
canine 94.6
indoors 94.4
two 93.8
sit 93.7
dress 92.9
son 92.2
five 92
wedding 91.9
group together 90.8

Imagga
created on 2022-01-22

room 48.2
home 46.2
interior 45.1
house 34.4
bed 32.7
groom 31.8
bedroom 31.5
sofa 30
furniture 29.7
comfortable 29.6
indoors 26.3
pillow 24.4
luxury 23.1
apartment 23
sitting 22.3
comfort 22.2
lifestyle 20.9
kin 19.6
adult 19.4
inside 19.3
modern 18.9
person 18.6
decor 18.6
relaxation 18.4
couple 18.3
women 18.2
living 18
people 17.8
happy 17.5
table 17.3
lamp 17.2
hotel 17.2
happiness 16.4
style 16.3
man 16.1
wood 15.8
floor 15.8
chair 15.6
window 15.6
indoor 15.5
design 15.4
smiling 15.2
couch 14.5
family 14.2
light 14
rest 13.9
mother 13.5
relax 13.5
decoration 13.3
husband 12.9
smile 12.8
fashion 12.8
living room 12.7
fun 12.7
sleep 12.6
love 12.6
together 12.3
male 12
domestic 11.9
cozy 11.8
leisure 11.6
attractive 11.2
pillows 10.8
color 10.6
cheerful 10.6
residential 10.5
new 10.5
enjoyment 10.3
elegance 10.1
residence 9.9
furnishings 9.8
vacation 9.8
luxurious 9.7
estate 9.5
wall 9.4
architecture 9.4
casual 9.3
holding 9.1
portrait 9.1
dress 9
father 8.8
looking 8.8
carpet 8.7
full length 8.7
two 8.5
outfit 8.4
grandfather 8.3
relaxing 8.2
sensuality 8.2
life 8.1
parent 8
mattress 7.9
clothing 7.9
men 7.7
adults 7.6
togetherness 7.5
seat 7.2
holiday 7.2
romance 7.1
fireplace 7.1
face 7.1
curtain 7

Google
created on 2022-01-22

Smile 97.4
Dog 96
Photograph 94.3
Carnivore 87.5
Dog breed 86.7
Happy 86
Companion dog 81
Formal wear 75.8
Snapshot 74.3
Event 73.8
Tie 70.2
Toy dog 68.6
Fur 67.3
Sporting Group 65.3
Vintage clothing 64.6
Suit 63.7
Canidae 62.6
Pattern 58.9
Fashion design 57.4
Ceremony 56.6

Microsoft
created on 2022-01-22

person 97.6
smile 90.5
clothing 88.3
dog 88
woman 82.9
dress 80.8
carnivore 59.4
posing 35.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-41
Gender Female, 99.9%
Happy 96%
Surprised 1.3%
Calm 1%
Fear 0.8%
Angry 0.2%
Confused 0.2%
Sad 0.2%
Disgusted 0.2%

AWS Rekognition

Age 38-46
Gender Female, 86.9%
Happy 93.5%
Fear 4%
Surprised 1.2%
Angry 0.5%
Confused 0.3%
Calm 0.2%
Disgusted 0.2%
Sad 0.1%

AWS Rekognition

Age 39-47
Gender Male, 100%
Happy 89.8%
Confused 4.6%
Surprised 1.6%
Angry 1.4%
Fear 1%
Disgusted 0.7%
Sad 0.6%
Calm 0.3%

AWS Rekognition

Age 25-35
Gender Female, 100%
Happy 97.5%
Surprised 1%
Angry 0.4%
Calm 0.3%
Confused 0.3%
Fear 0.3%
Disgusted 0.1%
Sad 0.1%

AWS Rekognition

Age 24-34
Gender Female, 99.9%
Happy 99.6%
Confused 0.1%
Calm 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%
Sad 0%

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Dog
Tie
Painting

Clarifai

Dress
Dog
Woman
Man
Human face
Human hair
Footwear
Human arm
Fashion accessory

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 95.5%

AWS Rekognition

Dog 95.4%

AWS Rekognition

Dog 93.3%

AWS Rekognition

Tie 93.5%

AWS Rekognition

Painting 61.7%

Clarifai

Dress 91.7%

Clarifai

Dress 85.8%

Clarifai

Dog 90.9%

Clarifai

Dog 90.1%

Clarifai

Dog 76.2%

Clarifai

Woman 84.6%

Clarifai

Woman 72.7%

Clarifai

Man 82.5%

Clarifai

Human face 73%

Clarifai

Human face 61.9%

Clarifai

Human face 61.8%

Clarifai

Human face 60.8%

Clarifai

Human face 54.5%

Clarifai

Human hair 41.5%

Clarifai

Human hair 39.2%

Clarifai

Human hair 37.8%

Clarifai

Footwear 37.6%

Clarifai

Footwear 37%

Clarifai

Footwear 33.7%

Clarifai

Human arm 37.1%

Clarifai

Human arm 35.3%

Clarifai

Fashion accessory 35.3%

Categories

Imagga
created on 2022-01-22

people portraits 99.9%

Captions

Clarifai

Created by general-english-image-caption-clip on 2025-07-12

family portrait of a family.

Salesforce

Created by general-english-image-caption-blip on 2025-05-20

a photograph of a family portrait of a man and two women and a dog

OpenAI GPT

Created by gpt-4o-2024-11-20 on 2025-06-09

The image features a group portrait set indoors with a brick wall background and a fireplace visible. Various individuals are dressed formally, with women wearing long dresses in colorful patterns and one man in a suit with a red-striped tie. Two large, fluffy white dogs and one black dog are present in the foreground, lying on a carpeted floor near the seated individuals. The overall setting gives a warm, domestic feel to the photograph. The name "Ken Whitmore" is visible at the bottom left corner, likely indicating the photographer or artist.

Created by gpt-4o-2024-08-06 on 2025-06-09

The image is a family portrait featuring six people and three dogs. The setting is indoors with a brick wall in the background, suggesting a cozy or rustic environment.

The individuals are dressed in 1970s-style formal clothing. The man seated in the center is wearing a dark suit with a white shirt and a striped red tie. Surrounding him, the women are in various dresses. The woman on the far left is seated and wearing a purple dress with a white crocheted or lace shawl. Next to her, a woman is standing wearing a yellow and white patterned dress. A woman in a white and light-colored striped dress is standing on the far right, with her hands resting on the back of a wooden chair. Sitting on the floor, a woman in a colorful patchwork-style dress is positioned at the front right of the group.

There are three dogs included in the portrait. To the left, there is an Old English Sheepdog with long, fluffy white fur and black patches, and a black dog, likely a Labrador, sitting in front of the woman with the shawl. On the right, an Old English Sheepdog similar to the leftmost dog is lying down in front of the man and the woman in the patchwork dress. The overall composition of the photo suggests a formal family portrait commonly seen in the past decades.

Anthropic Claude

Created by anthropic.claude-3-haiku-20240307-v1:0 on 2025-06-14

The image shows a family portrait with several people and two dogs. The people are dressed in a mix of formal and casual attire, suggesting this may be a special occasion. The background features a brick wall, adding a rustic and warm feel to the scene. The people in the image appear to be smiling and engaged with one another, conveying a sense of togetherness and happiness.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-14

This appears to be a formal family portrait from what looks like the 1970s, based on the clothing styles and photo quality. The image shows a group of five people posed against a brick wall backdrop. They're wearing various outfits including a yellow floral dress, a white dress with navy accents, a navy business suit with red tie, and a patchwork-style dress. The composition includes three dogs - two white shaggy dogs that appear to be Old English Sheepdogs or similar breeds, and one black dog. The photograph has that distinctive warm, slightly faded tone characteristic of photos from that era. The setting appears to be in a professional photography studio, with careful lighting and positioning of the subjects. The photographer's name "Ken Whitmire" is visible in the corner of the photo.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-06-05

The image depicts a family of six posing for a photograph in front of a brick wall. The family consists of two adults and four children, all dressed in formal attire. The adults are seated on chairs, with the man wearing a suit and tie and the woman wearing a dress. The children are standing behind them, with three girls and one boy.

In front of the family are three dogs, each with a unique appearance. The dog on the left is white with black patches, while the dog in the middle is black with white patches. The dog on the right is white with a long, shaggy coat.

The background of the image features a red brick wall, which adds a warm and cozy touch to the scene. The overall atmosphere of the image is one of happiness and togetherness, as the family appears to be enjoying each other's company.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-06-05

This image depicts a family portrait featuring a man and four women, accompanied by three dogs. The man is seated in the center, wearing a dark suit and tie, while the women are arranged around him. Two women stand behind him, one on either side, and two sit on the floor in front of him. The woman on the left is dressed in a white dress with black trim, and the woman on the right wears a yellow dress with white flowers. The two women sitting on the floor are attired in a white dress with black trim and a multicolored dress, respectively.

The three dogs are positioned in front of the women, with two white dogs on the left and a black dog in the middle. The background of the image features a brick wall, which adds a rustic touch to the overall scene. The image appears to be a vintage photograph, with a warm and nostalgic tone that evokes a sense of family and tradition.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-06-03

A family portrait features six people and three dogs. The family is posing in front of a brick fireplace. The woman on the left is wearing a white lace shawl over a blue and white dress. The man in the middle is wearing a suit and tie. The woman on the right is wearing a yellow dress. The two women on the side are wearing a yellow dress. The three dogs are lying on the floor.

Created by amazon.nova-pro-v1:0 on 2025-06-03

A family photo features a group of people, including a man and a woman, sitting on chairs with two dogs. They are all smiling, perhaps posing for a photograph. Behind them, a brick wall is there, and a fireplace is attached to the wall. Some objects are kept on the fireplace. The photo has a watermark with the text "Ken Whitemire" in the bottom left corner.

Google Gemini

Created by gemini-2.0-flash on 2025-04-30

The image shows a family portrait, with five people and three dogs posed in front of a brick fireplace. The backdrop behind the people is a rustic brick wall, with a dark, possibly textured, feature on the left side.

From left to right, the first person is an older woman seated in a chair, wearing a white dress with a crocheted shawl featuring a dark blue patterned border. To her right is a woman in a bright yellow dress with a white floral pattern.

Seated in the center of the composition is a bald man, dressed in a dark suit with a red and blue striped tie. To his right stands a tall woman in a light yellow and white striped dress.

Seated on the floor to the right of the man is a woman wearing a colorful, patchwork-style dress.

In front of the group are three dogs: one on the left, one in the middle, and one on the right. The dogs on the left and right are similar in appearance, with long, shaggy white and gray fur that covers their eyes. The dog in the middle is a black Labrador.

The overall style of the image suggests it is an older photograph, likely from the 1970s or 1980s.

Created by gemini-2.0-flash-lite on 2025-04-30

Here's a description of the image:

The image is a family portrait, likely taken in the 1970s or early 1980s based on the clothing and style. The setting appears to be indoors, with a brick wall serving as a backdrop.

People:

  • There are six people in the image.
  • The father is seated in a chair. He is wearing a dark suit and tie and is smiling.
  • The mother is sitting down, wearing a white dress with lace.
  • There are three adult daughters. One is wearing a yellow dress, one is wearing a long dress made up of patch work material and the other is in a light-colored dress.
  • All the family members are smiling.

Animals:

  • There are three dogs, two Old English Sheepdogs and a black dog.

Overall Impression: The photograph exudes a sense of warmth, with the family members smiling and appearing comfortable. The style of clothing and the setting suggest a traditional family portrait.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-06-04

The image is a family portrait taken in front of a brick wall, likely from the 1970s based on the clothing styles and overall aesthetic. The family consists of six individuals and three dogs.

From left to right:

  1. The first person is seated and wearing a white dress with a crocheted shawl.
  2. The second person is standing, wearing a yellow dress with a floral pattern.
  3. The third person is a man seated in the center, wearing a dark suit with a striped tie.
  4. The fourth person is standing, wearing a light-colored dress with a floral pattern.
  5. The fifth person is seated, wearing a colorful dress with a bold, geometric pattern.
  6. The sixth person is standing, wearing a light-colored dress with a floral pattern.

In front of the family members are three dogs:

  1. The first dog on the left is a white, fluffy breed.
  2. The second dog in the center is a black, medium-sized breed.
  3. The third dog on the right is another white, fluffy breed similar to the first dog.

The family appears to be posed formally for the photograph, with the adults dressed in what seems to be their best attire. The brick wall background and the wooden chair add a rustic touch to the setting. The photograph is credited to "Ken Whitmore," as indicated by the signature in the bottom left corner.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-07-14

This image features a family portrait taken in what appears to be a home setting, with a brick wall in the background. The photo is well-framed with a group of individuals and two dogs sitting on the floor in the foreground.

  • Group of Individuals: There are five people in the photo. They are all seated or standing, arranged in a semi-circle. The individuals include both adults and what look like children, dressed in a mix of formal and casual attire. The clothing styles suggest the image might have been taken several decades ago, possibly in the 1960s or 1970s. The women are wearing dresses with floral and patterned designs, and one is dressed in a more formal suit, indicating a mix of formality and casualness in the group. The men are dressed in formal suits, with one seated in the center wearing a striped tie and button-up shirt.

  • Dogs: In the foreground, there are two large dogs. One is white and fluffy, lying on the floor to the left, while the other appears to be a black and white dog, lying to the right. These dogs add a homely and relaxed element to the photo.

  • Setting: The setting is indoors, with a brick wall in the background and a carpeted floor. There is a piece of furniture, possibly a table or a dresser, slightly visible on the left side of the image, along with some decorative items on top.

The overall tone of the image is warm and family-oriented, capturing a moment of togetherness. The style of the clothing and the setup suggest a formal family portrait from a time when such photos were popular for documenting family gatherings.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-07-14

This is a vintage-style family portrait featuring five people and three dogs. The photograph appears to be taken indoors in front of a brick wall. The central figure is a man in a suit, seated on a wooden chair. He is flanked by four women, two standing behind him and two seated on either side. The women are dressed in colorful, patterned dresses. In the foreground, three dogs are present: a white Old English Sheepdog on the left, a black dog in the center, and another white Old English Sheepdog on the right. The overall composition is balanced, with the family members and dogs arranged symmetrically. The image has a warm, nostalgic feel, typical of family portraits from the mid-20th century.

Text analysis

Amazon

Ken
Ken whitmine
whitmine

Google

Ken Whreene
Ken
Whreene