Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.26

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.26

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 99.2
Face 98.8
Art 98.2
Drawing 98.2
Head 98.2
Sketch 93.2
Portrait 76.7
Photo 76.7
Photography 76.7

Clarifai
created on 2019-05-31

old 97.5
people 97.2
one 96.3
art 95.9
man 95.8
portrait 95.3
illustration 94.3
adult 92.7
face 90.6
veil 88.8
painting 88.7
print 87
wear 86.1
elderly 83.7
person 83
lid 82.1
artistic 81.6
vintage 81.5
desktop 81.3
ancient 81.2

Imagga
created on 2019-05-31

face 34.8
sketch 33.6
portrait 30.4
representation 28.2
drawing 24.4
person 24.2
head 22.7
eyes 21.5
close 21.1
hair 20.6
man 18.8
expression 18.8
people 17.9
smile 17.8
currency 17.1
money 17
bust 16.4
male 16.3
skin 16
sculpture 15.8
cash 15.6
closeup 15.5
bill 15.2
facial 15
bank 14.8
one 14.2
dollar 13.9
banking 13.8
adult 13.6
attractive 13.3
old 13.2
model 13.2
child 13
happy 12.5
finance 11.8
hat 11.7
studio 11.4
business 10.9
smiling 10.9
mug shot 10.8
financial 10.7
senior 10.3
cute 10
human 9.8
art 9.7
boy 9.6
mature 9.3
plastic art 9.3
care 9.1
fashion 9
lady 8.9
paper 8.9
looking 8.8
clothing 8.8
banknote 8.7
brunette 8.7
lifestyle 8.7
elderly 8.6
casual 8.5
photograph 8.4
blond 8.3
healthy 8.2
beard 8.2
wealth 8.1
mask 8.1
spa 8.1
sexy 8
handsome 8
dollars 7.7
pay 7.7
health 7.6
thinking 7.6
rich 7.4
purity 7.4
emotion 7.4
nose 7.3
cheerful 7.3
body 7.2
look 7

Google
created on 2019-05-31

Face 98.9
Forehead 96.5
Chin 95.4
Cheek 95.1
Nose 94.7
Head 92.8
Skin 91.4
Facial hair 89.2
Illustration 89.1
Moustache 87.3
Wrinkle 86.6
Eyebrow 86.4
Jaw 83.9
Drawing 83.1
Sketch 83.1
Portrait 77.2
Self-portrait 76.1
Line 75.5
Watercolor paint 74.3
Mouth 71.5

Microsoft
created on 2019-05-31

sketch 98.4
drawing 98
human face 95
art 94
face 83.1
illustration 76.7
person 65.4
portrait 63.4
forehead 51.7

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 60-90
Gender Male, 94%
Happy 1.1%
Disgusted 1.2%
Angry 75.5%
Calm 7.5%
Sad 4.2%
Confused 3.9%
Surprised 6.7%

Feature analysis

Amazon

Person

Clarifai

Human face
Clothing
Fashion accessory
Human nose
Human mouth
Human eye
Human ear

AWS Rekognition

Person 94.1%

Clarifai

Human face 99.2%

Clarifai

Clothing 75.8%

Clarifai

Fashion accessory 61.1%

Clarifai

Fashion accessory 58%

Clarifai

Human nose 52%

Clarifai

Human mouth 50.8%

Clarifai

Human eye 41.6%

Clarifai

Human eye 39.8%

Clarifai

Human ear 40.1%

Clarifai

Human ear 37.6%

Categories

Imagga
created on 2019-05-31

paintings art 99.9%

Captions

Microsoft
created by unknown on 2019-05-31

a close up of a hat 30.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a portrait of a man with a flower in his hair

Created by general-english-image-caption-blip-2 on 2025-06-27

an old woman with a flower in her hair

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image features an individual wearing a uniform or formal attire, which includes decorative elements with gold accents. A portion of what appears to be a feathered headdress or adornment is visible on the top left side, suggesting the attire could be part of a traditional or ceremonial outfit. The uniform includes detailed shoulder decorations and what looks like a badge or medal hanging from a ribbon or chain at the center of the chest. The background is plain and provides no additional context about the individual or the setting. The overall presentation suggests it may be a historical or official portrait of some sort.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This is a traditional Chinese portrait painting or illustration, appearing to be from a historical period. The artwork depicts an elderly figure wearing a light blue traditional Chinese collar with small decorative buttons. The subject has distinctive features including gold hoop earrings and what appears to be a small red ornamental hairpiece. The painting style is delicate, with soft watercolor-like tones used to create the skin tones and facial features. The background is plain, focusing attention on the portrait itself. The artistic technique shows careful attention to detail, particularly in rendering the subtle wrinkles and facial contours. This type of portrait was commonly created as a formal documentation of important individuals in Chinese history.

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a traditional Chinese portrait painting or illustration, appearing to be from a historical period. The artwork shows an elderly figure wearing a light blue traditional Chinese collar with small gold buttons. The subject has distinctive gold hoop earrings and what appears to be a pink floral ornament in their gray hair. The painting style is delicate, with subtle watercolor-like tones used to create the skin tones and facial features. The background is plain, focusing attention on the detailed facial features including natural age lines and a serene expression. This type of portrait was common in Chinese art for documenting important individuals or family members.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait drawing of an elderly individual. The drawing depicts an elderly person with wrinkled skin, a large nose, and pronounced facial features. The person is wearing earrings and has a serious, contemplative expression on their face. The portrait is rendered in a realistic style using colored pencils or similar media.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image is a watercolor painting of an elderly man's face, with a neutral expression. He has a receding hairline and gray hair pulled back into a ponytail, adorned with a pink feather and a gold hairpin. His eyes are dark brown, and he wears a light blue shirt with a high collar and three gold buttons. Two large gold earrings hang from his ears, featuring a curved design with a textured pattern. The background of the painting is off-white, with some faint pencil marks visible around the edges. The overall style of the painting suggests it may be a portrait or a character study, possibly created for artistic or illustrative purposes.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts an elderly woman with a somber expression, her eyes cast downward. Her hair is styled in a neat bun, adorned with a pink feather and a gold hairpin on the left side. She wears a gray shirt with a blue collar and gold hoop earrings.

The background of the image is a light beige color, resembling aged paper, with a rounded rectangular shape. The overall atmosphere of the image conveys a sense of serenity and introspection, inviting the viewer to reflect on the subject's quiet contemplation.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a detailed portrait of an elderly man. He is depicted in a half-length pose, facing forward with a serious expression. The man has white hair, neatly combed back, and a trimmed beard. His face is wrinkled, suggesting his advanced age. He wears a traditional blue garment with yellow buttons down the front. His ears are adorned with golden earrings, and he has a pink feather or decorative item in his hair. The background is plain and white, focusing attention on the subject.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image depicts an elderly man with a white beard and mustache. He is wearing a blue uniform with a high collar and a pink flower on his head. He has two yellow earrings on both ears. His eyes are slightly closed, and his mouth is slightly open. He has a serious expression on his face. The background is white.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

This is a watercolor portrait of an elderly Asian woman with a stern expression. The portrait, on a slightly off-white background, is an oval shape and focuses tightly on the woman's head and shoulders.

The woman has light pinkish-beige skin with many wrinkles, particularly on her forehead and around her eyes and mouth. Her eyes are small and dark, with a slightly downturned slant. Her nose is wide and fleshy, and her mouth is a thin, pale pink line.

Her hair is gray and pulled back, with a small pink floral ornament and gold hair clip on the left side. She is wearing gold hoop earrings that appear to be textured.

She is dressed in a light blue garment with a round collar outlined in darker blue. Two small gold buttons are visible on the garment near the bottom of the portrait.

The style of the portrait is realistic, with careful attention to detail in the depiction of the woman's features and clothing. The color palette is muted and understated.

Created by gemini-2.0-flash-lite on 2025-04-26

Certainly! Here's a description of the image:

Overall Impression

The image is a portrait of an elderly woman, rendered in a traditional watercolor style. The portrait is set against a white background and has a slightly oval shape.

Details

  • Facial Features: The woman's face is characterized by the visible signs of age: wrinkles across the forehead, around the eyes, and along the sides of the mouth. She has dark eyes and a neutral expression.
  • Accessories: She's wearing large, golden, crescent-shaped earrings. In her hair, on her left side, there's an ornamental piece, which appears to be a combination of a flower and jewelry, possibly a hairpin.
  • Clothing: She is wearing a light blue garment with a detailed neckline.
  • Color Palette and Style: The painting utilizes a soft, naturalistic color palette with light shades of pink and beige for the skin tones, accented by the grey of the hair and the touches of gold in the jewelry. The style is likely from East Asia, possibly China, based on the traditional attire and the subject matter.

Overall: The image is a delicate and detailed portrait of an elderly woman, capturing her aging features with care and a touch of cultural significance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a detailed portrait of an elderly individual. The person has a wrinkled face, indicating advanced age, with deep lines across the forehead, around the eyes, and on the cheeks. The hair is short and gray, and the individual is wearing a pair of large, gold hoop earrings. There is also a decorative hairpin with a pink ornament on one side of the head. The person is dressed in a light blue garment with a collar that features small gold ornaments. The expression on the face is neutral, with the eyes looking straight ahead. The overall style of the portrait suggests it might be a traditional or historical piece, possibly from an Asian cultural context given the style of the accessories and clothing.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

The image is a hand-drawn illustration of an elderly person's face. The individual appears to have a bald head with a small tuft of hair on the left side, possibly dyed pink. The person has numerous wrinkles on the forehead and around the eyes, indicating advanced age. The skin tone is pale, and the facial features include a prominent nose, a small mouth, and deep creases around the mouth and chin. The person is wearing a light blue garment with a collar and two small buttons, and there are gold-colored hoop earrings visible. The style of the drawing is detailed and appears to be done in a watercolor or pastel medium, giving it a somewhat soft and textured look. The background is plain white, which makes the subject stand out.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

The image is a watercolor portrait of an elderly person with a serene expression. The individual has light skin and is depicted from the shoulders up. The person is wearing a blue garment with a collar and two buttons. They have short, gray hair that is neatly combed back, and there is a red and gold ornament tucked into the hair on the left side. The person is also wearing gold hoop earrings. The background is plain white, and the portrait is framed by a light-colored border. The overall style of the painting is detailed and delicate, capturing the fine lines and wrinkles on the person's face.