Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.3

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.3

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 98.1
Face 98.1
Art 90
Head 88.8
Drawing 83.1
Painting 59.9
Skin 59.4

Clarifai
created on 2019-05-31

people 99.6
adult 99.3
man 99.1
portrait 98.9
veil 98.5
one 98.3
face 97.3
lid 95.6
facial expression 93.6
wear 93.5
facial hair 93.2
person 93.1
mustache 92.5
art 91.6
head 91.3
illustration 88.6
print 87.1
painting 84.4
serious 83.1
woman 79.1

Imagga
created on 2019-05-31

ruler 100
face 40.6
man 39
portrait 38.2
male 36.9
person 36.4
attractive 25.9
mask 25.4
adult 25.3
handsome 23.2
happy 22
people 21.8
smiling 21.7
looking 21.6
eyes 21.5
expression 21.4
head 21
smile 20
clothing 19.9
hat 19.6
covering 17.3
businessman 16.8
casual 16.1
guy 16
beard 14.5
studio 14.5
model 14
emotion 13.8
close 13.7
cap 13.6
human 12.8
professional 12.7
one 12.7
disguise 12.5
one person 12.3
business 12.2
sexy 12.1
serious 11.5
brunette 11.3
shirt 11.2
health 11.1
happiness 11
black 10.8
closeup 10.8
cute 10.8
pretty 10.5
skin 10.3
hair 10.3
alone 10.1
mustache 10
facial 9.9
worker 9.8
boy 9.6
mouth 9.6
work 9.4
youth 9.4
mature 9.3
occupation 9.2
bathing cap 9.1
hand 9.1
look 8.8
attire 8.6
senior 8.4
camera 8.3
fashion 8.3
teenager 8.2
pose 8.2
cheerful 8.1
lovely 8
headdress 7.8
expressive 7.8
men 7.7
elderly 7.7
fun 7.5
teen 7.4
lady 7.3
confident 7.3
make 7.3
lifestyle 7.2
posing 7.1

Google
created on 2019-05-31

Forehead 97.9
Face 97.3
Chin 92.4
Head 90.6
Cheek 83.8
Facial hair 79.5
Moustache 75
Headgear 73.7
Jaw 71.8
Illustration 71.8
Portrait 70.3
Drawing 64.2
Self-portrait 63.1
Turban 56
Beard 55.1
Gentleman 54.5
Art 50.2

Microsoft
created on 2019-05-31

drawing 99.6
sketch 99.2
art 98.9
painting 98.4
person 96.9
wearing 94.6
human face 92.6
hat 92.2
man 92.1
face 91.4
illustration 85.7
child art 84.3
portrait 66.3
eyes 50.9
old 46.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 95.6%
Happy 7.5%
Disgusted 3.3%
Angry 6.9%
Surprised 23.7%
Sad 2.5%
Calm 26.7%
Confused 29.5%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person

Clarifai

Human face
Human nose
Human mouth
Human ear
Human eye
Fashion accessory

AWS Rekognition

Person 94%

Clarifai

Human face 99.4%

Clarifai

Human nose 51.9%

Clarifai

Human mouth 49.8%

Clarifai

Human mouth 42%

Clarifai

Human ear 45.3%

Clarifai

Human ear 35.5%

Clarifai

Human eye 39.3%

Clarifai

Human eye 38.7%

Clarifai

Fashion accessory 33.5%

Categories

Imagga
created on 2019-05-31

paintings art 100%

Captions

Microsoft
created by unknown on 2019-05-31

a man wearing a hat 82.3%
a man wearing a hat and glasses 71%
a man wearing a black hat 70.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a portrait of a man with a beard and a mustache

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of an old man with a mustache

OpenAI GPT

Created by gpt-4 on 2024-12-03

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a traditional Chinese portrait painting or illustration, likely from a historical period. The artwork shows a person wearing a black traditional Chinese cap or head covering. The subject has a distinctive mustache, pale complexion, and gentle eyes. The style suggests this is a formal or official portrait, possibly of a scholar, official, or other prominent figure from Chinese history. The medium appears to be watercolor, with delicate shading and subtle color transitions, particularly in the facial features. The portrait is executed in a realistic yet somewhat stylized manner typical of formal Chinese portraiture.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait of a man wearing a traditional Asian hat, possibly from China or another East Asian country. The man has a prominent mustache and an intense, serious expression on his face. The painting or drawing style seems to be a realistic representation of the man's features and facial details. The background is a plain, light-colored surface, allowing the focus to remain on the portrayal of the man's face and expression.

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-26

This appears to be a traditional Chinese portrait painting or illustration, likely from a historical period. The artwork depicts a person wearing a black traditional Chinese cap or hat. The subject has a distinctive mustache and calm, steady gaze. The painting style is delicate and subtle, using soft colors and careful brushwork to capture facial features. The background is plain, focusing attention on the face itself. This type of portrait was common among officials or scholars in imperial China, and the style suggests it may be from the Qing Dynasty period. The technique appears to be watercolor on paper, with particular attention paid to subtle skin tones and facial details.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image presents a watercolor painting of an older man's face, characterized by a prominent mustache and a black hat. The subject's facial features are rendered in a realistic style, with attention to detail in the depiction of his eyes, nose, and mouth. The overall effect is one of a dignified and introspective individual, captured in a moment of quiet contemplation.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-22

The image depicts a watercolor painting of a man's face, rendered in muted colors. The subject has a prominent mustache and a black cap, with a neutral expression. His eyes are cast downward, and his gaze is directed at the viewer.

The painting is set against a light gray background, which provides a subtle contrast to the subject's features. The overall effect is one of understated elegance, with the artist's use of muted colors and delicate brushstrokes creating a sense of serenity and calm.

The subject's facial features are rendered in a realistic style, with attention to detail paid to the shape of his eyes, nose, and mouth. His mustache is particularly well-defined, with a distinctive curl at the ends.

The painting's composition is simple yet effective, with the subject's face taking center stage. The use of negative space around the subject creates a sense of depth and dimensionality, drawing the viewer's eye into the painting.

Overall, the image is a beautiful example of watercolor art, with its muted colors and delicate brushstrokes creating a sense of calm and serenity. The subject's facial features are rendered in a realistic style, making the painting feel both intimate and engaging.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a traditional Chinese portrait painting. The subject is a man with a serious expression, and he is wearing a traditional Chinese hat. The painting is rendered in a monochromatic palette, primarily using shades of gray and brown. The man's face is detailed, with distinct features such as his eyes, nose, and mouth. His hair is depicted in a simple style, and he has a mustache and beard. The background of the painting is plain, allowing the focus to remain on the subject's face and expression.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image depicts a close-up portrait of an elderly man. The man's face is shown in profile, and he is wearing a black hat. His facial features are well-defined, with wrinkles around his eyes and mouth, indicating his age. He has a mustache and a beard, which are neatly trimmed. The man's eyes are closed, and his mouth is slightly open, giving him a serene and peaceful expression. The background of the image is plain and white, which helps to focus the viewer's attention on the man's face. Overall, the image conveys a sense of dignity and respect for the elderly man.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here is a description of the image:

The image shows a detailed, frontal portrait of an older man with Asian features. The portrait appears to be a watercolor painting, meticulously crafted.

The man has a smooth, high forehead, likely bald underneath the close-fitting black cap he's wearing. His skin tone is pale with subtle hues of brown and pink, indicating age and realism. Fine lines and wrinkles are visible on his forehead and around his eyes, giving him a mature appearance. He has dark, almond-shaped eyes that appear to be looking directly at the viewer.

A thin, grey mustache sits above his lips, which are tinted a delicate pink. The area around his mouth and chin has delicate shading. His ears are subtly visible on either side of his face. The man is wearing a high-collared garment, with just a hint of its outline visible beneath his chin.

The portrait is painted on a slightly off-white background, which makes the colors of the man's face and clothing stand out. The composition is simple, focusing entirely on the man's face and upper neck area, which gives the portrait an intimate and personal feeling. The style and attire suggest the portrait may be historical, potentially from East Asia.

Created by gemini-2.0-flash-lite on 2025-04-26

Certainly! Here's a description of the image:

Overall Impression:

The image is a portrait of an older Asian man, likely a historical figure. The portrait is rendered in a watercolor style, giving it a delicate and somewhat aged appearance.

Key Features:

  • Facial Features: The man has a light complexion, with wrinkles around the eyes and on the forehead, suggesting age. He has dark eyes, a prominent nose, and a thick, dark mustache. The lips are a light pink.
  • Clothing: The man is wearing a dark hat.
  • Style: The style of the portrait seems to be traditional, possibly from East Asia. The shape of the portrait is unusual, with a slightly rounded edge.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a portrait of an older man, likely from an East Asian cultural background, given the style of the artwork and his attire. Here are some detailed observations:

  1. Facial Features:

    • The man has a prominent mustache and a goatee, both of which are neatly groomed.
    • His eyes are depicted with a focused and serious expression.
    • The skin tone is painted in a light beige color, with subtle shading to indicate facial contours.
  2. Attire:

    • The man is wearing a traditional black cap, which is typical in some East Asian cultures, particularly in historical contexts.
    • The cap appears to be made of a smooth, solid material and covers most of his head.
  3. Art Style:

    • The portrait is painted in a traditional style, possibly with watercolors or ink.
    • The use of lines is minimal, focusing more on shading and color to depict the facial features.
    • The background is plain, emphasizing the subject without any distractions.
  4. Expression and Mood:

    • The man's expression is calm and composed, suggesting a sense of dignity and wisdom.
    • The overall mood of the portrait is solemn and respectful, likely intended to honor or commemorate the individual.

This portrait could be a historical or cultural artifact, representing a figure of significance in the context of its creation.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-24

The image depicts a watercolor portrait of a man. The man is wearing a dark, round-brimmed hat. His face is detailed with a calm and composed expression. He has a light complexion, a straight nose, and a neatly trimmed, dark mustache. The shading around his face and the hat suggests a traditional style, possibly indicative of a historical or academic painting. The background is plain and does not distract from the subject.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-24

The image is a portrait of an elderly man, likely of East Asian descent, rendered in a traditional style that suggests it may be from a historical or cultural context. The man has a bald head with a black hat covering the top and back of his head. His face shows signs of aging with visible wrinkles and a calm, composed expression. He has a small, neatly trimmed mustache and a few strands of hair on his chin. The painting style is realistic, with attention to detail in the facial features and the texture of the skin. The background is plain white, which highlights the figure prominently. The overall mood of the portrait is serene and dignified.