Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.35

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.35

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 96
Drawing 92.7
Art 92.7
Face 92.3
Person 84.6
Painting 75.7
Sketch 61.3

Clarifai
created on 2019-05-31

adult 98.9
man 98.9
people 98.5
illustration 98.5
art 98.3
portrait 98.1
mustache 97.8
one 97.5
painting 97.3
lid 96.5
face 95
facial hair 94.3
veil 92.4
print 92.3
beard 92
person 91.6
wear 89.1
head 83.9
serious 81.3
artistic 80.1

Imagga
created on 2019-05-31

ruler 51.4
mask 46.8
face 42.6
portrait 35.6
covering 34.2
disguise 29
person 28.6
man 26.9
head 26.9
eyes 23.3
male 22.7
expression 22.2
skin 21.4
people 20.7
close 20.6
attractive 20.3
attire 20.2
adult 20.1
tattoo 19
clothing 18.4
bust 18.1
sculpture 17.8
model 17.1
smile 15
care 14
human 13.5
hair 13.5
fashion 12.8
one 12.7
eye 12.5
black 12
spa 11.7
sexy 11.3
health 11.1
emotion 11.1
casual 11
closeup 10.8
handsome 10.7
facial 10.6
makeup 10.4
mature 10.2
design 10.1
decoration 9.8
old 9.8
stress 9.6
skincare 9.5
happy 9.4
plastic art 9.4
relaxation 9.2
dark 9.2
beard 9.1
mustache 8.9
looking 8.8
look 8.8
mug shot 8.7
natural 8.7
lifestyle 8.7
art 8.7
pain 8.6
cute 8.6
guy 8.6
serious 8.6
pretty 8.4
clean 8.4
healthy 8.2
confident 8.2
representation 8.2
posing 8
sweatshirt 8
smiling 8
brunette 7.9
salon 7.7
men 7.7
photograph 7.7
studio 7.6
hand 7.6
therapy 7.5
senior 7.5
nose 7.4
body 7.2
consumer goods 7.1

Google
created on 2019-05-31

Facial hair 98
Hair 97.5
Face 97.2
Forehead 96.5
Beard 93.8
Moustache 93.7
Head 91
Chin 88.3
Illustration 86.6
Eyebrow 86.4
Nose 84.2
Cheek 83.8
Jaw 78.3
Drawing 76.7
Art 72.1
Self-portrait 71.7
Portrait 69.7
Sketch 68.6
Painting 61.3
Gentleman 59.6

Microsoft
created on 2019-05-31

drawing 99.8
sketch 99.6
art 99.6
abstract 99.2
painting 99.1
tattoo 96.4
child art 93.8
illustration 88.2
human face 84.4
face 80.4
person 58.9
portrait 58.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Male, 92.7%
Sad 3.6%
Confused 10.5%
Disgusted 6.5%
Surprised 48%
Angry 6.9%
Happy 3.1%
Calm 21.4%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Person 84.6%
Painting 75.7%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created by unknown on 2019-05-31

a tattoo on his face 77.7%
a tattoo on his neck 77.6%
a close up of a tattoo 77.5%

Clarifai
created by general-english-image-caption-blip on 2025-04-28

a photograph of a portrait of a man with a mustache and a mustache -100%

OpenAI GPT

Created by gpt-4o-2024-05-13 on 2025-01-04

The image features an illustration with a black, semi-circular hat at the top of the composition. The image also includes detailed depictions of two ears on either side. The hat appears to be part of a traditional attire, and the overall background is plain and light-colored.

Created by gpt-4 on 2024-12-03

The image displays a portion of an artwork, with the top section resembling the form of a traditional helmet or headdress, predominantly in a dark grey color. The texture of this component suggests a possible metallic or stone-like material, with visible brush strokes or texture lines contributing to the overall appearance. The main central region of the image is obscured by a large, rectangular grey overlay, which effectively conceals a significant part of the artwork, leaving only the outer edges visible. The bottom edge of the overlay is soft and irregular, suggesting the presence of natural shapes or forms beneath. The edges of the concealed area hint at lighter tones and possibly other details which are hidden from view. The background behind the artwork appears to be a plain, lightly textured white surface, allowing the darker colors of the artwork to contrast sharply against it.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a traditional Chinese portrait painting, likely from a historical period. The artwork shows a face rendered in a formal style typical of official or ancestral portraits. The subject wears a dark traditional hat or headpiece and has a distinctive mustache. The painting technique is delicate, using subtle colors and fine lines, particularly in the facial features. The background is plain, focusing attention on the face, which is portrayed in a straightforward, formal manner. The style suggests this could be from an official document or formal portrait collection, possibly of a scholar or government official from imperial China.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait of a man. The portrait depicts a male face with distinct features such as a prominent forehead, eyebrows, and a detailed mustache. The background of the portrait is a grayish tone, with the main focus being the detailed rendition of the man's facial features.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a watercolor painting of a man's face, rendered in muted tones. The subject is depicted from the shoulders up, with his head tilted slightly to the right. He wears a dark-colored hat that covers his forehead and hair, leaving only his eyebrows visible. His eyes are cast downward, and he sports a mustache that extends downward from his nose. The background of the painting is a light beige color, which provides a subtle contrast to the subject's features. Overall, the image presents a serene and contemplative portrait of the man, inviting the viewer to reflect on his expression and demeanor.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a hand-drawn portrait of a man's face, rendered in pencil and colored pencil on a white background. The subject is depicted from the nose up, with a prominent mustache and goatee. He wears a black hat, which is drawn in a simple, rounded shape. The background of the drawing is white, providing a clean and neutral backdrop for the subject.

The overall effect of the drawing is one of simplicity and elegance, with the artist focusing on capturing the essence of the subject's features rather than creating a highly detailed or realistic portrait. The use of colored pencil adds a touch of warmth and depth to the drawing, bringing the subject to life.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image features a traditional Chinese portrait painting of a man's face. The portrait is done in a monochromatic style, predominantly using shades of gray and light brown. The man has a serious expression and is depicted with a slightly open mouth, giving the impression of a contemplative or thoughtful demeanor. His eyes are almond-shaped, with a calm and focused gaze. He has a mustache and a beard, which are meticulously drawn, adding to the detailed and realistic portrayal of the face. The hair is styled in a traditional manner, with a neat bun on top, and is also rendered in shades of gray. The background is plain and white, which helps to emphasize the facial features and the intricate details of the portrait.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image shows a portrait of a man. The man has a mustache and a receding hairline. He is bald, and his eyebrows are thin. His eyes are small and slightly squinted. His lips are thin, and his nose is slightly upturned. His skin is light, and his face is slightly wrinkled. The background is plain white. The man's head is slightly tilted to the right.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is a watercolor portrait of a man's face. The man has fair skin, with a slight blush on his cheeks. He has dark, straight eyebrows and almond-shaped eyes. His nose is rounded, and he has a thin mustache. His lips are slightly pink, and his chin is clean-shaven. He is wearing a black cap that covers the top of his head. The background is a light, neutral color. The overall style of the portrait is simple and straightforward.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall: The image is a watercolor portrait, likely of a Chinese man. It has a slightly weathered and aged appearance. The portrait is presented in a stylized, oval-like shape.

Facial Features:

  • Face: The man has a pale complexion with a hint of pink. His skin tone appears to be lightly shaded.
  • Eyes: The eyes are small, with dark irises, giving a thoughtful or slightly stern expression.
  • Eyebrows: The eyebrows are thin and dark.
  • Nose: The nose is well-defined, with a slightly upturned tip.
  • Mouth/Mustache: A prominent feature is the mustache, which is long, dark, and finely detailed. The lips are a delicate pink.
  • Ears: The ears are visible and positioned on the side of the face.

Headwear:

  • The man wears a dark, possibly black, hat that is rounded and flat on top. The hat covers the top of his head and appears to be made of a matte material.

Artistic Style:

  • The style appears to be traditional Chinese portraiture. The details are delicate, with precise lines and careful shading using watercolor. The choice of colors is muted and subtle.
  • The paper background has a slightly textured and aged appearance.

Overall Impression: The portrait evokes a sense of traditional Chinese culture. The man's expression and clothing suggest a person of some status or importance. The details of the portrait hint at it being a vintage work.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image depicts a traditional portrait of a man, likely of East Asian descent, given the style and features. The portrait is a close-up of the man's face, focusing on his facial features and headgear. Here are some detailed observations:

  1. Headgear: The man is wearing a black hat that appears to be a traditional East Asian headpiece, possibly a type of cap or crown. The hat has a central seam running down the middle.

  2. Facial Features: The man has a light complexion with distinct facial features. He has a mustache and a goatee, both of which are neatly trimmed. His eyes are almond-shaped and look directly forward.

  3. Expression: The man's expression is neutral and composed, giving a sense of calmness and dignity.

  4. Art Style: The portrait is rendered in a traditional style, possibly using ink and watercolors. The colors are subtle and muted, with a focus on capturing the essence of the subject rather than detailed realism.

  5. Background: The background is plain and light-colored, which helps to highlight the subject's face and headgear.

This type of portrait is often associated with historical or cultural significance, potentially representing a figure of importance or a scholar from a bygone era.