Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.4

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.4

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 99
Art 98.7
Drawing 98.7
Sketch 94.5
Face 92.4
Person 87.4
Portrait 64.5
Photo 64.5
Photography 64.5

Clarifai
created on 2019-05-31

people 98.3
portrait 98.1
one 97.3
print 97.1
adult 96.6
art 96.1
man 95
painting 93.4
illustration 93.1
face 92.4
paper 90.9
vintage 89.7
veil 89.4
old 88.7
retro 85.1
antique 83.7
mustache 83.4
wear 81.9
ancient 79.3
person 78.8

Imagga
created on 2019-05-31

face 42.7
portrait 35
man 26.9
male 25.7
person 25.6
head 25.2
hair 23
skin 22.5
expression 22.2
beard 21.8
eyes 21.5
representation 21.1
adult 20.7
spectacles 20.5
people 19.5
mug shot 19.1
attractive 18.9
close 17.1
child 16.9
model 16.4
serious 16.2
handsome 16.1
sketch 15.4
facial 15.3
smile 15
photograph 14.8
optical instrument 14.7
boy 13.9
emotion 13.8
sexy 13.7
spa 13.5
old 13.3
care 13.2
looking 12.8
one 12.7
health 11.8
stress 11.5
cute 11.5
guy 11.3
drawing 11.1
relax 11
happy 10.7
human 10.5
senior 10.3
lifestyle 10.1
healthy 10.1
relaxation 10.1
pretty 9.8
thinking 9.5
bath 9.5
men 9.5
closeup 9.4
instrument 9.3
studio 9.1
fashion 9.1
body 8.8
brunette 8.7
hat 8.5
therapy 8.5
casual 8.5
mature 8.4
childhood 8.1
creation 8.1
kid 8
braid 8
smiling 8
nose 7.9
black 7.8
depression 7.8
stare 7.8
luxury 7.7
elderly 7.7
teeth 7.6
blond 7.6
horizontal 7.5
device 7.5
purity 7.4
treatment 7.4
nice 7.3
lady 7.3
salon 7.2
eye 7.2
look 7

Google
created on 2019-05-31

Face 99.3
Forehead 98.4
Cheek 96.5
Eyebrow 95.6
Chin 94.9
Nose 94.3
Head 93.5
Skin 92.5
Jaw 89.2
Sketch 86.8
Drawing 85.5
Lip 82.7
Portrait 79.9
Wrinkle 76.1
Eye 75.9
Illustration 72.5
Ear 71.6
Self-portrait 70.4
Mouth 67.9
Art 62.5

Microsoft
created on 2019-05-31

sketch 99
drawing 98.9
art 98
human face 95.8
face 95.3
indoor 89.7
person 85.8
painting 83.4
eyes 81.4
portrait 79.2
child art 77.7
illustration 66.3
forehead 58.9
cheek 50.7
posing 43.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Female, 59.4%
Happy 3.3%
Confused 62.1%
Angry 5.5%
Sad 3.4%
Calm 16.8%
Surprised 7.5%
Disgusted 1.3%

Microsoft Cognitive Services

Age 57
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 87.4%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created by unknown on 2019-05-31

a person posing for the camera 93.3%
a person smiling for the camera 85.9%
a person smiling for the picture 85.8%

Clarifai
created by general-english-image-caption-blip on 2025-04-29

a photograph of a portrait of a woman with a large earring -100%

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image displays part of a portrait with notable historical or classical style features. At the top, a section of a powdered wig can be seen, indicating a style that may be attributed to the 17th or 18th century, commonly associated with periods such as the Baroque or the Enlightenment in European history. The wig is white and appears to be well-groomed, with curls visible on the sides. Below the wig, just visible on either side of the central obscured area, are what seems to be the upper parts of the ears, and just a hint of a formal clothing collar can be discerned, suggesting the individual is dressed in attire typical of a historical period where formal wigs and attire were customary for certain classes. The background of the portrait is a plain, light color, providing a neutral backdrop for the subject. The portrait is framed with a softly rounded arch at the top, indicating that it might be contained within an oval or arched frame. The paper or medium upon which this portrait is made shows signs of aging or wear around the edges, which often happens with documents or artworks of considerable age.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a historical portrait drawing or watercolor painting with an Asian art style. The artwork shows a close-up view of someone wearing gold hoop earrings. The drawing technique is relatively simple but precise, with delicate shading and pale skin tones. The artwork has a minimalist quality, with just the head and a hint of clothing or collar sketched at the bottom. The style and composition suggest this may be from a historical document or record, possibly from East Asia.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait or sketch of an elderly person's face. The drawing depicts a bald or closely shaved head, defined facial features, and a serious expression. The person is wearing gold-colored hoop earrings. The overall style and technique suggest this may be a work of art or illustration, perhaps for a publication or documentary.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a watercolor painting of an elderly woman's face, rendered in muted tones. The subject has dark hair pulled back, with a few strands framing her face. Her eyes are gray, and her eyebrows are thin and sparse. She wears gold hoop earrings, and her facial expression is neutral, with a subtle hint of a smile.

The background of the painting is a light beige color, which provides a subtle contrast to the subject's features. The overall effect of the painting is one of quiet dignity and serenity, capturing the essence of the elderly woman's gentle spirit.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a watercolor painting of a woman's head, rendered in a realistic style. The subject has dark hair that is shaved close to the scalp on the sides and back, with a small amount of hair visible on top. Her eyes are gray, and she wears gold hoop earrings.

The painting is set against a white background, which provides a clean and neutral contrast to the subject's features. The overall effect is one of simplicity and elegance, with the focus squarely on the woman's face and expression.

The image appears to be a study or portrait, possibly created by an artist or student as an exercise in capturing the subtleties of human facial features. The level of detail and realism suggests a high degree of skill and attention to detail on the part of the artist.

Overall, the image presents a serene and contemplative atmosphere, inviting the viewer to focus on the subject's gentle expression and the subtle nuances of her features.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image depicts a detailed and intricate portrait of an elderly man. The man's face is the central focus, showing a close-up view that highlights his facial features with precision. His skin appears aged, with visible wrinkles and a slightly weathered texture. His eyes are large and expressive, with a contemplative gaze that draws the viewer in. The eyebrows are thick and well-defined, adding to the intensity of his expression. The man's hair is short and receding, with a few wisps remaining on the sides, contributing to his mature appearance. He wears gold earrings, which add a touch of elegance to his portrait. The background is a plain, light-colored surface that ensures the focus remains on the man's face and features. The overall composition and style of the portrait suggest it might be from an older art tradition, possibly from East Asia, given the cultural context of the earrings and the meticulous detail in the drawing.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image shows a drawing of a face of an elderly person. The person is bald with a few strands of hair on the sides of the head. The person has wrinkles on the forehead and around the eyes. The person's eyes are slightly closed, and the person's lips are slightly open. The person is wearing a pair of earrings. The person's face is drawn in a circular shape, and the background is white.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image shows a watercolor portrait of a person's face. The person is depicted from the neck up, directly facing the viewer. They appear to be of Asian descent with fair skin and gray eyes. The subject has a high forehead, a prominent nose, and thin lips. The watercolor technique is somewhat rudimentary with visible brushstrokes and minimal shading to define the features. Wrinkles on the forehead and around the eyes suggest age. The subject wears gold hoop earrings. The portrait is set against a plain, light gray background, and the edges of the paper are rounded. There are preliminary sketch lines visible around the neck area. The overall impression is one of simplicity and straightforward representation of the subject.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

The image is a portrait, likely a painting or drawing, of a person's face. The style appears to be somewhat classical or traditional.

Here's a breakdown of the details:

  • Subject: The subject is an older individual, likely male. This is suggested by the facial features, such as wrinkles and the overall shape.
  • Facial Features: The person has a large, somewhat balding forehead with dark hair framing the sides. The eyebrows are thin. The eyes are small and somewhat deep-set. The nose is fairly prominent. The mouth is closed, with thin lips. The cheeks appear to have some definition.
  • Accessories: The individual wears large, golden hoop earrings.
  • Style/Medium: The portrait is done in a soft, watercolor-like style. The lines are delicate, and the colors are muted, with emphasis on skin tones. The background is a simple light color.
  • Overall Impression: The portrait conveys a sense of age, perhaps wisdom, and a certain formality. The details suggest it might be a portrait of a person of some importance or someone that was likely considered to be important in society.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a detailed portrait of a woman. The artwork appears to be a drawing or painting, likely executed in a realistic style. Here are some key details:

  1. Facial Features: The woman has a serious expression on her face. Her eyes are looking directly forward, and her eyebrows are thin and slightly arched. Her nose is straight, and her lips are thin and closed.

  2. Hair: She has short, dark hair that is neatly combed back. The hairline is high, and the hair appears to be slicked back tightly against her head.

  3. Earrings: She is wearing large, golden hoop earrings that are prominent and add a touch of elegance to her appearance.

  4. Skin Tone: The skin tone is depicted in a naturalistic manner, with subtle shading to indicate the contours of her face.

  5. Background: The background is plain and light-colored, which helps to focus attention on the woman's face.

  6. Art Style: The portrait is executed in a realistic style, with attention to detail in the facial features and shading.

Overall, the portrait captures the woman's likeness with precision and a sense of dignity.