Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.31

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.31

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 98.3
Art 96.6
Drawing 96.6
Face 95.8
Person 91.7
Head 89.6
Sketch 77.7
Photo 61
Portrait 61
Photography 61
Doodle 58.1

Clarifai
created on 2019-05-31

portrait 99.5
people 99.4
adult 99.3
one 98.8
man 98.5
veil 97.7
face 97.1
art 97
lid 94.5
wear 93.4
illustration 91.9
painting 91.8
mustache 91.1
facial expression 90.9
person 90.3
print 90.1
head 89.5
facial hair 89.4
serious 83
confidence 81.6

Imagga
created on 2019-05-31

mug shot 82
photograph 63.6
face 49.1
representation 48.9
portrait 38.2
mask 35.4
head 35.3
creation 32.4
person 31.5
attractive 29.4
covering 28.4
man 28.2
eyes 27.6
model 24.9
expression 24.8
male 24.1
adult 22.7
people 22.3
clothing 22.1
smile 21.4
sculpture 21.2
bust 21
disguise 20.6
skin 19.7
ruler 19.1
hat 18.2
fashion 18.1
human 18
handsome 17.8
black 17.5
bathing cap 17.5
cap 17.4
sexy 16.9
close 16.6
attire 14.6
youth 14.5
cute 14.4
happy 13.8
headdress 13.7
looking 13.6
closeup 13.5
smiling 13
emotion 12.9
plastic art 12.8
make 12.7
one 12.7
pretty 12.6
facial 12.5
lady 12.2
style 11.9
health 11.8
look 11.4
brunette 11.3
boy 11.3
lips 11.1
hair 11.1
guy 11
eye 10.7
care 10.7
posing 10.7
studio 10.6
makeup 10.2
expressive 9.7
stress 9.6
serious 9.5
women 9.5
casual 9.3
relaxation 9.2
dark 9.2
sensuality 9.1
pose 9.1
stylish 9
spa 9
consumer goods 9
cool 8.9
healthy 8.8
complexion 8.8
nose 8.7
mouth 8.6
men 8.6
alone 8.2
teenager 8.2
art 8.2
gorgeous 8.2
lovely 8
body 8
skincare 7.6
natural 7.4
girls 7.3
confident 7.3
lifestyle 7.2
medical 7.1

Google
created on 2019-05-31

Face 97.4
Forehead 95.9
Chin 91.6
Head 90.6
Cheek 88.9
Nose 84.2
Illustration 78
Headgear 72.7
Jaw 69.6
Art 65.5
Portrait 65.1
Self-portrait 61.5
Painting 58.3
Drawing 57.6
Facial hair 55.5
Sketch 53.6
Watercolor paint 50.4

Microsoft
created on 2019-05-31

drawing 99.4
sketch 98.8
art 98.4
human face 95.8
painting 95.4
person 90.3
illustration 84.3
man 79.2
child art 77.1
portrait 71
face 66.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 98.2%
Disgusted 5.2%
Happy 2.7%
Surprised 17%
Sad 6.7%
Angry 26.5%
Confused 33%
Calm 8.9%

Microsoft Cognitive Services

Age 51
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 91.7%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2019-05-31

a tattoo on his face 67.5%
a close up of a tattoo 67.4%
a tattoo on his neck 67.3%

OpenAI GPT

Created by gpt-4 on 2024-12-03

This image depicts an illustration or painting of a person with a significant portion intentionally obscured. Visible elements include the subject's hairstyle, which is dark and seems to be styled in a manner that could be indicative of a historical period or cultural hairstyle—perhaps swept back and possibly powdered or white at the sides. There's a hint of some adornment or feature at the very top, possibly a bow, ornament, or some other type of accessory. Only the edges of the figure's ears are visible, suggesting the central part of the image where the face would typically be has been covered or intentionally removed. The edges of the illustration show signs of wear or damage, including tears and creasing. The overall aesthetic suggests it could be an old or historical image.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a traditional Chinese portrait painting, appearing to be from a historical period. The artwork depicts a figure wearing a black official's hat with a small ornamental detail at the top. The painting style is characteristic of formal ancestral or court portraiture, with delicate lines and subtle coloring. The subject wears what appears to be a grey collar or robe. The painting technique shows fine detail work, particularly in the rendering of the mustache and facial features. The overall style suggests this is likely from the Qing Dynasty period, when such formal portrait paintings were common among officials and aristocrats.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait or painting of an Asian man with a mustache and a distinctive headdress or hat. The man's face is depicted with detailed features, including his eyes, nose, and lips. The background of the image is mostly dark, with a crescent-shaped symbol or object visible at the top. The overall style of the artwork suggests it may be an East Asian or Chinese artistic representation.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a watercolor painting of a man's face, with a focus on his facial features and attire. The man is shown from the shoulders up, wearing a black hat adorned with a small gold ornament at the top. His facial hair is neatly trimmed, featuring a mustache and a thin beard that extends from his chin to his lower lip. The man's attire consists of a dark-colored jacket or robe, which is visible around his neck and shoulders. The background of the painting is a light beige color, providing a subtle contrast to the subject's dark clothing. Overall, the image presents a dignified and elegant portrait of the man, showcasing his refined features and stylish attire.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a watercolor painting of a man's face, rendered in muted tones of gray and beige. The subject is portrayed with a neutral expression, gazing directly at the viewer. His facial features are characterized by a prominent mustache and goatee, which are rendered in darker shades than his skin tone. The man's eyes are depicted as blue, while his eyebrows are drawn in a subtle, curved line. A small, gold crescent-shaped ornament adorns the top of his head, adding a touch of elegance to the overall composition. The background of the painting is a soft, off-white color, which provides a subtle contrast to the subject's features. The overall effect is one of understated sophistication, with the muted colors and simple composition evoking a sense of serenity and calmness.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

This image shows a portrait of a man, possibly from the Qing dynasty. The man is depicted in a serious expression, wearing a black hat with a golden ornament on top. He has a mustache and beard, and his hair is tied up in a bun. The portrait is painted in a traditional Chinese style, with a white background and a gray border. The man's face is slightly tilted to the right, and his eyes are looking straight ahead.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image depicts a portrait of a man. He has a mustache and is wearing a hat. The image is in black and white, and the man's face is the main focus of the image. The man's eyes are looking straight ahead, and he has a serious expression. The image is framed by a white border, and the background is plain and simple.