Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.15

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.15

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Face 98.1
Human 98.1
Art 96.2
Person 93.1
Drawing 92.4
Painting 77.5
Head 77.1
Photo 67
Photography 67
Portrait 67
Sketch 61.5
Clothing 60.3
Apparel 60.3
Hat 60.3

Clarifai
created on 2019-05-31

people 99.5
art 99.5
man 98.9
adult 98.9
portrait 98.9
veil 98.8
one 98.8
painting 98.4
illustration 98.2
print 97.6
lid 96.9
wear 95.2
ancient 94.2
old 93.4
face 93.1
antique 91.9
facial hair 90.5
leader 89.9
vintage 86.9
mustache 84.7

Imagga
created on 2019-05-31

mug shot 44.6
photograph 36.5
face 35.5
hat 32.5
portrait 32.4
man 31.6
male 30.6
person 29.7
bust 27.8
sculpture 27.1
representation 26.6
head 24.4
handsome 24.1
attractive 23.8
people 21.8
eyes 20.7
beard 20.5
adult 20
cap 19.1
expression 18.8
model 18.7
smile 17.8
clothing 17.8
creation 17.5
hair 17.4
child 16.8
happy 16.3
plastic art 15.9
headdress 15.8
black 14.5
close 14.3
guy 13.7
sexy 13.7
human 13.5
serious 13.3
boy 13
one 11.2
looking 11.2
old 11.1
blond 11.1
closeup 10.8
facial 10.5
youth 10.2
smiling 10.1
fashion 9.8
look 9.6
men 9.4
cute 9.3
mature 9.3
professional 9.3
mortarboard 9.2
emotion 9.2
studio 9.1
art 8.9
skin 8.8
thinking 8.5
casual 8.5
pretty 8.4
eye 8
worker 8
bathing cap 7.7
ethnic 7.6
ruler 7.5
nice 7.3
kid 7.1
work 7.1
consumer goods 7.1
covering 7

Google
created on 2019-05-31

Face 96.6
Forehead 93.9
Head 89.8
Chin 89.5
Cheek 86.1
Portrait 84.5
Self-portrait 82.7
Painting 78.7
Watercolor paint 78.5
Illustration 74.9
Art 73.1
Headgear 67.5
Drawing 60.7
Gentleman 54.5
Wrinkle 50.7

Microsoft
created on 2019-05-31

art 99.5
drawing 99.4
sketch 98.7
hat 98.2
painting 96.8
wearing 94
human face 91
face 77.1
illustration 73.6
child art 70
portrait 64.2
person 58.3
old 52.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 93.6%
Sad 4.5%
Angry 11.7%
Calm 16.4%
Confused 53.3%
Disgusted 2.3%
Happy 1.5%
Surprised 10.4%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 93.1%

Categories

Imagga

paintings art 100%

Captions

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image shows a portion of a person wearing a dark-colored, possibly black, cap. The cap has a rounded crown and maybe part of a uniform or casual wear. The material of the cap looks worn or aged, with visible creases and possible fading, suggesting it has been used or exposed to the elements over time. The person also seems to have visible earlobes that appear just below the cap line. The background is a nondescript, neutral color and appears somewhat textured, which could indicate a paper or wall surface. The centerpiece of the image (likely the face of the person) is obscured by a gray rectangle, preventing the identification or description of facial features.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This appears to be a traditional Chinese portrait painting, likely from a historical period. The artwork shows a person wearing a black scholar's cap and what seems to be traditional Chinese clothing. The painting style is delicate and precise, with subtle coloring and fine details, particularly in the facial features and wispy beard. The background is minimal and muted, typical of classical Chinese portraiture. The painting technique appears to use watercolor or similar traditional materials on paper or silk. The composition is formal and straightforward, which was common for official or ancestral portraits in Chinese art history.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts an elderly man with a serious expression on his face. He is wearing a black hat or cap and has a long, white beard. The background is muted, with a grey-toned color scheme. The portrait appears to be a traditional or historical artwork, possibly a painting or sketch.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image is a watercolor painting of an older man's face, rendered in muted colors. The man wears a black hat and a purple robe, with a subtle smile on his face. His eyes are cast downward, and his eyebrows are thin and gray. He has a long white beard that extends from his chin to his neck. The background of the painting is a light beige color, which provides a neutral backdrop for the subject's features. The overall effect of the painting is one of serenity and contemplation, as if the man is lost in thought. The style of the painting suggests that it may be a traditional Chinese or Japanese artwork, given the use of watercolors and the subject's attire. The level of detail and realism in the painting is high, indicating that the artist was skilled in their craft. Overall, the image presents a peaceful and introspective portrait of an older man, inviting the viewer to reflect on their own thoughts and emotions.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image depicts a portrait of an Asian man, likely from the 18th or 19th century. The man's face is the primary focus of the image, and he is depicted with a serious expression. He has a high forehead, prominent cheekbones, and a pointed chin. His eyes are dark brown, and his eyebrows are thin and straight. He has a small nose and thin lips that are painted pink. The man's hair is black and styled in a traditional Asian manner, with a flat top and a rounded edge at the back. He wears a black hat that covers his hair, and a purple robe with a high collar. The background of the image is a light beige color, which provides a subtle contrast to the man's features. Overall, the image presents a dignified and introspective portrait of an Asian man, showcasing his unique facial features and traditional attire.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-05

The image features a portrait of an elderly man with a serious expression, likely from an old painting. The man has a white beard and mustache and is wearing a traditional black hat with a flat top. His face is slightly wrinkled, and he has a mole on his left cheek. The painting has a vintage look, with a slightly faded color palette and a white border.

Created by amazon.nova-pro-v1:0 on 2025-01-05

The image features a portrait of an elderly man. He has a wrinkled face and a white beard. He is wearing a black hat and a grayish-white shirt. He has blue eyes and a pinkish nose. His face is painted with a light brown color, and his eyes are painted with a darker shade of brown. The painting is done on a white surface, which is probably a piece of paper.