Human Generated Data

Title

Portrait of a Chinese Official, Perhaps Shang Lu (1414-1486)

Date

15th century

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Denman W. Ross, 1931.212

Human Generated Data

Title

Portrait of a Chinese Official, Perhaps Shang Lu (1414-1486)

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Denman W. Ross, 1931.212

Machine Generated Data

Tags

Amazon
created on 2019-04-03

Art 95.7
Human 94.3
Painting 75
Advertisement 59.6
Poster 58.9

Clarifai
created on 2018-03-24

people 99.7
adult 97.6
one 97.5
man 97.4
portrait 96.5
painting 96.4
wear 95.8
art 94.6
veil 93.8
lid 92.9
leader 91.4
text 90.2
old 89.8
print 89.2
ancient 87.8
retro 87.6
vintage 87.4
illustration 85.7
mustache 83.1
antique 82.7

Imagga
created on 2018-03-24

ski mask 100
face mask 100
mask 100
covering 56.1
protective covering 54.8
hat 45.3
face 35.5
portrait 33
man 30.9
male 29.1
disguise 27.6
cowboy hat 27.4
person 27.2
clothing 26.3
black 23.4
adult 22
attractive 18.9
people 18.4
model 17.9
dark 16.7
headdress 16.1
crime 15.6
eyes 15.5
head 15.1
danger 14.5
sexy 14.4
handsome 14.3
human 14.2
criminal 13.7
expression 13.6
attire 13.2
close 13.1
fashion 12.8
one 11.9
religion 11.6
boy 11.3
happy 11.3
looking 11.2
hair 11.1
guy 11
robber 10.9
smiling 10.8
thief 10.8
hands 10.4
security 10.1
consumer goods 10.1
burglar 9.9
hand 9.9
theft 9.9
old 9.7
mysterious 9.7
mystery 9.6
spiritual 9.6
serious 9.5
closeup 9.4
culture 9.4
cute 9.3
emotion 9.2
eye 8.9
bandit 8.9
gangster 8.9
illegal 8.9
bad 8.8
look 8.8
coat 8.6
dangerous 8.6
ethnic 8.6
smile 8.5
pretty 8.4
studio 8.4
style 8.2
youth 7.7
god 7.6
casual 7.6
child 7.5
religious 7.5
holding 7.4

Google
created on 2018-03-24

text 86.3
art 85.9
portrait 85.7
facial hair 83.8
forehead 74.4
illustration 70.6
poster 68.5
gentleman 67.5
human behavior 66.8
painting 62.4
vintage clothing 61.8
visual arts 60.2
font 55.1
moustache 53.9
artwork 52.4
modern art 52.3
self portrait 50.5

Microsoft
created on 2018-03-24

text 99.4
book 95.9

Color Analysis

Face analysis

Amazon

Imagga

AWS Rekognition

Age 57-77
Gender Male, 82.2%
Angry 5.1%
Sad 4.4%
Disgusted 2.8%
Surprised 5%
Happy 2%
Calm 75.2%
Confused 5.4%

Feature analysis

Amazon

Person

Clarifai

Human face
Clothing
Human nose
Human eye
Human mouth

AWS Rekognition

Person 94.3%

Categories

Captions

Microsoft
created by unknown on 2018-03-24

a bear wearing a red hat 21.1%
a bear that is wearing a hat 21%
a person wearing a hat 20.9%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man with a hat on

Created by general-english-image-caption-blip-2 on 2025-06-27

a portrait of a man in a red shirt and hat

OpenAI GPT

Created by gpt-4 on 2024-01-24

The image depicts a figure adorned in traditional East Asian apparel. The garment appears to be a vibrant shade of red with distinct, broad strokes suggesting the texture and flow of the fabric. The figure is wearing a large black hat that juxtaposes sharply against the red of the clothing. To the right of the figure, there is a vertical column of East Asian script, indicating the picture may be of historical or cultural significance or may include a narrative or poem related to the figure portrayed. The overall condition of the paper suggests age, with visible creases and a gradient of color suggesting weathering or antiquity.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This appears to be a classical Chinese portrait painting, likely from an ancient dynasty. The artwork shows a figure wearing traditional red robes and a distinctive black hat or headdress with what appears to be side projections or wings. The figure has a short grey beard and is depicted in a traditional Chinese artistic style on what appears to be aged paper or silk with some Chinese characters visible in the upper right corner. The background is a neutral tan color, and the painting style is characteristic of formal portrait paintings from imperial China, with careful attention to detail in the facial features and clothing.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image appears to be an old Chinese painting or illustration depicting a man with distinctive facial features wearing a traditional Chinese hat or headpiece. The man has a serious expression and is dressed in a red garment. The background appears to have some calligraphic text or writing in Chinese characters.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image depicts a portrait of an elderly man, likely from the Ming dynasty in China. The man is attired in traditional Chinese clothing, consisting of a red robe and a black hat with two circular protrusions on either side. His facial features are characterized by a prominent mustache and a goatee, which are typical of the style during that era.

In the background, there is a piece of aged paper with Chinese characters written on it. The overall atmosphere of the image suggests that it may be a historical or cultural artifact, possibly created during the Ming dynasty or later as a representation of that period.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a portrait of Genghis Khan, the founder of the Mongol Empire. The painting is rendered in a traditional Chinese style, with bold lines and vibrant colors.

  • Genghis Khan's Portrait
    • The portrait features Genghis Khan wearing a red robe and a black hat.
    • He has a long white beard and mustache, which is characteristic of his appearance in many historical depictions.
    • His eyes are cast downward, giving him a contemplative expression.
  • Background
    • The background of the painting is a warm, beige color, which provides a subtle contrast to the bold colors of Genghis Khan's clothing.
    • There are some faint lines and marks on the background, which may be intended to represent the texture of the paper or the surface on which the painting was created.
  • Chinese Calligraphy
    • At the top of the painting, there is a section of Chinese calligraphy that appears to be a poem or inscription.
    • The text is written in black ink and features a traditional Chinese font.
    • The calligraphy is intricate and ornate, with many flourishes and decorative elements.
  • Overall Impression
    • The painting exudes a sense of dignity and authority, reflecting the powerful legacy of Genghis Khan.
    • The use of traditional Chinese techniques and motifs adds a layer of cultural depth to the portrait, highlighting the complex interactions between different civilizations during the time of the Mongol Empire.

In summary, the image is a striking portrait of Genghis Khan, rendered in a traditional Chinese style with bold lines and vibrant colors. The painting captures the essence of the Mongol leader, conveying a sense of dignity and authority. The inclusion of Chinese calligraphy adds an extra layer of cultural significance, reflecting the complex historical context in which the painting was created.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image depicts a portrait of an old man with a mustache and beard. He is wearing a black hat with two large, round shapes on the sides and a red robe. The man is looking to the left, and his eyes are slightly closed. The portrait is painted on a brown background with some Chinese characters on the top right corner. The image is framed with a white border.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a portrait painting of an elderly man with a serious expression. He is wearing a red garment with a white collar, and his hair is styled in a traditional manner with two long, black pigtails. The portrait is set against a brown background with Chinese characters written in black ink. The painting appears to be old, with visible wear and tear on the paper.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the image:

This is a portrait of an Asian man done in a traditional painting style, possibly Chinese or Korean, on what appears to be aged paper or parchment. The man is depicted from the chest up, slightly turned to his left, with his eyes cast downwards.

He wears a distinctive black headdress that has a rounded top and two circular shapes on either side of his head. His skin tone is light, and he has a neatly trimmed dark beard and mustache with a few very long strands hanging from the beard. The man is wearing a red robe over a grey undergarment.

The background is a textured, tan color, likely due to the age of the paper or the painting style. There are vertical lines of what seem to be traditional Chinese or Korean script on the upper portions of the image, adding to the overall sense of historical context. The artwork has a faded, aged appearance, with some cracks and imperfections in the paper.

Created by gemini-2.0-flash-lite on 2025-04-26

The image is a portrait of an East Asian man, likely a government official or scholar, given the traditional attire and the inscription in Chinese characters. The man is depicted from the chest up, with a focused gaze directed slightly to his right.

Here are the key features:

  • Attire: He wears a traditional black hat with two large ear-flaps, a characteristic of some historical East Asian formal wear. He's dressed in a red robe with a light-colored collar, a common choice for government officials.
  • Facial features: He has a serene expression, with thin eyebrows, a small mustache, and a full beard. The skin appears slightly tanned.
  • Background: The background is plain, likely a light-colored material, perhaps aged paper or silk. It has some visible creases and marks, indicating age or wear.
  • Inscription: There is a column of Chinese characters to the left of the portrait. These characters likely identify the person depicted, including his title, achievements, and possibly posthumous honors.

Overall, the portrait has a formal, dignified, and historical aesthetic, which is typical of traditional East Asian portraiture.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image depicts a traditional portrait of an elderly man, likely from East Asia, given the style and attire. The man is wearing a black hat with large, distinctive ear flaps and a red robe, which was common attire for officials or scholars in ancient China. He has a long, white beard and mustache, indicating his advanced age and wisdom. The portrait is painted on what appears to be aged paper, with visible creases and discoloration, suggesting it is quite old.

At the top of the portrait, there is Chinese calligraphy, which likely provides information about the individual depicted, such as his name, titles, or achievements. The calligraphy is written in traditional Chinese characters, which are often used in classical and historical contexts.

The overall style of the painting is reminiscent of traditional Chinese portraiture, which emphasizes simplicity and realism, focusing on capturing the essence and dignity of the subject. The use of color is minimal, with the red robe standing out against the muted tones of the background and the man's skin. The portrait conveys a sense of solemnity and respect, typical of such historical depictions.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-27

The image depicts a traditional Chinese painting of a man wearing a black official hat with large, rounded side pieces known as "bun ears," which is typical of certain historical Chinese garments, such as those worn by officials or scholars during the Ming or Qing dynasties. The man is dressed in a red robe, which could signify a position of importance or high rank. The background is a textured, weathered paper, giving the painting an aged appearance. There are inscriptions in Chinese characters at the top of the painting, which appear to be titles or descriptions, but without translation, the exact meaning is unclear. The style of the painting, including the use of minimalistic brushwork and the facial features, suggests historical Chinese portraiture, possibly from the Ming dynasty.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-27

This is a traditional East Asian portrait painting, likely from the historical Chinese period. The subject is an elderly man with a calm and composed expression. He has a light complexion and a short, neatly trimmed beard. His attire includes a red garment, which might signify a certain status or role, and a distinctive black hat with wide, flat sides, which is typical of certain historical periods or official attire in East Asia.

The background is a plain, aged paper or fabric with some vertical creases, suggesting it might be a scroll painting. There is also vertical text written in Chinese characters on the right side of the image, which likely provides information about the subject or the painting itself. The text appears to be in black ink and is written in a traditional calligraphic style. The overall composition and style suggest that this is an official portrait or a painting of a person of some importance.

Text analysis

Amazon

E
i
E ih
ih
a
a T
3.
G i
T
G

Google

み尚士子 灾, 築 葉+4雲 气畿尚書無 边澐文誓公 神道道
み尚士子
,
+4
尚書
神道