Human Generated Data

Title

[Meta-Koosega] (Pure Tobacco), Chippewa Warrior

Date

c. 1832-1834

People

Artist: Henry Inman, American 1801 - 1846

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Peabody Museum of Archaeology and Ethnology, Harvard University, gift of the heirs of E. P. Tileston and Amor Hollingsworth, 1882, 2023.196

Human Generated Data

Title

[Meta-Koosega] (Pure Tobacco), Chippewa Warrior

People

Artist: Henry Inman, American 1801 - 1846

Date

c. 1832-1834

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Peabody Museum of Archaeology and Ethnology, Harvard University, gift of the heirs of E. P. Tileston and Amor Hollingsworth, 1882, 2023.196

Machine Generated Data

Tags

Amazon
created on 2023-07-18

Art 100
Painting 100
Face 99.5
Head 99.5
Photography 99.5
Portrait 99.5
Accessories 94.8
Jewelry 94.8

Clarifai
created on 2023-10-13

portrait 99.9
people 99.6
one 99.4
man 99.2
adult 99.1
facial hair 97.6
outerwear 95.6
wear 94.8
leader 94.6
jacket 92.6
writer 92.3
knitwear 91.3
art 91.1
music 86.7
model 86.4
facial expression 82.8
elderly 81
fashionable 80.7
religion 79.7
mustache 79.3

Imagga
created on 2023-07-18

man 47.7
male 43.2
portrait 34.9
person 34.9
adult 33
people 29
happy 22.6
smiling 21.7
attractive 21.7
face 21.3
guy 21.1
couple 20.9
handsome 20.5
clothing 19.3
looking 19.2
sitting 18.9
model 18.7
casual 18.6
black 17.7
fashion 17.3
expression 17.1
love 16.6
one 16.4
shirt 16
lifestyle 15.9
youth 15.3
serious 15.3
human 15
happiness 14.9
garment 14.4
grandfather 14.4
smile 14.2
dark 14.2
bathrobe 14
men 13.7
home 13.6
posing 13.3
beard 13.2
standing 13
confident 12.7
hair 12.7
together 12.3
suit 12.2
cheerful 12.2
senior 11.2
old 11.1
grandma 10.9
pose 10.9
cool 10.7
sofa 10.5
style 10.4
eyes 10.3
close 10.3
head 10.1
indoor 10
husband 10
modern 9.8
businessman 9.7
sexy 9.6
look 9.6
robe 9.6
boy 9.6
mature 9.3
alone 9.1
studio 9.1
lady 8.9
family 8.9
couch 8.7
married 8.6
thinking 8.5
tie 8.5
wife 8.5
smart 8.5
room 8.5
relax 8.4
sweatshirt 8.1
indoors 7.9
hands 7.8
pretty 7.7
life 7.6
living 7.6
relaxed 7.5
pullover 7.5
camera 7.4
sweater 7.3
business 7.3
jacket 7

Google
created on 2023-07-18

Picture frame 86.6
Sleeve 84.1
Art 83.3
Painting 81.3
Beard 80.2
Self-portrait 72.8
Facial hair 70.6
Visual arts 67
Drawing 65.7
Sitting 60.8
Darkness 60.7
Wrinkle 60.7
Portrait 57.6
Illustration 56.2
Portrait photography 55.4
Moustache 52.7
Artwork 51.4
Elder 50.1

Microsoft
created on 2023-07-18

person 99.7
painting 99.1
wall 98.4
man 97.5
drawing 96.9
human face 96.3
portrait 92.1
sketch 89.6
art 82.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 54-64
Gender Male, 94.9%
Confused 44.1%
Sad 40.6%
Calm 12.3%
Disgusted 11.2%
Surprised 7.5%
Fear 6.3%
Angry 3.3%
Happy 1.7%

Microsoft Cognitive Services

Age 58
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Adult
Male
Man
Necklace

Clarifai

Human face
Man
Fashion accessory
Human arm
Human nose
Human mouth
Human eye

AWS Rekognition

Person 99.5%

AWS Rekognition

Adult 99.5%

AWS Rekognition

Male 99.5%

AWS Rekognition

Man 99.5%

AWS Rekognition

Necklace 94.8%

Clarifai

Human face 96.1%

Clarifai

Man 90.1%

Clarifai

Fashion accessory 41.4%

Clarifai

Human arm 40.2%

Clarifai

Human nose 38.9%

Clarifai

Human mouth 38.8%

Clarifai

Human eye 37.8%

Clarifai

Human eye 36.7%

Categories

Imagga
created on 2023-07-18

events parties 99.8%

Captions

Microsoft
created by unknown on 2023-07-18

a man wearing a suit and tie 86.1%
a close up of a man 81.7%
a man in a suit and tie 81.6%

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man in a white robe

Created by general-english-image-caption-blip on 2025-04-28

a photograph of a painting of a man in a white coat

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image shows an individual wearing a white robe or cloak that has a textured appearance, reminiscent of heavy fabric, possibly wool or another thick material. There's a dark-colored ribbon or string with a metal ornament hanging from the neck of the garment. In the background, there appears to be a subdued landscape with a hint of greenery, giving the impression of looking out onto a field or a park from a higher elevation. The color palette of the image is quite muted, with emphasis on earth tones, and the lighting suggests an overcast or subdued environment. The painting style suggests a classic or traditional approach, with attention to detail and shading to create a sense of volume and three-dimensionality in the garment.

Created by gpt-4o-2024-05-13 on 2025-01-02

The image depicts a person wrapped in a large, draped white or cream-colored garment. The background consists of a landscape view with greenery and possibly a body of water in the distance, under an overcast sky. The person is also wearing a medallion or pendant around their neck. The overall lighting and style suggest that it is a painted portrait, likely of historical or cultural significance.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-27

This is a historical portrait painting, appearing to be from the 19th century. The subject is wearing a light-colored, cream or off-white cloak or blanket draped around their shoulders. They are wearing what appears to be a dark shirt or jacket underneath. Around their neck is a medallion or pendant on a red cord. The background shows a muted landscape with some trees or foliage visible. The painting style is characteristic of formal portraiture of the period, with subtle tones and careful attention to the fabric's draping and texture. The overall mood of the painting is somber and contemplative, enhanced by the muted color palette and the dramatic lighting.

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a historical portrait painting showing a middle-aged person wearing a cream or off-white colored robe or cloak. The subject has dark hair and a contemplative or serious expression. They are wearing what appears to be a medallion or decorative pendant on a red cord around their neck. The background shows a muted landscape with some trees or foliage visible. The painting style appears to be from the 19th century, with soft, dark tones and classical portrait composition. The brushwork and lighting create a somber, dignified mood typical of formal portraiture from this era.

Created by claude-3-haiku-20240307 on 2024-11-27

The image depicts a middle-aged or older man with a somber expression. He is wearing a white coat or cloak, which contrasts with the dark background. The man has dark, tousled hair and appears to be looking directly at the viewer with a pensive, slightly troubled gaze. The image has a moody, atmospheric quality, with the subject set against a dark, indistinct backdrop.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

This image is a painting of a man, possibly a portrait. The man is wearing a white coat over a black shirt with a high collar. He has dark hair that is slightly unkempt and is looking directly at the viewer with a serious expression. Around his neck, he wears a pendant on a red cord, which appears to be a cameo or intaglio featuring a bust of a man. The background of the painting is a muted gray color, with a darker area at the bottom left that may represent foliage or another object. The overall atmosphere of the painting is somber and introspective, suggesting that it may be a formal portrait of an important individual.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a portrait of a Native American man, likely from the 19th century. The man is shown from the chest up, facing the viewer with a neutral expression. He has dark hair that is slightly disheveled and parted in the middle, with a few strands falling across his forehead. His eyes are cast downward, giving him a contemplative appearance.

He wears a white shawl draped over his shoulders, which appears to be made of a lightweight material such as cotton or linen. Underneath the shawl, he has on a black shirt with a high collar, which adds a touch of elegance to his overall appearance. A silver medallion hangs around his neck, featuring an intricate design that may be symbolic or ceremonial in nature.

In the background, there is a subtle landscape that suggests the man is standing outdoors. The sky above him is a muted gray, while the ground beneath his feet appears to be covered in a layer of greenery, possibly grass or foliage. The overall atmosphere of the painting is one of serenity and quiet reflection, capturing a moment in time when the subject is lost in thought.

The style of the painting is reminiscent of 19th-century portraiture, with soft brushstrokes and muted colors that evoke a sense of nostalgia and historical significance. The level of detail and realism in the painting suggests that it was created by a skilled artist who was familiar with the subject's culture and traditions.

Overall, the image presents a poignant and evocative portrait of a Native American man, one that invites the viewer to reflect on the rich cultural heritage and history of the indigenous peoples of North America.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image shows a painting of a man, probably an old man, standing and looking at something in front of him. He is wearing a white robe and a necklace with a pendant. He has a serious expression on his face. Behind him, there is a blurry view of a forest, and in the distance, there is a body of water, perhaps a lake. The sky is gray, and it seems like it is going to rain.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a painting of an old man. He is wearing a white robe with a black inner shirt. He has a serious expression on his face. He is wearing a necklace with a pendant. The painting is done in a realistic style, with attention to detail in the man's face and clothing. The background is a landscape with trees and a body of water. The painting is framed in a simple frame.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here is a description of the image:

The image is a painted portrait of a man set against a somewhat blurred background that appears to feature a body of water and some foliage. The man is the focal point of the portrait, and he is depicted from the chest up.

The man has a weathered complexion with prominent wrinkles and lines around his eyes and on his forehead. His hair is dark and somewhat disheveled. He appears to be middle-aged or older. He is wearing a dark collar, possibly part of a shirt or jacket, with a white collar visible above it. Over this, he wears what seems to be a large, loose-fitting light-colored coat or shawl.

Around his neck, he has a pendant or medallion on a red cord. The pendant has a silver-like color and appears to depict a profile image, though the details are somewhat obscured.

His expression is serious and thoughtful, with his gaze directed downward and slightly to the left. The overall tone of the painting suggests a somber or contemplative mood.

The background is painted in muted tones of gray and green, adding to the subdued atmosphere of the portrait.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression:

The image is a portrait, likely a painting, of a man. He is depicted in a half-length view, with a somber and contemplative expression. The style suggests a classical or romantic period of art.

The Subject:

  • Appearance: The man appears to be middle-aged or older, with a weathered face. He has dark hair. His complexion is pale with some redness, suggesting age or emotion.
  • Attire: He is wearing a dark coat or jacket with a white collar. Over this he wears a loose, light-colored wrap or cloak. A necklace with a small, possibly metallic, pendant hangs around his neck. The pendant has a small image of a person on it.
  • Expression: His face is the focal point, with downcast eyes and a slightly downturned mouth, conveying a sense of sadness, contemplation, or perhaps weariness.

Background and Composition:

  • Setting: The background is a muted, ambiguous landscape. There is a suggestion of a body of water and possibly a low-lying land.
  • Color Palette: The dominant colors are muted and earthy, with browns, grays, and creams. This contributes to the overall somber mood.
  • Lighting: The lighting is soft and diffused. The light appears to be coming from the upper left, gently illuminating the man's face and highlighting the folds in his cloak.

Overall Mood and Style:

The portrait evokes a sense of introspection, perhaps even melancholy. The brushstrokes appear to be soft, creating a realistic and detailed representation of the subject. The overall aesthetic points to the art of the 18th or early 19th century.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image is a portrait painting of an older man with a serious expression. He has short, dark hair and is wearing a light-colored coat over a darker shirt. The background is muted and appears to depict a landscape with trees and a faint skyline. The man is looking directly at the viewer, and his posture suggests a sense of formality and dignity. The painting style is realistic, capturing the details of the man's face and clothing with precision. The overall mood of the portrait is solemn and reflective.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-25

This is an oil painting of a man, likely a Native American, depicted in a contemplative pose. He is seated and wearing a light-colored, possibly white or cream, garment with a dark ribbon or scarf around his neck. A medallion with a circular design hangs from the ribbon. The background is a muted, bluish-gray, and the setting appears to be outdoors, with a suggestion of trees and a sky, though the focus is on the figure. The painting style is realistic, with attention to detail in the texture of the garment and the facial features, giving a lifelike quality to the subject. The overall mood of the painting is serene and introspective.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-25

This image is a painting of a man in a formal, historical style. The man has a serious expression and is dressed in what appears to be a high-collared white shirt with a dark vest. Around his neck, he wears a medallion on a red ribbon. The background is subdued with muted colors, featuring a landscape that includes a body of water and some trees. The overall tone of the painting is somber and reflective. The artist has used a realistic technique to capture the details of the man's face and clothing.