Human Generated Data

Title

Colonel Gustav Friedrich von Dachenhausen

Date

1787

People

Artist: John Singleton Copley, American 1738 - 1815

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Gordon Dexter, 1942.178

Human Generated Data

Title

Colonel Gustav Friedrich von Dachenhausen

People

Artist: John Singleton Copley, American 1738 - 1815

Date

1787

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Gordon Dexter, 1942.178

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Clothing 96.8
Apparel 96.8
Art 93.3
Human 86.1

Clarifai
created on 2018-03-16

people 99.9
painting 99.6
art 99.1
one 98.3
print 98.1
famous 98.1
lid 96.8
portrait 95.6
person 95
illustration 94
adult 90.1
fame 89.6
entertainment 88.4
wear 87.3
pop 83.1
veil 79.9
event 79
vintage 76.8
man 75.4
graffiti 74.4

Imagga
created on 2018-03-16

hat 100
headdress 100
cowboy hat 100
clothing 69
sombrero 37.5
covering 36.2
consumer goods 35.6
portrait 32.4
person 31.2
man 25.5
model 24.9
people 24.5
face 24.2
hair 22.2
male 21.3
sexy 20.9
adult 20.7
cowboy 20.6
attractive 19.6
happy 19.4
fashion 18.1
smile 17.1
black 16.8
guy 15.9
skin 15.2
handsome 15.2
senior 15
pretty 14.7
western 14.5
looking 14.4
one 13.4
posing 13.3
body 12.8
human 12.7
sensual 12.7
outdoors 12.7
old 12.5
wearing 12.4
smiling 12.3
lifestyle 12.3
style 11.9
head 11.8
dark 11.7
blond 11.7
hand 11.4
brunette 11.3
boy 11.3
shirt 11.2
eyes 11.2
pose 10.9
cute 10.8
mysterious 10.7
straw 10.6
fun 10.5
casual 10.2
beach 10.1
eye 9.8
child 9.6
children 9.1
lady 8.9
mystery 8.7
happiness 8.6
hairstyle 8.6
vintage 8.3
retro 8.2
gorgeous 8.2
brown 8.1
close 8
kid 8
women 7.9
elderly 7.7
gesture 7.6
studio 7.6
costume 7.4
water 7.3
make 7.3
summer 7.1

Google
created on 2018-03-16

painting 82.7
portrait 80.8
art 78.8
headgear 63.1
artwork 55
illustration 52.4
visual arts 51.5

Microsoft
created on 2018-03-16

text 97.6
person 93.1
hat 74.8

Color Analysis

Face analysis

Amazon

Google

Imagga

AWS Rekognition

Age 48-68
Gender Male, 72.1%
Calm 77.5%
Disgusted 6.2%
Angry 3.1%
Happy 3.5%
Confused 1.5%
Surprised 3.2%
Sad 5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Hat
Painting
Person

Clarifai

Human face
Clothing
Hat
Human nose
Human ear
Human eye
Human mouth

AWS Rekognition

Hat 96.8%

AWS Rekognition

Painting 91.6%

AWS Rekognition

Person 86.1%

Clarifai

Human face 95.4%

Clarifai

Clothing 83.6%

Clarifai

Hat 67.3%

Clarifai

Human nose 49.2%

Clarifai

Human ear 46.2%

Clarifai

Human eye 39.5%

Clarifai

Human eye 36.2%

Clarifai

Human mouth 35.5%

Categories

Captions

Microsoft
created by unknown on 2018-03-16

a person wearing a red hat 55.8%
a person wearing a hat 55.7%
a person wearing a red hat 41.4%

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-04-29

a photograph of a painting of a man in a hat

Created by general-english-image-caption-blip-2 on 2025-06-27

a painting of a man wearing a hat

OpenAI GPT

Created by gpt-4 on 2024-01-27

This artwork features a figure dressed in a dark, wide-brimmed hat and a vibrant red garment which resembles a cloak or coat. The attire suggests an element of style or formality. Fine lines sketched into the background give the impression of an unfinished piece, where the figure stands out due to the bold use of color and detailing in the accessories and attire. The lines behind the figure add dynamism and context, hinting at a larger scene or setting awaiting completion. The textures visible on the canvas surface suggest the artwork has some age or is styled to appear so.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This is a classical portrait painting showing a figure in profile wearing 18th century attire, including a distinctive black tricorn hat and a red coat or jacket. The background appears to have some loose sketched lines or drawings. The painting style is characteristic of 18th century portraiture, with careful attention to facial features and a warm, reddish skin tone. The composition shows just the head and shoulders of the subject against a light, neutral background. The painting appears to be unfinished in some areas, particularly the background, giving it the quality of a study or work in progress.

Created by claude-3-haiku-48k-20240307 on 2024-03-29

The image shows a portrait of a person wearing a black hat and a red coat. The individual appears to be an older man with a pensive expression on his face. The background is a mix of faint sketched shapes and lines. The painting style seems to have a expressionistic or abstract quality to it, with a textured and brushy appearance.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image presents a captivating portrait of an older gentleman, rendered in oil on canvas. The subject is depicted from the shoulders up, gazing to his left with a subtle smile. His attire consists of a black tricorn hat adorned with a white feather, a red coat featuring black lapels, and a white cravat. The background of the painting is characterized by a light beige hue, with visible outlines of other figures and shapes that appear to be unfinished or in the process of being sketched.

The overall atmosphere of the painting exudes a sense of elegance and refinement, while also conveying a sense of informality and spontaneity. The use of bold brushstrokes and vivid colors adds depth and texture to the image, drawing the viewer's attention to the subject's expressive face and dignified demeanor.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a painting of a man's head and shoulders, set against a beige background with a large black hat. The man is depicted in profile, facing left, with his head turned slightly towards the viewer. He has a reddish-brown complexion and is wearing a red coat with a black collar and a white shirt. His hair is gray and pulled back, and he has a small white mustache.

The background of the painting is a light beige color, with some darker brown lines and shapes visible behind the man. These lines and shapes appear to be sketches or outlines of other figures or objects, but they are not fully developed.

Overall, the image is a portrait of a man in a red coat, with a large black hat and a gray mustache. The background is a simple beige color with some darker lines and shapes, giving the impression of a sketch or study rather than a finished painting.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image is a painting of a person. The person is wearing a black hat with a white button on top, a red jacket, and a black inner shirt. The person's face is slightly turned to the left, and the person's eyes are looking in the same direction. The person's hair is white, and the person's skin is wrinkled. The background of the painting is white, and there are some lines drawn on it.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a portrait of a man. He is wearing a black hat with a white button and a red coat. The portrait is painted on a white background with some brown lines. The man's face is slightly turned to the right, and he is looking at something. The portrait is probably unfinished, as some parts of the painting are still rough and unrefined. The image has a vintage or antique look, suggesting that it may be an old painting.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

Here's a description of the image:

The image is an oil painting of a man in profile, dressed in what appears to be a late 18th or early 19th-century military or formal outfit. The man has fair skin, a prominent nose, and graying hair that is styled in a queue. He wears a large, black cocked hat adorned with a white plume or rosette. His jacket is a deep red color on the upper part, fading to a lighter, almost white hue toward the bottom. He wears a black neckcloth or cravat.

The background of the painting is pale, with faint, sketched outlines of what appear to be figures or architectural elements. The style of the painting is loose and impressionistic, with visible brushstrokes and a sense of the work being unfinished or a study. The canvas texture is also visible, giving the artwork a raw and textured feel.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression:

The image is a portrait painting, likely a study or a sketch. It depicts a man in profile, and the style is somewhat loose and expressive. The background features abstract, almost sketch-like outlines, contributing to the unfinished aesthetic.

Subject:

  • The Man: The central figure is an older man with a fair complexion and a prominent nose. He is wearing a black hat, which covers his head and has a white feather. His outfit also includes a red coat or jacket and a white collared shirt.
  • Facial Features: The portrait focuses on the man's profile. The artist has emphasized his facial features with a red tinge.

Color Palette and Technique:

  • Colors: The color scheme mainly includes black, red, white, and skin tones. The background is in light tones.
  • Brushwork: The brushwork appears to be loose and suggestive, with visible brushstrokes, giving the artwork a sketch-like quality.

Style and Context:

  • Style: The painting could be in the style of a study or sketch, with a focus on capturing the essence of the subject's likeness rather than a highly detailed representation. It has a somewhat unfinished, yet artistic, quality.
  • Potential Era: Based on the attire, the portrait may depict a man from the 18th or early 19th century.

Overall, the image is a compelling portrait study with an interesting style and a focus on character.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-26

The image is a portrait painting of a man wearing a tricorn hat, which was a common style of hat during the 18th century. The man has a red coat, a white shirt, and a dark cravat. His hair is tied back in a ponytail, and he is looking to the side. The background of the painting is unfinished, showing sketch-like lines and a light, unpainted surface, suggesting that this might be an unfinished work or a preparatory study. The overall style and clothing suggest that this portrait could be from the 18th century. The man's expression is serious, and the painting captures a sense of dignity and formality.

Qwen

Created by Qwen/Qwen2.5-VL-7B-Instruct on 2025-06-24

This image is a portrait painting of a man, likely from the 18th century, given the style of clothing and hat. The subject is wearing a red coat with black lapels and a white shirt. He has medium-length, wavy dark hair and is wearing a tricorn hat adorned with a white feather. The background is simple and minimalistic, with some decorative elements painted in a neutral tone. The overall style of the painting is reminiscent of portraiture from the late 18th or early 19th century.

Created by Qwen/Qwen2.5-VL-72B-Instruct on 2025-06-24

This image is a portrait painting of a man dressed in formal attire from the 18th century. The man is wearing a black tricorn hat with a white feather, and his hair is styled in a manner typical of that era. He is dressed in a red coat with black trim, a white shirt, and a black cravat. The background is simple, with some faint sketches or markings, and the man is depicted in a three-quarter view, looking upward and to the side. The painting has a classic, somewhat formal style, indicative of the portraiture of that time period.