Human Generated Data

Title

Portrait of Joseph Coolidge, Jr.

Date

1820

People

Artist: Jean Baptiste Joseph Duchesne, French 1770 - 1856

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica in honor of John Coolidge, 2021.83

Human Generated Data

Title

Portrait of Joseph Coolidge, Jr.

People

Artist: Jean Baptiste Joseph Duchesne, French 1770 - 1856

Date

1820

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Catherine Coolidge Lastavica in honor of John Coolidge, 2021.83

Machine Generated Data

Tags

Amazon
created on 2022-05-19

Person 94.3
Human 94.3
Art 92.6
Pendant 88.4
Painting 88.3
Locket 56.9
Accessories 56.9
Jewelry 56.9
Accessory 56.9

Clarifai
created on 2023-10-14

portrait 99.5
one 99.4
people 99.4
adult 98.8
man 97
woman 96.9
art 96.2
veil 94
wear 92.6
painting 91.3
retro 88.5
facial hair 88.4
museum 84.5
exploration 83.8
lid 81.8
sculpture 80.2
jewelry 78.7
no person 77.8
girl 75.2
necklace 74.6

Imagga
created on 2022-05-19

person 21.9
black 21.4
symbol 19.5
sign 18
yellow 17.9
adult 16.1
icon 15.8
portrait 15.5
danger 15.4
warning 15.3
face 14.9
sorcerer 14.3
hat 13.6
people 12.8
computer 12
safety 11.9
attractive 11.9
toilet seat 11.5
style 11.1
caution 10.7
fashion 10.5
shield 10.1
model 10.1
happy 10
armor 9.8
looking 9.6
dangerous 9.5
youth 9.4
male 9.2
hand 9.2
pretty 9.1
old 9
seat 9
road 9
design 9
fun 9
one 8.9
clothing 8.9
button 8.8
object 8.8
man 8.7
business 8.5
studio 8.3
human 8.2
pose 8.1
square 8.1
shadow 8.1
attention 7.8
orange 7.7
web 7.6
ethnic 7.6
label 7.6
traffic 7.6
reflection 7.5
technology 7.4
japan 7.3
smile 7.1
women 7.1
posing 7.1
silver 7.1
hazard 7.1

Google
created on 2022-05-19

Hair 98.3
Eye 93.8
Oval 90.2
Picture frame 86.3
Art 80
Jewellery 76.4
Circle 75
Fashion accessory 65.9
Metal 58.5
Collar 57.6
Drawing 57.3
Painting 55.9
Illustration 52.7
History 52.4
Symbol 50.8
Vintage clothing 50.6

Microsoft
created on 2022-05-19

human face 98.1
person 94
clothing 77
oval 61.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Female, 99.5%
Calm 89.7%
Surprised 6.7%
Fear 6.1%
Sad 4.9%
Angry 1.1%
Disgusted 1.1%
Happy 0.3%
Confused 0.2%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Painting
Locket
Person 94.3%
Painting 88.3%
Locket 56.9%

Categories

Captions

OpenAI GPT

Created by gpt-4 on 2024-11-15

The image depicts an antique oval portrait encased in a gold-tone frame, likely from the 19th century based on the clothing style and the format of the portrait. The portrait shows an individual wearing a dark coat with a high collar and light-colored shirt. The image has notable aging signs, including discoloration and surface wear, which add to its vintage character. There is a loop at the top of the frame indicating it may have been used as a pendant or attached to something for display.

Created by gpt-4o-2024-05-13 on 2025-01-02

The image displays an oval-shaped portrait encased in a golden frame with a small loop at the top, likely for hanging or attaching to a chain. The person in the portrait is dressed in period clothing, including a high-collared shirt and dark coat.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a historical miniature portrait painting set in an oval gold-colored frame with a hanging loop at the top. The portrait appears to be from the late 18th or early 19th century, given the style of dress and painting technique. The subject is wearing a white cravat or neck cloth and what appears to be a dark coat. The painting is executed in a realistic style typical of portrait miniatures from this period, with careful attention to detail and subtle coloring. The background is a dark, muted tone that helps emphasize the subject's features. The overall condition of the miniature shows some age, with slight spotting or wear visible on the surface, but it remains well-preserved in its original frame.

Created by claude-3-haiku-20240307 on 2024-11-14

The image shows a portrait painting of a man wearing a white collar and dark jacket. He has dark hair and a serious expression on his face. The portrait is framed in a gold-colored oval frame.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-25

This image features a portrait of a young man, likely from the 19th century, encased in an oval-shaped gold frame. The subject is depicted wearing a dark jacket over a white cravat and shirt, with a small pin or brooch at the center of his collar. His hair is styled in a neat, dark brown manner.

The background of the portrait is a muted gray tone, which complements the subject's attire. The overall atmosphere of the image exudes a sense of elegance and refinement, characteristic of portraiture from this era.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image presents a small, oval-shaped portrait painting of a young man, encased in a gold frame. The subject is depicted wearing a dark-colored suit jacket over a white cravat or ascot, with a subtle hint of a button visible at the front of his jacket.

The background of the painting is a deep, muted black, which provides a striking contrast to the subject's attire. The overall effect is one of elegance and refinement, suggesting that the painting may have been created for a formal occasion or as a gift for someone of importance.

The gold frame adds a touch of luxury and sophistication to the piece, while the oval shape of the painting creates a sense of intimacy and closeness to the subject. The painting appears to be an antique, with signs of wear and tear visible on the surface, including small scratches and scuffs.

Overall, the image presents a beautiful and intriguing portrait of a young man, one that invites the viewer to ponder the story behind the painting and the person who created it.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-01-04

The image shows a portrait of a man in a circular frame with a golden border. The portrait is in a vintage style, with a faded color palette and a slightly blurry effect. The man in the portrait is wearing a black coat with a white inner shirt. He has short, dark hair and a clean-shaven face. He is looking straight ahead, with a serious expression on his face.

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is of a portrait miniature of a man. He is wearing a black coat with a white collar and a white shirt. He has short dark hair and is looking straight ahead with a neutral expression. The portrait is framed in a gold oval frame. The background of the portrait is plain and gray. The portrait appears to be old and has some wear and tear.

Google Gemini

Created by gemini-2.0-flash on 2025-04-26

The image is a portrait miniature, oval in shape and framed in gold. It depicts a person with fair skin, blue eyes, and dark hair. They are wearing a black coat and a white cravat or neckcloth, fastened with a small gold pin or button. The background is dark and undefined, creating a sense of depth and focusing attention on the subject. The miniature has a loop at the top, suggesting it could be worn as a pendant or attached to a chain. The style of dress and the painting technique indicate that it is likely a historical piece, possibly from the late 18th or early 19th century.

Created by gemini-2.0-flash-lite on 2025-04-26

Here's a description of the image:

Overall Impression:

The image is a miniature portrait, likely painted in the style of the late 18th or early 19th century. It's an oval-shaped painting of a person, likely a man, set within a gold-colored frame. The style is delicate and detailed.

Subject:

  • The portrait depicts a person with fair skin, possibly a man.
  • They have short, dark hair and blue eyes.
  • They're wearing a white, high-collared shirt or cravat and a dark coat or jacket.

Details:

  • The painting seems to be done on a small scale, typical of miniature portraits.
  • The frame has a loop at the top, suggesting it was designed to be hung or worn as a pendant.
  • The style of the clothing and the portrait's aesthetic hint at a historical period.

Artistic Features:

  • The brushwork appears to be fine and precise, creating a realistic likeness.
  • The lighting is soft, illuminating the face and creating a sense of depth.
  • The background is a dark, neutral tone, emphasizing the subject.

Overall, it is a beautiful and well-preserved miniature portrait, likely of historical significance.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-04-25

The image shows a miniature portrait of a man, painted in a traditional style. The portrait is oval-shaped and framed in a gold-colored oval frame with a loop at the top, suggesting it could be worn as a piece of jewelry or displayed as a small artwork.

The man depicted has light brown or dark blonde hair, neatly styled, and is wearing a dark jacket over a white shirt with a high, stiff collar. His expression is serious, and he is looking directly at the viewer. The background of the portrait is dark, which helps to highlight the subject's face and attire. The painting appears to be done with fine detail, capturing the likeness and expression of the man accurately. The overall style and attire suggest that this portrait might date back to the late 18th or early 19th century.