Human Generated Data

Title

Captain Caleb Coggeshall (1758-1847)

Date

1808

People

Artist: William Dunlap, American 1766 - 1839

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.571

Human Generated Data

Title

Captain Caleb Coggeshall (1758-1847)

People

Artist: William Dunlap, American 1766 - 1839

Date

1808

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.571

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Human 97.3
Apparel 96.1
Clothing 96.1
Art 85.7
Coat 76
Home Decor 63.5
Overcoat 63.1
Furniture 62.3
Wood 59.9

Clarifai
created on 2018-03-16

people 99.5
adult 99.4
one 99
woman 97.8
portrait 95.1
wear 94.8
painting 92.4
indoors 92.3
print 92.2
furniture 91.3
man 87.1
book series 86.8
book bindings 85.8
sit 85.7
education 85
writing 83.1
military 82.1
administration 80.8
facial expression 79.6
seat 79.5

Imagga
created on 2018-03-16

man 47
male 44.8
couple 38.3
grandma 36.6
senior 36.6
people 34
happy 32.6
portrait 31.1
grandfather 30.7
adult 28
family 27.6
person 26.9
elderly 26.8
home 26.3
lifestyle 23.9
smile 23.5
wife 22.8
smiling 22.4
mature 22.3
old 22.3
husband 21.9
together 20.2
casual 19.5
retired 18.4
love 18.1
bow tie 18.1
retirement 17.3
mother 15.8
human 15.7
father 15.2
executive 15.1
two 14.4
looking 14.4
married 14.4
boy 13.9
sitting 13.7
expression 13.6
handsome 13.4
necktie 13.1
director 13.1
grandmother 12.7
happiness 12.5
child 12.3
room 12.3
lady 12.2
face 12.1
attractive 11.9
son 11.8
loving 11.4
cheerful 11.4
togetherness 11.3
standing 11.3
men 11.2
older 10.7
indoors 10.5
sofa 10.5
pretty 10.5
life 10.1
aged 10
romantic 9.8
black 9.7
youth 9.4
parent 9.3
camera 9.2
suit 9.2
fashion 9
outdoors 9
daughter 8.9
businessman 8.8
60s 8.8
hugging 8.8
two people 8.8
hair 8.7
affectionate 8.7
couch 8.7
age 8.6
model 8.6
shirt 8.5
relationship 8.4
modern 8.4
garment 8.3
fun 8.2
romance 8
close 8
kid 8
business 7.9
cute 7.9
neck brace 7.7
tie 7.6
joy 7.5
office 7.5
one 7.5
confident 7.3
professional 7.1
interior 7.1

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

person 98

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 35-52
Gender Male, 98.5%
Happy 0.9%
Calm 81.5%
Surprised 5.7%
Angry 3.6%
Confused 4.1%
Disgusted 1.6%
Sad 2.5%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Feature analysis

Amazon

Person
Painting

Clarifai

Human face
Clothing
Window
Human hand
Human nose
Human arm
Human mouth
Human eye
Tree

AWS Rekognition

Person 97.3%

AWS Rekognition

Painting 62.4%

Clarifai

Human face 94.5%

Clarifai

Clothing 87%

Clarifai

Window 52.2%

Clarifai

Human hand 42.4%

Clarifai

Human hand 37.7%

Clarifai

Human nose 41.8%

Clarifai

Human arm 40.4%

Clarifai

Human mouth 40.2%

Clarifai

Human eye 38.4%

Clarifai

Human eye 34.3%

Clarifai

Tree 38.3%

Categories

Imagga
created on 2018-03-16

events parties 55.6%
people portraits 43.5%
interior objects 0.2%
food drinks 0.2%
streetview architecture 0.2%
pets animals 0.1%
text visuals 0.1%

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip on 2025-05-11

a photograph of a portrait of a man in a blue jacket

Created by general-english-image-caption-blip-2 on 2025-06-28

a painting of a man in blue with a white shirt and a pen

OpenAI GPT

Created by gpt-4 on 2025-03-07

The image depicts a classic portrait of an individual wearing a blue coat with gold-colored buttons, which suggests a uniform or formal attire common in historical or military contexts. The subject is seated at a desk with what appears to be navigational maps or charts spread out in front of them, and they are holding a drawing instrument, possibly related to navigation or cartography, which could indicate that the person is engaged in planning or study.

In the background to the right, there is a window that looks out onto a serene landscape scene with trees and a calming sky, giving a sense of peacefulness and thoughtfulness to the setting. The window admits light into the room, reflecting on the papers and the subject’s attire, emphasizing the details of the desk work.

The lighting and detail in the portrait suggest it is of a formal nature, typical of the style used for prominent figures of history, possibly a leader, scholar, or officer, highlighting their profession and status. The renaissance or neoclassical elements in the image evoke a sense of a past era, focusing on the individual’s role and environment.

Created by gpt-4o-2024-05-13 on 2025-03-07

The image depicts a historical painting of a person sitting at a desk. The individual is dressed in an elaborate blue coat with gold buttons and white trousers, embodying fashion from the late 18th or early 19th century. The person is holding a pen, which is poised above a piece of paper on the desk. The background features a large window looking out onto a serene landscape with blue sky, white clouds, and distant trees, suggesting that the scene is set indoors with an outdoor view. Additionally, the title "Captain Jo(h)n Croizettel of Newport" can be seen written in elegant script in the top left corner, which implies that this person may be of some significance, potentially within a naval or military context.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-25

This is a historical portrait painting, likely from the late 18th century, showing a person seated at a desk by a window. The subject is wearing a striking royal blue double-breasted coat with brass buttons, a white ruffled cravat, and white trousers. They appear to be in a study or office setting, with papers and writing implements on the desk before them. Through the window, there's a scenic view of what appears to be a coastal landscape with hills and possibly a ship in the distance. The painting style is typical of formal portraits from this period, with careful attention to detail in the clothing and setting. The dark background contrasts with the bright blue of the coat and the natural light coming through the window panes.

Created by claude-3-haiku-20240307 on 2024-12-29

The image depicts a man in formal attire, with a blue coat and white frilled cravat, standing in what appears to be an interior setting. He is posed in a thoughtful or contemplative manner, with one hand resting on a table in front of him and the other held at his side. The background includes a window with a landscape scene visible through it, adding a sense of depth and context to the composition.

Created by claude-3-opus-20240229 on 2024-12-29

The painting depicts a man with light hair wearing a blue military-style jacket with gold buttons, a ruffled white collar or cravat, and white pants. He is sitting at a desk or table with papers and writing implements in front of him, with a scenic landscape visible through the window behind him. The painting has an aged, vintage appearance with some cracks and wear visible on the surface.

Created by claude-3-5-sonnet-20241022 on 2024-12-29

This is a formal portrait painting from what appears to be the late 18th century. The subject is shown seated at a desk wearing a striking royal blue double-breasted coat with brass buttons and a white ruffled cravat. They are positioned near a window that shows a scenic landscape view with trees and what appears to be a body of water in the distance. On the desk are papers and writing implements, suggesting this may be a portrait of someone of scholarly or professional occupation. The painting style is characteristic of formal portraiture of the Georgian era, with careful attention paid to details of clothing and setting. The interior space has dark, shadowed walls that contrast with the bright natural light coming through the window panes.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-03-14

The image depicts a portrait of a man in a blue coat sitting at a desk, with papers and a ruler in front of him. The man is wearing a blue coat with gold buttons, a white shirt with a blue-and-white striped cravat, and white pants. He has short, curly hair and is holding a pen in his right hand. The desk is made of wood and has a few papers and a ruler on it. The background of the painting is a dark wall with a window on the right side, through which a landscape can be seen. The overall atmosphere of the painting suggests that it was created in the 18th century, possibly in Europe.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-03-14

The image depicts a painting of a man in 18th-century attire, seated at a desk with papers and a ruler. He wears a blue coat with gold buttons, a white shirt with blue stripes, and white pants. The man is positioned in front of a window that offers a view of the sea, with a ship visible in the distance. The overall atmosphere of the painting suggests that it may be a portrait of a naval officer or someone associated with maritime activities.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-10

The image shows a portrait of a man sitting on a chair with a desk in front of him. He is dressed in a blue coat with gold buttons and a white shirt. He is holding a pen and a piece of paper on the desk. He is looking at something on the right side. Behind him is a window with a view of a landscape with trees and mountains.

Created by amazon.nova-pro-v1:0 on 2025-01-10

The painting depicts a man sitting on a chair in front of a desk. He is wearing a blue coat with gold buttons and white pants. He is holding a pencil in his hand, and there are some papers on the desk. Behind him is a window with a white curtain. The window has a view of a tree and a field. The painting is framed in a white frame.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-02

Here's a description of the image:

The image is a portrait of a man, presumably a Captain, as indicated by the inscription in the upper left corner ("Captain Caleb Coggeshall / of Newport"). The portrait is rendered in a style that suggests it's a drawing or pastel on paper, dating back to a period perhaps the 18th or early 19th century.

Here are some key features:

  • The Man: The man is seated, dressed in what appears to be a naval uniform - a dark blue double-breasted coat with gold buttons, white breeches, a white neckcloth, and striped shirt/undershirt. His hair is short and appears to be receding. He's holding a small drawing tool, perhaps a compass or dividers, over a table with charts and a ruler. He has a neutral or serious expression on his face.
  • Setting: He is seated in a room with a window to his right. The window reveals a landscape view - fields, trees, and a soft, hazy atmosphere, which is indicative of an overcast day. The background is a dark, simple wall.
  • Artistic Style: The artwork uses soft colors. The drawing style is precise with some indication of volume and detail.

The overall composition is well-balanced, with the captain as the clear focus. The window offers a glimpse of the outside world and provides some contrast to the darker interior setting. The inclusion of the charts and drawing instruments suggest a profession connected to navigation, cartography, or surveying.

Created by gemini-2.0-flash on 2025-05-02

Here is a description of the image:

The image is a portrait of a man named Captain Caleb Coggeshall of New Port. He is dressed in the blue naval jacket with gold buttons, and white pants. He is at a desk in front of a window. On the desk is some writing and a ruler.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-29

The image is a portrait painting of a man dressed in late 18th or early 19th-century attire. He is seated at a wooden desk with papers and a drawing instrument, suggesting he might be an architect, engineer, or surveyor. The man is wearing a blue double-breasted coat with gold buttons, white breeches, and a white ruffled shirt with a high collar. His hair is styled in a fashion typical of the period, slightly powdered and tied back.

The background includes a large window with multiple panes, through which a landscape with trees and a body of water is visible, indicating a serene, possibly rural setting. The painting is signed in the upper left corner, though the signature is somewhat difficult to read clearly. The overall style and setting suggest this is a formal portrait, possibly of a professional or someone of notable status during that era.

Qwen

No captions written

Text analysis

Amazon

ont
zoh
t ont
Ct zoh
Ct
t