Human Generated Data

Title

Benjamin Clark (1776-1863)

Date

1840

People

Artist: Asahel Lynde Powers, American 1813 - 1843

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. John S. Barss, 1979.315

Human Generated Data

Title

Benjamin Clark (1776-1863)

People

Artist: Asahel Lynde Powers, American 1813 - 1843

Date

1840

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. John S. Barss, 1979.315

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Clothing 95.4
Hat 95.4
Apparel 95.4
Human 94.5
Person 94.5
Art 93
Painting 63.4

Clarifai
created on 2018-03-23

people 99.7
one 99.4
portrait 99.3
lid 99
adult 99
man 97.7
wear 97.5
veil 94.6
music 93.4
mustache 92.6
leader 91.6
cap 91
musician 90.8
retro 87.8
facial hair 86.4
outerwear 85.9
jacket 85.9
outfit 84.9
coat 82.4
theater 80.3

Imagga
created on 2018-03-23

person 40.9
man 32.2
male 24.1
portrait 23.3
black 20.6
adult 20.4
hat 18.2
people 17.8
sax 17.4
face 17
performer 15.6
lady 15.4
expression 15.4
musician 15.3
fashion 15.1
business 14.6
senior 14.1
clothing 13.9
model 13.2
smile 12.8
singer 12.6
style 12.6
guy 12
suit 12
happy 11.9
attractive 11.9
old 11.8
vintage 11.6
holding 11.6
costume 11.3
sexy 11.2
looking 11.2
make 10.9
studio 10.6
musical instrument 10.6
music 10.2
outfit 10.1
professional 10
art 9.8
handsome 9.8
businessman 9.7
ruler 9.7
hair 9.5
elegant 9.4
smiling 9.4
glasses 9.3
head 9.2
indoor 9.1
happiness 8.6
culture 8.5
clothes 8.4
hand 8.4
dark 8.3
traditional 8.3
entertainment 8.3
wind instrument 8.2
gold 8.2
alone 8.2
retro 8.2
dress 8.1
office 8
mask 7.9
standing 7.8
carnival 7.8
mysterious 7.8
golden 7.7
luxury 7.7
artist 7.7
pretty 7.7
musical 7.7
elderly 7.7
money 7.7
tie 7.6
instrument 7.4
playing 7.3
entertainer 7.3
religion 7.2
actor 7.1
job 7.1
interior 7.1
indoors 7

Google
created on 2018-03-23

gentleman 86.5
portrait 86.3
profession 70
monarch 64.8
painting 60.3
art 54.5

Microsoft
created on 2018-03-23

person 99.8
man 97.4
black 71.6
dressed 29.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-65
Gender Male, 99.5%
Angry 2.7%
Surprised 1.1%
Calm 87.5%
Happy 1.5%
Disgusted 1%
Confused 3.3%
Sad 3%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat
Person
Painting
Hat 95.4%
Person 94.5%
Painting 63.4%

Categories

Captions

Microsoft
created on 2018-03-23

a man wearing a black hat 87.9%
a man wearing a hat 86.7%
a man in a black hat 86.5%

OpenAI GPT

Created by gpt-4 on 2024-12-03

The image depicts a figure dressed in a black coat with gold buttons, a white shirt, and a black bow tie. The individual wears a brown top hat and is seated on a wooden chair with ornate, curved armrests adorned with a leaf pattern. The person's right hand holds what appears to be an open newspaper. The setting provides limited contextual detail, but the attire and furnishings suggest a setting from a bygone era, often associated with historical or period pieces. The solemn, formal attire indicates a sense of seriousness or formality in the setting or the individual's social standing.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a formal portrait painting from what appears to be the 19th century. The subject is wearing a black coat with brass buttons and a white cravat, along with a distinctive tall brown top hat. In the painting, the subject is holding what appears to be a document or newspaper, and there are quill feathers visible on the desk or table beside them. The background is dark and somewhat plain, creating a stark contrast with the figure in the foreground. The style is typical of formal portraiture of the period, with careful attention paid to the details of the clothing and facial features. The painting shows its subject as a person of status and education, as suggested by the writing implements and formal attire.

Created by claude-3-haiku-20240307 on 2024-11-27

The image shows a portrait of a man wearing a black coat and a tall, tan hat. He appears to be an older gentleman with gray hair and a serious expression. He is sitting in what looks like a study or library, with shelves and books visible in the background. The man is holding some papers or documents in his hand, suggesting he may be an important figure or public official.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

This image is a painting of a man in a top hat, holding a newspaper and a quill pen. The man is wearing a black coat with gold buttons, a white shirt, and a black bow tie. He has white hair and is looking at the viewer. The man is holding a newspaper in his left hand and a quill pen in his right hand. The newspaper appears to be the Washington Globe, which was a newspaper published in Washington, D.C. from 1830 to 1872. The background of the painting is dark, but it appears to be a room with a chair or desk behind the man. There are also some feathers and other objects on the desk or chair. Overall, the painting suggests that the man is a writer or journalist, possibly associated with the Washington Globe.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-23

The image depicts a painting of an older man dressed in formal attire, sitting in a chair with a quill pen and inkwell on a table behind him. He is wearing a top hat adorned with a feather, a black coat with gold buttons, a white shirt, and a black bow tie. His right hand holds a newspaper, while his left hand grasps a red cane. The background of the painting features a dark wall with a wooden chair and a stack of papers, suggesting a study or office setting. The overall atmosphere of the painting is one of elegance and sophistication, with the subject's formal attire and the luxurious surroundings evoking a sense of refinement and culture. The use of muted colors and the subtle lighting create a sense of intimacy and quiet contemplation, inviting the viewer to reflect on the subject's thoughts and emotions.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a portrait of a man, possibly a politician, sitting on a chair. He is wearing a black coat, a white inner shirt, a black bow tie, and a hat. He is holding a newspaper in his left hand and a cane in his right hand. Behind him, there is a wooden cabinet with a few objects on it, including a feather and a newspaper. The background is dark, and the image is framed.

Created by amazon.nova-pro-v1:0 on 2025-01-04

In a portrait painting, a man is sitting on a chair with a hat on his head. He is wearing a black coat with a white inner shirt and a black bow tie. He is holding a stick in his right hand and a pair of eyeglasses in his left hand. Behind him, there is a desk with two quill pens and a newspaper on top. The background is dark.

Text analysis

Amazon

oeyincrova