Human Generated Data

Title

Self-Portrait

Date

c. 1818

People

Artist: Benjamin West, American 1738 - 1820

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.163

Human Generated Data

Title

Self-Portrait

People

Artist: Benjamin West, American 1738 - 1820

Date

c. 1818

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.163

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Painting 99.5
Art 99.5
Person 92.8
Human 92.8
Person 91
Photography 60.4
Portrait 60.4
Photo 60.4
Face 60.4

Clarifai
created on 2018-03-23

people 99.8
adult 99.3
portrait 98.7
one 98.7
painting 98.2
two 98
man 95.9
woman 95.2
wear 94.8
leader 94.7
art 94.3
side view 91.3
religion 87.4
royalty 86.6
veil 86.6
lid 84.6
indoors 83.4
administration 83.2
profile 82.1
outerwear 81.9

Imagga
created on 2018-03-23

portrait 31.7
man 31.6
male 26.2
person 23.4
face 21.3
old 19.5
baron 18.8
currency 17.9
business 17.6
suit 17.4
one 17.2
people 16.7
dollar 16.7
senior 15.9
black 15.8
money 15.3
head 15.1
businessman 15
executive 14.6
expression 14.5
adult 13
bill 12.4
look 12.3
human 12
god 11.5
tie 11.4
happy 11.3
culture 11.1
cash 11
dark 10.8
smile 10.7
success 10.5
close 10.3
religion 9.9
prayer 9.7
elderly 9.6
hair 9.5
eyes 9.5
art 9.4
manager 9.3
finance 9.3
attractive 9.1
gold 9
professional 8.9
handsome 8.9
sculpture 8.9
office 8.8
spiritual 8.6
men 8.6
grandfather 8.5
glasses 8.3
secretary 8.3
church 8.3
banking 8.3
bank 8.2
wealth 8.1
financial 8
looking 8
smiling 8
work 7.8
paper 7.8
banknote 7.8
pray 7.8
stone 7.7
serious 7.6
studio 7.6
hand 7.6
religious 7.5
vintage 7.4
mature 7.4
makeup 7.3
lady 7.3

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 96.6
man 95

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 94.3%
Calm 53.4%
Disgusted 5.4%
Angry 7.8%
Happy 9.4%
Confused 5.6%
Sad 12.9%
Surprised 5.4%

AWS Rekognition

Age 26-43
Gender Male, 99%
Sad 1.5%
Angry 0.4%
Disgusted 0.2%
Surprised 0.3%
Calm 96%
Happy 0.2%
Confused 1.4%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting
Person
Painting 99.5%
Person 92.8%
Person 91%

Categories

Imagga

events parties 98.7%
people portraits 1.3%

Captions

Microsoft
created on 2018-03-23

a man wearing a suit and tie 87.6%
a man in a suit and tie 87.5%
a man wearing a hat 60.9%

OpenAI GPT

Created by gpt-4 on 2024-12-03

This image portrays a classic painting of an individual seated in a red upholstered chair, wearing a dark jacket and white shirt. The figure holds a piece of paper in one hand and rests the other on a large, open book. The setting suggests a studious or scholarly environment, possibly a study room, indicated by the presence of books and documents, and another partially visible painting or document framed in the background. The person's pose and the presence of reading and writing materials imply engagement in intellectual work or contemplation. The painting uses chiaroscuro lighting, with a high contrast between light and shadow, to draw attention to the hands and the papers, enhancing the sense of focus on scholarly activities.

Created by gpt-4o-2024-05-13 on 2025-01-04

This image portrays a detailed classical painting with a subject dressed in formal 18th-century attire, including a dark coat and white cravat. The setting features a rich red curtain in the background and a sculpted bust to the left. The subject appears to be engrossed with a piece of paper in hand, which rests on a table alongside a closed book, signifying a scholarly or intellectual activity. The composition and the elements suggest an atmosphere of contemplation and study.

Anthropic Claude

Created by claude-3-5-sonnet-20241022 on 2024-12-28

This is a formal portrait painting from the late 18th century showing a figure in traditional colonial-era attire, including a black coat and white cravat. The subject has powdered white hair styled in the fashion of the period. In the background, there is a sculptural bust or relief visible on the left side of the painting, and rich brown drapery forms the backdrop. The composition also includes some books or documents on what appears to be a table, suggesting the subject may have been a scholar or statesman. The painting style is characteristic of formal portraiture from this period, with careful attention to detail and a dignified, serious tone.

Created by claude-3-haiku-20240307 on 2024-11-27

The image appears to be a portrait painting depicting a man with a serious and pensive expression. The man has white powdered hair and is wearing a dark coat and lace cravat, indicating that this is likely a historical portrait from the 18th or 19th century. Behind him, there is a curtain and what appears to be another figure in the background, creating a sense of depth and context to the scene. The overall composition and use of light and shadow suggest this is a skilled work of portraiture from the Baroque or Neoclassical period.

Meta Llama

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2024-12-26

The image is a painting of John Adams, the second President of the United States. He is depicted sitting at a desk, wearing a dark-colored coat with gold buttons and a white shirt with a lace collar. His right hand rests on the desk, holding a piece of paper, while his left hand is placed on top of two books. The background of the painting features a red curtain, and to the left of Adams, there is a bust of a man, possibly a classical figure or another historical figure. The overall atmosphere of the painting suggests that it was created during the late 18th or early 19th century, given the style of clothing and the classical influence evident in the bust.

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2024-11-24

The image is a portrait of James Madison, the fourth President of the United States, painted by Gilbert Stuart in 1804. The painting depicts Madison in a seated position, wearing a black coat with gold buttons and a white shirt, holding a piece of paper in his left hand. He has white hair and is looking to the right of the viewer. In the background, there is a red curtain and a bust of a man, possibly George Washington, on the left side of the painting. The overall atmosphere of the painting is one of dignity and seriousness, reflecting Madison's reputation as a statesman and leader. The painting is considered one of the most important portraits of Madison and is widely regarded as a masterpiece of American art. It is now housed in the National Portrait Gallery in Washington, D.C.

Amazon Nova

Created by amazon.nova-lite-v1:0 on 2025-01-04

The image is a portrait painting of a man, possibly a politician, sitting on a chair. He is wearing a black suit with a white shirt and a black tie. He is holding a piece of paper in his left hand and a pen in his right hand. He is looking at something in front of him. Behind him is a portrait of a man with a wreath on his head. The portrait is painted on a red curtain.

Created by amazon.nova-pro-v1:0 on 2025-01-04

The painting depicts a man sitting on a chair, looking at something in front of him. He is holding a piece of paper in his left hand and a book in his right hand. Behind him, there is a red curtain. On the left side, there is a picture frame with a statue of a man wearing a laurel wreath on his head. The statue is looking at something on the left side.