Human Generated Data

Title

Self-Portrait

Date

c. 1818

People

Artist: Benjamin West, American 1738 - 1820

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.163

Human Generated Data

Title

Self-Portrait

People

Artist: Benjamin West, American 1738 - 1820

Date

c. 1818

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.163

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Painting 99.5
Art 99.5
Person 92.8
Human 92.8
Person 91
Photography 60.4
Portrait 60.4
Photo 60.4
Face 60.4

Clarifai
created on 2018-03-23

people 99.8
adult 99.3
portrait 98.7
one 98.7
painting 98.2
two 98
man 95.9
woman 95.2
wear 94.8
leader 94.7
art 94.3
side view 91.3
religion 87.4
royalty 86.6
veil 86.6
lid 84.6
indoors 83.4
administration 83.2
profile 82.1
outerwear 81.9

Imagga
created on 2018-03-23

portrait 31.7
man 31.6
male 26.2
person 23.4
face 21.3
old 19.5
baron 18.8
currency 17.9
business 17.6
suit 17.4
one 17.2
people 16.7
dollar 16.7
senior 15.9
black 15.8
money 15.3
head 15.1
businessman 15
executive 14.6
expression 14.5
adult 13
bill 12.4
look 12.3
human 12
god 11.5
tie 11.4
happy 11.3
culture 11.1
cash 11
dark 10.8
smile 10.7
success 10.5
close 10.3
religion 9.9
prayer 9.7
elderly 9.6
hair 9.5
eyes 9.5
art 9.4
manager 9.3
finance 9.3
attractive 9.1
gold 9
professional 8.9
handsome 8.9
sculpture 8.9
office 8.8
spiritual 8.6
men 8.6
grandfather 8.5
glasses 8.3
secretary 8.3
church 8.3
banking 8.3
bank 8.2
wealth 8.1
financial 8
looking 8
smiling 8
work 7.8
paper 7.8
banknote 7.8
pray 7.8
stone 7.7
serious 7.6
studio 7.6
hand 7.6
religious 7.5
vintage 7.4
mature 7.4
makeup 7.3
lady 7.3

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 96.6
man 95

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 94.3%
Calm 53.4%
Disgusted 5.4%
Angry 7.8%
Happy 9.4%
Confused 5.6%
Sad 12.9%
Surprised 5.4%

AWS Rekognition

Age 26-43
Gender Male, 99%
Sad 1.5%
Angry 0.4%
Disgusted 0.2%
Surprised 0.3%
Calm 96%
Happy 0.2%
Confused 1.4%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.5%
Person 92.8%

Categories

Imagga

events parties 98.7%
people portraits 1.3%

Captions

Microsoft
created on 2018-03-23

a man wearing a suit and tie 87.6%
a man in a suit and tie 87.5%
a man wearing a hat 60.9%

Azure OpenAI

Created on 2024-12-03

This image portrays a classic painting of an individual seated in a red upholstered chair, wearing a dark jacket and white shirt. The figure holds a piece of paper in one hand and rests the other on a large, open book. The setting suggests a studious or scholarly environment, possibly a study room, indicated by the presence of books and documents, and another partially visible painting or document framed in the background. The person's pose and the presence of reading and writing materials imply engagement in intellectual work or contemplation. The painting uses chiaroscuro lighting, with a high contrast between light and shadow, to draw attention to the hands and the papers, enhancing the sense of focus on scholarly activities.

Anthropic Claude

Created on 2024-11-27

The image appears to be a portrait painting depicting a man with a serious and pensive expression. The man has white powdered hair and is wearing a dark coat and lace cravat, indicating that this is likely a historical portrait from the 18th or 19th century. Behind him, there is a curtain and what appears to be another figure in the background, creating a sense of depth and context to the scene. The overall composition and use of light and shadow suggest this is a skilled work of portraiture from the Baroque or Neoclassical period.

Meta Llama

Created on 2024-11-24

The image is a portrait of James Madison, the fourth President of the United States, painted by Gilbert Stuart in 1804. The painting depicts Madison in a seated position, wearing a black coat with gold buttons and a white shirt, holding a piece of paper in his left hand. He has white hair and is looking to the right of the viewer. In the background, there is a red curtain and a bust of a man, possibly George Washington, on the left side of the painting. The overall atmosphere of the painting is one of dignity and seriousness, reflecting Madison's reputation as a statesman and leader. The painting is considered one of the most important portraits of Madison and is widely regarded as a masterpiece of American art. It is now housed in the National Portrait Gallery in Washington, D.C.