Human Generated Data

Title

Self-Portrait

Date

c. 1818

People

Artist: Benjamin West, American 1738 - 1820

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.163

Human Generated Data

Title

Self-Portrait

People

Artist: Benjamin West, American 1738 - 1820

Date

c. 1818

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.163

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Painting 99.5
Art 99.5
Person 92.8
Human 92.8
Person 91
Photography 60.4
Portrait 60.4
Photo 60.4
Face 60.4

Clarifai
created on 2018-03-23

people 99.8
adult 99.3
portrait 98.7
one 98.7
painting 98.2
two 98
man 95.9
woman 95.2
wear 94.8
leader 94.7
art 94.3
side view 91.3
religion 87.4
royalty 86.6
veil 86.6
lid 84.6
indoors 83.4
administration 83.2
profile 82.1
outerwear 81.9

Imagga
created on 2018-03-23

portrait 31.7
man 31.6
male 26.2
person 23.4
face 21.3
old 19.5
baron 18.8
currency 17.9
business 17.6
suit 17.4
one 17.2
people 16.7
dollar 16.7
senior 15.9
black 15.8
money 15.3
head 15.1
businessman 15
executive 14.6
expression 14.5
adult 13
bill 12.4
look 12.3
human 12
god 11.5
tie 11.4
happy 11.3
culture 11.1
cash 11
dark 10.8
smile 10.7
success 10.5
close 10.3
religion 9.9
prayer 9.7
elderly 9.6
hair 9.5
eyes 9.5
art 9.4
manager 9.3
finance 9.3
attractive 9.1
gold 9
professional 8.9
handsome 8.9
sculpture 8.9
office 8.8
spiritual 8.6
men 8.6
grandfather 8.5
glasses 8.3
secretary 8.3
church 8.3
banking 8.3
bank 8.2
wealth 8.1
financial 8
looking 8
smiling 8
work 7.8
paper 7.8
banknote 7.8
pray 7.8
stone 7.7
serious 7.6
studio 7.6
hand 7.6
religious 7.5
vintage 7.4
mature 7.4
makeup 7.3
lady 7.3

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 96.6
man 95

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 94.3%
Calm 53.4%
Disgusted 5.4%
Angry 7.8%
Happy 9.4%
Confused 5.6%
Sad 12.9%
Surprised 5.4%

AWS Rekognition

Age 26-43
Gender Male, 99%
Sad 1.5%
Angry 0.4%
Disgusted 0.2%
Surprised 0.3%
Calm 96%
Happy 0.2%
Confused 1.4%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.5%
Person 92.8%

Categories

Imagga

events parties 98.7%
people portraits 1.3%

Captions

Microsoft
created on 2018-03-23

a man wearing a suit and tie 87.6%
a man in a suit and tie 87.5%
a man wearing a hat 60.9%