Human Generated Data

Title

Thomas McKean (1735-1817)
Date

c. 1781-1782
People

Artist: Charles Willson Peale, American 1741 - 1827
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.146

Human Generated Data

Title

Thomas McKean (1735-1817)

People

Artist: Charles Willson Peale, American 1741 - 1827

Date

c. 1781-1782

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.146

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 97.4
Painting 97.4
Person 94.4
Human 94.4
Face 68.3
Photo 62.3
Portrait 62.3
Photography 62.3

Clarifai
created on 2018-03-23

people 99.9
one 98.7
portrait 98.1
adult 97
wear 94.6
man 94.1
leader 90.7
jacket 89.5
outerwear 89
neckwear 85.5
menswear 83.1
lid 83.1
painting 78.7
tie 78.3
facial expression 76.4
veil 76.1
famous 73.7
popularity 73.4
print 73
cravat 72.1

Imagga
created on 2018-03-23

man 51.7
suit 44.8
male 43.2
businessman 36.2
person 33
portrait 33
ruler 32.9
business 30.3
handsome 30.3
adult 25.9
people 25.1
executive 24.4
happy 21.3
men 20.6
professional 20.3
corporate 19.7
office 19.3
standing 18.2
senior 17.8
confident 17.3
smile 17.1
looking 16.8
face 16.3
expression 16.2
tie 16.1
smiling 15.9
success 15.3
work 14.9
manager 14.9
couple 14.8
old 14.6
mature 13.9
guy 13.5
love 13.4
elderly 13.4
black 13
worker 12.6
clothing 12.2
hat 11.7
together 11.4
outdoors 11.2
successful 11
garment 10.8
hand 10.6
attractive 10.5
one 10.4
friendly 10.1
lady 9.7
job 9.7
shirt 9.4
two 9.3
adolescent 9.3
covering 9
chain mail 9
working 8.8
60s 8.8
hair 8.7
boy 8.7
lifestyle 8.7
necktie 8.6
happiness 8.6
confidence 8.6
formal 8.6
money 8.5
glasses 8.3
aged 8.1
family 8
jacket 7.9
married 7.7
boss 7.6
serious 7.6
casual 7.6
director 7.6
juvenile 7.6
head 7.6
fashion 7.5
fun 7.5
beard 7.4
holding 7.4
cheerful 7.3
body armor 7.2

Google
created on 2018-03-23

photograph 94.9
portrait 94
gentleman 86
painting 74.8
elder 65.6
vintage clothing 54.9
self portrait 52.9
stock photography 50.9

Microsoft
created on 2018-03-23

person 96.1
man 94.6
wearing 86.2
suit 68.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-55
Gender Male, 99.5%
Surprised 1.2%
Confused 4.1%
Calm 84.2%
Sad 5.5%
Happy 2.8%
Disgusted 0.9%
Angry 1.3%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.4%
Person 94.4%

Categories

Imagga

events parties 93.3%
people portraits 6.6%

Captions

Microsoft
created on 2018-03-23

Tom McKean wearing a suit and tie 92.1%
Tom McKean wearing a hat 75%
Tom McKean wearing a suit and hat 74.9%