Human Generated Data

Title

The Reverend John Pierce (1773-1849)
Date

1846
People

Artist: Edward L. Mooney, American 1813 - 1887

Sitter: John Pierce, 1773 - 1849
Classification

Paintings
Credit Line

Harvard University Portrait Collection, Gift of Frederick T. Gray to Harvard College, 1848, H34

Human Generated Data

Title

The Reverend John Pierce (1773-1849)

People

Artist: Edward L. Mooney, American 1813 - 1887

Sitter: John Pierce, 1773 - 1849

Date

1846

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 98
Painting 97.4
Person 97.2
Human 97.2

Clarifai
created on 2018-03-23

portrait 99.7
people 99.6
one 99.5
adult 98.8
wear 98.2
leader 98.1
administration 96.8
politician 96.3
writer 95.6
outerwear 94.2
man 94
facial expression 90.2
painting 85.1
elderly 84.8
side view 84.8
art 84.1
jacket 84.1
bald 83.9
outfit 83
neckwear 82.2

Imagga
created on 2018-03-23

man 55.9
businessman 50.4
executive 47.8
male 47.6
baron 43.9
handsome 42.9
portrait 42.8
senior 42.3
suit 41.5
person 39.1
adult 38.9
mature 36.3
business 34.1
grandfather 32.7
professional 31.3
old 30.7
confident 30.1
elderly 29.7
people 29
men 27.5
judge 27.5
looking 26.4
corporate 25
tie 24.7
face 23.5
manager 23.3
happy 23.2
successful 21.1
black 20.5
glasses 20.4
boss 20.1
expression 19.7
smiling 19.6
smile 19.3
success 18.5
older 18.5
hair 18.3
retired 17.5
occupation 17.4
one 17.2
retirement 16.4
aged 16.3
serious 16.2
age 16.2
work 15.7
office 15.3
job 15.1
standing 14.8
casual 13.6
gray 13.5
worker 13.4
businesspeople 13.3
modern 12.6
lifestyle 12.3
cheerful 12.2
friendly 11.9
gray hair 11.8
grandmother 11.8
60s 11.7
businessperson 11.7
formal 11.5
studio 11.4
couple 11.3
human 11.3
shirt 11.2
happiness 11
alone 11
head 10.9
hand 10.7
one person 10.4
grandma 10.3
close 10.3
necktie 9.9
pensioner 9.8
secretary 9.6
collar 9.6
confidence 9.6
smart 9.4
guy 9.4
attractive 9.1
look 8.8
40s 8.8
love 8.7
leadership 8.7
eyes 8.6
supporter 8.4
sadness 7.8
depression 7.8
1 7.7
husband 7.6
only 7.6
lawyer 7.5
positive 7.4

Google
created on 2018-03-23

portrait 94.1
gentleman 83.2
elder 80
painting 75.3
official 73.1
professional 58.5
diplomat 54.1
academician 52.2
art 50.4

Microsoft
created on 2018-03-23

person 99.1
wall 97.7
man 97.3
indoor 89.3
suit 86.9
old 54.7
older 38.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 99.7%
Calm 47.6%
Surprised 2.1%
Angry 3%
Sad 3.6%
Disgusted 1.8%
Confused 5.6%
Happy 36.2%

Microsoft Cognitive Services

Age 52
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.4%
Person 97.2%

Captions

Microsoft

a man wearing a suit and tie 97.2%
a man wearing a suit and tie smiling at the camera 96%
a man wearing a suit and tie smiling and looking at the camera 94.9%