Human Generated Data

Title

Benjamin Waterhouse (1754-1846)
Date

1831
People

Artist: James Frothingham, American 1786 - 1864

Sitter: Benjamin Waterhouse, 1754-1846
Classification

Paintings
Credit Line

Harvard University Portrait Collection, Gift of Mrs. Benjamin (Louisa) Waterhouse to Harvard College, 1863, H502

Human Generated Data

Title

Benjamin Waterhouse (1754-1846)

People

Artist: James Frothingham, American 1786 - 1864

Sitter: Benjamin Waterhouse, 1754-1846

Date

1831

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-04

Person 97.1
Human 97.1
Art 96.4
Painting 95.2

Clarifai
created on 2018-03-23

people 99.8
adult 99.5
portrait 99.4
one 99.4
man 97.8
wear 97.8
leader 96.7
writer 96.2
music 95.8
administration 95.2
politician 93.8
musician 93.7
elderly 93.4
side view 93.1
painting 91.1
profile 89
facial expression 88.8
chair 87.8
poetry 85
jacket 83.8

Imagga
created on 2018-03-23

man 55.1
male 46.1
businessman 45.9
person 43.3
suit 41.3
portrait 37.5
handsome 35.7
executive 34.3
senior 32.8
business 30.4
tie 28.5
adult 27.6
people 25.1
speaker 24.1
professional 23.6
happy 21.9
confident 21.8
men 21.5
secretary 21.3
smiling 21
old 20.9
looking 20.8
successful 20.1
office 20.1
face 19.9
corporate 19.8
articulator 19.7
mature 19.5
black 18.1
glasses 17.6
expression 17.1
shirt 16.8
manager 16.8
smile 16.4
elderly 16.3
director 15.2
lifestyle 15.2
standing 14.8
communicator 14.7
baron 14.6
couple 13.9
success 13.7
hair 13.5
boss 13.4
attractive 13.3
cheerful 13
older 12.6
retired 12.6
judge 12.6
happiness 12.5
job 12.4
businesspeople 12.3
one 11.9
modern 11.9
work 11.8
retirement 11.5
serious 11.4
indoors 11.4
look 11.4
jacket 11.1
grandfather 10.7
hand 10.6
grandma 10.2
holding 9.9
human 9.8
guy 9.7
love 9.5
career 9.5
sitting 9.5
smart 9.4
occupation 9.2
friendly 9.2
generator 9.1
studio 9.1
aged 9.1
gray 9
worker 9
60s 8.8
age 8.6
elegant 8.6
desk 8.5
casual 8.5
head 8.4
alone 8.2
lady 8.1
together 7.9
husband 7.8
employee 7.8
corporation 7.7
married 7.7
formal 7.6
stylish 7.2
teacher 7.2

Google
created on 2018-03-23

portrait 92.4
painting 84.9
gentleman 81.1
art 67.3
elder 57.3
modern art 56.4

Microsoft
created on 2018-03-23

person 99.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 99.6%
Angry 6%
Confused 8.2%
Disgusted 0.8%
Surprised 2.5%
Calm 76.7%
Sad 3.1%
Happy 2.7%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Painting 95.2%

Captions

Microsoft

a man holding a guitar 82.1%
a man sitting at a guitar 82%
a man sitting next to a guitar 80.4%