Human Generated Data

Title

Mr. Cotting

Date

1850s?

People

Artist: Unidentified Artist,

Sitter: Mr. Cotting,

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Harvard Business School, H723

Human Generated Data

Title

Mr. Cotting

People

Artist: Unidentified Artist,

Sitter: Mr. Cotting,

Date

1850s?

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Harvard Business School, H723

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 96.8
Painting 93.4
Person 93.4
Human 93.4

Clarifai
created on 2018-03-23

people 99.9
portrait 99.6
one 99.3
leader 98.5
adult 95.5
politician 94.9
wear 93.9
menswear 93.7
administration 92.7
dinner jacket 92.4
man 91.6
elderly 89.2
painting 88
writer 87.4
neckwear 87.4
chair 83.8
outfit 82.7
facial expression 81
cravat 80.7
priest 79.5

Imagga
created on 2018-03-23

man 59.9
suit 57.5
businessman 52.2
male 50.4
handsome 42
person 39.6
portrait 38.2
business 36.5
executive 35.4
adult 33.8
tie 30.4
senior 30
necktie 27.9
mature 27
people 26.8
professional 25.9
men 25.8
grandfather 25.6
corporate 25
baron 24.6
old 23.7
confident 23.7
elderly 23
garment 22.8
clothing 22.8
looking 21.6
manager 21.4
expression 21.4
face 21.3
boss 21.1
judge 20.9
black 20
happy 19.5
smile 17.8
success 17.7
jacket 17.6
standing 17.4
glasses 16.7
successful 16.5
bow tie 16
smiling 15.9
shirt 15.9
work 15.7
older 15.6
serious 15.3
job 15.1
one 15
occupation 14.7
office 14.5
lifestyle 14.5
hand 14.5
worker 13.8
human 13.5
casual 12.7
hair 12.7
gray 12.6
retired 12.6
retirement 12.5
grandma 12.5
formal 12.4
studio 12.2
modern 11.9
confidence 11.5
businesspeople 11.4
guy 11.3
eyes 11.2
lawyer 11.1
head 10.9
aged 10.9
close 10.9
beard 10.8
alone 10.1
cheerful 9.8
businessperson 9.8
friendly 9.2
attractive 9.1
gray hair 8.9
60s 8.8
look 8.8
hands 8.7
career 8.5
one person 8.5
employee 8.4
scholar 8.3
director 8.3
couple 7.9
metropolitan 7.8
covering 7.8
pensive 7.8
only 7.6
age 7.6
intellectual 7.6
smart 7.5
consumer goods 7.3
stylish 7.2

Google
created on 2018-03-23

portrait 94.8
gentleman 85.9
painting 81.2
elder 75.3
art 68
diplomat 65.1
self portrait 54.6
parson 51.4
stock photography 51.2
modern art 50.7

Microsoft
created on 2018-03-23

person 99.2
man 96.8
wall 96.6
suit 89.7
black 70.4
older 26.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-90
Gender Male, 99.9%
Surprised 0.8%
Confused 12.4%
Disgusted 1.3%
Calm 66.3%
Angry 7.3%
Sad 8.7%
Happy 3.1%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 93.4%
Person 93.4%

Categories

Captions

Microsoft
created on 2018-03-23

a man wearing a suit and tie 97.9%
a man in a suit and tie 97.8%
a man wearing a black suit 96.1%