Human Generated Data

Title

Edward Stephen Harkness (1874-1940)
Date

1933
People

Artist: Frank Owen Salisbury, British 1874 - 1962

Sitter: Edward Stephen Harkness, 1874 - 1940
Classification

Paintings
Credit Line

Harvard University Portrait Collection, Gift of Edward S. Harkness to Harvard University for Lowell House, 1932, H424

Human Generated Data

Title

Edward Stephen Harkness (1874-1940)

People

Artist: Frank Owen Salisbury, British 1874 - 1962

Sitter: Edward Stephen Harkness, 1874 - 1940

Date

1933

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Art 96.9
Person 93.6
Human 93.6
Painting 91.9
Clothing 59.4
Apparel 59.4

Clarifai
created on 2019-04-10

gown (clothing) 100
people 99.8
one 99.6
adult 99.5
wear 99.4
religion 99.3
monk 98.9
portrait 97.1
reclining 96.7
facial expression 96.6
cape 93.1
seat 92.3
outfit 92.3
outerwear 92.1
man 91.8
robe 91.6
leader 91.2
furniture 91.2
sit 89.8
administration 89.4

Imagga
created on 2019-01-29

monk 78.1
male 39.8
man 39
portrait 31.7
adult 30.3
businessman 29.1
person 28.1
people 27.3
suit 27.1
handsome 24.1
smiling 21.7
happy 20.7
professional 19.7
tie 19
men 18.9
smile 18.5
business 18.2
executive 17.7
shirt 15.9
model 15.6
black 15
senior 15
one 14.9
work 14.9
face 14.2
success 13.7
hand 13.7
expression 13.6
job 13.3
standing 13
human 12.7
hair 12.7
old 12.5
elderly 12.4
serious 12.4
lifestyle 12.3
fashion 12.1
office 12
sitting 12
confident 11.8
clothing 11.8
happiness 11.7
guy 11.4
corporate 11.2
holding 10.7
attractive 10.5
alone 10
modern 9.8
worker 9.8
looking 9.6
casual 9.3
glasses 9.3
successful 9.1
studio 9.1
cheerful 8.9
couple 8.7
elegant 8.6
youth 8.5
manager 8.4
company 8.4
mature 8.4
traditional 8.3
student 8.2
dress 8.1
closeup 8.1
jacket 7.8
pretty 7.7
boss 7.7
gown 7.4
costume 7.4
20s 7.3
hat 7.3
stylish 7.2
home 7.2
posing 7.1
kimono 7.1

Google
created on 2019-01-29

Painting 88.3
Portrait 80.8
Zen master 75
Art 65.5
Elder 61.1
Monk 56

Microsoft
created on 2019-01-29

person 97.6
commencement 29
clothing 22.9
comedy 17.4
fashion 14.3
fall 12.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 86.3%
Sad 13.6%
Disgusted 11.9%
Angry 5.8%
Happy 0.7%
Confused 22.1%
Surprised 1.9%
Calm 44%

Microsoft Cognitive Services

Age 57
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.6%
Painting 91.9%

Captions

Microsoft

a person wearing a suit and tie 85%
a person wearing a suit and tie 84.9%
a person wearing a suit and tie 84.8%

Text analysis

Amazon

EGRUSG
GEODI
EGRUSG I GEODI
I

Google

GRUSG
GRUSG