Human Generated Data

Title

John Collins Warren (1842-1927)

Date

1902

People

Artist: Frederic Porter Vinton, American 1846 - 1911

Sitter: John Collins Warren, 1842 - 1927

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Gift of Dr. Richard Warren to the Harvard Medical School, 1982, H714

Human Generated Data

Title

John Collins Warren (1842-1927)

People

Artist: Frederic Porter Vinton, American 1846 - 1911

Sitter: John Collins Warren, 1842 - 1927

Date

1902

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-04

Human 94.5
Person 94.5
Art 93.5
Painting 93.3
Clothing 68.3
Apparel 68.3
Face 59.5
Photo 59.5
Photography 59.5
Portrait 59.5

Clarifai
created on 2018-03-23

people 99.8
portrait 99.8
one 99.7
adult 99.4
man 99
leader 98.1
wear 97.8
administration 95.9
book series 95.2
facial hair 94.8
outfit 94.8
writer 93.1
facial expression 92.3
clergy 91.3
priest 90.8
mustache 90.4
music 86.7
chair 85.9
gown (clothing) 85.1
musician 85

Imagga
created on 2018-03-23

bow tie 100
necktie 100
businessman 61.9
man 59.2
garment 56.6
suit 56.4
male 51.8
business 44.4
executive 41.8
handsome 38.4
person 37.4
tie 37
portrait 33.7
adult 32.4
men 30.9
clothing 30.1
professional 30
manager 29.8
corporate 28.4
confident 28.2
people 26.8
black 25.9
office 25.7
senior 23.5
mature 23.3
expression 23.1
work 20.4
boss 20.1
looking 20
face 19.9
old 19.5
success 19.3
judge 17.6
successful 17.4
standing 17.4
elderly 17.3
smile 17.1
smiling 16.7
businesspeople 16.2
worker 15.8
human 15
jacket 14.7
hand 14.4
shirt 14
glasses 13.9
one 13.5
job 13.3
happy 13.2
studio 12.9
hair 12.7
older 12.6
modern 12.6
lifestyle 12.3
occupation 11.9
working 11.5
guy 11.3
leadership 10.6
formal 10.5
serious 10.5
thinking 10.5
elegant 10.3
communication 10.1
friendly 10.1
gray hair 9.9
leader 9.7
smart 9.4
40s 8.8
look 8.8
expertise 8.7
confidence 8.6
finance 8.5
lawyer 8.4
cheerful 8.1
executives 7.9
60s 7.8
teacher 7.8
businessperson 7.8
masculine 7.8
collar 7.7
money 7.7
only 7.6
power 7.6
one person 7.5
close 7.4
employee 7.4
alone 7.3
stylish 7.2
computer 7.2
baron 7.2

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.5
man 98.2
old 41.9
necktie 22.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 45-63
Gender Male, 99.4%
Confused 13.3%
Angry 14.8%
Calm 30.8%
Sad 4.8%
Surprised 3.1%
Disgusted 30.9%
Happy 2.2%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.5%

Captions

Microsoft

a man wearing a suit and tie 96.9%
a man standing in front of a building 84.2%
a man in a suit and tie 84.1%