Human Generated Data

Title

Portrait of a Man

Date

1892

People

Artist: John Briggs Potter, American 1864 - 1949

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Denman W. Ross, 1919.2

Human Generated Data

Title

Portrait of a Man

People

Artist: John Briggs Potter, American 1864 - 1949

Date

1892

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Person 99.1
Human 99.1
Art 96.7
Drawing 95.1
Sketch 82
Face 81.6
Painting 77.7
Coat 67.8
Clothing 67.8
Overcoat 67.8
Apparel 67.8
Suit 67.8
Photo 65.4
Photography 65.4
Portrait 65.4

Clarifai
created on 2019-05-31

portrait 99.9
people 99.9
one 99.5
man 98.9
adult 98.5
wear 93.7
leader 92.7
facial hair 85.4
popularity 84.4
pensive 83.1
jacket 82.3
serious 81.9
music 81.4
writer 80.7
facial expression 80.4
outerwear 80.1
retro 71.4
neckwear 68.2
confidence 68.2
administration 66.1

Imagga
created on 2019-05-31

man 56.6
suit 47.9
male 46.9
portrait 43.4
person 43.1
handsome 39.3
businessman 38
adult 35.9
mature 35.4
people 32.4
senior 31.9
face 30.6
smile 29.3
business 29.2
garment 24.9
tie 24.7
professional 24.5
glasses 24.1
looking 24
smiling 23.9
confident 22.8
clothing 22.2
beard 22.1
happy 22
executive 21.8
old 21.6
elderly 21.1
one 20.2
casual 19.5
hair 19.1
men 18.9
guy 18.6
expression 17.9
grandfather 17.9
attractive 17.5
corporate 17.2
serious 17.2
success 16.9
successful 16.5
age 16.2
office 16.1
shirt 16
gray 15.4
work 14.9
manager 14.9
necktie 14.8
older 14.6
boss 14.4
human 14.3
close 13.7
retirement 13.5
studio 12.9
friendly 12.8
aged 12.7
jacket 11.9
happiness 11.8
lifestyle 11.6
job 11.5
look 11.4
standing 11.3
modern 11.2
head 10.9
40s 10.7
retired 10.7
grandma 10.4
occupation 10.1
baron 10
cheerful 9.8
working 9.7
planner 9.7
black 9.6
coat 9.6
thinking 9.5
closeup 9.5
model 9.4
consumer goods 9.1
covering 9
color 8.9
gray hair 8.9
specialist 8.8
pensive 8.8
formal 8.6
director 8.5
doctor 8.5
health 8.4
bow tie 8.3
worker 8.2
mustache 8.1
eyes 7.8
youth 7.7
confidence 7.7
healthy 7.6
fashion 7.6
active 7.2
cool 7.1

Google
created on 2019-05-31

Photograph 95
Portrait 87.4
Chin 85
Gentleman 85
Forehead 84.6
Self-portrait 73.5
Jaw 69.6
Art 65.5
Drawing 65.2
Sketch 58.5
Facial hair 55.5
Vintage clothing 50.7

Microsoft
created on 2019-05-31

person 99.7
wall 98.6
man 98.5
sketch 97.7
drawing 97
human face 96
portrait 87.2
clothing 78.2
suit 65.4
old 62.1
white 61.2
posing 60.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Male, 98.6%
Calm 66.4%
Disgusted 2.3%
Sad 9.3%
Surprised 3.5%
Happy 0.2%
Confused 7.2%
Angry 11.1%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 67.8%

Captions

Microsoft

a man wearing a white shirt 91.2%
a person posing for the camera 91.1%
a man wearing a suit and tie 91%

Text analysis

Amazon

J.B.R.
181

Google

1892 J.B.P.
J.B.P.
1892