Human Generated Data

Title

Portrait of a Chinese Gentleman
Date
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Dr. Denman W. Ross, Class of 1875, 1936.112

Human Generated Data

Title

Portrait of a Chinese Gentleman

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Face 97.8
Human 97.8
Art 87.3
Person 83.1
Painting 72.1
Wood 68.2
Photo 67.3
Photography 67.3
Portrait 67.3
Texture 63.7
Tapestry 60.5
Ornament 60.5
Plywood 58.1
Apparel 57.8
Hat 57.8
Clothing 57.8

Clarifai
created on 2019-07-07

people 99.6
wear 92.1
painting 91.9
no person 90.5
print 89.7
adult 87.8
art 86.1
man 86.1
one 84.9
famous 82.7
person 81
texture 76.1
lid 76
veil 75.6
vintage 73.3
mammal 71.1
illustration 69.6
text 66.9
portrait 66.4
color 64

Imagga
created on 2019-07-07

face mask 100
ski mask 100
mask 100
protective covering 61.8
covering 56
face 31.9
disguise 25.7
portrait 22.6
person 21.3
eyes 18.9
head 17.6
clothing 15.7
man 15.4
close 15.4
adult 14.9
people 13.9
black 13.8
look 12.3
cute 12.2
looking 12
expression 11.9
attire 11.8
attractive 11.2
fashion 10.5
sexy 10.4
nice 10.1
eye 9.8
brunette 9.6
closeup 9.4
happy 9.4
lady 8.9
lovely 8.9
mystery 8.6
youth 8.5
male 8.5
pretty 8.4
old 8.4
dark 8.3
alone 8.2
fantasy 8.1
smile 7.8
bad 7.8
scary 7.7
skin 7.6
human 7.5
fun 7.5
one 7.5
teenager 7.3
danger 7.3
religion 7.2

Google
created on 2019-07-07

Art 80.3
Headgear 72.7
Portrait 68
Painting 63.8
Illustration 57.7
Self-portrait 56.9
Gentleman 54.5

Microsoft
created on 2019-07-07

drawing 99.7
human face 99
painting 98.8
sketch 98.7
art 98.5
person 89.5
child art 84.5
cartoon 83.2
portrait 67
leather 39.9

Face analysis

Amazon

Google

AWS Rekognition

Age 14-23
Gender Male, 84.2%
Disgusted 1.6%
Confused 5.6%
Happy 3%
Sad 13.5%
Surprised 22.7%
Calm 47%
Angry 6.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 83.1%
Painting 72.1%

Captions

Microsoft

a tattoo on his head 72.8%
a close up of a tattoo on his head 66.9%
a brown leather hat 58.3%