Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.28

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.28

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Art 99.3
Drawing 99.3
Human 99.3
Face 96.9
Sketch 95.7
Person 81
Head 79.1
Doodle 67.6
Photo 66.4
Photography 66.4
Portrait 66.4
Modern Art 55.7

Clarifai
created on 2019-05-31

portrait 98.8
art 98.2
one 98.1
people 97.9
face 97.7
adult 96.5
artistic 92.7
woman 92.2
painting 91.8
man 91.5
illustration 88.6
wear 87.2
head 86.9
style 84.8
no person 81.8
desktop 81.4
ancient 80.6
veil 80.5
facial expression 79.7
mask 79.5

Imagga
created on 2019-05-31

disguise 100
mask 100
covering 100
attire 83.2
face 56.9
clothing 52.6
portrait 37.6
eyes 35.4
head 31.1
person 30.9
skin 30.1
adult 29.8
attractive 29.4
model 28.8
consumer goods 28.1
close 22.3
care 21.4
spa 20.7
facial 20.4
skincare 20
people 19.6
make 19.1
complexion 18.6
fashion 18.1
health 18.1
smile 17.9
look 17.6
pretty 16.8
lips 16.7
one 16.5
sexy 16.1
cosmetics 15.9
makeup 15.7
cosmetic 15.4
looking 15.2
clean 15.1
human 15
lady 14.6
studio 14.5
closeup 14.2
man 14.1
brunette 14
expression 13.7
serious 13.4
relaxation 12.6
happy 12.6
treatment 12
salon 11.6
male 11.4
healthy 11.4
therapy 11.3
cute 10.8
body 10.4
black 10.2
relax 10.1
elegance 10.1
sensual 10
sensuality 10
style 9.7
hair 9.5
women 9.5
luxury 9.5
smiling 9.4
dark 9.2
20s 9.2
fresh 9.2
lovely 8.9
medical 8.8
natural 8.7
sketch 8.4
alone 8.2
gorgeous 8.2
art 8.1
eye 8.1
posing 8
lifestyle 8
medicine 7.9
cleanse 7.9
beautician 7.9
clay 7.8
youth 7.7
negative 7.5
wellbeing 7.5
feminine 7.5
purity 7.4
camera 7.4
drawing 7.1
representation 7.1

Google
created on 2019-05-31

Face 99.4
Forehead 96.9
Cheek 95.5
Eyebrow 94.6
Facial expression 94.5
Head 93.7
Chin 92.7
Nose 92.3
Skin 89.6
Lip 89.5
Drawing 87.6
Sketch 84.4
Eye 75.9
Jaw 75
Portrait 75
Art 73.1
Painting 71.9
Illustration 69.1
Watercolor paint 68.9
Self-portrait 62

Microsoft
created on 2019-05-31

drawing 99.4
sketch 98.7
painting 96.4
face 95.8
human face 92.6
eyes 91.6
child art 91
art 76.3
person 75.8
portrait 59.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 75.1%
Confused 12%
Surprised 3.7%
Happy 1.8%
Angry 19.8%
Sad 34.8%
Disgusted 2.2%
Calm 25.6%

Microsoft Cognitive Services

Age 21
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 81%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-05-31

a close up of a person 84.5%
close up of a person 79.5%
a person taking a selfie 52.1%