Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.40

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 98.9
Art 97.9
Drawing 97.9
Face 97.7
Sketch 89.2
Person 89.1
Head 86.2
Doodle 68.7
Photo 65.8
Portrait 65.8
Photography 65.8

Clarifai
created on 2019-05-31

art 98.6
people 98
adult 98
one 97.6
illustration 97.3
portrait 96.4
painting 96.4
face 95.8
man 94.7
veil 91.3
artistic 91.1
print 90.9
wear 90.4
woman 89.2
paper 87.4
desktop 87.3
ancient 87
facial expression 84.7
vintage 84.4
no person 83.9

Imagga
created on 2019-05-31

face 51.2
portrait 42.1
mug shot 33.7
head 33.6
attractive 32.2
skin 30.4
adult 28.5
photograph 28.1
person 28.1
model 27.3
expression 24.8
representation 24.2
people 24
eyes 23.3
close 21.7
sexy 21.7
smile 21.4
mask 21
brunette 20.1
male 19.9
man 19.5
looking 18.4
fashion 18.1
makeup 18.1
human 18
facial 17.6
hair 16.7
serious 16.2
lifestyle 15.9
look 15.8
lips 15.8
health 15.3
creation 15.2
negative 15
one 15
happy 14.4
care 14
make 13.6
beard 13.6
closeup 13.5
spa 13.5
handsome 13.4
lady 13
black 12.6
pretty 12.6
posing 12.5
covering 12.2
studio 12.2
healthy 12
complexion 11.8
relaxation 11.7
cute 11.5
skincare 11.4
film 11
sensual 10.9
clean 10.9
nose 10.9
smiling 10.9
hairstyle 10.5
style 10.4
feminine 10.3
youth 10.2
clothing 10.2
dark 10
confident 10
gorgeous 10
eye 9.8
body 9.6
women 9.5
natural 9.4
cosmetics 9.4
emotion 9.2
cosmetic 9.1
lovely 8.9
luxury 8.6
elegant 8.6
photographic paper 8.5
fresh 8.5
therapy 8.5
one person 8.5
casual 8.5
camera 8.3
20s 8.3
sensuality 8.2
pose 8.2
hands 7.8
stare 7.8
salon 7.7
hand 7.7
stress 7.7
purity 7.4
treatment 7.4
wellness 7.3
disguise 7.3
stylish 7.2
happiness 7.1

Google
created on 2019-05-31

Face 99.3
Cheek 97.2
Forehead 96.6
Eyebrow 94.8
Chin 94.7
Head 93.3
Nose 92.3
Lip 90.6
Drawing 89.5
Sketch 89
Watercolor paint 88
Skin 85.9
Jaw 84.9
Illustration 82.6
Portrait 82.3
Art 78.6
Painting 78.4
Self-portrait 76.6
Line 75.5
Iris 63.9

Microsoft
created on 2019-05-31

sketch 99.3
drawing 99.2
art 98.2
human face 92.9
painting 90.2
person 89.3
child art 86.6
face 85.3
wearing 80.4
illustration 77.5
posing 75.1
portrait 72
bow 66.4
forehead 57.4
old 49.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-27
Gender Male, 87.5%
Angry 18.2%
Disgusted 5.6%
Happy 4.5%
Sad 6.3%
Surprised 7%
Calm 38%
Confused 20.4%

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 89.1%

Captions

Microsoft

a person posing for the camera 92.8%
a man posing for a photo 75.7%
a man wearing a bow tie 74.2%