Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.16

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Face 99.5
Human 99.5
Person 94.2
Art 90.2
Drawing 89.8
Photo 66
Portrait 66
Photography 66
Head 65.9
Painting 60

Clarifai
created on 2019-05-31

people 99.3
one 99
portrait 98.2
adult 98
art 96
painting 95.8
wear 95.3
illustration 94.8
man 94.8
print 93.6
veil 92
face 90.4
facial expression 89.6
leader 84.9
lid 82.3
vintage 76.6
old 76.6
profile 76.3
side view 74.8
text 73

Imagga
created on 2019-05-31

child 49.6
face 42.7
portrait 36.3
eyes 31.9
person 31.1
expression 28.2
head 26.1
cute 23.7
smile 22.8
attractive 21.7
hat 21.7
happy 20.7
people 20.7
baby 19.8
hair 19.8
skin 19.6
model 19.5
boy 18.3
childhood 17.9
male 17.5
adult 17.5
kid 16.9
care 16.5
looking 15.2
smiling 15.2
emotion 14.8
girls 14.6
facial 14.5
youth 14.5
bonnet 13.8
fashion 13.6
clothing 13.4
handsome 13.4
man 12.8
headdress 12.6
little 12.4
lifestyle 12.3
lady 12.2
sexy 12.1
close 12
healthy 12
pretty 11.9
juvenile 11.5
children 10.9
black 10.9
innocent 10.6
look 10.5
brunette 10.5
health 10.4
blond 10.1
one 9.7
closeup 9.4
human 9
spa 9
body 8.8
happiness 8.6
casual 8.5
lips 8.3
purity 8.3
fun 8.2
braid 7.8
towel 7.8
infant 7.7
daughter 7.6
serious 7.6
guy 7.6
studio 7.6
bath 7.6
life 7.6
relax 7.6
one person 7.5
joy 7.5
clean 7.5
adorable 7.4
funny 7.4
cheerful 7.3
make 7.3
gorgeous 7.3
cap 7.1

Google
created on 2019-05-31

Face 99.2
Forehead 97.8
Cheek 96.4
Chin 94.4
Head 93
Eyebrow 92.9
Watercolor paint 92
Nose 88.7
Skin 85.9
Portrait 80.8
Illustration 78.7
Lip 75.4
Jaw 73.5
Art 72.1
Painting 71.9
Paint 68.2
Drawing 67.7
Sketch 65.2
Acrylic paint 64.1
Ear 63

Microsoft
created on 2019-05-31

drawing 98.9
sketch 98.2
person 98.1
face 95.5
art 94.6
human face 93.8
painting 90.9
child art 87.7
indoor 86.9
eyes 86.3
old 74.5
portrait 68.5
illustration 51.5
older 39.4
posing 37.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 92%
Angry 20.1%
Surprised 24%
Disgusted 4%
Sad 6%
Calm 12.2%
Happy 3.6%
Confused 30.2%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.2%

Captions

Microsoft

a person posing for the camera 93.1%
a person smiling for the camera 83.1%
a person smiling for the camera 83%