Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.24

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.24

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Face 98.7
Human 98.7
Person 95.6
Art 95.4
Drawing 94.7
Head 80.6
Sketch 80.6
Photo 72.8
Photography 72.8
Portrait 72.8
Painting 68.3

Clarifai
created on 2019-05-31

people 98.3
portrait 98.3
adult 96.8
one 96.2
face 95.8
man 95.3
art 95.2
person 92.7
artistic 88.5
illustration 88
painting 87.8
wear 86.4
desktop 85.9
head 85.6
style 82.1
lid 81.6
color 80.8
serious 79.9
young 79.9
retro 79

Imagga
created on 2019-05-31

face 54.8
portrait 41.5
child 37.8
person 34.1
eyes 29.3
people 28.5
expression 23.9
cute 23.7
skin 23.4
hair 22.2
head 21.9
adult 21.4
happy 20.7
smile 20.7
care 20.6
attractive 20.3
bonnet 20
kid 19.5
male 18.8
hat 18.6
look 18.4
looking 18.4
baby 18.1
smiling 18.1
model 17.9
youth 17.9
little 17.7
childhood 16.1
close 16
human 15.8
health 15.3
man 14.8
boy 14.8
pretty 14.7
facial 14.6
lifestyle 14.5
one 14.2
braid 14.2
healthy 13.9
headdress 13.7
clothing 13
emotion 12.9
eye 12.5
mouth 12.2
lady 12.2
mask 11.6
serious 11.5
studio 11.4
fashion 11.3
adorable 11.1
closeup 10.8
complexion 10.8
stare 10.7
innocence 10.6
fun 10.5
sexy 10.5
casual 10.2
clean 10
make 10
daughter 9.9
handsome 9.8
cheerful 9.8
innocent 9.7
skincare 9.5
bath 9.5
therapy 9.4
happiness 9.4
nose 9.4
natural 9.4
girls 9.1
children 9.1
old 9.1
spa 9
lovely 8.9
teeth 8.8
sweet 8.7
infant 8.7
toddler 8.6
cream 8.6
relax 8.4
beard 8.4
joy 8.4
lips 8.3
friendly 8.2
salon 7.9
men 7.7
makeup 7.6
senior 7.5
cosmetics 7.5
purity 7.4
joyful 7.4
black 7.3
fresh 7.2
women 7.1
medical 7.1

Google
created on 2019-05-31

Face 99.1
Cheek 96.9
Forehead 95.3
Chin 94.6
Facial expression 94.4
Nose 94.3
Eyebrow 93.4
Head 92.6
Watercolor paint 92.3
Lip 88.1
Illustration 85.1
Painting 82.4
Jaw 78.3
Art 78.1
Eye 75.9
Portrait 75.7
Line 73
Drawing 63.2
Paint 63
Sketch 59.7

Microsoft
created on 2019-05-31

drawing 99.2
sketch 99.2
person 97.7
face 94.3
child art 94.1
art 93.5
human face 93.5
painting 93.1
wearing 91
bow 82.5
portrait 80.5
eyes 79.9
illustration 75
old 63.1
posing 49.4
blue 43.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 85.3%
Surprised 11%
Confused 19.9%
Disgusted 3.2%
Happy 4.6%
Sad 4.4%
Calm 43.2%
Angry 13.7%

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.6%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-05-31

a person posing for the camera 94.2%
a person wearing a blue hat 62.4%
a person wearing a bow tie 62.3%