Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.4

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.4

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 99
Drawing 98.7
Art 98.7
Sketch 94.5
Face 92.4
Person 87.4
Portrait 64.5
Photo 64.5
Photography 64.5

Clarifai
created on 2019-05-31

people 98.3
portrait 98.1
one 97.3
print 97.1
adult 96.6
art 96.1
man 95
painting 93.4
illustration 93.1
face 92.4
paper 90.9
vintage 89.7
veil 89.4
old 88.7
retro 85.1
antique 83.7
mustache 83.4
wear 81.9
ancient 79.3
person 78.8

Imagga
created on 2019-05-31

face 42.7
portrait 35
man 26.9
male 25.7
person 25.6
head 25.2
hair 23
skin 22.5
expression 22.2
beard 21.8
eyes 21.5
representation 21.1
adult 20.7
spectacles 20.5
people 19.5
mug shot 19.1
attractive 18.9
close 17.1
child 16.9
model 16.4
serious 16.2
handsome 16.1
sketch 15.4
facial 15.3
smile 15
photograph 14.8
optical instrument 14.7
boy 13.9
emotion 13.8
sexy 13.7
spa 13.5
old 13.3
care 13.2
looking 12.8
one 12.7
health 11.8
stress 11.5
cute 11.5
guy 11.3
drawing 11.1
relax 11
happy 10.7
human 10.5
senior 10.3
lifestyle 10.1
healthy 10.1
relaxation 10.1
pretty 9.8
thinking 9.5
bath 9.5
men 9.5
closeup 9.4
instrument 9.3
studio 9.1
fashion 9.1
body 8.8
brunette 8.7
hat 8.5
therapy 8.5
casual 8.5
mature 8.4
childhood 8.1
creation 8.1
kid 8
braid 8
smiling 8
nose 7.9
black 7.8
depression 7.8
stare 7.8
luxury 7.7
elderly 7.7
teeth 7.6
blond 7.6
horizontal 7.5
device 7.5
purity 7.4
treatment 7.4
nice 7.3
lady 7.3
salon 7.2
eye 7.2
look 7

Google
created on 2019-05-31

Face 99.3
Forehead 98.4
Cheek 96.5
Eyebrow 95.6
Chin 94.9
Nose 94.3
Head 93.5
Skin 92.5
Jaw 89.2
Sketch 86.8
Drawing 85.5
Lip 82.7
Portrait 79.9
Wrinkle 76.1
Eye 75.9
Illustration 72.5
Ear 71.6
Self-portrait 70.4
Mouth 67.9
Art 62.5

Microsoft
created on 2019-05-31

sketch 99
drawing 98.9
art 98
human face 95.8
face 95.3
indoor 89.7
person 85.8
painting 83.4
eyes 81.4
portrait 79.2
child art 77.7
illustration 66.3
forehead 58.9
cheek 50.7
posing 43.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Female, 59.4%
Happy 3.3%
Confused 62.1%
Angry 5.5%
Sad 3.4%
Calm 16.8%
Surprised 7.5%
Disgusted 1.3%

Microsoft Cognitive Services

Age 57
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 87.4%

Categories

Imagga

paintings art 100%

Captions