Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

-

People

-

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.29

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.29

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 98.6
Drawing 98.2
Art 98.2
Person 93.4
Face 90.9
Sketch 90.3
Portrait 60.5
Photography 60.5
Photo 60.5
Head 58.3

Clarifai
created on 2019-05-31

man 99.1
portrait 98.3
people 98.2
art 97.7
adult 97.4
one 96.5
face 96.1
facial hair 96
mustache 95
veil 94.8
lid 94
beard 93.1
illustration 92.8
painting 92.2
ancient 89.8
old 88.7
person 85.8
wear 84.4
antique 84.4
print 82.6

Imagga
created on 2019-05-31

beard 51.7
face 47.7
portrait 41.5
person 32.3
head 31.1
man 31
adult 27.2
mask 26.9
people 26.3
attractive 25.9
male 25.6
expression 24.8
close 24.6
mug shot 24.3
facial 22.4
eyes 22.4
skin 21.6
smile 20
photograph 19.8
spa 19.8
looking 19.2
handsome 18.7
smiling 18.1
care 17.3
one 17.2
model 16.4
happy 16.3
representation 15.2
hair 15.1
health 14.6
skincare 14.3
relaxation 14.3
guy 14.1
therapy 12.3
cute 12.2
fashion 12.1
treatment 12
casual 11.9
salon 11.9
complexion 11.8
serious 11.5
one person 11.3
boy 11.3
luxury 11.2
ruler 11.2
emotion 11.1
closeup 10.8
studio 10.7
mature 10.2
purity 10.2
creation 10.1
covering 9.7
sexy 9.6
look 9.6
brunette 9.6
stress 9.6
men 9.5
senior 9.4
clean 9.2
alone 9.1
black 9
human 9
cheerful 9
beautician 8.8
healthy 8.8
head shoulders 8.8
natural 8.7
lifestyle 8.7
happiness 8.6
relax 8.4
hat 8.4
cosmetics 8.4
old 8.4
camera 8.3
cream 8.2
clothing 8.2
lady 8.1
vertical 7.9
bust 7.9
pretty 7.7
youth 7.7
horizontal 7.5
mouth 7.4
friendly 7.3
child 7.3
make 7.3
body 7.2
nose 7

Google
created on 2019-05-31

Face 98.5
Forehead 97.9
Facial hair 94.4
Chin 93.9
Cheek 93
Head 91.8
Nose 89.8
Eyebrow 89.3
Moustache 88.7
Beard 82.6
Illustration 82
Jaw 79.1
Portrait 73.9
Line 73
Art 70.9
Drawing 70.3
Self-portrait 66.9
Sketch 61.4
Painting 58.3
Wrinkle 52.9

Microsoft
created on 2019-05-31

drawing 98.7
sketch 98.5
art 97.6
face 93.5
human face 93
painting 90.7
illustration 78.9
person 76.3
man 74.3
portrait 67.7
forehead 54.4
eyes 53.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.4%
Sad 7.7%
Happy 16.4%
Confused 12.9%
Angry 23.2%
Surprised 13.8%
Disgusted 15%
Calm 10.9%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.4%

Categories

Captions

Microsoft
created on 2019-05-31

a man wearing a hat 65.6%
a close up of a man 65.5%
a close up of a man wearing a hat 62.8%