Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.35

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.35

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 96
Drawing 92.7
Art 92.7
Face 92.3
Person 84.6
Painting 75.7
Sketch 61.3

Clarifai
created on 2019-05-31

adult 98.9
man 98.9
people 98.5
illustration 98.5
art 98.3
portrait 98.1
mustache 97.8
one 97.5
painting 97.3
lid 96.5
face 95
facial hair 94.3
veil 92.4
print 92.3
beard 92
person 91.6
wear 89.1
head 83.9
serious 81.3
artistic 80.1

Imagga
created on 2019-05-31

ruler 51.4
mask 46.8
face 42.6
portrait 35.6
covering 34.2
disguise 29
person 28.6
man 26.9
head 26.9
eyes 23.3
male 22.7
expression 22.2
skin 21.4
people 20.7
close 20.6
attractive 20.3
attire 20.2
adult 20.1
tattoo 19
clothing 18.4
bust 18.1
sculpture 17.8
model 17.1
smile 15
care 14
human 13.5
hair 13.5
fashion 12.8
one 12.7
eye 12.5
black 12
spa 11.7
sexy 11.3
health 11.1
emotion 11.1
casual 11
closeup 10.8
handsome 10.7
facial 10.6
makeup 10.4
mature 10.2
design 10.1
decoration 9.8
old 9.8
stress 9.6
skincare 9.5
happy 9.4
plastic art 9.4
relaxation 9.2
dark 9.2
beard 9.1
mustache 8.9
looking 8.8
look 8.8
mug shot 8.7
natural 8.7
lifestyle 8.7
art 8.7
pain 8.6
cute 8.6
guy 8.6
serious 8.6
pretty 8.4
clean 8.4
healthy 8.2
confident 8.2
representation 8.2
posing 8
sweatshirt 8
smiling 8
brunette 7.9
salon 7.7
men 7.7
photograph 7.7
studio 7.6
hand 7.6
therapy 7.5
senior 7.5
nose 7.4
body 7.2
consumer goods 7.1

Google
created on 2019-05-31

Facial hair 98
Hair 97.5
Face 97.2
Forehead 96.5
Beard 93.8
Moustache 93.7
Head 91
Chin 88.3
Illustration 86.6
Eyebrow 86.4
Nose 84.2
Cheek 83.8
Jaw 78.3
Drawing 76.7
Art 72.1
Self-portrait 71.7
Portrait 69.7
Sketch 68.6
Painting 61.3
Gentleman 59.6

Microsoft
created on 2019-05-31

drawing 99.8
sketch 99.6
art 99.6
abstract 99.2
painting 99.1
tattoo 96.4
child art 93.8
illustration 88.2
human face 84.4
face 80.4
person 58.9
portrait 58.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 12-22
Gender Male, 92.7%
Sad 3.6%
Confused 10.5%
Disgusted 6.5%
Surprised 48%
Angry 6.9%
Happy 3.1%
Calm 21.4%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 84.6%
Painting 75.7%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-05-31

a tattoo on his face 77.7%
a tattoo on his neck 77.6%
a close up of a tattoo 77.5%