Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.33

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.33

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 99.9
Face 99.9
Drawing 95.5
Art 95.5
Head 94.5
Person 91.6
Portrait 81.3
Photography 81.3
Photo 81.3
Sketch 79.1
Text 68.7
Selfie 62.8
Beard 59.5
Doodle 55

Clarifai
created on 2019-05-31

man 98.6
people 97.9
portrait 97.7
one 96.5
adult 96.1
person 93.3
face 92.8
mustache 91.8
beard 91
facial hair 87.1
art 85.7
illustration 81.3
lid 81.1
head 79.3
old 79.2
desktop 78.7
print 76.5
hair 76.5
isolated 75.4
serious 73.9

Imagga
created on 2019-05-31

mustache 58
beard 48.3
face 45.6
portrait 45.4
person 34.4
adult 32.4
man 30.3
people 30.2
head 28.6
male 27.7
attractive 26.6
expression 24.8
close 24.6
eyes 24.1
happy 22
skin 21.5
smile 21.4
smiling 20.3
hair 19.9
one 19.4
mask 18.6
model 17.9
human 17.3
senior 16.9
looking 16.8
look 14.9
mature 14.9
sexy 14.5
casual 14.4
happiness 14.1
handsome 13.4
relaxation 12.6
lifestyle 12.3
brunette 12.2
cute 12.2
black 12
old 11.9
health 11.8
facial 11.7
lady 11.4
teeth 11.3
pretty 11.2
men 11.2
emotion 11.1
mug shot 10.7
studio 10.7
cheerful 10.6
elderly 10.6
guy 10.4
confident 10
care 9.9
spa 9.9
older 9.7
healthy 9.5
closeup 9.5
lips 9.3
photograph 9.3
joy 9.2
covering 8.8
women 8.7
serious 8.6
skincare 8.6
youth 8.5
one person 8.5
friendly 8.3
alone 8.2
gorgeous 8.2
stylish 8.2
eye 8.1
natural 8
cream 8
businessman 8
complexion 7.8
nose 7.8
masculine 7.8
tattoo 7.8
stress 7.7
thinking 7.6
relax 7.6
therapy 7.6
mouth 7.5
vertical 7

Google
created on 2019-05-31

Forehead 97.6
Face 97.5
Facial hair 96.3
Moustache 91.7
Chin 91.6
Beard 90.7
Head 90.4
Eyebrow 87.6
Nose 87
Cheek 86.1
Illustration 76.8
Drawing 76.7
Sketch 68.6
Portrait 68.6
Jaw 66.8
Gentleman 63.5
Self-portrait 62
Art 58.1
Elder 52.9

Microsoft
created on 2019-05-31

art 98.2
sketch 97.8
drawing 97.3
man 97
human face 94.1
person 93.8
wearing 90.6
face 88.3
portrait 72
forehead 69.8
painting 57.8
bow 55.7
jacket 53.2
jaw 50
posing 41.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-52
Gender Male, 89.8%
Happy 5%
Surprised 14.9%
Calm 31.3%
Sad 19.9%
Disgusted 7.5%
Angry 9.4%
Confused 12%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.6%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-05-31

a man wearing a hat 59.4%
a person posing for the camera 59.3%
a man wearing a bow tie 59.2%