Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.19

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.19

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 100
Face 100
Head 99.8
Art 96.6
Drawing 96.6
Person 90.4
Photo 83.4
Photography 83.4
Portrait 83.4
Sketch 79.3
Skin 78
Tattoo 78
Beard 60.8
Doodle 55.1

Clarifai
created on 2019-05-31

people 99.5
man 99.5
adult 99.2
one 98.6
portrait 98.5
old 98
face 98
art 96.4
mustache 95.9
person 94
facial hair 92.9
lid 91.5
bald 91.5
elder 90.5
beard 89.8
veil 89.7
facial expression 89.2
elderly 87.9
leader 87.6
head 87

Imagga
created on 2019-05-31

mustache 45.1
portrait 38.2
face 37.7
man 36.3
male 34.8
trilobite 31.8
person 28.6
adult 26.5
arthropod 25.4
mature 25.1
senior 24.4
people 24
head 21.8
happy 20.7
expression 20.5
close 19.4
invertebrate 19.1
smiling 18.8
one 17.9
handsome 16.9
mug shot 16.5
attractive 16.1
smile 15.7
old 15.3
health 15.3
elderly 14.4
skin 13.9
photograph 13.8
eyes 13.8
spatula 13.7
vertical 13.1
mask 13.1
guy 13
looking 12.8
human 12.8
happiness 12.5
care 12.3
hand 12.2
healthy 12
older 11.7
retired 11.6
studio 11.4
natural 11.4
hair 11.1
turner 11
relaxation 10.9
lifestyle 10.8
spa 10.8
facial 10.5
cap 10.5
one person 10.4
representation 10.2
animal 10.1
professional 10.1
model 10.1
aged 10
beard 9.9
retirement 9.6
men 9.4
clean 9.2
friendly 9.2
pretty 9.1
body 8.8
closeup 8.8
therapy 8.5
relaxed 8.4
relax 8.4
cooking utensil 8.2
home 8
businessman 7.9
business 7.9
covering 7.7
casual 7.6
mouth 7.5
purity 7.4
emotion 7.4
lady 7.3
confident 7.3
relaxing 7.3
clothing 7.3
copy space 7.2
black 7.2
headdress 7.2
fresh 7.2
cute 7.2
wet 7.2
look 7

Google
created on 2019-05-31

Face 98.4
Forehead 97.6
Chin 93.5
Facial hair 93.2
Moustache 93
Skin 92.9
Head 91.7
Nose 89.8
Cheek 83.8
Wrinkle 83.1
Jaw 81.1
Illustration 73.2
Portrait 71.8
Beard 71
Art 62.5
Drawing 62
Self-portrait 59.6
Elder 52.9

Microsoft
created on 2019-05-31

art 99.4
man 97.7
sketch 97.4
wall 97.3
drawing 95.1
face 94.8
human face 92.9
portrait 88.7
old 81.4
illustration 75.4
person 73.1
painting 53.8
older 53.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-44
Gender Male, 98.1%
Happy 2.5%
Calm 34.1%
Angry 17.6%
Confused 8.4%
Surprised 25.6%
Sad 10.9%
Disgusted 1%

Microsoft Cognitive Services

Age 69
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 90.4%
Tattoo 78%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-05-31

the face of a man 75.9%
a man wearing a suit and tie 75.8%
a man wearing a hat 59.6%