Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.5

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.5

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 97.7
Face 97.3
Drawing 96.8
Art 96.8
Person 78.2
Sketch 72.6
Doodle 70.1
Painting 68.8
Portrait 62.3
Photography 62.3
Photo 62.3

Clarifai
created on 2019-05-31

people 99.6
man 99.3
adult 99.2
portrait 99
face 98.1
one 97.6
veil 97.2
facial expression 93.7
wear 92.1
art 91.7
facial hair 91.1
mask 90.3
person 90.1
mustache 88.3
head 87.1
hairdo 85.3
painting 85.1
human 82.9
lid 79.6
face disguise 79

Imagga
created on 2019-05-31

mask 49.8
face 46.2
portrait 38.8
mustache 36
person 34.3
covering 32.8
man 26.9
disguise 26.4
male 26.3
adult 25.9
head 25.2
people 22.3
eyes 20.7
skin 20.5
attractive 20.3
expression 19.6
one 18.7
attire 18.4
care 18.1
smile 17.1
ceramic ware 16.9
looking 16.8
facial 16.8
spa 16.2
health 16
hair 15.9
happy 15.7
clothing 15.5
skincare 15.2
negative 15.2
close 14.8
earthenware 14.8
model 13.2
delft 13.1
smiling 13
salon 12.6
black 12
human 12
film 12
look 11.4
brunette 11.3
utensil 11.2
relaxation 10.9
complexion 10.8
vertical 10.5
senior 10.3
container 10.2
casual 10.2
lifestyle 10.1
closeup 10.1
cute 10
confident 10
make 10
handsome 9.8
fashion 9.8
pretty 9.8
lady 9.7
cosmetic 9.7
youth 9.4
photographic paper 9.2
clean 9.2
studio 9.1
sexy 8.8
china 8.7
men 8.6
luxury 8.6
therapy 8.5
mature 8.4
emotion 8.3
treatment 8.3
teenager 8.2
eye 8
body 8
happiness 7.8
boy 7.8
guy 7.7
teenage 7.7
old 7.7
stress 7.7
pain 7.7
one person 7.5
relaxed 7.5
cosmetics 7.5
consumer goods 7.5
makeup 7.5
vessel 7.3
cheerful 7.3
porcelain 7.3
medical 7.1
face mask 7.1

Google
created on 2019-05-31

Face 97.7
Forehead 96.4
Facial hair 94.2
Head 92.2
Nose 88.7
Chin 86.5
Moustache 86.3
Cheek 83.8
Illustration 79
Beard 78
Art 70.9
Jaw 69.6
Self-portrait 68.5
Drawing 64.2
Portrait 62.5
Painting 62.2

Microsoft
created on 2019-05-31

art 99.2
drawing 98.5
sketch 97.9
human face 95.4
person 91.1
man 91
painting 90
face 88.7
illustration 58.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 97.5%
Confused 12.1%
Disgusted 13.6%
Happy 14.5%
Surprised 12.5%
Calm 26.1%
Sad 10.1%
Angry 11.1%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 78.2%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-05-31

a close up of a tattoo 71.8%
a tattoo on his face 58.2%
a tattoo on his head 58.1%