Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.39

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 99.6
Drawing 99.6
Art 99.6
Sketch 97.7
Person 91.5
Face 85.5
Photography 62.2
Portrait 62.2
Photo 62.2

Clarifai
created on 2019-05-31

man 99.2
portrait 98.6
people 98.1
adult 97.8
one 97.4
mustache 95.7
illustration 95.7
face 95.4
art 94.2
beard 92.3
facial hair 90.8
person 90.8
lid 88.8
print 88.8
head 86.4
desktop 82.7
serious 82.4
painting 81.6
veil 81.3
leader 80.8

Imagga
created on 2019-05-31

face 48.4
portrait 48
man 46.4
beard 43.5
male 40.5
person 33.1
expression 29
head 28.6
handsome 27.7
adult 27.2
mustache 26.1
close 25.2
people 25.1
mug shot 24.8
representation 23
model 22.6
photograph 21.2
eyes 20.7
hair 20.6
attractive 20.3
looking 19.2
serious 18.1
black 18.1
casual 17
mature 16.8
skin 15.6
smiling 15.2
guy 15.2
human 15
one 15
closeup 14.8
men 14.6
studio 14.5
fashion 13.6
senior 13.1
boy 13.1
emotion 12.9
sketch 12.9
confident 12.8
facial 12.5
happy 11.9
old 11.9
lifestyle 11.6
smile 11.4
look 11.4
sexy 11.3
creation 11.1
stare 10.7
businessman 10.6
dark 10
eye 9.8
cheerful 9.8
elderly 9.6
thinking 9.5
drawing 9.3
horizontal 9.2
brunette 8.7
shirt 8.5
one person 8.5
professional 8.5
pose 8.2
posing 8
cute 7.9
older 7.8
retirement 7.7
stress 7.7
mask 7.5
style 7.4
nose 7.4
alone 7.3
business 7.3
success 7.3
cool 7.1
happiness 7.1
mouth 7

Google
created on 2019-05-31

Face 99
Forehead 97.9
Chin 95.6
Cheek 95
Facial hair 94.8
Nose 93.8
Eyebrow 93.7
Head 92.3
Skin 91.4
Moustache 88.8
Jaw 87.6
Beard 80.9
Drawing 78.9
Illustration 78.4
Sketch 75.1
Portrait 74.6
Self-portrait 68.9
Wrinkle 66.7
Art 58.1

Microsoft
created on 2019-05-31

art 99.8
sketch 99.7
drawing 99.6
man 99.5
wearing 96
person 94.5
illustration 93.6
face 93.4
painting 93
human face 90.7
child art 88.3
bow 82.4
suit 79.4
portrait 73
posing 70.3
old 61.7
eyes 57.2
dressed 27.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 99.6%
Happy 22.7%
Disgusted 1.7%
Angry 1.3%
Calm 60.7%
Surprised 5.5%
Confused 6.9%
Sad 1.2%

Microsoft Cognitive Services

Age 65
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.5%

Captions

Microsoft

a man wearing a suit and tie 89.9%
a man wearing a suit and tie smiling at the camera 86.2%
a man wearing a bow tie 83.2%