Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.26

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 99.2
Face 98.8
Art 98.2
Drawing 98.2
Head 98.2
Person 94.1
Sketch 93.2
Photography 76.7
Portrait 76.7
Photo 76.7

Clarifai
created on 2019-05-31

old 97.5
people 97.2
one 96.3
art 95.9
man 95.8
portrait 95.3
illustration 94.3
adult 92.7
face 90.6
veil 88.8
painting 88.7
print 87
wear 86.1
elderly 83.7
person 83
lid 82.1
artistic 81.6
vintage 81.5
desktop 81.3
ancient 81.2

Imagga
created on 2019-05-31

face 34.8
sketch 33.6
portrait 30.4
representation 28.2
drawing 24.4
person 24.2
head 22.7
eyes 21.5
close 21.1
hair 20.6
man 18.8
expression 18.8
people 17.9
smile 17.8
currency 17.1
money 17
bust 16.4
male 16.3
skin 16
sculpture 15.8
cash 15.6
closeup 15.5
bill 15.2
facial 15
bank 14.8
one 14.2
dollar 13.9
banking 13.8
adult 13.6
attractive 13.3
old 13.2
model 13.2
child 13
happy 12.5
finance 11.8
hat 11.7
studio 11.4
business 10.9
smiling 10.9
mug shot 10.8
financial 10.7
senior 10.3
cute 10
human 9.8
art 9.7
boy 9.6
mature 9.3
plastic art 9.3
care 9.1
fashion 9
lady 8.9
paper 8.9
looking 8.8
clothing 8.8
banknote 8.7
brunette 8.7
lifestyle 8.7
elderly 8.6
casual 8.5
photograph 8.4
blond 8.3
healthy 8.2
beard 8.2
wealth 8.1
mask 8.1
spa 8.1
sexy 8
handsome 8
dollars 7.7
pay 7.7
health 7.6
thinking 7.6
rich 7.4
purity 7.4
emotion 7.4
nose 7.3
cheerful 7.3
body 7.2
look 7

Google
created on 2019-05-31

Face 98.9
Forehead 96.5
Chin 95.4
Cheek 95.1
Nose 94.7
Head 92.8
Skin 91.4
Facial hair 89.2
Illustration 89.1
Moustache 87.3
Wrinkle 86.6
Eyebrow 86.4
Jaw 83.9
Drawing 83.1
Sketch 83.1
Portrait 77.2
Self-portrait 76.1
Line 75.5
Watercolor paint 74.3
Mouth 71.5

Microsoft
created on 2019-05-31

sketch 98.4
drawing 98
human face 95
art 94
face 83.1
illustration 76.7
person 65.4
portrait 63.4
forehead 51.7

Face analysis

Amazon

AWS Rekognition

Age 60-90
Gender Male, 94%
Happy 1.1%
Disgusted 1.2%
Angry 75.5%
Calm 7.5%
Sad 4.2%
Confused 3.9%
Surprised 6.7%

Feature analysis

Amazon

Person 94.1%

Captions

Microsoft

a close up of a hat 30.9%