Human Generated Data

Title

Portrait of One of the Thirty-Six Immortal Poets (Sanjurokkasen)
Date

Late Edo period, 19th century
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Dr. Denman W. Ross, 1930.26

Human Generated Data

Title

Portrait of One of the Thirty-Six Immortal Poets (Sanjurokkasen)

People
Date

Late Edo period, 19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-07-07

Art 97.5
Painting 88.4
Person 82
Human 82

Clarifai
created on 2019-07-07

people 99.1
wear 99
adult 98.9
painting 98.9
one 98.8
art 97.6
man 96.8
veil 96.5
portrait 95.7
illustration 94.4
facial expression 93.5
lid 92.5
print 92.1
side view 91.3
leader 85.6
gown (clothing) 84.9
woman 84
retro 82.5
vintage 80.5
outerwear 78.4

Imagga
created on 2019-07-07

ruler 31.6
portrait 29.8
person 24.7
hat 24.6
adult 24.6
face 23.4
clothing 22.3
sweatshirt 19.9
covering 18.5
people 18.4
attractive 18.2
religion 17.9
cowboy hat 17.6
male 17.5
man 17.5
fashion 16.6
happy 16.3
pullover 15.9
model 15.6
cloak 15
expression 14.5
headdress 14.5
smile 14.3
pretty 14
smiling 13.7
culture 13.7
garment 13.5
eyes 12.9
sexy 12.9
sweater 12.8
black 12.6
ethnic 12.4
make 11.8
handsome 11.6
hand 11.4
lady 11.4
monk 11.3
human 11.2
hair 11.1
worship 10.6
spiritual 10.6
casual 10.2
old 9.8
youth 9.4
religious 9.4
church 9.2
traditional 9.1
gold 9
style 8.9
look 8.8
hands 8.7
lifestyle 8.7
happiness 8.6
cute 8.6
joy 8.4
book 8.2
pose 8.2
blond 8.1
yellow 7.9
women 7.9
temple 7.7
relaxed 7.5
lips 7.4
retro 7.4
natural 7.4
relaxing 7.3
looking 7.2

Google
created on 2019-07-07

Art 77.7
Painting 77.1
Fictional character 58.6
Cardinal 50.7
Illustration 50.4

Microsoft
created on 2019-07-07

drawing 99.7
sketch 99.3
painting 99.2
child art 96.3
human face 94.4
art 94.2
cartoon 90.9
person 73.9
illustration 62.7
woman 62.3

Face analysis

Amazon

Google

AWS Rekognition

Age 45-63
Gender Female, 87.5%
Calm 42.2%
Angry 7.1%
Surprised 5.5%
Confused 17.1%
Happy 8.9%
Sad 16.4%
Disgusted 2.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 88.4%
Person 82%

Captions

Microsoft

a person wearing a red hat 35.2%
a person wearing a costume 35.1%
a person wearing a red shirt 27.4%