Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.13

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.13

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Face 98.7
Human 98.7
Person 94.6
Art 87.3
Drawing 87.3
Apparel 64.8
Clothing 64.8
Head 62.2
Photo 59.8
Photography 59.8
Portrait 59.8
Painting 56.1

Clarifai
created on 2019-05-31

people 99.8
man 99.2
adult 99.1
portrait 98.8
veil 98.5
one 98
lid 97.7
person 96.3
facial expression 95.2
facial hair 94.8
face 94.7
print 93.5
art 93.2
wear 92.9
mustache 90.1
painting 88.8
leader 88.5
illustration 87.5
confidence 86.5
famous 85.1

Imagga
created on 2019-05-31

mug shot 90.7
photograph 72.3
representation 54.2
face 51.2
portrait 47.3
man 42.4
mask 40.3
male 38.3
creation 35.9
person 35.5
head 32.8
beard 32.3
covering 29.9
attractive 29.4
expression 28.2
adult 26.5
disguise 26.4
close 26.3
model 25.7
handsome 25
people 23.5
sexy 20.1
looking 20
black 19.9
hair 19.8
eyes 19.8
skin 18.3
casual 17.8
attire 17.5
one 17.2
serious 17.2
guy 16.9
look 15.8
human 15.8
happy 15.7
closeup 15.5
smiling 15.2
clothing 15.1
men 14.6
facial 14.6
smile 14.3
mature 13
fashion 12.8
confident 12.8
masculine 12.7
one person 12.3
cute 11.5
senior 11.3
eye 10.7
mustache 10.7
old 10.5
thinking 10.5
emotion 10.2
lifestyle 10.1
alone 10.1
dark 10
studio 9.9
style 9.7
boy 9.6
hat 9.5
bust 9.5
health 9
spa 9
sculpture 9
cool 8.9
complexion 8.8
body 8.8
brunette 8.7
elderly 8.6
posing 8
nose 8
head shoulders 7.8
happiness 7.8
muscles 7.8
thoughtful 7.8
stress 7.7
hand 7.6
horizontal 7.5
outdoors 7.5
camera 7.4
natural 7.4
friendly 7.3
sensual 7.3

Google
created on 2019-05-31

Face 98.4
Forehead 97.6
Cheek 94.4
Chin 93.9
Facial hair 92.2
Head 90.8
Eyebrow 89.9
Nose 88.7
Moustache 87.2
Illustration 84.1
Beard 80.1
Jaw 77.3
Portrait 75.7
Art 69.5
Painting 66.8
Drawing 66.1
Gentleman 65.1
Self-portrait 64.6
Acrylic paint 59.9
Watercolor paint 58.2

Microsoft
created on 2019-05-31

art 97.2
human face 96.2
drawing 96
sketch 92.9
hat 91
man 90.7
person 90.4
painting 88.9
wearing 79.1
face 76.2
portrait 72
forehead 63.6
old 50

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 98.7%
Happy 1.6%
Sad 4.8%
Surprised 2%
Confused 6.4%
Disgusted 1.3%
Calm 82.3%
Angry 1.8%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 94.6%

Categories

Imagga

paintings art 98%
people portraits 2%

Captions

Microsoft
created on 2019-05-31

a man wearing a hat 85.5%
a close up of a man wearing a hat 81.5%
a man wearing a hat posing for the camera 80.6%