Human Generated Data

Title

Album Leaf of an Ancestral Portrait
Date

-
People

-
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.15

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.15

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Face 98.1
Human 98.1
Art 96.2
Person 93.1
Drawing 92.4
Painting 77.5
Head 77.1
Photo 67
Photography 67
Portrait 67
Sketch 61.5
Clothing 60.3
Apparel 60.3
Hat 60.3

Clarifai
created on 2019-05-31

people 99.5
art 99.5
man 98.9
adult 98.9
portrait 98.9
veil 98.8
one 98.8
painting 98.4
illustration 98.2
print 97.6
lid 96.9
wear 95.2
ancient 94.2
old 93.4
face 93.1
antique 91.9
facial hair 90.5
leader 89.9
vintage 86.9
mustache 84.7

Imagga
created on 2019-05-31

mug shot 44.6
photograph 36.5
face 35.5
hat 32.5
portrait 32.4
man 31.6
male 30.6
person 29.7
bust 27.8
sculpture 27.1
representation 26.6
head 24.4
handsome 24.1
attractive 23.8
people 21.8
eyes 20.7
beard 20.5
adult 20
cap 19.1
expression 18.8
model 18.7
smile 17.8
clothing 17.8
creation 17.5
hair 17.4
child 16.8
happy 16.3
plastic art 15.9
headdress 15.8
black 14.5
close 14.3
guy 13.7
sexy 13.7
human 13.5
serious 13.3
boy 13
one 11.2
looking 11.2
old 11.1
blond 11.1
closeup 10.8
facial 10.5
youth 10.2
smiling 10.1
fashion 9.8
look 9.6
men 9.4
cute 9.3
mature 9.3
professional 9.3
mortarboard 9.2
emotion 9.2
studio 9.1
art 8.9
skin 8.8
thinking 8.5
casual 8.5
pretty 8.4
eye 8
worker 8
bathing cap 7.7
ethnic 7.6
ruler 7.5
nice 7.3
kid 7.1
work 7.1
consumer goods 7.1
covering 7

Google
created on 2019-05-31

Face 96.6
Forehead 93.9
Head 89.8
Chin 89.5
Cheek 86.1
Portrait 84.5
Self-portrait 82.7
Painting 78.7
Watercolor paint 78.5
Illustration 74.9
Art 73.1
Headgear 67.5
Drawing 60.7
Gentleman 54.5
Wrinkle 50.7

Microsoft
created on 2019-05-31

art 99.5
drawing 99.4
sketch 98.7
hat 98.2
painting 96.8
wearing 94
human face 91
face 77.1
illustration 73.6
child art 70
portrait 64.2
person 58.3
old 52.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 93.6%
Sad 4.5%
Angry 11.7%
Calm 16.4%
Confused 53.3%
Disgusted 2.3%
Happy 1.5%
Surprised 10.4%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.1%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-05-31

a man wearing a hat 89.6%
a close up of a man wearing a hat 86.1%
a man wearing a hat posing for the camera 84.1%