Human Generated Data

Title

Album Leaf of an Ancestral Portrait

Date

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.893.27

Human Generated Data

Title

Album Leaf of an Ancestral Portrait

People
Date

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Human 97.2
Face 93.3
Person 88.8
Art 88.8
Head 86.5
Drawing 84.7
Photography 61.3
Portrait 61.3
Photo 61.3
Outdoors 58.3
Painting 57.4
Military Uniform 56.7
Military 56.7
Leisure Activities 55.8

Clarifai
created on 2019-05-31

people 99.1
one 98.6
art 97.8
adult 97.4
portrait 96.6
illustration 96
man 95.7
painting 94.8
woman 94.2
veil 93.4
wear 92.9
print 88.7
lid 88.6
face 85.1
no person 80.9
artistic 80.7
facial expression 80.6
ancient 79.6
leader 78.1
retro 77

Imagga
created on 2019-05-31

mug shot 75.9
photograph 58.9
representation 45.2
spectacles 42
face 41.2
portrait 32.4
optical instrument 31
person 30.2
creation 29.8
head 28.6
man 27.6
sculpture 26.7
model 26.4
bust 26.3
eyes 25.8
male 25.5
attractive 21
people 20.6
hair 20.6
hat 20.4
expression 19.6
handsome 19.6
instrument 19.4
smile 19.2
adult 18.1
black 17.4
sexy 16.1
close 15.4
fashion 15.1
plastic art 14.8
looking 14.4
serious 14.3
boy 13.9
happy 13.8
guy 13.8
human 13.5
skin 13.3
art 13
emotion 12
pretty 11.9
cute 11.5
cap 11.3
child 11.2
youth 11.1
casual 11
facial 10.5
device 10.4
dark 10
blond 9.9
old 9.8
one 9.7
thinking 9.5
health 9
beard 8.9
closeup 8.8
smiling 8.7
stress 8.6
men 8.6
studio 8.4
style 8.2
figure 8.1
stylish 8.1
eye 8
posing 8
kid 8
look 7.9
mouth 7.5
clothing 7.4
girls 7.3
pose 7.2
lovely 7.1

Google
created on 2019-05-31

Face 95.4
Forehead 94.4
Head 89.5
Chin 88.9
Illustration 76.4
Headgear 71.1
Art 65.5
Portrait 65.1
Painting 59.3
Self-portrait 52.8

Microsoft
created on 2019-05-31

drawing 99.3
sketch 98.7
art 98.1
human face 96.6
painting 95.7
wearing 91.1
person 87.3
hat 86.5
child art 80.2
old 80
face 74.4
illustration 65.5
portrait 64.8
bow 56.7
posing 50.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 97.3%
Disgusted 4.2%
Calm 31.8%
Confused 35.6%
Sad 6.9%
Surprised 9.2%
Angry 9.5%
Happy 2.8%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 88.8%

Captions

Microsoft

a person wearing a hat 84.2%
an old photo of a person wearing a hat 80.7%
a person wearing a hat posing for a photo 78.7%