Human Generated Data

Title

Saint Catherine of Siena
Date

c. 1462
People

Artist: Giovanni di Paolo, Italian c. 1398/99 - 1482
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sir Joseph Duveen, 1921.13

Human Generated Data

Title

Saint Catherine of Siena

People

Artist: Giovanni di Paolo, Italian c. 1398/99 - 1482

Date

c. 1462

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Painting 98.7
Art 98.7
Person 90.9
Human 90.9

Clarifai
created on 2020-04-24

painting 99.7
art 99.6
religion 99.2
saint 98.2
god 97.8
holy 96.8
book 95.8
Mary 95.4
illustration 94.9
sacred 94.8
aura 94.8
virgin 94.3
spirituality 94
veil 94
people 93.7
church 93.6
Renaissance 93
woman 92.7
prayer 92.1
cross 91

Imagga
created on 2020-04-24

covering 32.8
religion 32.2
cloak 30.3
vestment 26.3
church 25.9
gown 21.8
costume 20.6
art 20.4
religious 18.7
clothing 18.6
dress 18.1
person 17.7
statue 17.6
old 17.4
fashion 17.3
face 17
portrait 16.8
holy 16.4
faith 16.3
outerwear 15.9
sculpture 15.1
temple 14.5
god 14.3
architecture 14.1
catholic 14
lady 13.8
golden 13.7
culture 13.7
spirituality 13.4
people 13.4
traditional 13.3
man 12.8
prayer 12.5
saint 12.5
vintage 12.4
antique 12.1
black 12
bible 11.7
worship 11.6
gold 11.5
colorful 11.5
attractive 11.2
style 11.1
wall 11.1
tourism 10.7
sacred 10.7
adult 10.7
pray 10.7
interior 10.6
stringed instrument 10.3
figure 10.1
detail 9.6
sexy 9.6
mystery 9.6
spiritual 9.6
ancient 9.5
historical 9.4
monument 9.3
building 9.2
fantasy 9
cathedral 8.9
icon 8.7
eyes 8.6
elegant 8.6
model 8.5
dark 8.3
historic 8.2
ornate 8.2
mask 8
decoration 8
male 7.8
carnival 7.8
mysterious 7.8
pretty 7.7
consumer goods 7.6
mosaic 7.5
famous 7.4
performer 7.4
lips 7.4
musical instrument 7.3
make 7.3
color 7.2
history 7.1
lovely 7.1
posing 7.1
travel 7

Google
created on 2020-04-24

Painting 90.5
Art 78.9
Prophet 67.2
Visual arts 55

Microsoft
created on 2020-04-24

painting 99.7
drawing 97.8
cartoon 83.6
sketch 76.2
child art 55.4
art 50.4
stone 11.9

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-35
Gender Female, 94.6%
Fear 0.1%
Happy 0.3%
Angry 0.3%
Surprised 0.2%
Disgusted 0.1%
Sad 3.3%
Calm 95.2%
Confused 0.4%

AWS Rekognition

Age 22-34
Gender Male, 69.1%
Surprised 0.5%
Confused 3.3%
Angry 25.2%
Fear 0.7%
Calm 8.7%
Disgusted 44.5%
Sad 16.9%
Happy 0.2%

AWS Rekognition

Age 22-34
Gender Male, 60.7%
Calm 4.6%
Disgusted 3%
Angry 17.1%
Fear 2.4%
Confused 1.6%
Happy 0.2%
Surprised 0.5%
Sad 70.6%

Microsoft Cognitive Services

Age 24
Gender Female

Feature analysis

Amazon

Painting 98.7%
Person 90.9%

Captions

Microsoft

a person wearing a costume 59.9%
a person wearing a costume 59.8%
a close up of a stuffed animal 27%