Human Generated Data

Title

Saint Jerome in His Study
Date

1521
People

Artist: Joos van Cleve, Netherlandish c. 1485/1490 - 1540-1541

Previous attribution: Quentin Metsys, Netherlandish c. 1460 - 1530
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Howland Warren, Dr. Richard P. Warren, and Mrs. Grayson M.P. Murphy, 1961.26

Human Generated Data

Title

Saint Jerome in His Study

People

Artist: Joos van Cleve, Netherlandish c. 1485/1490 - 1540-1541

Previous attribution: Quentin Metsys, Netherlandish c. 1460 - 1530

Date

1521

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 97.6
Person 97.6
Art 96.5
Painting 96.5
Face 94.2
Beard 73.5
Church 67.2
Building 67.2
Altar 67.2
Architecture 67.2

Clarifai
created on 2018-03-16

people 99.5
religion 99.1
lid 97.9
one 97.6
adult 97.4
furniture 97
painting 96.9
Christmas 96.8
saint 96.6
room 96.3
candle 95.5
seat 95.4
art 95.1
man 93.2
gown (clothing) 91.3
two 91
indoors 91
church 90
facial hair 89
veil 88.8

Imagga
created on 2018-03-16

metropolitan 69
religion 47.5
throne 35.3
church 32.4
religious 31.9
chair of state 28.2
temple 27.2
old 27.2
sculpture 27
god 26.8
antique 25.3
art 24.8
culture 24.8
ancient 23.3
prayer 23.2
chair 23.1
historic 22.9
statue 22.8
architecture 21.9
gold 21.4
building 21.2
spiritual 21.1
faith 21
holy 20.2
pray 19.4
worship 19.3
spirituality 18.2
history 17.9
historical 17.9
golden 17.2
travel 16.9
sacred 16.6
altar 16.5
monument 15.9
east 15.9
seat 15.8
tourism 15.7
landmark 15.3
cathedral 14.5
traditional 14.1
tobacco shop 13.9
peace 13.7
interior 13.3
face 12.8
meditation 12.5
decoration 12.3
oriental 12.3
belief 11.7
color 11.7
city 11.6
saint 11.5
detail 11.3
famous 11.2
shop 11.2
icon 11.1
stone 11
colorful 10.8
structure 10.4
style 10.4
scene 10.4
furniture 10.3
tourist 10.1
window 10.1
catholic 10.1
gong 10
bible 9.8
door 9.5
china 9.4
tradition 9.2
percussion instrument 9.1
vintage 9.1
vestment 9
mercantile establishment 8.8
praying 8.8
luxury 8.6
musical instrument 8.5
gown 8.1
light 8
portrait 7.8
carving 7.6
serene 7.5
monastery 7.5

Google
created on 2018-03-16

art 73.8
facial hair 72
window 65.1
painting 60.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-69
Gender Male, 75.7%
Sad 6.1%
Disgusted 6.9%
Surprised 18.9%
Confused 26.8%
Angry 28.7%
Happy 5.8%
Calm 6.8%

Microsoft Cognitive Services

Age 54
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Painting 96.5%
Altar 67.2%

Captions

Microsoft

a person sitting in front of a building 55.1%
a person standing in front of a building 55%
a person sitting in front of a building with a stuffed animal 32.7%

Text analysis

Amazon

RESPICE
RESPICE FINEM
FINEM
BVLA