Human Generated Data

Title

Saint Jerome in the Desert with Saints John the Baptist and Ansanus
Date

c. 1455
People

Artist: Filippo Lippi, Italian c. 1406 - 1469

Previous attribution: Fra Diamante, Italian 1430 - 1498
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes to honor the memory of Richard Norton, 1963.111

Human Generated Data

Title

Saint Jerome in the Desert with Saints John the Baptist and Ansanus

People

Artist: Filippo Lippi, Italian c. 1406 - 1469

Previous attribution: Fra Diamante, Italian 1430 - 1498

Date

c. 1455

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.5
Human 99.5
Person 99.5
Painting 99.4
Art 99.4
Person 88.3
Angel 75.4
Archangel 75.4

Clarifai
created on 2018-03-16

art 100
saint 99.9
religion 99.8
god 99.6
book 99.5
virgin 99.4
holy 99.2
Mary 99.1
church 98.9
aura 98.8
Renaissance 98.3
painting 97.8
religious 97.4
miracle 97
Apostle 97
baroque 96.7
Gospel 96.1
baby 95.6
sculpture 95.5
interior 95.5

Imagga
created on 2018-03-16

religion 57.4
architecture 45.8
church 45.4
temple 44
gold 42
culture 40.2
pyramid 38.4
statue 35.3
art 35.2
old 32.1
ancient 32
travel 31
famous 30.7
building 29.9
sculpture 29.3
religious 29.1
ruler 28.1
cathedral 26.9
god 26.8
tourism 24.8
monument 24.3
worship 24.2
golden 24.1
saint 24.1
history 23.3
dome 23.2
faith 23
landmark 22.6
st 21.3
east 20.6
prayer 20.3
holy 20.2
historic 20.2
spiritual 20.2
antique 19.3
spirituality 19.2
sky 19.1
square 19
orthodox 18.6
pray 18.4
cross 17.9
palace 17.8
sacred 17.5
traditional 17.5
tourist 17.2
city 17.1
decoration 15.9
detail 15.3
mosaic 14.7
historical 14.1
place 14
basil 13.6
symbol 13.5
brick 13.2
basil s 12.9
bangkok 12.8
structure 12.5
design 12.4
stone 11.8
oriental 11.7
museum 11.6
shrine 11.6
meditation 11.5
face 11.4
ornament 11.2
color 11.1
exterior 11.1
colorful 10.8
belief 10.7
construction 10.3
ornate 10.1
peace 10.1
roof 9.6
capital 9.5
wall 9.4
tradition 9.2
window 9.2
calm 9.2
tower 9
crucifix 8.9
basilica 8.9
grand 8.7
icon 8.7
destinations 8.7
style 8.2
domes 7.9
transducer 7.9
praying 7.8
scene 7.8
cloud 7.8
architectural 7.7
decorative 7.5
vacation 7.4
monastery 7.4
light 7.4
peaceful 7.3
altar 7.3

Google
created on 2018-03-16

tapestry 81.7
art 79.5
religion 67.3
middle ages 56.7
stock photography 50.5
miniature 50

Microsoft
created on 2018-03-16

text 96.5
different 34.8
several 10.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 99.3%
Angry 0.3%
Sad 1.6%
Calm 97.4%
Confused 0.4%
Surprised 0.2%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 57-77
Gender Female, 91.2%
Angry 1.2%
Calm 88.7%
Happy 1.4%
Disgusted 0.7%
Surprised 2%
Sad 1.9%
Confused 4.1%

AWS Rekognition

Age 20-38
Gender Female, 92.1%
Angry 1%
Disgusted 0.2%
Happy 0.1%
Sad 96.5%
Calm 1.3%
Confused 0.6%
Surprised 0.3%

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 99.4%

Captions

Microsoft

a group of stuffed animals 36.4%
a group of stuffed animals on a bed 18.7%
a group of stuffed animals sitting on top of a bed 15.4%