Human Generated Data

Title

The Crucifixion, with figures of the Virgin, Saint Nicholas, Saint Michael and Saint George
Date

19th century
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mary Mills Thierry, 1976.1

Human Generated Data

Title

The Crucifixion, with figures of the Virgin, Saint Nicholas, Saint Michael and Saint George

People

Artist: Unidentified Artist,

Date

19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Altar 97.5
Architecture 97.5
Building 97.5
Church 97.5
Painting 94.4
Art 94.4
Indoors 88.4
Interior Design 88.4
Symbol 80
Cross 76.1
Person 74.5
Human 74.5
Crucifix 68
Person 59.2

Clarifai
created on 2018-03-23

painting 100
art 99.9
religion 99.6
church 99.5
saint 99.3
illustration 99
aura 98.7
Mary 97.3
fresco 96.7
god 96.6
Gothic 96.2
cross 96.1
chapel 95.9
people 94
old 93.9
Renaissance 92
spirituality 89.6
book 89.2
antique 88.7
holy 87.8

Imagga
created on 2018-03-23

prayer rug 100
rug 100
furnishing 78.6
floor cover 77.4
covering 53.3
religion 45.7
old 35.5
art 35.3
altar 33.4
church 29.6
ancient 29.4
religious 29
antique 27.7
architecture 26.6
culture 26.5
structure 24.6
vintage 24
temple 23.7
door 22.8
gold 20.6
decoration 20.3
texture 19.5
historic 19.3
design 18
history 17.9
east 17.7
detail 17.7
travel 17.6
building 16.7
pattern 16.4
god 16.3
wall 16.3
traditional 15.8
prayer 15.5
sculpture 15.3
post 15.3
oriental 15.1
historical 15.1
icon 15
postage 14.7
letter 14.7
golden 14.6
holy 14.5
cathedral 14.4
spirituality 14.4
mail 14.4
faith 14.4
wood 14.2
stamp 13.5
entrance 13.5
style 13.4
statue 13.3
interior 13.3
postmark 12.8
postal 12.8
pray 12.6
saint 12.5
famous 12.1
ornament 12.1
landmark 11.7
sacred 11.7
mosaic 11.5
symbol 11.4
grunge 11.1
carving 11
paint 10.9
masterpiece 10.9
close 10.8
tourism 10.7
museum 10.7
painted 10.5
aged 10
painting 9.9
renaissance 9.8
painter 9.8
catholic 9.7
gate 9.7
wooden 9.7
worship 9.7
spiritual 9.6
brown 9.6
color 9.5
monument 9.3
retro 9
stamps 8.9
bangkok 8.9
metal 8.9
doorway 8.9
bible 8.8
binding 8.8
delivery 8.8
artistic 8.7
obsolete 8.6
colorful 8.6
frame 8.3
peace 8.2
decor 8
shows 7.9
printed 7.9
orthodox 7.8
orient 7.8
paintings 7.8
face 7.8
envelope 7.8
belief 7.8
eastern 7.8
artist 7.7
middle 7.7
fine 7.6
city 7.5
tourist 7.3
office 7.2
dirty 7.2

Google
created on 2018-03-23

religious item 82.8
history 73.8
art 72.5
middle ages 70.9
crucifix 62.1
artifact 61.6
antique 61.2
ancient history 53.5

Microsoft
created on 2018-03-23

text 90.4
old 66.4
posing 51.2
store 38
colorful 27

Face analysis

Amazon

Google

AWS Rekognition

Age 38-59
Gender Female, 51.3%
Calm 49.2%
Disgusted 45.1%
Angry 46%
Happy 45.3%
Confused 45.4%
Sad 48.2%
Surprised 45.8%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Disgusted 49.5%
Surprised 49.6%
Sad 49.6%
Calm 50.1%
Angry 49.6%
Happy 49.6%
Confused 49.5%

AWS Rekognition

Age 48-68
Gender Male, 54.9%
Sad 45.6%
Surprised 45.1%
Calm 53.9%
Happy 45.1%
Angry 45.2%
Disgusted 45%
Confused 45.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 94.4%
Person 74.5%

Captions

Microsoft

a graffiti covered wall 68.2%
graffiti on a wall 63.2%
a person posing for a photo in front of a graffiti covered wall 53.6%

Text analysis

Amazon

xp
Cbllonel
To
swy
swy Oy UC xp arol. Cbllonel
UC
Oy
arol.
La.l

Google

氷 Tn
氷
Tn