Human Generated Data

Title

Martyrdom of Saint Lawrence

Date

1389

People

Artist: Mariotto di Nardo, Italian c. 1380 - 1425

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Tucker Murray, 1938.79

Human Generated Data

Title

Martyrdom of Saint Lawrence

People

Artist: Mariotto di Nardo, Italian c. 1380 - 1425

Date

1389

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.5
Human 99.5
Painting 98.7
Art 98.7
Person 91.9
Person 86.6
Mural 59.5

Clarifai
created on 2018-03-16

art 99.6
painting 99.4
people 97.9
religion 97.9
saint 97
god 95.4
indoors 94.2
adult 93.7
Renaissance 93.2
woman 92.8
church 92.3
one 90.8
interior 90.6
aura 89.6
reclining 89.4
nude 88.7
sculpture 86
religious 84.2
travel 84
man 83.9

Imagga
created on 2018-03-16

temple 85.1
sculpture 65.8
throne 62.2
religion 54.7
chair of state 49.8
statue 43.7
carving 40
art 37.5
culture 36.8
chair 35.7
religious 32.8
gold 30.4
god 28.7
architecture 28.5
travel 28.2
ancient 27.7
worship 27.1
spiritual 26.9
east 25.2
seat 25
spirituality 23
oriental 21.7
old 21.6
sacred 21.4
pray 21.3
golden 20.6
tourism 20.6
palace 20.6
history 20.6
church 18.5
plastic art 18.4
faith 18.2
face 17.8
historic 17.4
monument 16.8
famous 16.8
prayer 16.4
holy 16.4
traditional 15.8
bangkok 15.7
antique 14.9
meditation 13.4
decoration 13.2
furniture 12.9
detail 12.9
figure 12.9
belief 12.7
stone 12.7
historical 12.2
tourist 12.2
tradition 12
style 11.9
shrine 11.7
landmark 11.7
grand 11.6
building 11.6
symbol 11.5
color 11.1
colorful 10.8
china 10.3
peace 10.1
giant 9.8
door 9.6
design 9.1
monastery 8.8
carved 8.8
ornament 8.6
holiday 8.6
decorative 8.4
ornate 8.2
world 8.1
heritage 7.7
serene 7.5
calm 7.3

Google
created on 2018-03-16

Face analysis

Amazon

Google

AWS Rekognition

Age 26-44
Gender Male, 51.9%
Happy 45%
Confused 45%
Angry 45.1%
Disgusted 45%
Sad 45.1%
Calm 54.6%
Surprised 45%

AWS Rekognition

Age 26-43
Gender Female, 84.1%
Confused 3.5%
Surprised 9.6%
Angry 12%
Sad 67.7%
Happy 0.9%
Calm 4.3%
Disgusted 1.9%

AWS Rekognition

Age 35-52
Gender Male, 78.8%
Angry 2.9%
Happy 0.2%
Calm 90.2%
Surprised 0.6%
Confused 0.4%
Disgusted 0.3%
Sad 5.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 98.7%

Captions

Microsoft

a dog sitting in front of a building 62.2%
a dog that is standing in front of a building 62.1%
a dog is sitting in front of a building 62%