Human Generated Data

Title

Saints Blaise, Catherine of Alexandria, and Lawrence
Date

14th century
People

Artist: Naddo Ceccarelli, Italian

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Adele L. and Arthur Lehman, 1965.96

Human Generated Data

Title

Saints Blaise, Catherine of Alexandria, and Lawrence

People

Artist: Naddo Ceccarelli, Italian

Date

14th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 99.4
Painting 99.4
Human 98.8
Person 98.8
Person 98.3
Person 96.7
Tile 93.4
Mosaic 93.4
Archaeology 58.2

Clarifai
created on 2018-03-16

painting 99.9
art 99.6
people 99.5
religion 99.5
aura 98.9
veil 98.4
monarch 98.1
Mary 97.6
gown (clothing) 97.5
saint 97.5
facial hair 96.7
print 96.4
god 96.1
royalty 96.1
crown 96
adult 96
wear 95.3
illustration 95.2
throne 95.2
Renaissance 94.2

Imagga
created on 2018-03-16

prayer rug 100
rug 100
floor cover 87.1
furnishing 84.3
covering 58.5
old 36.9
vintage 34.7
art 32.7
texture 31.3
ancient 30.3
antique 27.7
pattern 24.6
grunge 23
retro 22.1
decoration 21.8
paper 21.2
design 19.1
brown 18.4
aged 18.1
culture 18
textured 17.5
letter 17.4
postage 16.7
postal 16.7
stamp 16.5
religion 16.1
detail 16.1
surface 15.9
decorative 15.9
postmark 15.8
symbol 15.5
mail 15.3
post 15.3
color 14.5
material 14.3
wall 13.7
travel 13.4
traditional 13.3
architecture 13.3
gold 13.2
wallpaper 13
stamps 12.8
style 12.6
close 12.6
history 12.5
frame 12.5
parchment 12.5
temple 12.3
grungy 11.4
golden 11.2
blank 11.1
historic 11
dirty 10.8
museum 10.7
decor 10.6
worn 10.5
ornamental 10.4
ornament 10.3
religious 10.3
icon 10.3
rough 10
paint 10
painting 9.9
canceled 9.9
printed 9.8
renaissance 9.8
letters 9.7
office 9.6
used 9.6
empty 9.4
east 9.3
colorful 9.3
mosaic 9.3
book 9.3
document 9.3
church 9.3
global 9.1
tourism 9.1
border 9
container 9
wallet 8.9
envelope 8.9
sculpture 8.8
closeup 8.8
delivery 8.7
torn 8.7
cutting 8.7
artistic 8.7
holy 8.7
obsolete 8.6
communications 8.6
faith 8.6
weathered 8.5
unique 8.5
backdrop 8.2
ornate 8.2
metal 8
case 8
zigzag 7.9
fabric 7.9
shows 7.9
text 7.9
paintings 7.8
black 7.8
rust 7.7
rustic 7.7
craft 7.6
painted 7.6
rusty 7.6
oriental 7.6
page 7.4
collection 7.2

Google
created on 2018-03-16

art 93.2
ancient history 84.2
history 84.1
painting 81.4
religion 78.1
middle ages 72.4
temple 69.9
archdeacon 62.9
carving 60.3
tapestry 59
artifact 58.9
artwork 55.3
impressionist 54.3
prophet 51.3
visual arts 51.2
stock photography 50.8

Microsoft
created on 2018-03-16

old 82.5
painting 23.6
stone 13.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-57
Gender Male, 87.9%
Happy 2.6%
Confused 3.9%
Sad 19.1%
Angry 6.6%
Calm 65.7%
Disgusted 0.8%
Surprised 1.3%

AWS Rekognition

Age 19-36
Gender Male, 65.1%
Happy 3.4%
Disgusted 3.5%
Calm 48.3%
Sad 3.9%
Confused 7.1%
Angry 3.4%
Surprised 30.4%

AWS Rekognition

Age 20-38
Gender Female, 89.7%
Surprised 4.2%
Disgusted 4.2%
Confused 5.8%
Sad 25.8%
Angry 4.2%
Happy 7.6%
Calm 48.3%

Microsoft Cognitive Services

Age 77
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.4%
Person 98.8%

Captions

Microsoft

a painting of a person 83.4%
a painting of a person 76.6%
a painting on the wall 76.5%

Text analysis

Amazon

UXM