Human Generated Data

Title

The Mystic Marriage of Saint Catherine of Alexandria
Date

c. 1500
People

Artist: Bernardino di Mariotto, Italian 1478 - 1566
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edward W. Forbes, 1917.205

Human Generated Data

Title

The Mystic Marriage of Saint Catherine of Alexandria

People

Artist: Bernardino di Mariotto, Italian 1478 - 1566

Date

c. 1500

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Painting 99.5
Art 99.5
Human 94.6
Person 94.6
Person 92.3
Person 83.3
Architecture 66.6
Building 66.6
Archangel 63.3
Angel 63.3
Archaeology 58.6

Clarifai
created on 2020-04-23

art 99.7
Mary 99.7
saint 99.7
religion 99.7
painting 99.5
people 99.5
aura 99.4
god 99.2
woman 99.1
veil 99
gown (clothing) 98.3
Renaissance 98.2
baby 98.1
illustration 97.4
church 96.7
kneeling 96.1
group 96
adult 95.9
book 95.8
man 95.4

Imagga
created on 2020-04-23

comic book 76.7
art 45.1
religion 39.5
church 38
book jacket 32
print media 30.7
sculpture 27.7
religious 26.3
jacket 25.1
culture 23.9
saint 22.1
holy 21.2
altar 21
faith 19.2
god 19.1
icon 19
wrapping 18.9
old 18.8
carving 18.5
spirituality 18.3
vintage 18.2
ancient 18.2
postmark 17.7
painter 17.5
letter 17.4
stamp 17.4
mail 17.2
museum 16.9
postage 16.7
postal 16.7
bible 16.7
prayer 16.4
temple 16.2
painted 16.2
masterpiece 15.8
one 15.7
envelope 15.6
historic 15.6
catholic 15.6
worship 15.5
architecture 14.8
symbol 14.8
printed 14.8
renaissance 14.7
structure 14.7
golden 14.6
pray 14.6
post 14.3
history 14.3
covering 14.2
shows 13.8
antique 13.8
paintings 13.7
fine 13.4
unique 13.3
historical 13.2
detail 12.9
post mail 12.9
zigzag 12.9
fame 12.8
known 12.8
travel 12.7
sacred 12.7
delivery 12.6
cutting 12.6
artist 12.5
communications 12.5
face 12.1
global 11.9
stamps 11.8
statue 11.8
spiritual 11.5
gold 11.5
colorful 11.5
decoration 11.4
famous 11.2
landmark 10.8
belief 10.7
cathedral 10.7
window 10.6
office 10.5
close 10.3
black 10.2
closeup 10.1
mosaic 10
letters 9.7
plastic art 9.6
stained 9.6
glass 9.3
design 9.2
tourism 9.1
paint 9.1
stained glass 8.9
interior 8.9
man 8.7
rich 8.4
circa 7.9
artistic 7.8
color 7.8
money 7.7
figure 7.5
monument 7.5
building 7.3
palace 7.2
currency 7.2
portrait 7.1

Google
created on 2020-04-23

Painting 93
Art 88.6
History 66.1
Prophet 65.4
Visual arts 59.3
Middle ages 57.3

Microsoft
created on 2020-04-23

painting 99.5
text 98.2
art 90.8
person 90.5
human face 81.7
clothing 80
woman 74.4
drawing 69.8
museum 69.6
old 61.8
mythology 51.6
picture frame 51.2
posing 36.1

Face analysis

Amazon

AWS Rekognition

Age 28-44
Gender Female, 54.5%
Happy 45.4%
Angry 46.2%
Surprised 45.1%
Calm 51%
Confused 45.1%
Fear 45.3%
Disgusted 45.2%
Sad 46.7%

AWS Rekognition

Age 7-17
Gender Female, 54.5%
Disgusted 45%
Happy 45%
Fear 45%
Calm 55%
Confused 45%
Angry 45%
Sad 45%
Surprised 45%

AWS Rekognition

Age 22-34
Gender Female, 95.8%
Surprised 0.6%
Calm 41.2%
Angry 1.6%
Disgusted 1.6%
Sad 51.9%
Happy 0.8%
Fear 0.8%
Confused 1.6%

Feature analysis

Amazon

Painting 99.5%
Person 94.6%

Captions

Microsoft

a group of people posing for a photo 61.8%
a group of people posing for the camera 61.7%
an old photo of a group of people posing for the camera 57.4%