Human Generated Data

Title

The Mystic Marriage of Saint Catherine of Alexandria with Three Female Saints: Ursula, Margaret of Antioch, and an Unidentified Martyr

Date

c. 1520

People

Artist: Adriaen Isenbrant, Netherlandish c.1480/90 - 1551

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Nettie G. Naumburg, 1930.197

Human Generated Data

Title

The Mystic Marriage of Saint Catherine of Alexandria with Three Female Saints: Ursula, Margaret of Antioch, and an Unidentified Martyr

People

Artist: Adriaen Isenbrant, Netherlandish c.1480/90 - 1551

Date

c. 1520

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Nettie G. Naumburg, 1930.197

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 99.7
Painting 99.7
Human 98.6
Person 98.6
Person 98.2
Person 98.1
Person 96.9
Person 83.1
Musical Instrument 55.8
Lute 55.8

Clarifai
created on 2018-03-16

people 99.9
religion 99.7
adult 99.4
group 99.3
woman 98.8
painting 97.6
wear 96.3
man 95.4
furniture 95
room 93.1
seat 92.6
child 91.5
royalty 91.1
gown (clothing) 90.9
veil 90.1
art 89
Mary 88.2
position 87.7
son 87.6
book series 87.2

Imagga
created on 2018-03-16

throne 72.3
chair of state 57.9
chair 53.1
seat 28.7
sitting 26.6
people 25.6
man 24.9
interior 24.7
adult 23.4
fashion 23.4
room 22.9
couple 22.6
person 22.1
home 21.5
furniture 21.1
portrait 20.7
lifestyle 20.2
male 20.1
attractive 19.6
indoors 18.4
indoor 18.2
sofa 18.2
happy 18.2
together 17.5
lady 17
love 16.6
couch 16.4
women 15.8
elegant 15.4
family 15.1
style 14.8
mother 14.8
model 14.8
luxury 14.6
dress 14.4
sexy 13.6
happiness 13.3
pretty 13.3
smiling 13
cute 12.9
stylish 12.6
holding 12.4
fun 12
cabaret 11.9
posing 11.5
smile 11.4
togetherness 11.3
table 11.2
casual 11
leisure 10.8
human 10.5
living 10.4
expression 10.2
elegance 10.1
house 10
vintage 9.9
husband 9.7
child 9.4
two 9.3
spot 9.2
teenager 9.1
sensual 9.1
cheerful 8.9
father 8.8
hair 8.7
boy 8.7
loving 8.6
face 8.5
sit 8.5
inside 8.3
one 8.2
retro 8.2
make 8.2
group 8.1
romantic 8
full length 7.8
golden 7.7
modern 7.7
jeans 7.6
wife 7.6
passion 7.5
joy 7.5
emotion 7.4
sensuality 7.3
decoration 7.2
color 7.2
looking 7.2
blond 7.2
holiday 7.2
romance 7.1
place of business 7.1

Google
created on 2018-03-16

painting 85.8
religion 75.8
art 70
artwork 54.9
middle ages 53
girl 52.7

Microsoft
created on 2018-03-16

person 96.7
people 57
crowd 0.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 56.3%
Confused 3%
Sad 70.9%
Surprised 1.2%
Calm 18%
Happy 0.7%
Disgusted 1.5%
Angry 4.7%

AWS Rekognition

Age 26-43
Gender Female, 99.7%
Disgusted 0.4%
Surprised 2.4%
Angry 4.7%
Sad 54.3%
Confused 5.7%
Happy 0.6%
Calm 31.8%

AWS Rekognition

Age 29-45
Gender Female, 99.2%
Surprised 0.8%
Happy 0.6%
Angry 3.3%
Sad 87.3%
Calm 4.9%
Confused 2.3%
Disgusted 0.8%

AWS Rekognition

Age 26-43
Gender Female, 97.8%
Angry 1.3%
Surprised 0.2%
Happy 0.2%
Sad 67.1%
Calm 30.2%
Disgusted 0.2%
Confused 0.9%

AWS Rekognition

Age 26-43
Gender Female, 64.4%
Disgusted 12%
Surprised 6.3%
Happy 4.9%
Confused 14.5%
Calm 20.6%
Sad 26.5%
Angry 15.2%

AWS Rekognition

Age 35-52
Gender Male, 65.5%
Calm 17.7%
Sad 73.5%
Confused 1.5%
Happy 0.2%
Disgusted 0.9%
Angry 5.4%
Surprised 0.7%

Microsoft Cognitive Services

Age 4
Gender Female

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.7%
Person 98.6%

Categories

Imagga

events parties 95.6%
people portraits 4.3%