Human Generated Data

Title

The Virgin and Child with Angels

Date

c. 1475

People

Artist: Benvenuto di Giovanni, Italian 1436 - c. 1518

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Felix M. Warburg in commemoration of the 70th anniversary of Mr. Felix M. Warburg's birth, 1941.132

Human Generated Data

Title

The Virgin and Child with Angels

People

Artist: Benvenuto di Giovanni, Italian 1436 - c. 1518

Date

c. 1475

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 97.5
Painting 97.5
Person 97.3
Human 97.3
Building 95.7
Architecture 95.7
Person 87.5
Person 82.9
Church 79.8
Altar 68.1
Person 56.3
Angel 55.2
Archangel 55.2

Clarifai
created on 2020-04-24

painting 99.6
people 99.1
religion 98.7
art 98.5
Mary 98.1
church 97.3
woman 97.3
no person 97
saint 96.6
adult 93.3
veil 93.3
Madonna 93.2
baby 93.1
god 92.6
man 92.2
aura 90.5
Renaissance 90.3
nude 88
chapel 87.9
group 87

Imagga
created on 2020-04-24

harp 100
architecture 57
church 49.1
support 48.3
building 43.1
cathedral 42.7
religion 40.4
device 36.1
landmark 34.3
city 33.4
monument 31.8
historic 31.2
history 30.4
altar 29.4
sculpture 29.1
tourism 28.9
old 28.6
historical 28.3
travel 27.5
stringed instrument 27
famous 27
religious 25.3
catholic 25.3
structure 25.1
art 23.6
tourist 22.7
statue 22.2
ancient 21.6
musical instrument 20.4
culture 19.7
holy 19.3
gold 18.9
palace 18.3
god 18.2
stone 17.7
arch 17.4
door 17.1
worship 16.5
column 16.4
carving 16.1
entrance 15.5
medieval 15.4
faith 15.3
temple 15.2
tower 14.3
facade 13.9
catholicism 13.8
pray 13.6
golden 12.9
detail 12.9
marble 12.6
saint 12.5
spirituality 12.5
attraction 12.4
roman 11.9
window 11.7
grand 11.7
prayer 11.6
urban 11.4
house 10.8
sacred 10.7
sightseeing 10.7
interior 10.6
basilica 9.8
chapel 9.8
dome 9.7
spiritual 9.6
cross 9.4
destination 9.4
baroque 8.8
st 8.7
decoration 8.7
architectural 8.7
throne 8.6
colorful 8.6
east 8.4
place 8.4
sky 8.3
memorial 8.3
inside 8.3
symbol 8.1
light 8
statues 7.9
antique 7.8
ornament 7.8
heritage 7.7
majestic 7.7
decorated 7.7
buildings 7.6
traditional 7.5
exterior 7.4
vacation 7.4
ornate 7.3
night 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

human face 92.6
person 88.2
drawing 87.6
art 84.3
text 83.2
museum 78.4
clothing 75.6
picture frame 68
baby 51.8
arch 34
altar 30.1
painting 22.2

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 22-34
Gender Female, 85.4%
Angry 4.3%
Happy 0.3%
Disgusted 2.2%
Surprised 0.4%
Fear 0.7%
Sad 82.8%
Confused 5.9%
Calm 3.4%

AWS Rekognition

Age 5-15
Gender Female, 97.5%
Calm 80%
Surprised 0%
Angry 0.2%
Happy 0.2%
Sad 19.3%
Disgusted 0.1%
Fear 0.1%
Confused 0.2%

AWS Rekognition

Age 25-39
Gender Female, 95.1%
Confused 0.2%
Fear 0.2%
Calm 92.5%
Disgusted 0.1%
Surprised 0.1%
Happy 2.2%
Sad 4.4%
Angry 0.4%

AWS Rekognition

Age 22-34
Gender Female, 92.5%
Sad 71.7%
Angry 0.6%
Happy 0.1%
Fear 0.2%
Disgusted 0.2%
Calm 26.5%
Confused 0.5%
Surprised 0.1%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 43
Gender Female

Feature analysis

Amazon

Painting 97.5%
Person 97.3%

Captions

Microsoft

a painting of a person 75.3%
a painting of a person 71.9%
a painting on the side of a building 62.5%

Text analysis

Amazon

IAVEMARIS.STELLADELMRAM

Google

MRAM
E
AVEMARIS STELA DEI MRAM E
AVEMARIS
DEI
STELA