Human Generated Data

Title

Virgin and Child Surrounded by Angels

Date

15th century

People

Artist: Sano di Pietro (Ansano di Pietro di Mencio), Italian 1405 - 1481

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of The Felix M. and Frieda Schiff Warburg Foundation, 1959.34

Human Generated Data

Title

Virgin and Child Surrounded by Angels

People

Artist: Sano di Pietro (Ansano di Pietro di Mencio), Italian 1405 - 1481

Date

15th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 98.7
Painting 98.7
Human 93
Person 93
Person 92.1
Building 74.9
Architecture 74.9
Archaeology 65.6

Clarifai
created on 2018-03-16

art 99.8
religion 99.6
painting 99
god 98.7
people 97.8
aura 97.7
saint 97.7
Mary 97.4
one 96
Renaissance 95.6
veil 95.4
spirituality 95
ancient 94.9
holy 93.8
sculpture 93.4
baby 92.9
adult 92.3
religious belief 91.4
illustration 90.9
antique 90.6

Imagga
created on 2018-03-16

mosaic 60.1
religion 57.4
temple 44.2
sculpture 39
art 37.7
transducer 37.1
religious 33.8
church 33.3
architecture 33.3
statue 32.4
god 31.6
culture 30.8
ancient 28.6
electrical device 27.8
holy 24.1
spirituality 24
gold 23
travel 22.6
history 22.4
golden 22.4
tourism 22.3
faith 22
old 21.6
historic 21.1
worship 20.3
device 19.6
prayer 19.3
spiritual 19.2
pray 18.4
throne 18.3
antique 17.8
east 17.8
detail 16.9
carving 16.7
icon 16.6
sacred 16.6
palace 15.5
oriental 15.1
historical 15.1
face 14.9
bible 14.7
chair of state 14.6
landmark 14.5
meditation 14.4
monument 14
building 13.8
stone 13.3
famous 13
tourist 12.7
belief 12.7
museum 12.6
structure 12.2
bangkok 11.8
symbol 11.5
door 11.4
monastery 11
carved 10.8
chair 10.5
traditional 10
prophet 9.9
masterpiece 9.9
orthodox 9.8
century 9.8
praying 9.8
jigsaw puzzle 9.6
saint 9.6
window 9.6
puzzle 9.6
instrumentality 9.3
tradition 9.2
decoration 9.1
empire 8.8
grand 8.7
eastern 8.7
heritage 8.7
artist 8.7
shrine 8.6
design 8.5
painter 8.5
altar 8.4
peace 8.2
halo 7.9
byzantine 7.9
gilded 7.9
orient 7.8
visit 7.8
tile 7.7
figure 7.7
head 7.6
seat 7.5
city 7.5
style 7.4
protection 7.3
plastic art 7.2
colorful 7.2
ruler 7.2
portrait 7.1

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

text 97

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 66.5%
Sad 21.9%
Disgusted 7.2%
Surprised 2.1%
Confused 8.2%
Angry 4.8%
Happy 0.5%
Calm 55.5%

AWS Rekognition

Age 26-43
Gender Female, 57.2%
Happy 0.7%
Disgusted 1.5%
Calm 7.6%
Sad 81.9%
Confused 3.7%
Angry 2.4%
Surprised 2.3%

AWS Rekognition

Age 4-9
Gender Female, 99.4%
Sad 1.5%
Calm 86.9%
Angry 1.1%
Surprised 5.1%
Confused 4.1%
Happy 0.6%
Disgusted 0.8%

AWS Rekognition

Age 26-43
Gender Female, 83.8%
Sad 9.4%
Angry 1%
Happy 0.6%
Calm 86%
Surprised 0.6%
Disgusted 0.7%
Confused 1.9%

AWS Rekognition

Age 20-38
Gender Male, 62.6%
Happy 0.2%
Disgusted 0.4%
Calm 15.4%
Surprised 0.6%
Angry 0.8%
Sad 80.5%
Confused 2.2%

AWS Rekognition

Age 20-38
Gender Male, 79.8%
Disgusted 0.5%
Angry 0.5%
Calm 4.3%
Sad 91.7%
Happy 0.4%
Confused 2%
Surprised 0.7%

AWS Rekognition

Age 20-38
Gender Male, 81.6%
Confused 4.3%
Sad 54.2%
Calm 32.3%
Happy 3.6%
Surprised 1.1%
Angry 3.2%
Disgusted 1.3%

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.7%
Person 93%

Captions

Microsoft

a large brown teddy bear holding a book 27.4%
a brown teddy bear holding a book 27.3%
a large brown teddy bear sitting on top of a book 20.3%

Text analysis

Amazon

CC