Human Generated Data

Title

The Descent to Hell
Date

15th century
People

Artist: Andrea Mantegna, Italian 1431 - 1506
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Fine Arts Department, Harvard University, FA60

Human Generated Data

Title

The Descent to Hell

People

Artist: Andrea Mantegna, Italian 1431 - 1506

Date

15th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-03

Art 97.8
Painting 97.5
Human 81.4
Person 81.4
Archaeology 58.3
Person 53.8

Clarifai
created on 2019-11-03

people 99.9
art 99.8
group 99.2
adult 99.1
man 99.1
illustration 97.3
Renaissance 96.9
kneeling 96.6
religion 96.2
pain 96
sword 95.8
weapon 94.9
woman 94.5
nude 93.7
force 92.9
allegory 92.5
painting 92.4
veil 91.7
two 91.5
facial hair 91.2

Imagga
created on 2019-11-03

sculpture 52.2
statue 40.4
art 37.7
architecture 34.7
ancient 33.7
religion 32.3
history 30.4
temple 29.6
carving 28.3
stone 26.6
culture 26.5
old 23.7
religious 23.4
sketch 21.5
carved 21.5
god 20.1
decoration 18.3
drawing 18.1
travel 16.9
monument 16.8
design 16.1
historical 16
holy 15.4
antique 15.3
representation 14.5
building 14.3
sand 13.9
church 13.9
marble 13.9
detail 13.7
face 13.5
city 13.3
famous 13
figure 13
spirituality 12.5
historic 11.9
statues 11.8
vintage 11.6
tourism 11.5
east 11.2
texture 11.1
museum 11.1
pattern 10.9
landmark 10.8
traditional 10.8
symbol 10.8
spiritual 10.6
wall 10.4
golden 10.3
soil 10.1
relief 10
tourist 10
sculptures 9.9
catholic 9.7
meditation 9.6
exterior 9.2
style 8.9
earth 8.9
carvings 8.9
figurine 8.8
arabesque 8.8
man 8.7
worship 8.7
faith 8.6
grunge 8.5
oriental 8.5
head 8.4
decorative 8.4
holiday 7.9
bangkok 7.9
ruins 7.8
heritage 7.7
architectural 7.7
details 7.6
roman 7.5
column 7.5
gold 7.4
zebra 7.4
bronze 7.3
aged 7.2
plastic art 7.1

Google
created on 2019-11-03

Art 89.9
Painting 84.2
Mythology 72.5
Visual arts 72.2
Organism 71.5
Drawing 68.4
Relief 68.4
Tapestry 68.4
Stock photography 66.6
Illustration 64
Printmaking 61.5
History 57.6
Artwork 56

Microsoft
created on 2019-11-03

text 99.8
book 99.1
drawing 97.3
sketch 94.9
person 82.7
painting 68.3
horse 63.5
cartoon 63.1
clothing 50.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Male, 84.3%
Confused 1.2%
Sad 35.2%
Angry 3.2%
Fear 49.4%
Happy 0.1%
Disgusted 0.1%
Surprised 4.5%
Calm 6.3%

AWS Rekognition

Age 51-69
Gender Male, 71.9%
Surprised 11.4%
Happy 3%
Sad 2.8%
Confused 0.9%
Fear 61.7%
Angry 12.8%
Calm 5.7%
Disgusted 1.7%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.5%
Person 81.4%

Captions

Microsoft

an old photo of a book 43.8%
an old photo of a person 43.7%

Text analysis

Amazon

AMF
MA

Google

AMF MA
AMF
MA