Human Generated Data

Title

One of the Ten Kings of Hell

Date

15th - 16th century

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Clifford A. Kaye, 1966.89.1

Human Generated Data

Title

One of the Ten Kings of Hell

People
Date

15th - 16th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 99.2
Person 99.2
Person 98.1
Painting 95.1
Art 95.1
Person 91.6
Home Decor 68.7
Person 65.2
Person 65
Poster 56.9
Advertisement 56.9

Clarifai
created on 2018-02-19

illustration 99.8
painting 99.8
art 99.6
people 99.1
print 97.8
manuscript 97.3
kneeling 97
saint 96.2
religion 96
Renaissance 95.9
adult 95.4
veil 93.7
baby 93.5
gown (clothing) 93.4
man 92.9
group 92.4
woman 91.8
Mary 91.7
aura 91.1
god 90.6

Imagga
created on 2018-02-19

mosaic 87.5
transducer 59.1
vintage 35.6
art 34.3
old 32.8
rug 29.5
device 28.4
antique 24.2
tile 23.9
grunge 23.8
paper 22.7
retro 22.1
ancient 21.6
texture 21.5
altar 20.9
church 20.4
furnishing 19.9
puzzle 19.2
religion 18.8
postage 17.7
stamp 17.4
pattern 17.1
structure 16.8
letter 16.5
mail 16.3
postmark 15.8
instrumentality 14.8
covering 14.7
historic 14.7
design 14.6
painted 14.3
post 14.3
postal 13.7
culture 13.7
paint 13.6
game 13.1
icon 12.7
stained 12.5
wall 12
global 11.9
aged 11.8
dirty 11.7
collection 11.7
color 11.7
decoration 11.7
parchment 11.5
unique 11.4
symbol 10.8
paintings 10.8
museum 10.7
obsolete 10.5
colorful 10
masterpiece 9.9
stamps 9.9
travel 9.9
material 9.8
sacred 9.7
saint 9.6
god 9.6
brown 9.6
religious 9.4
artwork 9.2
frame 9.2
traditional 9.2
printed 8.9
renaissance 8.8
cutting 8.7
heritage 8.7
artistic 8.7
holy 8.7
communications 8.6
drawing 8.6
worn 8.6
close 8.6
wallpaper 8.4
decorative 8.4
page 8.4
gold 8.2
painting 8.1
history 8.1
detail 8
envelope 8
interior 8
yellow 8
surface 7.9
philately 7.9
shows 7.9
painter 7.8
black 7.8
architecture 7.8
delivery 7.8
letters 7.7
torn 7.7
messy 7.7
collage 7.7
flower 7.7
damaged 7.6
rusty 7.6
grungy 7.6
style 7.4
backdrop 7.4
note 7.4
border 7.2
office 7.2
world 7.1

Google
created on 2018-02-19

art 88.7
history 69.3
tapestry 67.8
miniature 64
painting 63.5
artwork 58.6
middle ages 56.1
illustration 50.5

Microsoft
created on 2018-02-19

decorated 26.4

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 53%
Confused 45.9%
Angry 46.8%
Sad 48.9%
Calm 46.4%
Disgusted 45.9%
Surprised 45.7%
Happy 45.3%

AWS Rekognition

Age 35-52
Gender Male, 97.2%
Happy 0.9%
Angry 9.1%
Calm 57.2%
Confused 4%
Disgusted 3.4%
Sad 23.9%
Surprised 1.5%

AWS Rekognition

Age 45-66
Gender Female, 52.2%
Disgusted 47.8%
Angry 45.6%
Sad 49.4%
Happy 45.5%
Calm 46.1%
Surprised 45.3%
Confused 45.3%

AWS Rekognition

Age 6-13
Gender Female, 54.8%
Calm 45.3%
Angry 45.2%
Confused 45.2%
Surprised 45.2%
Sad 53.1%
Disgusted 45.2%
Happy 45.7%

AWS Rekognition

Age 23-38
Gender Male, 54.7%
Calm 45.6%
Sad 52%
Confused 45.5%
Disgusted 46%
Happy 45.3%
Surprised 45.2%
Angry 45.4%

AWS Rekognition

Age 29-45
Gender Female, 80.2%
Happy 84.8%
Calm 5.6%
Angry 1.7%
Disgusted 2.2%
Sad 2%
Confused 1.2%
Surprised 2.5%

Feature analysis

Amazon

Person 99.2%
Painting 95.1%

Captions

Microsoft

a bunch of stuffed animals on display in a store 24.6%
a bunch of stuffed animals and covered with graffiti 24.5%
a bunch of stuffed animals 24.1%