Human Generated Data

Title

One of the Ten Kings of Hell

Date

15th - 16th century

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Claudia Brown and Emily Rabiner in memory of Donald N. Rabiner and in honor of Robert D. Mowry, 2002.57

Human Generated Data

Title

One of the Ten Kings of Hell

People
Date

15th - 16th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Person 93.7
Human 93.7
Person 93.5
Painting 93
Art 93
Person 90.1
Person 82.9
Building 79.7
Architecture 79.7
Person 78.6
Person 75.6
Person 70.6
Person 65.9
Housing 63.3
Monastery 63.3
Worship 58.8
Person 58.5
Shrine 58.2
Temple 58.2

Clarifai
created on 2018-02-19

painting 99.5
art 99.3
illustration 99.3
religion 97.2
saint 96.6
people 95
church 93.4
Renaissance 89.1
cross 88.3
man 88.3
god 88
decoration 87.1
old 87
fresco 86.3
Gothic 84.5
picture frame 83.8
symbol 83.4
ancient 82.7
woman 82
manuscript 81.1

Imagga
created on 2018-02-19

vintage 41.4
old 35.6
retro 34.5
texture 33.4
grunge 29.8
tile 28.7
antique 28.6
art 28.2
pattern 27.4
paper 26.7
mosaic 26
decoration 23.6
wallpaper 23
ancient 21.6
design 21.5
floral 19.6
flower 18.5
transducer 18.2
color 17.3
aged 17.2
binding 16.7
decorative 15
frame 14.2
element 14.1
stamp 13.7
paint 13.6
dirty 13.6
cotton 13.4
material 13.4
bookmark 13.4
surface 13.2
backdrop 13.2
graphic 13.2
postmark 12.8
postage 12.8
border 12.7
brown 12.5
mail 12.5
letter 11.9
graffito 11.7
textile 11.4
canvas 11.4
detail 11.3
covering 10.9
postal 10.8
textured 10.5
post 10.5
plant 10.5
fabric 10.4
blank 10.3
colorful 10
rough 10
jacket 10
collection 9.9
travel 9.9
envelope 9.8
decor 9.7
obsolete 9.6
puzzle 9.6
grungy 9.5
patterns 9.5
symbol 9.4
device 8.9
torn 8.7
stained 8.7
map 8.7
stain 8.7
empty 8.6
leaf 8.6
page 8.4
game 8.4
historic 8.3
style 8.2
backgrounds 8.1
creative 8
blackboard 7.9
philately 7.9
printed 7.9
wall 7.8
flowers 7.8
artistic 7.8
ornament 7.8
drawing 7.7
decay 7.7
collage 7.7
parchment 7.7
worn 7.6
damaged 7.6
set 7.6
seamless 7.6
close 7.4
note 7.4

Google
created on 2018-02-19

art 95.2
painting 87.1
tapestry 82.1
modern art 65.8
artwork 63.8
mural 56
visual arts 55.2
paint 54.9
history 52.2
stock photography 52.2

Microsoft
created on 2018-02-19

fabric 10.1

Face analysis

Amazon

AWS Rekognition

Age 10-15
Gender Male, 84.9%
Disgusted 1.4%
Calm 4.3%
Angry 1.8%
Happy 1.4%
Confused 3.2%
Sad 81.2%
Surprised 6.6%

AWS Rekognition

Age 23-38
Gender Male, 97%
Angry 3.4%
Happy 1.3%
Calm 84.1%
Disgusted 1.1%
Surprised 3.1%
Sad 4.6%
Confused 2.4%

AWS Rekognition

Age 29-45
Gender Female, 58.7%
Disgusted 30.5%
Confused 6%
Happy 14.6%
Angry 25%
Calm 7.9%
Surprised 8.1%
Sad 8%

AWS Rekognition

Age 26-44
Gender Female, 51.5%
Happy 45.6%
Sad 48.6%
Confused 45.3%
Surprised 45.3%
Calm 46.2%
Angry 47.5%
Disgusted 46.5%

AWS Rekognition

Age 48-68
Gender Male, 53.4%
Surprised 45.4%
Disgusted 52.3%
Sad 45.3%
Angry 45.4%
Happy 45.2%
Confused 45.7%
Calm 45.6%

AWS Rekognition

Age 45-63
Gender Male, 86.7%
Confused 3.1%
Sad 4.3%
Surprised 3%
Angry 19.1%
Calm 45%
Happy 1.5%
Disgusted 24%

AWS Rekognition

Age 57-77
Gender Male, 54.6%
Surprised 45.2%
Happy 45.5%
Disgusted 45.4%
Confused 45.3%
Sad 52%
Angry 45.9%
Calm 45.7%

AWS Rekognition

Age 6-13
Gender Female, 54.4%
Calm 45.5%
Happy 46%
Surprised 45.4%
Confused 45.3%
Disgusted 46%
Sad 50%
Angry 46.8%

Feature analysis

Amazon

Person 93.7%
Painting 93%

Captions

Microsoft

a group of people posing for a photo 38%
a group of people posing for the camera 37.9%
a group of people posing for a picture 37.8%