Human Generated Data

Title

Rustam Fending off the Rock Dropped by Bahman (painting, recto; text, verso), folio from a manuscript of the Shahnama by Firdawsi
Date

1562
People
Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Norma Jean Calderwood Collection of Islamic Art, 2002.50.163

Human Generated Data

Title

Rustam Fending off the Rock Dropped by Bahman (painting, recto; text, verso), folio from a manuscript of the Shahnama by Firdawsi

People
Date

1562

Classification

Manuscripts

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Animal 85.4
Horse 85.4
Mammal 85.4
Person 83.2
Human 83.2
Art 83
Rug 79.9
Painting 77.8
Ornament 76.4
Tapestry 76.4
Person 64.6
Bird 61.5
Quilt 56.4

Clarifai
created on 2018-03-23

art 99.3
painting 98.8
illustration 98.4
religion 97.3
decoration 96.1
pattern 95.4
old 94.9
ancient 94.1
picture frame 93.9
manuscript 93.2
antique 92.8
print 91.7
design 90.8
desktop 90.2
wall 88.9
ornate 88.8
culture 88.2
mosaic 88.1
god 88
architecture 87.5

Imagga
created on 2018-03-23

mosaic 64.5
transducer 39.7
old 37.7
vintage 37.3
map 34.3
art 33.9
ancient 30.3
prayer rug 30.2
electrical device 29.8
antique 29.2
tile 27.9
retro 26.2
rug 25
texture 22.3
paper 22
representation 20.5
grunge 20.5
jigsaw puzzle 19.4
stamp 19.4
device 19.1
religion 18.8
postage 18.7
puzzle 18.3
furnishing 18.1
floor cover 18.1
postmark 17.8
letter 17.4
mail 17.3
post 17.2
pattern 17.1
postal 16.7
decoration 16
culture 15.4
covering 15.4
history 14.3
binding 13.8
historic 13.8
dirty 13.6
design 13.5
close 13.1
global 12.8
aged 12.7
frame 12.5
parchment 12.5
obsolete 12.5
painted 12.4
game 12.3
symbol 12.1
church 12
money 11.9
stamps 11.8
traditional 11.7
color 11.1
paint 10.9
world 10.6
geography 10.6
grungy 10.4
finance 10.1
instrumentality 9.9
canceled 9.9
currency 9.9
travel 9.9
bank 9.9
detail 9.7
used 9.6
worn 9.6
icon 9.5
ornament 9.5
artwork 9.2
cash 9.2
border 9.1
gold 9
collection 9
style 8.9
office 8.8
manuscript 8.8
delivery 8.8
museum 8.7
stained 8.7
god 8.6
unique 8.5
envelope 8.5
religious 8.4
decorative 8.4
ornate 8.2
decor 8
masterpiece 7.9
business 7.9
shows 7.9
printed 7.9
painter 7.8
artistic 7.8
paintings 7.8
letters 7.7
wall 7.7
mark 7.7
flower 7.7
middle 7.7
ornamental 7.6
communication 7.6
east 7.5
one 7.5
page 7.4
dollar 7.4
atlas 7.4
surface 7.1

Google
created on 2018-03-23

fauna 86.7
art 72.7
miniature 68.1
history 63.7
painting 61.4
picture frame 61
tapestry 60.5
artwork 55

Microsoft
created on 2018-03-23

indoor 88.5
old 45.5
painting 28.6
painted 19.7

Face analysis

Amazon

AWS Rekognition

Age 12-22
Gender Female, 50.3%
Surprised 49.5%
Angry 49.5%
Sad 50.5%
Calm 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%

AWS Rekognition

Age 30-47
Gender Male, 50.1%
Angry 49.6%
Sad 50.3%
Calm 49.5%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.6%

Feature analysis

Amazon

Horse 85.4%
Person 83.2%
Rug 79.9%
Painting 77.8%
Bird 61.5%

Captions

Microsoft

a painting on the wall 78.6%
a painting on a wall 77.7%
a painting hanging on a wall 77.6%

Text analysis

Amazon

OV
SUHLS