Human Generated Data

Title

The Man Who Disrespected Hajjaj b. Yusuf (painting recto; text verso of folio 64), painting from a manuscript of the Kulliyat of Sa‘di

Date

16th century

People
Classification

Manuscripts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 16.2015.93

Human Generated Data

Title

The Man Who Disrespected Hajjaj b. Yusuf (painting recto; text verso of folio 64), painting from a manuscript of the Kulliyat of Sa‘di

People
Date

16th century

Classification

Manuscripts

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 90.9
Person 90.9
Art 86.3
Person 75.6
Painting 67.5
Rug 63.5
Text 60.6
Mural 59
Advertisement 57.1
Poster 57.1
Drawing 56.9
Person 41.7

Clarifai
created on 2018-02-10

old 96.9
vintage 96.6
retro 96.4
antique 96.4
art 95.9
illustration 95.7
no person 94.9
painting 94.9
paper 94.9
ancient 93.8
architecture 93.2
wear 92
manuscript 91.7
decoration 90.8
picture frame 89.6
text 89.5
design 89.3
wall 89
print 88
desktop 86.7

Imagga
created on 2018-02-10

vintage 43.8
bookmark 43.6
old 42.5
tile 41.2
texture 29.9
grunge 29
retro 27
antique 24.4
art 23.5
ancient 23.4
mosaic 23.3
paper 22.7
board 19.9
pattern 19.8
wall 19.7
letter 18.3
stamp 17.4
mail 17.2
postage 16.7
aged 16.3
decoration 15.5
design 15.2
postmark 14.8
dirty 14.5
post 14.3
door 13.5
history 13.4
worn 13.4
postal 12.8
paint 12.7
rusty 12.4
color 12.2
frame 11.7
wallpaper 11.5
culture 11.1
brown 11
philately 10.9
decorative 10.9
border 10.9
stained 10.6
metal 10.5
blank 10.3
page 10.2
cover 10.2
global 10
collection 9.9
religion 9.9
travel 9.9
binding 9.9
transducer 9.8
material 9.8
world 9.7
surface 9.7
torn 9.7
heritage 9.7
rust 9.6
temple 9.5
grungy 9.5
empty 9.4
historic 9.2
artwork 9.2
close 9.1
rough 9.1
shabby 8.8
burnt 8.7
entrance 8.7
parchment 8.6
obsolete 8.6
yellow 8.6
architecture 8.6
damaged 8.6
envelope 8.3
backdrop 8.2
building 8.2
detail 8
delivery 7.8
flower 7.7
cardboard 7.7
weathered 7.6
canvas 7.6
sign 7.5
sheet 7.5
east 7.5
map 7.2
book 7.1

Google
created on 2018-02-10

text 85.5
art 70.7
painting 61.9
artwork 56.4
picture frame 55.8
modern art 52.3
miniature 51.8

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 50.7%
Angry 45.4%
Happy 45.7%
Calm 49.3%
Surprised 46.6%
Sad 46.2%
Disgusted 45.7%
Confused 46.1%

AWS Rekognition

Age 30-47
Gender Male, 53.2%
Calm 49.3%
Sad 47.6%
Surprised 45.5%
Happy 46.4%
Confused 45.3%
Angry 45.5%
Disgusted 45.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 54.6%
Confused 45%
Happy 45.1%
Angry 45.1%
Calm 45.1%
Surprised 45.1%
Sad 45%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Surprised 45.6%
Happy 47.8%
Sad 47.4%
Calm 47.1%
Disgusted 45.8%
Angry 45.8%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Male, 52.3%
Confused 46.1%
Sad 45.4%
Disgusted 46.5%
Happy 46%
Surprised 46%
Angry 45.9%
Calm 49.1%

Feature analysis

Amazon

Person 90.9%
Rug 63.5%

Captions

Microsoft

a graffiti covered wall 64.1%
graffiti on a wall 60.9%
a sign above a door 59.9%

Text analysis

Amazon

AAANAVAANA
AAAAATAAVAIM
EK
isile
S?:KS
ste
AEE
22