Human Generated Data

Title

Yusuf Tells His Story (text recto; painting verso of folio 64); illustrated folio from a manuscript of Yusuf and Zulaykha by Nizami
Date

16th century
People

-
Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 27.2015.64

Human Generated Data

Title

Yusuf Tells His Story (text recto; painting verso of folio 64); illustrated folio from a manuscript of Yusuf and Zulaykha by Nizami

Date

16th century

Classification

Manuscripts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 27.2015.64

Machine Generated Data

Tags

Amazon
created on 2019-12-19

Text 98.5
Human 84.8
Person 84.8
Person 81.1
Rug 79.5
Person 78.5
Art 73.6
Diary 69.1
Page 56.9

Clarifai
created on 2019-12-19

retro 97.7
painting 97.7
antique 96.3
no person 96.1
picture frame 95.4
old 95.4
art 95.2
paper 95.2
illustration 94.5
vintage 94.4
wear 93
text 92.3
ancient 91.1
print 90.2
dirty 89.7
decoration 88.7
empty 87.4
writing 87.1
desktop 86.6
book bindings 86.3

Imagga
created on 2019-12-19

binding 59.5
vintage 57.1
old 50.9
texture 38.2
grunge 35
retro 32
paper 29
antique 28.8
letter 25.7
aged 25.4
ancient 25.1
empty 22.4
frame 22.2
art 19.3
border 19
cover 18.5
stamp 18.4
blank 18
mail 17.2
wall 17.1
wallpaper 16.9
design 16.3
postage 15.7
covering 15.1
pattern 15.1
decoration 14.8
postmark 14.8
doormat 14.8
book 14.6
backgrounds 14.6
rough 14.6
rusty 14.3
worn 13.4
decorative 13.4
post 13.4
canvas 13.3
bookmark 13.3
sheet 13.2
postal 12.8
board 12.6
philately 11.9
dirty 11.8
mat 11.7
cardboard 11.5
parchment 11.5
document 11.1
envelope 10.9
floor cover 10.9
pages 10.8
gold 10.7
aging 10.6
grungy 10.4
symbol 10.1
ornate 10.1
religion 9.9
material 9.8
museum 9.7
obsolete 9.6
brown 9.6
container 9.4
culture 9.4
tray 9.4
tile 9.3
message 9.1
paint 9.1
painting 9
world 8.9
decor 8.9
country 8.8
faded 8.8
delivery 8.8
used 8.7
old fashioned 8.6
book jacket 8.5
page 8.4
wood 8.3
backdrop 8.3
global 8.2
style 8.2
national 8.2
close 8
philatelic 7.9
text 7.9
paintings 7.8
insulating material 7.7
international 7.6
receptacle 7.6
nation 7.6
jacket 7.6
historic 7.3
artwork 7.3
metal 7.2
color 7.2
black 7.2
collection 7.2
icon 7.1
blackboard 7.1
wooden 7
textured 7

Google
created on 2019-12-19

Painting 78.7
Still life 72.6
Art 67.7
Illustration 64
Picture frame 60.7
Modern art 58.3
Rectangle 55.7
Paper 54.3

Microsoft
created on 2019-12-19

text 97.1
cartoon 94.6
illustration 85.8
painting 83.9
child art 82.3
person 82
book 80.2
binding 72.6
drawing 72.3
manuscript 70.4
sign 68.8
handwriting 63.2
clothing 61.9
plaque 33.8
picture frame 32.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 25-39
Gender Female, 50.7%
Happy 45.3%
Disgusted 45%
Sad 45%
Fear 45%
Calm 54.6%
Surprised 45.1%
Angry 45%
Confused 45%

AWS Rekognition

Age 37-55
Gender Male, 50.3%
Sad 46.4%
Happy 45.1%
Calm 48.3%
Surprised 45.3%
Confused 45.1%
Disgusted 45.2%
Angry 47.9%
Fear 46.7%

Feature analysis

Amazon

Person 84.8%
Rug 79.5%

Categories

Imagga

paintings art 98.3%

Captions

Microsoft
created on 2019-12-19

a sign on the side of a building 71.5%
a sign on a wall 71.4%
a sign on a brick wall 62%

Text analysis

Amazon

Son::
i
Son:: .6:
uis:
iti
iru, iti
.6:
iru,
i yp
''
W:'f. uis:
ore ''
W:'f.
ore
yp