Human Generated Data

Title

Yusuf’s Brothers Plead to Take Their Youngest Brother Home (text recto; painting verso of folio 50); illustrated folio from a manuscript of Yusuf and Zulaykha by Nizami

Date

16th century

People
Classification

Manuscripts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 27.2015.50

Human Generated Data

Title

Yusuf’s Brothers Plead to Take Their Youngest Brother Home (text recto; painting verso of folio 50); illustrated folio from a manuscript of Yusuf and Zulaykha by Nizami

People
Date

16th century

Classification

Manuscripts

Machine Generated Data

Tags

Amazon
created on 2019-12-19

Human 89.2
Person 89.2
Art 88.8
Person 87.6
Text 84.9
Person 84.5
Rug 78.6
Person 75
Person 70.6
Drawing 64.9

Clarifai
created on 2019-12-19

retro 99.1
antique 98.7
old 98.6
paper 97.8
vintage 97.5
painting 97
art 96.7
picture frame 96.6
no person 96.5
ancient 96.4
dirty 94.9
empty 94
wear 93.7
blank 92.4
album 91.8
text 91.6
illustration 91.6
desktop 91.5
decoration 91.1
book bindings 90.7

Imagga
created on 2019-12-19

binding 62.8
old 52.3
vintage 48.8
texture 41.7
grunge 33.2
antique 33.2
wall 29.1
paper 29
ancient 27.7
aged 27.2
retro 26.2
frame 23.6
empty 22.3
wallpaper 19.2
rough 19.1
design 19.1
border 19
cover 18.5
letter 18.4
worn 18.2
blank 17.2
art 16.4
door 16.4
rusty 16.2
building 15.5
structure 15.5
binder 15.4
dirty 15.4
pattern 15.1
architecture 14.9
material 14.3
decoration 14
brown 14
entrance 13.5
covering 13.4
wood 13.4
canvas 13.3
sheet 13.2
backgrounds 13
cardboard 12.5
container 12.3
protective covering 12.1
document 12.1
board 11.9
pages 11.7
bookmark 11.7
backdrop 11.5
parchment 11.5
wooden 11.4
book 10.9
faded 10.7
aging 10.6
mail 10.5
weathered 10.5
stone 10.2
ornate 10.1
decorative 10
religion 9.9
torn 9.7
stamp 9.7
metal 9.7
grungy 9.5
tray 9.3
house 9.2
historic 9.2
paint 9.1
doorway 8.9
postage 8.9
decor 8.8
surface 8.8
textured 8.8
post 8.6
page 8.4
exterior 8.3
style 8.2
painting 8.1
device 8.1
symbol 8.1
detail 8.1
text 7.9
ragged 7.8
window 7.8
crumpled 7.8
gate 7.8
rust 7.7
culture 7.7
stained 7.7
stain 7.7
used 7.7
rustic 7.7
floral 7.7
painted 7.6
old fashioned 7.6
nation 7.6
receptacle 7.5
close 7.4
gold 7.4
artwork 7.3
national 7.3
square 7.2
framework 7.1
country 7

Google
created on 2019-12-19

Painting 71.4
Art 70.9
Illustration 69.1
Paper 61.1
Still life 57.1
Modern art 51.9
Miniature 50.6
Paper product 50.3

Microsoft
created on 2019-12-19

building 99.8
text 98.7
handwriting 95.7
outdoor 91.1
child art 80.7
drawing 74.5
book 71.5
binding 68.7
pink 65.9
old 65.1
cartoon 57.2
painting 23.7
painted 22.1
picture frame 16.8
plaque 15.5

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Male, 54.9%
Surprised 45%
Angry 45%
Calm 54.9%
Disgusted 45%
Sad 45%
Confused 45%
Happy 45%
Fear 45%

AWS Rekognition

Age 23-37
Gender Male, 54.7%
Sad 45.1%
Fear 45.2%
Calm 45.6%
Surprised 49.4%
Confused 45.1%
Happy 49.7%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 23-35
Gender Male, 51.8%
Disgusted 45%
Happy 45.3%
Calm 50.9%
Confused 45.1%
Sad 45%
Fear 45%
Angry 45%
Surprised 48.7%

AWS Rekognition

Age 29-45
Gender Male, 55%
Calm 54.9%
Confused 45%
Sad 45%
Happy 45%
Disgusted 45%
Surprised 45.1%
Fear 45%
Angry 45%

AWS Rekognition

Age 36-54
Gender Male, 53.6%
Disgusted 45%
Happy 45.2%
Confused 45.1%
Calm 53.6%
Surprised 45.9%
Angry 45.1%
Sad 45%
Fear 45%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 89.2%
Rug 78.6%

Captions

Microsoft

a painting on the side of a building 62.9%
a painting on the wall 62.8%
a painting on a wall 62.7%

Text analysis

Amazon

otiit:
otiit: Aos
Aos
eien
issg, eien
Syi'
issg,
iEifiter
iEifiter ntelis
Py Syi'
ntelis
Py
sty
S sty
S

Google

بان
سانای
راست
کر
زو
ک
راسن
کها
ار
موای
را
دا
روی
رکا
جام
می
بان ار کسن بان ر رزی سن سانای خوع ' ک امت وست موای فن راست با را کر ارت دا کر روی رکا یم برورستی زو ا جام وانت ار ک راسن کها ان رخور می ارازی
خوع
وست
ارت
برورستی
ا
وانت
ان
رخور
سن
'
ارازی
کسن
ر
رزی
امت
فن
با
یم