Human Generated Data

Title

Egyptian Women Overwhelm by Yusuf’s Beauty (painting recto; text verso of folio 90); illustrated folio from a manuscript of Yusuf and Zulaykha by Nizami
Date

16th century
People

-
Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 27.2015.90

Human Generated Data

Title

Egyptian Women Overwhelm by Yusuf’s Beauty (painting recto; text verso of folio 90); illustrated folio from a manuscript of Yusuf and Zulaykha by Nizami

Date

16th century

Classification

Manuscripts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 27.2015.90

Machine Generated Data

Tags

Amazon
created on 2019-12-18

Person 90.2
Human 90.2
Art 87.5
Person 79.5
Person 77.9
Text 74.4
Person 70.6
Person 70
Painting 69.5
Person 69.3
Rug 64.2
Person 64
Drawing 63.5
Person 61.4

Clarifai
created on 2019-12-18

painting 99.1
no person 98.1
retro 97.8
antique 96.7
art 96.1
old 96
picture frame 94.1
wear 92.1
ancient 92.1
text 91.7
people 91.4
print 91.3
illustration 90.8
paper 89.1
one 88.8
writing 88.1
dirty 87.7
religion 87.2
empty 87.1
vintage 86.9

Imagga
created on 2019-12-18

binding 54.5
old 50.2
vintage 45.5
texture 37.5
antique 33.9
grunge 32.4
ancient 31.2
wall 28.2
retro 26.2
paper 24.3
frame 24.2
structure 24
aged 23.5
blackboard 22.9
brass 21.8
empty 20.6
art 20.4
design 19.7
memorial 17.2
cover 16.7
book 16.6
decoration 16.2
bookmark 15.6
blank 15.4
border 15.4
letter 14.7
pattern 14.4
rusty 14.3
religion 13.5
worn 13.4
door 13.3
covering 13.2
wallpaper 13
material 12.5
rough 11.9
chalkboard 11.8
wood 11.7
faded 11.7
stamp 11.6
entrance 11.6
gold 11.5
old fashioned 11.4
binder 11.3
document 11.1
brown 11.1
historic 11
dirty 10.9
postage 10.8
building 10.7
backgrounds 10.6
mail 10.5
post 10.5
board 10.2
architecture 10.2
ornate 10.1
decorative 10
decor 9.7
style 9.7
parchment 9.6
damaged 9.5
symbol 9.4
book jacket 9.2
backdrop 9.1
paint 9.1
device 9
protective covering 9
history 8.9
grime 8.8
graphic 8.8
crumpled 8.7
decay 8.7
used 8.6
concrete 8.6
culture 8.6
grungy 8.5
sheet 8.5
grain 8.3
artwork 8.2
jacket 8.1
close 8
stone 7.9
icon 7.9
doorway 7.9
text 7.9
pages 7.8
mottled 7.8
ornament 7.8
heritage 7.7
stain 7.7
cardboard 7.7
obsolete 7.7
canvas 7.6
church 7.4
object 7.3
metal 7.2
product 7.2
black 7.2
textured 7

Google
created on 2019-12-18

Painting 83.3
Art 67.7
Miniature 63.2
Antique 61.2
Still life 58.2
Picture frame 54.8
History 54.1

Microsoft
created on 2019-12-18

building 99.6
text 99.3
cartoon 96.7
book 92.2
poster 91.1
handwriting 88.8
binding 83.2
drawing 73.4
old 68.2
person 65.3
child art 62.5
painting 41.9
plaque 33.4
picture frame 33.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 15-27
Gender Male, 53.3%
Sad 45%
Disgusted 45%
Fear 45.2%
Confused 45%
Calm 45%
Happy 45%
Angry 45%
Surprised 54.8%

AWS Rekognition

Age 22-34
Gender Male, 54.3%
Sad 45%
Fear 45%
Calm 53.8%
Surprised 45.7%
Confused 45.1%
Happy 45.2%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 23-35
Gender Male, 54.9%
Calm 46.6%
Happy 45.4%
Surprised 52.4%
Disgusted 45%
Fear 45.2%
Angry 45.1%
Confused 45.1%
Sad 45%

AWS Rekognition

Age 22-34
Gender Male, 54.3%
Fear 47%
Angry 45.1%
Happy 45.2%
Confused 45.1%
Disgusted 45.1%
Surprised 50.8%
Calm 46.7%
Sad 45%

AWS Rekognition

Age 22-34
Gender Female, 50.5%
Fear 45%
Disgusted 45%
Angry 45%
Calm 46.1%
Sad 45%
Surprised 53.8%
Happy 45%
Confused 45%

AWS Rekognition

Age 22-34
Gender Male, 53.8%
Disgusted 45%
Angry 45.1%
Happy 45.6%
Calm 46.8%
Confused 45%
Surprised 52%
Fear 45.4%
Sad 45%

AWS Rekognition

Age 22-34
Gender Male, 54.1%
Confused 46.1%
Surprised 47.3%
Happy 45%
Calm 51.4%
Disgusted 45%
Sad 45.2%
Angry 45%
Fear 45%

AWS Rekognition

Age 22-34
Gender Female, 51%
Disgusted 45%
Calm 53.7%
Surprised 45.5%
Confused 45%
Fear 45.1%
Happy 45.5%
Sad 45.1%
Angry 45.2%

AWS Rekognition

Age 17-29
Gender Female, 52.6%
Disgusted 45.1%
Sad 45.3%
Angry 45.8%
Fear 45.9%
Calm 50.4%
Confused 45.1%
Happy 45.7%
Surprised 46.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 90.2%
Rug 64.2%

Captions

Microsoft
created on 2019-12-18

a painting on the wall 71.7%
a painting on a wall 71.1%
a painting on the side of a building 53.8%

Text analysis

Amazon

o.,o;;
o.,o;; inub
E
inub
ns
ydthss
l, ydthss
l,
Fsi;
y

Google

ن ا رتن ر تن ز ب نیرد نردوم انام کایر ون آرام ر)و م راشتن ان مصرادا رشاده ال پرست ریاد ات کر رس بایاد یار دیدران ری بن در ا ور نداببا فرزو ر ان
ن
ا
رتن
ر
تن
ز
ب
نیرد
نردوم
انام
کایر
ون
آرام
ر)و
م
راشتن
ان
مصرادا
رشاده
ال
پرست
ریاد
ات
کر
رس
بایاد
یار
دیدران
ری
بن
در
ور
نداببا
فرزو