Human Generated Data

Title

The Orphan from Whose Guardian the Ruler Asked for Gold (painting recto; text verso of folio 27), painting from a manuscript of the Kulliyat of Sa‘di
Date

16th century
People

-
Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 16.2015.27

Human Generated Data

Title

The Orphan from Whose Guardian the Ruler Asked for Gold (painting recto; text verso of folio 27), painting from a manuscript of the Kulliyat of Sa‘di

Date

16th century

Classification

Manuscripts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Loan from A. Soudavar in memory of his mother Ezzat-Malek Soudavar, 16.2015.27

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Text 97.3
Art 85.9
Human 82.9
Person 82.9
Person 82.6
Drawing 71.7
Advertisement 69.2
Poster 67.2
Person 56.1
Label 55.8
Collage 55.1

Clarifai
created on 2018-02-10

art 98.5
old 98.2
painting 97.7
antique 97.5
retro 97.1
vintage 97
illustration 96.6
ancient 95.8
wear 95.3
decoration 94.6
picture frame 94.4
manuscript 93.9
paper 93.5
text 93.5
architecture 92.9
design 92.4
print 91.5
desktop 90.9
wall 90.1
texture 89.1

Imagga
created on 2018-02-10

bookmark 93.1
vintage 51.3
old 43.9
rug 32.2
retro 31.2
grunge 29.8
stamp 28.1
mail 27.8
ancient 27.7
paper 27.5
antique 27.1
postage 26.6
texture 24.3
letter 23.9
furnishing 23.5
post 22.9
postmark 22.7
postal 20.6
art 19.6
aged 18.1
philately 17.8
covering 17
frame 15
envelope 14.8
pattern 14.4
design 14.1
collection 13.5
religion 13.5
history 13.4
decoration 13.1
global 12.8
binding 12.5
page 12.1
wall 12
stamps 11.8
border 11.8
dirty 11.8
worn 11.5
culture 11.1
torn 10.7
used 10.6
door 10.5
tile 10.4
mosaic 10.4
empty 10.3
card 10.2
historic 10.1
traditional 10
philatelic 9.9
shabby 9.8
delivery 9.7
rusty 9.5
symbol 9.4
communication 9.2
travel 9.2
material 8.9
circa 8.9
printed 8.9
correspondence 8.8
entrance 8.7
book 8.7
parchment 8.6
architecture 8.6
blank 8.6
grungy 8.5
decorative 8.4
cover 8.3
message 8.2
style 8.2
paint 8.2
brown 8.1
world 8
canceled 7.9
shows 7.9
collect 7.9
doorway 7.9
ragged 7.8
ornament 7.8
stained 7.7
obsolete 7.7
wallpaper 7.7
international 7.6
close 7.4
church 7.4
gold 7.4
object 7.3
yellow 7.3
map 7.2

Google
created on 2018-02-10

text 86.1
picture frame 77.5
art 75.1
painting 65.4
collection 65.3
miniature 62.7
artwork 60.7
modern art 60.6

Microsoft
created on 2018-02-10

picture frame 27.3
plaque 20.9
painting 16.1

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 52.5%
Disgusted 46.6%
Confused 45.2%
Happy 47.9%
Angry 45.7%
Calm 47.5%
Surprised 45.8%
Sad 46.2%

AWS Rekognition

Age 19-36
Gender Female, 54.6%
Happy 47%
Angry 45.7%
Calm 46%
Confused 45.2%
Disgusted 46.1%
Sad 45.4%
Surprised 49.7%

AWS Rekognition

Age 57-77
Gender Female, 55%
Happy 52.4%
Sad 46.9%
Confused 45.1%
Surprised 45.2%
Calm 45.2%
Angry 45.1%
Disgusted 45.1%

AWS Rekognition

Age 11-18
Gender Female, 51.8%
Confused 45.3%
Calm 51.4%
Happy 45.6%
Disgusted 45.4%
Angry 45.4%
Sad 45.4%
Surprised 46.5%

AWS Rekognition

Age 26-44
Gender Female, 50.2%
Sad 45.7%
Surprised 45.5%
Disgusted 45.1%
Angry 45.5%
Calm 52%
Happy 45.6%
Confused 45.5%

Feature analysis

Amazon

Person 82.9%

Categories

Imagga

paintings art 99.6%
interior objects 0.4%

Captions

Microsoft
created on 2018-02-10

a sign on the side of a building 71%
a sign above a door 63.7%
a sign on a wall 63.6%

Text analysis

Amazon

6
iu..
06:
iirc,
ibmiepfs
ss.i0 io, iirc,
io,
ss.i0