Human Generated Data

Title

Rustam in Combat at the Castle of Mount Sipand (painting recto; text verso of folio 64), Illustrated folio from a manuscript of the Shahnama by Firdawsi
Date

17th-18th century
People
Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of José M. Soriano in honor of Thomas W. Lentz and in memory of Stuart Cary Welch, 2015.63.12

Human Generated Data

Title

Rustam in Combat at the Castle of Mount Sipand (painting recto; text verso of folio 64), Illustrated folio from a manuscript of the Shahnama by Firdawsi

People
Date

17th-18th century

Classification

Manuscripts

Machine Generated Data

Tags

Amazon
created on 2019-03-29

Text 99.8
Human 85.1
Person 85.1
Page 81.6
Calendar 58
Poster 55.4
Advertisement 55.4
Person 50.7

Clarifai
created on 2018-02-09

manuscript 98.8
paper 98.7
illustration 98.6
old 98.1
vintage 98
retro 98
antique 97.3
art 97.3
text 96.7
painting 95.9
document 95.6
book bindings 95.3
page 95.2
ancient 94.7
print 93
picture frame 91.9
wear 90.9
people 90.2
card 89
texture 88.7

Imagga
created on 2018-02-09

newspaper 54.6
vintage 46.4
product 42.1
old 38.4
map 37.5
retro 35.3
creation 35
paper 32.2
envelope 26.2
ancient 26
letter 25.7
antique 25.4
stamp 24.2
currency 23.4
money 22.2
brass 20.4
finance 20.3
cash 20.2
mail 20.1
postmark 19.7
aged 19
bank 17.9
grunge 17.1
memorial 16.8
close 16
art 15.6
geography 15.4
texture 15.3
dollar 14.9
postal 14.7
bill 14.3
representation 14.3
travel 14.1
philately 13.8
note 13.8
postage 13.8
exchange 13.4
world 13.3
capital 13.3
page 13
structure 12.7
financial 12.5
jacket 12.4
text 12.2
card 11.9
circa 11.9
printed 11.8
history 11.6
business 11.6
banking 11
global 11
shows 10.8
wealth 10.8
states 10.6
dollars 10.6
book 10.4
message 10.1
wallpaper 10
religion 9.9
bills 9.7
notes 9.6
pattern 9.6
wrapping 9.4
economy 9.3
atlas 9.3
frame 9.2
gold 9.1
container 8.7
us 8.7
pay 8.6
post 8.6
daily 8.5
sheet 8.5
design 8.5
savings 8.4
globe 8.3
city 8.3
border 8.2
dirty 8.1
new 8.1
stamps 7.9
sepia 7.8
banknote 7.8
continent 7.8
navigation 7.7
covering 7.6
grungy 7.6
plan 7.6
print 7.5
planet 7.5
writing 7.5
sign 7.5
rich 7.5
brown 7.4
earth 7.3
collection 7.2

Google
created on 2018-02-09

text 89.2
history 72.8
miniature 66.4
art 52
font 50.9

Microsoft
created on 2018-02-09

text 90.4
plaque 40.5

Face analysis

Amazon

AWS Rekognition

Age 29-45
Gender Male, 54.7%
Confused 46.2%
Sad 48.8%
Calm 47.5%
Happy 45.9%
Surprised 45.6%
Angry 45.5%
Disgusted 45.6%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Confused 45.2%
Sad 45%
Disgusted 45.1%
Surprised 53.7%
Calm 45.4%
Angry 45.1%
Happy 45.5%

AWS Rekognition

Age 35-52
Gender Male, 51.9%
Happy 46.6%
Surprised 45.6%
Calm 45.4%
Disgusted 45.3%
Confused 45.5%
Sad 50.7%
Angry 45.9%

Feature analysis

Amazon

Person 85.1%

Captions

Microsoft

a close up of text on a white background 49.4%
a close up of text on a white surface 48.5%
a close up of text on a black background 44%

Text analysis

Amazon

00000
00000 00000DNOOO
cu
00000DNOOO
irs
lb'i;
ybe'niis
iwwsi.b:
uozinsy
PPA
iwwsi.b: irs 1ig
yisre'
Osi
cu yp1sit iolt
gsirl
lb'i; vo1 Wonitg
ion'E
Osi Ssilio:
-ECIifo
bilit
Wonitg
enii bilit
yp1sit
enii
Ssilio:
i PPA yisre'
vo1
n ion'E -ECIifo
ybe'niis 1
iolt
r
1ig
Sb
As
n
1
$
i