Human Generated Data

Title

Poetry (recto), Painting (verso), folio 168 from a Manuscript of the Complete Works of Sa`di
Date

c. 1805
People

Artist: Unknown Artist,

Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Adele L. and Arthur Lehman, 1965.99.168

Human Generated Data

Title

Poetry (recto), Painting (verso), folio 168 from a Manuscript of the Complete Works of Sa`di

People

Artist: Unknown Artist,

Date

c. 1805

Classification

Manuscripts

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Human 97.1
Animal 84.6
Horse 84.6
Mammal 84.6
Person 83.3
Person 79.3
Advertisement 79.2
Person 76.9
Art 75.3
Drawing 72
Text 69.6
Person 69
Collage 63.9
Game 59.3
Jigsaw Puzzle 59.3
Person 58.3
Poster 56.5

Clarifai
created on 2018-04-19

art 99.2
painting 98.7
illustration 98.4
old 98.1
manuscript 97.7
antique 96.5
ancient 95.9
retro 95.7
vintage 95.3
religion 93.5
print 92.3
decoration 91.4
picture frame 91.2
paper 89.9
wear 89.8
text 88.4
symbol 88
wall 87.3
design 86.9
people 86.2

Imagga
created on 2018-04-19

vintage 48.8
old 46.7
grunge 36.6
retro 35.3
paper 30.7
texture 30.6
map 30
antique 27.6
ancient 25.1
board 24.1
aged 22.6
bookmark 21.1
art 20.7
letter 20.2
stamp 18.6
frame 18.3
worn 18.2
wall 18.1
torn 17.4
pattern 17.1
dirty 16.3
decoration 16.1
rough 15.5
border 15.4
mail 15.3
graffito 15.1
envelope 14.9
page 14.9
wallpaper 14.6
rust 14.5
stained 14.4
grungy 14.2
postmark 13.8
postage 13.8
geography 13.5
brown 13.3
design 13
blank 12.9
color 12.8
global 12.8
postal 12.8
representation 12.8
world 12.6
damaged 12.4
binding 11.8
paint 11.8
collection 11.7
decorative 11.7
material 11.6
parchment 11.5
canvas 11.4
card 11.2
document 11.1
philately 10.9
flower 10.8
history 10.7
surface 10.6
cardboard 10.6
sheet 10.3
empty 10.3
floral 10.2
artwork 10.1
tile 10
book 9.8
mosaic 9.8
backgrounds 9.7
textured 9.6
post 9.5
rusty 9.5
leaf 9.3
jigsaw puzzle 9.2
book jacket 9.2
travel 9.2
stamps 8.9
manuscript 8.8
burnt 8.8
messy 8.7
artistic 8.7
yellow 8.6
atlas 8.5
country 8.4
cover 8.3
backdrop 8.2
container 8.2
text 7.9
shabby 7.9
used 7.7
rustic 7.7
aging 7.7
weathered 7.6
sign 7.5
greeting 7.4
note 7.4
cash 7.3
earth 7.3
puzzle 7.3
currency 7.2

Google
created on 2018-04-19

art 82.1
painting 68.7
miniature 64.2
history 60.9
artwork 59.5
picture frame 51.9
modern art 50

Microsoft
created on 2018-04-19

sign 65.3
various 64.8
posing 46.2
box 42.9
different 37.6
thing 25
painting 15.3
picture frame 11.4
several 10.8

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 15-25
Gender Male, 50.1%
Disgusted 49.7%
Angry 49.6%
Happy 49.6%
Surprised 49.5%
Sad 49.5%
Calm 50.1%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Confused 49.5%
Surprised 49.6%
Angry 49.6%
Calm 49.6%
Happy 49.9%
Disgusted 49.6%
Sad 49.7%

AWS Rekognition

Age 17-27
Gender Female, 50.2%
Calm 50.2%
Sad 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.6%
Surprised 49.6%
Angry 49.6%

Feature analysis

Amazon

Horse 84.6%
Person 83.3%
Poster 56.5%

Captions

Microsoft

a group of people posing for a photo 35.9%
a group of people posing for a photo in front of a sign 35.8%
a sign posing for the camera 35.7%

Text analysis

Amazon

ritiii
ispie
iv
ieh ritiii
Yhriris
ieth
ieh
ptgy Yhriris
ptgy