Human Generated Data

Title

Painting (recto), Poetry (verso), folio 117 from a Manuscript of the Complete Works of Sa`di

Date

c. 1805

People

Artist: Unknown Artist,

Classification

Manuscripts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of Adele L. and Arthur Lehman, 1965.99.117

Human Generated Data

Title

Painting (recto), Poetry (verso), folio 117 from a Manuscript of the Complete Works of Sa`di

People

Artist: Unknown Artist,

Date

c. 1805

Classification

Manuscripts

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Human 96.3
Person 96.3
Art 92.3
Person 91.2
Person 91.1
Person 89
Rug 79.6
Painting 70.2
Person 64.6
Drawing 56.7

Clarifai
created on 2018-04-19

art 99.3
religion 98.1
painting 97.2
illustration 97.2
old 96.9
ancient 96.9
antique 96.3
retro 94.9
print 94.7
mosaic 94.7
decoration 94.5
vintage 93.9
architecture 93.8
paper 91.5
church 90.2
manuscript 89.7
historic 87.7
pattern 87.2
god 87.1
wall 86.7

Imagga
created on 2018-04-19

mosaic 72.8
transducer 48.7
electrical device 36.5
art 31.9
old 30.7
vintage 29
texture 27.8
retro 27
pattern 26.7
device 23.5
prayer rug 22.2
antique 21.6
ancient 21.6
rug 20.7
design 19.7
paper 18.8
grunge 18.7
tile 18.7
decoration 17.6
flower 15.4
collection 15.3
mail 15.3
colorful 15.1
traditional 15
postage 14.7
unique 14.2
furnishing 14.1
jigsaw puzzle 13.9
floor cover 13.6
cotton 13.5
letter 12.8
postmark 12.8
color 12.8
floral 12.8
postal 12.8
pillow 12.6
stamp 12.6
religion 12.6
post 12.4
wallpaper 12.3
instrumentality 12.2
puzzle 12
covering 11.7
surface 11.5
culture 11.1
stamps 10.9
frame 10.8
history 10.7
style 10.4
game 10.2
cushion 10.2
paint 10
fabric 9.9
ornate 9.2
rough 9.1
aged 9.1
border 9.1
gold 9
plant 9
material 8.9
graphic 8.8
symbol 8.8
artistic 8.7
parchment 8.6
blank 8.6
wall 8.6
east 8.4
historic 8.3
backdrop 8.2
global 8.2
colors 7.9
leaf 7.8
torn 7.7
stained 7.7
padding 7.7
obsolete 7.7
money 7.7
painted 7.6
sheet 7.5
greeting 7.4
structure 7.4
church 7.4
cash 7.3
dirty 7.2
currency 7.2
icon 7.1
financial 7.1
world 7.1
travel 7

Google
created on 2018-04-19

art 78.8
miniature 71.2
history 60
artwork 56.2
painting 55.5
middle ages 52.8
tapestry 51.2

Microsoft
created on 2018-04-19

decorated 51.2
old 50
painting 22.1
altar 11.4

Face analysis

Amazon

AWS Rekognition

Age 20-38
Gender Female, 50.9%
Angry 45.5%
Happy 45.4%
Surprised 45.4%
Sad 45.5%
Disgusted 45.3%
Confused 45.2%
Calm 52.5%

AWS Rekognition

Age 16-27
Gender Female, 51.9%
Surprised 45.9%
Happy 45.6%
Calm 48.6%
Disgusted 45.7%
Sad 46.6%
Confused 45.2%
Angry 47.3%

AWS Rekognition

Age 20-38
Gender Female, 50.7%
Angry 46.7%
Disgusted 46%
Calm 47.5%
Confused 45.6%
Surprised 45.9%
Happy 46.2%
Sad 47.2%

AWS Rekognition

Age 23-38
Gender Female, 50.9%
Happy 49.8%
Surprised 45.3%
Calm 46.3%
Confused 45.3%
Sad 46.5%
Angry 46.2%
Disgusted 45.6%

AWS Rekognition

Age 23-38
Gender Male, 51.6%
Calm 53.6%
Happy 45.1%
Disgusted 45.1%
Sad 45.2%
Surprised 45.1%
Angry 45.8%
Confused 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.4%
Confused 46.4%
Calm 46.1%
Disgusted 45.4%
Angry 46.1%
Happy 45.2%
Sad 50.3%
Surprised 45.7%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Sad 45.4%
Surprised 45.6%
Angry 45.1%
Happy 45.4%
Calm 52.9%
Confused 45.4%
Disgusted 45.2%

Feature analysis

Amazon

Person 96.3%
Rug 79.6%

Captions

Microsoft

a painting on the wall 75%
a painting on a wall 74.2%
a painting hanging on a wall 74.1%

Text analysis

Amazon

F