Human Generated Data

Title

Emperor Akbar and Gosain Jadrup, Folio from the St. Petersburg Muraqqa’
Date

c. 1625-1630
People
Classification

Albums
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Grenville L. Winthrop, Class of 1886, 1937.20

Human Generated Data

Title

Emperor Akbar and Gosain Jadrup, Folio from the St. Petersburg Muraqqa’

People
Date

c. 1625-1630

Classification

Albums

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Rug 98.5
Person 97.9
Human 97.9
Person 96.8
Person 92.4
Art 85.6
Quilt 72.7
Painting 66.4
Ornament 61.7
Tapestry 61.7
Person 60.5
Applique 59.2

Clarifai
created on 2018-02-10

art 99
painting 98.4
retro 97.8
antique 96.9
decoration 96.6
illustration 96.3
picture frame 96
vintage 95.9
old 95.4
print 94.6
pattern 93.7
ornate 92.7
paper 92.6
design 92
letter 91.9
ancient 91.8
desktop 90.3
artistic 89.6
exhibition 89.4
scrapbook 88.4

Imagga
created on 2018-02-10

rug 100
furnishing 74.5
covering 50.5
vintage 43
old 40.4
mosaic 40
art 38.4
retro 32
ancient 29.4
frame 26.9
stamp 26.1
antique 26.1
mail 24.9
postmark 23.7
decoration 23.2
grunge 23
postage 22.6
texture 22.2
letter 22
design 21.4
paper 20.4
aged 19.9
postal 19.6
pattern 18.5
ornate 18.3
border 18.1
gold 17.3
post 17.2
transducer 17
printed 16.7
envelope 16.6
shows 15.8
culture 15.4
philately 14.8
museum 14.6
religion 14.4
empty 13.7
blank 13.7
style 13.4
puzzle 13.2
wall 12.8
circa 12.8
card 12.8
decorative 12.5
color 12.2
golden 12
painter 11.8
paintings 11.7
history 11.6
interior 11.5
obsolete 11.5
floral 11.1
global 10.9
masterpiece 10.9
stamps 10.9
painting 10.8
flower 10.8
delivery 10.7
decor 10.6
painted 10.5
unique 10.4
icon 10.3
church 10.2
message 10
paint 10
renaissance 9.8
close 9.7
cutting 9.7
communications 9.6
symbol 9.4
page 9.3
wallpaper 9.2
traditional 9.1
device 9.1
game 9
collection 9
material 8.9
zigzag 8.9
known 8.9
detail 8.9
office 8.8
used 8.6
parchment 8.6
rustic 8.6
ornament 8.6
god 8.6
brown 8.1
closeup 8.1
object 8.1
post mail 7.9
canceled 7.9
fame 7.9
gallery 7.9
leaf 7.8
artist 7.7
palace 7.7
fine 7.6
ornamental 7.6
textile 7.6
canvas 7.6
creation 7.5
sheet 7.5

Google
created on 2018-02-10

picture frame 85.9
art 80.2
painting 79.5
miniature 68.3
artwork 64.9
paint 56.3

Microsoft
created on 2018-02-10

indoor 91.2
painting 86.9
decorated 77.8
painted 27.4
picture frame 14.2

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 49-69
Gender Male, 54.8%
Confused 45.6%
Disgusted 45.9%
Angry 45.6%
Surprised 45.8%
Happy 46.3%
Sad 45.6%
Calm 50.3%

AWS Rekognition

Age 30-47
Gender Male, 52.5%
Happy 45.6%
Sad 45.7%
Disgusted 45.5%
Surprised 45.5%
Calm 51.8%
Confused 45.4%
Angry 45.5%

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Angry 45.8%
Happy 45.3%
Confused 45.7%
Sad 49%
Surprised 45.6%
Calm 48.1%
Disgusted 45.5%

AWS Rekognition

Age 48-68
Gender Male, 50.7%
Surprised 47.1%
Happy 45.5%
Sad 47.2%
Calm 46.8%
Disgusted 45.5%
Angry 46.9%
Confused 46.1%

AWS Rekognition

Age 26-43
Gender Male, 54.1%
Happy 45.3%
Confused 45.6%
Angry 48.9%
Surprised 45.5%
Disgusted 45.8%
Calm 47%
Sad 47%

Feature analysis

Amazon

Rug 98.5%
Person 97.9%
Painting 66.4%

Captions

Microsoft

a painting on the wall 83.1%
a painting hanging on a wall 81.9%
a painting on a wall 81.8%