Human Generated Data

Title

Portrait of a Mughal Nobleman, folio from the Salim Album
Date

c. 1580-85
People
Classification

Albums
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, The Stuart Cary Welch Collection, Gift of Edith I. Welch in memory of Stuart Cary Welch, 2009.202.254

Human Generated Data

Title

Portrait of a Mughal Nobleman, folio from the Salim Album

People
Date

c. 1580-85

Classification

Albums

Machine Generated Data

Tags

Amazon
created on 2019-04-02

Human 98.5
Person 98.5
Rug 89.3
Art 88.2
Painting 61.6

Clarifai
created on 2018-04-18

painting 99
picture frame 97.2
art 97.2
decoration 95.3
no person 94
ornate 93.1
museum 92.8
people 92.4
illustration 90.3
print 89.4
retro 89.1
pattern 87.6
religion 86.5
exhibition 86.2
old 85.7
antique 85.1
design 83.9
wear 83.3
one 82.2
vintage 79.8

Imagga
created on 2018-04-18

prayer rug 89.6
rug 73.4
floor cover 54
furnishing 53.6
covering 38.1
old 34.8
vintage 33.1
art 29.4
ancient 28.5
religion 23.3
antique 23.3
paper 22
decoration 21.7
culture 21.4
retro 21.3
texture 19.5
pattern 18.5
design 17.4
stamp 17.4
mail 17.2
grunge 17
postage 16.7
gold 16.4
traditional 15.8
mosaic 15.7
letter 15.6
frame 15.2
postmark 14.8
history 14.3
religious 14.2
architecture 14.1
envelope 12.9
temple 12.8
style 11.9
aged 11.8
symbol 11.4
post 11.4
travel 11.3
detail 11.3
golden 11.2
color 11.1
wall 11.1
border 10.9
postal 10.8
sculpture 10.8
palace 10.6
close 10.3
church 10.2
philately 9.9
renaissance 9.8
parchment 9.6
god 9.6
ornamental 9.5
ornament 9.5
floral 9.4
decorative 9.2
ornate 9.2
carving 8.9
shows 8.9
printed 8.9
decor 8.8
paintings 8.8
museum 8.7
oriental 8.7
painted 8.6
blank 8.6
door 8.6
east 8.4
global 8.2
brown 8.1
saint 8.1
interior 8
icon 7.9
stamps 7.9
rustic 7.8
card 7.7
flower 7.7
obsolete 7.7
wallpaper 7.7
money 7.7
geometric 7.6
mother 7.5
building 7.5
closeup 7.4
cash 7.3
collection 7.2
currency 7.2

Google
created on 2018-04-18

picture frame 88.9
text 85.6
painting 74.9
art 72.8
artwork 58.7
paint 52.1

Microsoft
created on 2018-04-18

posing 60.3
rug 59.1
painting 57
decorated 56.8
old 42
painted 32.5
picture frame 27.7

Face analysis

Amazon

AWS Rekognition

Age 38-57
Gender Male, 92.2%
Sad 3.2%
Angry 4.9%
Confused 9.9%
Calm 11.4%
Happy 6%
Disgusted 2.6%
Surprised 62%

Feature analysis

Amazon

Person 98.5%
Rug 89.3%
Painting 61.6%

Captions

Microsoft

a painting on the wall 84.8%
a painting on a wall 84.1%
a painting of a person 76.2%

Text analysis

Amazon

s;
erir
avioers:
Tw
PAT