Human Generated Data

Title

Hindola Raga, illustration from a Ragamala (Garland of Melodies) series
Date

c. 1735
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mr. and Mrs. Peter Bienstock, 1974.132

Human Generated Data

Title

Hindola Raga, illustration from a Ragamala (Garland of Melodies) series

People
Date

c. 1735

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 95.2
Painting 88.3

Clarifai
created on 2020-04-24

people 99.2
art 99.2
painting 97.2
one 94.9
print 91
museum 90.3
picture frame 89.8
religion 89.4
illustration 89.4
decoration 87.4
man 87.3
ornate 86.9
sculpture 86.8
antique 86.1
old 86.1
leader 84.1
adult 82.9
group 80.6
vintage 80.3
no person 80.2

Imagga
created on 2020-04-24

book jacket 60.4
jacket 47
art 36.2
wrapping 35.7
vintage 34.8
old 32.1
religion 30.5
covering 29.4
brass 28.1
antique 25.8
memorial 25
church 24.1
structure 22.8
ancient 22.5
culture 22.2
letter 20.2
stamp 19.4
religious 18.8
postage 18.7
frame 18.4
mail 18.2
post 18.1
wall 18
museum 17.7
icon 17.4
historic 17.4
architecture 17.3
postmark 16.8
texture 16.7
gold 16.5
door 16.2
history 16.1
decoration 15.9
postal 15.7
retro 15.6
temple 15.5
saint 15.4
binding 15
symbol 14.8
paintings 14.7
envelope 14.6
painted 14.3
sculpture 14.1
design 14.1
carving 13.9
masterpiece 13.9
printed 13.8
renaissance 13.8
painter 13.7
delivery 13.6
window 13.5
shows 12.8
ornate 12.8
stone 12.6
fine 12.4
framework 12.3
historical 12.2
travel 12
one 12
post mail 11.9
zigzag 11.9
fame 11.9
known 11.9
cutting 11.6
communications 11.5
interior 11.5
unique 11.4
prayer rug 11.3
grunge 11.1
paper 11
global 11
decorative 10.9
entrance 10.6
detail 10.5
building 10.5
black 10.2
stamps 9.9
decor 9.7
letters 9.7
office 9.7
style 9.6
holy 9.6
pattern 9.6
altar 9.5
border 9.1
landmark 9
rug 9
artist 8.7
golden 8.6
close 8.6
famous 8.4
wood 8.3
traditional 8.3
paint 8.2
aged 8.2
painting 8.1
amulet 7.9
canceled 7.9
circa 7.9
blank 7.7
spirituality 7.7
cathedral 7.7
statue 7.6
furnishing 7.5
monument 7.5
tourism 7.4
closeup 7.4
brown 7.4
metal 7.2
home 7.2
floor cover 7.1

Google
created on 2020-04-24

Picture frame 92.3
Stock photography 72.8
Art 69.5
Black-and-white 68.3
Photography 62.4
Painting 56
Monochrome 54.4
Fictional character 52.8
Style 52.5

Microsoft
created on 2020-04-24

gallery 94.9
art 89.3
text 88.5
scene 85
room 84.5
poster 77.3
black and white 68.4
posing 57.7
picture frame 22.3

Face analysis

Amazon

AWS Rekognition

Age 16-28
Gender Female, 52.8%
Disgusted 45%
Sad 45.1%
Angry 51.2%
Confused 45%
Calm 46.4%
Happy 47.1%
Surprised 45.1%
Fear 45.1%

AWS Rekognition

Age 12-22
Gender Male, 50.7%
Calm 46.6%
Disgusted 45%
Surprised 45.1%
Fear 45.2%
Happy 52.4%
Angry 45%
Sad 45.7%
Confused 45%

AWS Rekognition

Age 13-25
Gender Male, 50.7%
Surprised 45%
Disgusted 45.1%
Confused 45.1%
Calm 45.1%
Sad 45.8%
Happy 45.1%
Fear 45.4%
Angry 53.4%

AWS Rekognition

Age 14-26
Gender Male, 50.4%
Angry 49.5%
Fear 49.5%
Sad 49.5%
Surprised 49.5%
Calm 50.5%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 37-55
Gender Male, 50.4%
Calm 49.5%
Sad 49.5%
Surprised 49.5%
Disgusted 49.5%
Angry 50.5%
Happy 49.5%
Confused 49.5%
Fear 49.5%

Feature analysis

Amazon

Painting 88.3%

Captions

Microsoft

a black and white photo of a person 44%
an old photo of a person 43.9%
old photo of a person 43.8%