Human Generated Data

Title

Young Lord Krishna and His Friends Steal His Mother's Butter, from a Bhagavata Purana series
Date

17th century
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Mr. and Mrs. Peter Bienstock, 1974.128

Human Generated Data

Title

Young Lord Krishna and His Friends Steal His Mother's Butter, from a Bhagavata Purana series

People
Date

17th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 92
Art 91.6
Drawing 88.4
Text 74.2
Person 66.4
Person 66.2
Person 64.6
Painting 61.4
Person 61.4
Sketch 56
Person 51.7

Clarifai
created on 2020-04-24

people 99.8
illustration 99.5
art 99.2
print 99
adult 98.7
group 98.4
painting 97.4
veil 96
cavalry 95.6
man 94.9
one 94.8
engraving 93.5
home 92.6
religion 92.4
many 89.9
wear 88.8
furniture 88.7
gown (clothing) 88.4
sword 88.3
war 87.7

Imagga
created on 2020-04-24

brass 32.1
old 32.1
vintage 30.6
memorial 29.2
wall 27.5
structure 27.1
window 25.4
ancient 25.1
antique 24.7
art 24.6
decoration 20.1
architecture 20
religion 17.9
texture 17.4
detail 16.9
church 16.7
grunge 16.2
graffito 15.8
stamp 15.8
retro 15.6
history 15.2
case 14.8
frame 14.6
mail 14.4
sculpture 14.3
paper 14.1
door 14
postage 13.8
letter 13.8
culture 13.7
aged 13.6
post 13.4
temple 13.3
building 13.2
stone 13.2
postmark 12.8
postal 12.8
carving 12.7
house 11.7
pattern 11.6
framework 11.5
museum 10.8
symbol 10.8
design 10.7
painted 10.5
religious 10.3
black 10.2
facade 10.2
glass 10.1
landmark 9.9
entrance 9.7
brown 9.6
fire screen 9.5
icon 9.5
shop 9.3
screen 9.2
historic 9.2
travel 9.2
delivery 8.8
covering 8.4
global 8.2
border 8.1
protective covering 8.1
material 8
sketch 8
printed 7.9
drawing 7.9
cathedral 7.7
damaged 7.6
envelope 7.6
unique 7.6
historical 7.5
wood 7.5
monument 7.5
mercantile establishment 7.4
paint 7.2
dirty 7.2
surface 7.1
wooden 7

Google
created on 2020-04-24

Painting 88.3
Art 82.9
Visual arts 73.9
Picture frame 73.3
Illustration 71.8
Stock photography 64
Modern art 63.1
Collection 62.9
Artwork 61.8
Black-and-white 56.4
History 54.1
Still life 52.9
Drawing 51.1

Microsoft
created on 2020-04-24

drawing 99.7
sketch 99.2
cartoon 98.3
gallery 98.2
scene 94.1
room 92.1
illustration 87.4
text 83.8
child art 83.7
posing 79.7
old 63.2
person 61.1
clothing 54.1
painting 26.7

Face analysis

Amazon

AWS Rekognition

Age 16-28
Gender Female, 50.9%
Calm 45%
Confused 45.2%
Happy 45%
Fear 54.1%
Disgusted 45%
Angry 45%
Sad 45.4%
Surprised 45.2%

AWS Rekognition

Age 65-79
Gender Male, 50.1%
Angry 49.7%
Calm 49.9%
Disgusted 49.5%
Happy 49.6%
Fear 49.5%
Confused 49.5%
Surprised 49.6%
Sad 49.8%

AWS Rekognition

Age 19-31
Gender Male, 50.1%
Happy 49.5%
Sad 50.3%
Confused 49.5%
Fear 49.5%
Disgusted 49.5%
Angry 49.5%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 10-20
Gender Female, 50%
Calm 49.5%
Sad 49.7%
Happy 49.5%
Angry 49.6%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Fear 50.1%

AWS Rekognition

Age 16-28
Gender Male, 50.3%
Calm 49.8%
Fear 49.5%
Surprised 49.5%
Angry 49.8%
Sad 49.5%
Disgusted 49.8%
Confused 49.5%
Happy 49.5%

Feature analysis

Amazon

Person 66.4%
Painting 61.4%

Captions

Microsoft

a vintage photo of a painting 68.2%
a vintage photo of a person 68.1%
a vintage photo of a person in a room 68%