Human Generated Data

Title

Initial M
Date

15th century
People

Artist: Anonymous Germany, German

Artist: Anonymous Italy (Venice) 1499,

Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Paul J. Sachs, M1230

Human Generated Data

Title

Initial M

People

Artist: Anonymous Germany, German

Artist: Anonymous Italy (Venice) 1499,

Date

15th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Rug 99.3
Art 93.9
Doodle 93.8
Drawing 93.8
Label 61.1
Text 61.1

Clarifai
created on 2019-11-06

art 98.6
illustration 98.4
retro 98.2
decoration 97
imperial 95.4
print 94.8
old 94.4
vintage 93.4
pattern 93.3
ornate 92.9
margin 91.8
design 91.7
antique 91.3
desktop 90.9
symbol 90
paper 87.9
ancient 87.6
texture 84.6
style 84.5
artistic 84

Imagga
created on 2019-11-06

vintage 48.9
old 48.2
arabesque 41.4
retro 37.7
ancient 36.4
antique 32.5
stamp 32.4
grunge 30.7
mail 28.8
postage 27.6
prayer rug 26.7
art 26.2
frame 25.8
texture 25.7
paper 25.1
post 24.8
postmark 23.7
letter 22.1
aged 21.8
postal 21.6
rug 21.3
covering 21.1
floor cover 20.4
binding 19.1
wall 18.8
tile 18.5
historic 16.5
collection 16.3
furnishing 16.1
design 15.9
pattern 15.8
symbol 14.8
brown 14.7
decoration 14.6
container 14.1
philately 13.8
stamps 13.8
blank 13.7
tray 13.7
border 13.6
icon 13.5
communication 13.5
history 13.4
chalkboard 12.8
finance 12.7
envelope 12.6
used 12.5
gold 12.3
mosaic 12.3
textured 12.3
black 12
empty 12
close 12
money 11.9
ornate 11.9
decorative 11.7
religion 11.7
parchment 11.5
obsolete 11.5
culture 11.1
receptacle 11.1
printed 10.8
style 10.4
dirty 10
collectible 9.9
shows 9.9
museum 9.8
business 9.7
metal 9.7
office 9.7
mark 9.6
worn 9.6
ornamental 9.5
ornament 9.5
one 9
canceled 8.9
philatelic 8.9
detail 8.9
colors 8.8
send 8.8
closeup 8.8
board 8.7
stain 8.7
concrete 8.6
international 8.6
architecture 8.6
rusty 8.6
wallpaper 8.4
cash 8.2
painting 8.1
currency 8.1
success 8.1
decor 8
text 7.9
delivery 7.8
golden 7.7
card 7.7
book 7.6
grungy 7.6
head 7.6
page 7.4
backdrop 7.4
protective covering 7.4
rough 7.3
idea 7.1
face 7.1
carving 7.1
surface 7.1
doormat 7

Google
created on 2019-11-06

Art 82.4
Illustration 76.8
Visual arts 68.6
Painting 65.4
Miniature 65.2
Printmaking 62.8
Style 51

Microsoft
created on 2019-11-06

text 98.5
drawing 98.5
painting 84.9
sketch 77.3
art 67.7
cartoon 66.1
rug 52.9
fabric 20
picture frame 11.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 40-58
Gender Female, 73.1%
Happy 4%
Disgusted 2.5%
Sad 1.8%
Calm 55.4%
Angry 26.2%
Fear 0.7%
Confused 1.8%
Surprised 7.5%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Rug 99.3%

Captions

Microsoft

a close up of a rug 72.4%
a fabric surface 54.9%
close up of a rug 54.8%