Human Generated Data

Title

Jean Baptiste Colbert, Marquis de Seignelay
Date

1680
People

Artist: Nicolas de Larmessin the Elder, French c. 1640 - 1725
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from The Map Room, Widener Library, M12828

Human Generated Data

Title

Jean Baptiste Colbert, Marquis de Seignelay

People

Artist: Nicolas de Larmessin the Elder, French c. 1640 - 1725

Date

1680

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Human 98.5
Person 98.5
Art 85.4
Text 75.3
Painting 75.2
Advertisement 57.4
Poster 57.4

Clarifai
created on 2019-11-09

art 98.8
people 98.3
illustration 96
antique 95.2
print 94.8
painting 93
one 92.9
vintage 92.7
portrait 92.6
picture frame 92
adult 91.9
old 91.7
engraving 91.6
retro 89.5
decoration 89.4
symbol 88
ancient 87.5
baroque 86.9
Renaissance 86.7
historic 85.7

Imagga
created on 2019-11-09

stucco 58
old 39
vintage 32.3
antique 31.2
frame 30.1
art 29.7
retro 29.5
decoration 27.7
ancient 25.1
design 24.8
paper 24.3
shield 22.5
dollar 22.3
knocker 22.3
finance 22
currency 20.6
pattern 20.5
money 20.4
style 19.3
decorative 19.2
ornament 19
gold 18.9
cash 18.3
ornate 16.5
bank 16.5
blank 16.3
device 16.2
financial 16
armor 15.8
architecture 15.6
grunge 15.3
texture 15.3
wealth 15.3
bill 15.2
close 14.8
stamp 14.5
decor 14.2
business 14
window 14
banking 13.8
border 13.6
rich 13
framework 12.9
golden 12.9
wall 12.8
mail 12.5
protective covering 12.1
detail 12.1
empty 12
culture 12
one 12
letter 11.9
historic 11.9
postage 11.8
dollars 11.6
us 11.6
post 11.4
savings 11.2
luxury 11.2
classic 11.1
elegance 10.9
symbol 10.8
element 10.7
history 10.7
banknote 10.7
pay 10.6
object 10.3
floral 10.2
aged 10
postal 9.8
deco 9.8
card 9.7
portrait 9.7
amulet 9.7
hundred 9.7
metal 9.7
loan 9.6
building 9.6
artistic 9.6
closeup 9.4
carving 9.1
sign 9
museum 8.9
postmark 8.9
carved 8.8
baroque 8.8
wooden 8.8
classical 8.6
face 8.5
covering 8.5
wood 8.3
traditional 8.3
structure 8.1
backgrounds 8.1
treasury 8.1
religion 8.1
concepts 8
interior 8
charm 7.7
obsolete 7.7
wallpaper 7.7
exchange 7.6
ornamental 7.6
number 7.5
brown 7.4
investment 7.3
graphic 7.3
dirty 7.2
collection 7.2
icon 7.1
leaf 7

Google
created on 2019-11-09

Photograph 95
Illustration 72.5
Picture frame 70.2
Stock photography 69.2
Art 67.7
Circle 56.3
Portrait 55.1
History 54.1

Microsoft
created on 2019-11-09

text 99.9
book 98.4
human face 96.9
person 96
clothing 93.4
victorian 60.8
old 58.5
drawing 57.6
sketch 51.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 97.7%
Confused 1.5%
Angry 2.2%
Happy 0.8%
Fear 5.2%
Sad 37.8%
Calm 45.8%
Disgusted 2.9%
Surprised 3.6%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Poster 57.4%

Captions

Microsoft

a close up of a book 41.3%
close up of a book 36.8%
a close up of a book cover 36.7%

Text analysis

Amazon

BAPTISTE
IEAN
Secvetare
Marquis
Con
COLBERT
tous
Charon
Et
Roy
Colbert
Dame
Fits
ME.Sre IEAN BAPTISTE COLBERT chter Marquis
Sa
u
et
Charon Sa feme
chter
Sseignelay,
Or
B
Sstat
pouse'
Comaderin
asne
Comand:
feme
aptis
Conee
Genevald laMarine Fits asne eTean B
pouse' renopces
eTean
autres
de Sseignelay, Et autres breux Conee u Roy En tous Ses Con ols
renopces
St
Mmimistre
Comand: es Or dres maj Secvetare Sstat et DeSses Comaderin
Genevald
laMarine
Secretau
ols
Colbert Mmimistre St Secretau 'Estat s de Dame aptis
'Estat
ME.Sre
Ses
dres
maj
de
En
DeSses
es
breux
balamnean
s

Google

De Larme COLBERT Chter Marquus Conou Roy.En tous Ses Conils Secvetaire Estat et deSes Comnader Fils aisme de MesTean Baptiste le Charon Safne ustre MESe IEAN BAPTISTE de Seignelay,&t autres lieu Comand,des Ordres deSamaj Intendane Generalde la Marine Colbert,mistre & Secretaire Esta acpose enpnopces iddealegre,Iriedes Comtes allegre,maso & de Dame Margnedontila ls Vnef Capitaine des ches deomerre Jogny fleren f Come deuxere gnd bejoi HChe faYehra Stoqsocatalounedope c Prsibder Roy les Ordrer du Rey e a en de femreRabeit gercon en atan toyy It mert a Paris la nui't du feudy 2nou Gre tendra an'i690 -ep anfans junernt rrigue, Ct or 2f1nopces 1mage ematignon,fille du En 1mahgnon Co ntNormandie, JemBabhsle olbert auti coel
Marquus
Secvetaire
de
ustre
IEAN
lieu
Ordres
Intendane
la
Capitaine
deomerre
Jogny
faYehra
Stoqsocatalounedope
Ordrer
e
a
femreRabeit
en
atan
toyy
It
mert
feudy
Gre
1mahgnon
olbert
coel
Larme
COLBERT
Roy.En
deSes
aisme
Baptiste
Seignelay,&t
Marine
iddealegre,Iriedes
Vnef
f
Come
deuxere
bejoi
HChe
du
gercon
an'i690
2f1nopces
En
auti
Chter
le
autres
deSamaj
&
Comtes
allegre,maso
Dame
Margnedontila
ls
ches
Roy
les
Rey
-ep
rrigue,
or
ntNormandie,
JemBabhsle
De
Conou
Estat
et
Fils
Charon
Safne
BAPTISTE
Secretaire
Paris
nui't
2nou
tendra
junernt
1mage
ematignon,fille
tous
Ses
Conils
Comnader
MesTean
MESe
Comand,des
Generalde
Colbert,mistre
Esta
acpose
enpnopces
des
fleren
gnd
c
Prsibder
anfans
Ct
Co