Human Generated Data

Title

Jean Baptiste Colbert, Marquis de Seignelay
Date

1680
People

Artist: Nicolas de Larmessin the Elder, French c. 1640 - 1725
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from The Map Room, Widener Library, M12828

Human Generated Data

Title

Jean Baptiste Colbert, Marquis de Seignelay

People

Artist: Nicolas de Larmessin the Elder, French c. 1640 - 1725

Date

1680

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from The Map Room, Widener Library, M12828

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Person 98.5
Human 98.5
Art 85.4
Text 75.3
Painting 75.2
Poster 57.4
Advertisement 57.4

Clarifai
created on 2019-11-09

art 98.8
people 98.3
illustration 96
antique 95.2
print 94.8
painting 93
one 92.9
vintage 92.7
portrait 92.6
picture frame 92
adult 91.9
old 91.7
engraving 91.6
retro 89.5
decoration 89.4
symbol 88
ancient 87.5
baroque 86.9
Renaissance 86.7
historic 85.7

Imagga
created on 2019-11-09

stucco 58
old 39
vintage 32.3
antique 31.2
frame 30.1
art 29.7
retro 29.5
decoration 27.7
ancient 25.1
design 24.8
paper 24.3
shield 22.5
dollar 22.3
knocker 22.3
finance 22
currency 20.6
pattern 20.5
money 20.4
style 19.3
decorative 19.2
ornament 19
gold 18.9
cash 18.3
ornate 16.5
bank 16.5
blank 16.3
device 16.2
financial 16
armor 15.8
architecture 15.6
grunge 15.3
texture 15.3
wealth 15.3
bill 15.2
close 14.8
stamp 14.5
decor 14.2
business 14
window 14
banking 13.8
border 13.6
rich 13
framework 12.9
golden 12.9
wall 12.8
mail 12.5
protective covering 12.1
detail 12.1
empty 12
culture 12
one 12
letter 11.9
historic 11.9
postage 11.8
dollars 11.6
us 11.6
post 11.4
savings 11.2
luxury 11.2
classic 11.1
elegance 10.9
symbol 10.8
element 10.7
history 10.7
banknote 10.7
pay 10.6
object 10.3
floral 10.2
aged 10
postal 9.8
deco 9.8
card 9.7
portrait 9.7
amulet 9.7
hundred 9.7
metal 9.7
loan 9.6
building 9.6
artistic 9.6
closeup 9.4
carving 9.1
sign 9
museum 8.9
postmark 8.9
carved 8.8
baroque 8.8
wooden 8.8
classical 8.6
face 8.5
covering 8.5
wood 8.3
traditional 8.3
structure 8.1
backgrounds 8.1
treasury 8.1
religion 8.1
concepts 8
interior 8
charm 7.7
obsolete 7.7
wallpaper 7.7
exchange 7.6
ornamental 7.6
number 7.5
brown 7.4
investment 7.3
graphic 7.3
dirty 7.2
collection 7.2
icon 7.1
leaf 7

Google
created on 2019-11-09

Photograph 95
Illustration 72.5
Picture frame 70.2
Stock photography 69.2
Art 67.7
Circle 56.3
Portrait 55.1
History 54.1

Microsoft
created on 2019-11-09

text 99.9
book 98.4
human face 96.9
person 96
clothing 93.4
victorian 60.8
old 58.5
drawing 57.6
sketch 51.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 97.7%
Confused 1.5%
Angry 2.2%
Happy 0.8%
Fear 5.2%
Sad 37.8%
Calm 45.8%
Disgusted 2.9%
Surprised 3.6%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Poster 57.4%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-11-09

a close up of a book 41.3%
close up of a book 36.8%
a close up of a book cover 36.7%

Text analysis

Amazon

BAPTISTE
IEAN
Secvetare
Marquis
Con
COLBERT
tous
Charon
Et
Roy
Colbert
Dame
Fits
ME.Sre IEAN BAPTISTE COLBERT chter Marquis
Sa
u
et
Charon Sa feme
chter
Sseignelay,
Or
B
Sstat
pouse'
Comaderin
asne
Comand:
feme
aptis
Conee
Genevald laMarine Fits asne eTean B
pouse' renopces
eTean
autres
de Sseignelay, Et autres breux Conee u Roy En tous Ses Con ols
renopces
St
Mmimistre
Comand: es Or dres maj Secvetare Sstat et DeSses Comaderin
Genevald
laMarine
Secretau
ols
Colbert Mmimistre St Secretau 'Estat s de Dame aptis
'Estat
ME.Sre
Ses
dres
maj
de
En
DeSses
es
breux
balamnean
s

Google

De Larme COLBERT Chter Marquus Conou Roy.En tous Ses Conils Secvetaire Estat et deSes Comnader Fils aisme de MesTean Baptiste le Charon Safne ustre MESe IEAN BAPTISTE de Seignelay,&t autres lieu Comand,des Ordres deSamaj Intendane Generalde la Marine Colbert,mistre & Secretaire Esta acpose enpnopces iddealegre,Iriedes Comtes allegre,maso & de Dame Margnedontila ls Vnef Capitaine des ches deomerre Jogny fleren f Come deuxere gnd bejoi HChe faYehra Stoqsocatalounedope c Prsibder Roy les Ordrer du Rey e a en de femreRabeit gercon en atan toyy It mert a Paris la nui't du feudy 2nou Gre tendra an'i690 -ep anfans junernt rrigue, Ct or 2f1nopces 1mage ematignon,fille du En 1mahgnon Co ntNormandie, JemBabhsle olbert auti coel
De
Larme
COLBERT
Chter
Marquus
Conou
Roy.En
tous
Ses
Conils
Secvetaire
Estat
et
deSes
Comnader
Fils
aisme
de
MesTean
Baptiste
le
Charon
Safne
ustre
MESe
IEAN
BAPTISTE
Seignelay,&t
autres
lieu
Comand,des
Ordres
deSamaj
Intendane
Generalde
la
Marine
Colbert,mistre
&
Secretaire
Esta
acpose
enpnopces
iddealegre,Iriedes
Comtes
allegre,maso
Dame
Margnedontila
ls
Vnef
Capitaine
des
ches
deomerre
Jogny
fleren
f
Come
deuxere
gnd
bejoi
HChe
faYehra
Stoqsocatalounedope
c
Prsibder
Roy
les
Ordrer
du
Rey
e
a
en
femreRabeit
gercon
atan
toyy
It
mert
Paris
nui't
feudy
2nou
Gre
tendra
an'i690
-ep
anfans
junernt
rrigue,
Ct
or
2f1nopces
1mage
ematignon,fille
En
1mahgnon
Co
ntNormandie,
JemBabhsle
olbert
auti
coel