Human Generated Data

Title

Pepin, First Duke of Brabant, and His Daughter, Bega
Date

17th century
People

Artist: Frans van der Steen, Dutch 1626 - 1679

Artist after: Peter Paul Rubens, Flemish 1577 - 1640
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Nelson Goodman, M15701

Human Generated Data

Title

Pepin, First Duke of Brabant, and His Daughter, Bega

People

Artist: Frans van der Steen, Dutch 1626 - 1679

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Nelson Goodman, M15701

Machine Generated Data

Tags

Amazon
created on 2019-08-07

Art 98.1
Painting 95.5
Person 93.6
Human 93.6
Person 90.7

Clarifai
created on 2019-08-07

people 99.9
two 98.9
adult 98.9
portrait 98.8
art 98.3
man 96.7
engraving 96.1
print 95.8
veil 95
wear 93.8
woman 93.7
leader 93.2
one 91
illustration 90.1
three 89.6
group 89.5
affection 88.2
royalty 86.7
lid 86.7
interaction 85.9

Imagga
created on 2019-08-07

sketch 60.1
drawing 43.4
representation 37.4
book jacket 35.6
sculpture 29.8
art 28.8
statue 28.3
religion 27.8
jacket 27.7
god 23
wrapping 21.1
money 20.4
church 20.4
currency 19.8
culture 19.7
ancient 19
covering 17.2
religious 16.9
dollar 16.7
cash 16.5
face 16.4
portrait 16.2
old 16
architecture 15.7
holy 15.4
antique 15.3
history 15.2
close 14.3
symbol 14.2
banking 13.8
closeup 13.5
decoration 13.4
one 12.7
catholic 12.7
wealth 12.6
bank 12.6
vintage 12.4
bill 12.4
historical 12.2
finance 11.8
paper 11.8
design 11.6
financial 11.6
museum 11.6
saint 11.6
spirituality 11.5
faith 11.5
temple 11.4
detail 11.3
comic book 11.2
golden 11.2
figure 11.1
painter 11.1
banknote 10.7
marble 10.7
dollars 10.6
spiritual 10.6
business 10.3
monument 10.3
stone 10.2
bible 9.8
us 9.7
icon 9.5
carving 9.4
savings 9.3
rich 9.3
economy 9.3
man 8.7
pray 8.7
prayer 8.7
artist 8.7
exchange 8.6
decorative 8.4
city 8.3
historic 8.3
mask 8.2
roman 8
masterpiece 7.9
mosaic 7.8
worship 7.7
person 7.7
luxury 7.7
bust 7.7
loan 7.7
head 7.6
famous 7.5
style 7.4
gold 7.4
investment 7.3
artwork 7.3
makeup 7.3
people 7.3
dress 7.2
building 7.1
model 7

Google
created on 2019-08-07

Painting 89
Art 86.2
Drawing 85.9
Lady 84.3
Portrait 76
Visual arts 75.9
Illustration 71.8
Sketch 70.9
Stock photography 65.4
Picture frame 61.8
Artwork 61.8
Vintage clothing 52.1
Style 51

Microsoft
created on 2019-08-07

text 100
book 99.8
sketch 99.6
drawing 99.5
human face 97.3
painting 96.6
person 92.6
art 89
clothing 87.9
woman 76.2
hat 68.7
portrait 52.3
fashion accessory 51.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-44
Gender Male, 96.5%
Sad 4.7%
Happy 2.6%
Angry 6.4%
Confused 8.3%
Calm 62.3%
Disgusted 9.1%
Surprised 6.5%

AWS Rekognition

Age 26-43
Gender Female, 65.1%
Disgusted 1.4%
Surprised 5.9%
Happy 0.3%
Calm 74%
Sad 11.9%
Angry 2.9%
Confused 3.5%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 95.5%
Person 93.6%

Categories

Imagga

people portraits 94.2%
paintings art 5.3%

Captions

Text analysis

Amazon

PHILIPPO
Ducis
F
BEGGA.
VALKENISSE,
PIPINI
Priario
PIPINVS
F BRAB.
Furudatricis
PIPINVS I.
D.
BR
llustrium
S. BEGGA.
Antuerpia
I.
PIPINI1
Clarisfimo,
Secretario.
BRAB.
S
Przsantisfimog,
Curlod
Brabantia
hane
Clarisfimo, Przsantisfimog, uiro D. PHILIPPO DE VALKENISSE, Iuriscohulwo, Priario Vrhis Antuerpia Secretario. Archrui Vrhiei Curlod Patriae Artineituitis
uiro
Paul,
S.
Patriae
udionshmo,
Vrhis
Filia.
Rubenio,
udionshmo, hane PIPINI1 Brabantia Ducis mls Filia. S BEGga Ducis llustrium Viramuimt Namurcum Furudatricis ETFnies,
VX
Vrhiei
Namurcum
Archrui
Viramuimt
DE
ETFnies,
Iuriscohulwo,
Artineituitis
VX HI.
Fof Paul, Rubenio, EuitE
BEGga
EuitE
HI.
Fof
ll
Y
K
mls

Google

S. PIPI NVS, I. BRA BANTI E DVX S. BEGGA, PIPINI F. BRAB. DVX III Clarisfimo Prastantisfimog airo D. PHILIPPO DE VALKENISSE, Iuriscomfulo, Primario Vrbis Antuerpie Secretario, et Archui Vbici Cuflodi, Patria Antiquitats feudigfes furo, hane S. PIPINI, I. Brabantia Ducis, eiu Filie, S BEGG. Duc II. lustrium Vrgmum Canonicarum Andane, ud Namircum, Fundatricis ffigies 4 Pir. Pa Rubenio, Equite,e priscus tahuhs deneatas, Cura fuà ari ncifas, La Mer. Dedicabat Franciec, vanden Wynga oe exad dre nd Fr Pa Rabs p. aerde Fre dn Stren fuf
S.
PIPI
NVS,
I.
BRA
BRAB.
DVX
D.
PHILIPPO
Iuriscomfulo,
Primario
Secretario,
et
Antiquitats
feudigfes
PIPINI,
eiu
Duc
II.
lustrium
Vrgmum
Canonicarum
Namircum,
Fundatricis
ffigies
Pa
Rubenio,
tahuhs
ari
ncifas,
Wynga
dre
nd
Fr
aerde
Fre
fuf
BANTI
E
BEGGA,
PIPINI
F.
III
Clarisfimo
Prastantisfimog
airo
DE
VALKENISSE,
Vrbis
Antuerpie
Archui
Vbici
Cuflodi,
Patria
furo,
hane
Brabantia
Ducis,
Filie,
S
BEGG.
Andane,
ud
4
Pir.
Equite,e
priscus
deneatas,
Cura
fuà
La
Mer.
Dedicabat
Franciec,
vanden
oe
exad
Rabs
p.
dn
Stren