Human Generated Data

Title

Maximilian, Archduke of Austria
Date

17th century
People

Artist: Dominicus Custos, German after 1550 - 1612
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R13493

Human Generated Data

Title

Maximilian, Archduke of Austria

People

Artist: Dominicus Custos, German after 1550 - 1612

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-08

Human 98.5
Person 98.5
Money 81.1
Art 76.4
Painting 71.7
Dollar 56.4

Clarifai
created on 2019-08-08

people 98.7
one 97.9
art 96.7
portrait 95.4
leader 94.2
religion 93.6
saint 93
adult 92.7
symbol 90.3
man 89.2
crown 88.1
church 87.9
illustration 86.5
print 83.8
sculpture 83.6
facial hair 80.9
money 79.1
engraving 78.4
old 78.3
administration 78.2

Imagga
created on 2019-08-08

mosaic 93.7
transducer 44.2
art 42
money 35.8
ingot 34.8
currency 33.3
electrical device 33.1
cash 31.2
dollar 30.7
finance 28.8
paper 27.5
block 27
religion 26.9
bank 26.9
wealth 25.2
ancient 24.2
history 24.2
financial 24.1
banking 23.9
architecture 23.8
dollars 23.2
device 22.9
culture 22.2
business 21.3
old 20.9
one 20.2
temple 20.2
bill 20
creation 19.8
close 19.4
hundred 19.4
us 19.3
pay 19.2
sculpture 19
religious 18.8
relief 18.3
god 18.2
savings 17.7
franklin 17.7
rich 17.7
loan 17.3
exchange 16.3
statue 16.2
face 15.7
stucco 14.9
detail 14.5
church 13.9
golden 13.8
historic 13.8
spirituality 13.5
gold 13.2
decoration 13
finances 12.6
commerce 12.2
monument 12.2
closeup 12.1
antique 12.1
travel 12
landmark 11.8
instrumentality 11
investment 11
palace 10.9
bills 10.7
banknote 10.7
holy 10.6
historical 10.4
carving 10.2
stone 10.1
symbol 10.1
roman 10.1
profit 9.6
pattern 9.6
coin 9.6
famous 9.3
ornate 9.2
museum 9.1
vintage 9.1
tourism 9.1
concepts 8.9
market 8.9
success 8.9
president 8.9
wages 8.8
banknotes 8.8
carved 8.8
object 8.8
worship 8.7
payment 8.7
spiritual 8.6
east 8.4
number 8.4
icon 7.9
bangkok 7.9
funds 7.9
paying 7.8
portrait 7.8
sign 7.5
economy 7.4
sale 7.4
note 7.4
design 7.3
tourist 7.3
building 7.3
nobody 7

Google
created on 2019-08-08

Facial hair 92.4
Art 83.4
Stock photography 75.6
Painting 75.3
History 75.2
Beard 74.6
Portrait 73.9
Illustration 73.8
Picture frame 73.8
Prophet 70.4
Moustache 64.5
Self-portrait 52.8
Historian 50.7

Microsoft
created on 2019-08-08

text 99.7
book 98.1
human face 94.7
drawing 94.6
sketch 90.5
person 85.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 85.5%
Disgusted 0.7%
Angry 1.7%
Happy 1.8%
Confused 4.7%
Sad 20.8%
Calm 69.3%
Surprised 1%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 71.7%

Captions

Microsoft

a close up of a book 62.7%
an old photo of a book 58.3%
close up of a book 58.2%

Text analysis

Amazon

SE
TEVT
TIROLIS
FATA
MAGIST
REX
ORDINIS
ARCHIDVX
TEVT MAGNVS MAGIST
VIRIVTE
MAKIMILANVS
LSAV
MAGNVS
ORDINIS ICISTMDACV TIROLIS Ao.M.D.XCVI
D.C.excud.augf
OVEMVR.
Ao.M.D.XCVI
VIRIVTE XAIISAV SE LSAV
FATA OVEMVR. DAT XACI
XACI
POL.
.FLECT
DIGIELECT .FLECT
DIGIELECT
DAT
ICISTMDACV
XAIISAV

Google

DVX
BVRG
SE
D.C.
excut
TIROLIS
A
POL
ORDINIS TEVT. MAGNVS AVST. DVX BVRG FATA VIRTVTE SE OVEMVR D.C. excut augf COM TIROLIS MAGIST A M.DXCVI MAXIMILIANVS D. D.G.ELECT POL REX ARCHIDVX
TEVT.
OVEMVR
MAGIST
M.DXCVI
ARCHIDVX
VIRTVTE
MAXIMILIANVS
D.
ORDINIS
MAGNVS
AVST.
FATA
augf
D.G.ELECT
COM
REX