Human Generated Data

Title

Ecce Homo

Date

1612

People

Artist: Lukas Kilian, German 1579 - 1637

Artist after: Parmigianino, Italian 1503 - 1540

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3981

Human Generated Data

Title

Ecce Homo

People

Artist: Lukas Kilian, German 1579 - 1637

Artist after: Parmigianino, Italian 1503 - 1540

Date

1612

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3981

Machine Generated Data

Tags

Amazon
created on 2019-08-08

Human 99.2
Person 99.2
Person 98.8
Art 91.6
Person 90.7
Painting 82.1
Postage Stamp 59.8
Archaeology 55.5
Person 48.2

Clarifai
created on 2019-08-08

people 99.9
art 99.6
man 99.3
adult 99.3
print 98.9
illustration 98.7
painting 98.5
portrait 96.5
Renaissance 96.4
one 95.7
veil 95.6
two 95.5
leader 95.3
religion 95.2
facial hair 95.1
engraving 92.1
saint 89.8
wear 88.8
crown 88.4
god 88.3

Imagga
created on 2019-08-08

sketch 67.9
drawing 48.3
representation 43.1
money 31.5
currency 28.7
cash 28.4
dollar 27.9
paper 24.3
sculpture 23.3
art 22.8
religion 22.4
bank 22.4
banking 21.2
finance 21.1
bill 20.9
statue 20.9
architecture 20.9
ancient 19.9
history 19.7
business 19.5
wealth 18.9
dollars 18.4
stone 18.3
financial 17.8
book jacket 17.6
temple 17.6
us 16.4
carving 16.2
old 16
monument 15.9
comic book 15.6
hundred 15.5
culture 15.4
pay 15.4
religious 15
one 14.9
savings 14.9
close 14.9
loan 14.4
exchange 14.3
jacket 13.7
god 13.4
memorial 13.3
vintage 13.2
rich 13
franklin 12.8
holy 12.5
famous 12.1
figure 12.1
church 12
structure 12
antique 11.9
spirituality 11.5
face 11.4
historical 11.3
travel 11.3
investment 11
column 10.9
brass 10.8
symbol 10.8
wrapping 10.4
closeup 10.1
historic 10.1
tourism 9.9
banknotes 9.8
carved 9.8
bills 9.7
banknote 9.7
success 9.7
payment 9.6
capital 9.5
commerce 9.3
economy 9.3
cemetery 9.2
market 8.9
funds 8.8
finances 8.7
profit 8.6
city 8.3
decoration 8.3
note 8.3
landmark 8.1
man 8.1
building 8
president 7.9
legal 7.8
states 7.7
price 7.7
spiritual 7.7
notes 7.7
museum 7.4
tourist 7.3
covering 7.1

Google
created on 2019-08-08

Microsoft
created on 2019-08-08

text 100
book 100
painting 92.7
drawing 87.9
art 79.6
sketch 76.1
person 68.5
human face 66

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-30
Gender Male, 58.2%
Happy 1.4%
Calm 9.8%
Angry 11.5%
Sad 63.1%
Confused 1.8%
Disgusted 3.3%
Fear 6.9%
Surprised 2.2%

AWS Rekognition

Age 26-42
Gender Male, 99.2%
Angry 0.8%
Calm 93.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0.1%
Sad 5.5%
Confused 0.1%

AWS Rekognition

Age 44-62
Gender Male, 95.7%
Disgusted 1.3%
Fear 0.4%
Confused 0.5%
Calm 57.9%
Happy 0.1%
Sad 37.7%
Surprised 0.3%
Angry 1.7%

AWS Rekognition

Age 22-34
Gender Male, 52%
Disgusted 45.5%
Surprised 45.2%
Fear 45.3%
Sad 47.4%
Confused 48.6%
Happy 45.3%
Angry 45.5%
Calm 47.2%

AWS Rekognition

Age 51-69
Gender Male, 52.6%
Surprised 47.4%
Sad 45.1%
Angry 45.3%
Calm 46.7%
Fear 45.1%
Disgusted 45.3%
Happy 49.6%
Confused 45.5%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 82.1%

Categories

Captions

Microsoft
created on 2019-08-08

an old photo of a book 67.4%
a close up of a book 64.1%
an old photo of a person 64%

Text analysis

Amazon

ECCE
CHRISTI
teneras
Funis
NOBILI
Spinarum,
corona,
vinciat,
ET
hisce
CHRISTI,
verpums
Pslatum,
ecce,
DN.
REVERENDO.
ridentem
IBIDEM
en
HOMO,
ECCLESIAE
PATRONO
Spinarum, CHRISTI punctuom caput, ecce, corona, Pslatum, em; CHRISTI, en ridentem vuilnera verpums
REVERENDO. NOBILI ET CL.VIRO DN. HRISTOPHORO RECHLINGEROLVD.CATHEDRALIS ECCLESIAE FRESINGEN.
NEC
S.VITVM
salus
caput,
ESTE.
HRISTOPHORO
CANONICO.
Dic,
CANONICO. ET NEC NON IBIDEM S.VITVM BREPOSITO ET PATRONO ESTE.
NON
vulneribus
FRESINGEN.
CL.VIRO
pondet
KILIANVS
Funis ufi teneras vinciat, ecce, manis. Dic, mea vulneribus pondet ab hisce salus
vuilnera
RECHLINGEROLVD.CATHEDRALIS
mea
DLVVS
AVG
BREPOSITO
punctuom
em;
ufi
manis.
ab

Google

TLE
HOMO
en;
en
rideniem
vulnera
verrum
Dic,
mea
vulneribus
pendet
ab
lhisce
salus
Spinarum,
CHRISTI
caput,
uti
ecce,
RECHLINGER0,I.V.D.CATHEDRALIS
DEMISSA
EVCAS
KILIANVS
GLYPTES
AVC
circur
Parmesan.
pinseif
L.
Kil.
scalp.
ct
escc.
priul
TLE ECCE HOMO Palatum, en; CHRISTI, en rideniem vulnera verrum Dic, mea vulneribus pendet ab lhisce salus Spinarum, CHRISTI punchum caput, ecce, corona, Funis uti teneras vinciat, ecce, manus. RECHLINGER0,I.V.D.CATHEDRALIS ECCLESIA FRISINGEN BREPOSITO:SVPTIL.ET ELEGANT.ARTIVM PATRONO ET ESTE VINDEL.OBSERV. MONVM.HVMIL. DDDT.A.C.N.CID 1DC XII S. Ce. M. REVERENDO, NOBILLET CL.VIRO DN. CHRISTOPHORO CANONICO, ET SCHOLASTICO: NEC NON IBIDEM AD S.VITVM SINGVL.DNO SVO DEMISSA OBSERV.COL EVCAS KILIANVS GLYPTES AVC Frar circur Parmesan. pinseif L. Kil. scalp. ct escc. com priul
ECCE
Palatum,
CHRISTI,
punchum
corona,
Funis
teneras
vinciat,
manus.
ECCLESIA
FRISINGEN
BREPOSITO:SVPTIL.ET
ELEGANT.ARTIVM
PATRONO
ET
ESTE
VINDEL.OBSERV.
MONVM.HVMIL.
DDDT.A.C.N.CID
1DC
XII
S.
Ce.
M.
REVERENDO,
NOBILLET
CL.VIRO
DN.
CHRISTOPHORO
CANONICO,
SCHOLASTICO:
NEC
NON
IBIDEM
AD
S.VITVM
SINGVL.DNO
SVO
OBSERV.COL
Frar
com