Human Generated Data

Title

Illustration X
Date

c. 1489
People

Artist: Anonymous Switzerland (Basle) 1499, Swiss 15th century
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M3896

Human Generated Data

Title

Illustration X

People

Artist: Anonymous Switzerland (Basle) 1499, Swiss 15th century

Date

c. 1489

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Philip Hofer, M3896

Machine Generated Data

Tags

Amazon
created on 2019-11-01

Art 85.1
Human 80.5
Person 80.5
Text 76.6
Painting 72.4
Person 63.2
Person 63.1
Poster 56.6
Advertisement 56.6

Clarifai
created on 2019-11-01

art 98.5
illustration 98.2
manuscript 97.7
retro 96.6
old 96.6
text 95.7
vintage 95.3
painting 95.2
antique 94.1
paper 93.8
chalk out 93.5
ancient 91.9
print 91.5
people 91.1
religion 90.8
bill 90.7
picture frame 89.6
decoration 89
symbol 89
design 88

Imagga
created on 2019-11-01

brass 85.6
memorial 71
structure 48.3
cloud 31
old 30.7
art 27.7
artwork 25.7
cover 25
antique 24.3
book 23.6
composition 23.6
backdrop 23.1
advertising 23.1
decor 23
fabric 22.6
definition 22.6
design 22.5
advertisement 22.2
decorative 21.7
associated 21.7
association 21.7
collection 21.7
brochure 21.5
carpet 21.4
advertise 21.4
decoration 20.9
vintage 20.7
element 20.7
creative 20.3
conceptual 20.3
continuity 19.8
drapery 19.7
paper 19.6
ancient 19.1
religion 16.2
graphic 16.1
idea 16
texture 16
page 15.8
retro 15.6
map 15.5
history 15.2
business 15.2
text 14.9
bible 14.7
letter 13.8
holy 12.5
book jacket 12.4
religious 12.2
grunge 11.9
pattern 11.6
faith 11.5
new 11.4
church 11.1
money 11.1
close 10.9
information 10.6
prayer 10.6
jacket 10.6
creation 10.3
product 9.9
currency 9.9
detail 9.7
read 9.6
spiritual 9.6
god 9.6
capital 9.5
print 9.4
writing 9.4
city 9.2
data 9.1
aged 9.1
comic book 8.9
words 8.8
pages 8.8
newspaper 8.8
scrapbook 8.7
saint 8.7
notes 8.6
representation 8.6
cross 8.5
finance 8.5
stone 8.4
communication 8.4
frame 8.3
keywords 7.9
sepia 7.8
travel 7.8
blackboard 7.7
wall 7.7
word 7.6
note 7.4
historic 7.3
wrapping 7.3
cash 7.3
daily 7.3
dirty 7.2
open 7.2
bank 7.2

Google
created on 2019-11-01

Text 90.3
History 76.7
Art 74
Miniature 68
Middle ages 66.2
Ancient history 58.3
Illustration 50.4

Microsoft
created on 2019-11-01

text 99.9
manuscript 92.8
cartoon 87.7
drawing 78.7
illuminated 77.8
person 72.5
book 70.3
poster 62.4
woodcut 61

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 27-43
Gender Female, 50.2%
Happy 45%
Angry 45%
Sad 45%
Disgusted 45%
Calm 54.9%
Confused 45%
Surprised 45%
Fear 45%

AWS Rekognition

Age 34-50
Gender Male, 50.2%
Confused 45%
Fear 45%
Surprised 45%
Happy 45%
Calm 45.4%
Angry 45%
Sad 54.5%
Disgusted 45%

Feature analysis

Amazon

Person 80.5%
Poster 56.6%

Categories

Imagga

paintings art 90.2%
streetview architecture 9.5%

Captions

Microsoft
created on 2019-11-01

a sign on the side of a building 83.1%
a book on the side of a building 53.2%
a sign on the side of a book 53.1%

Text analysis

Amazon

fuit
peccadi
plus
in
fami
ouricia
pcto
reuocare.
nec
ma
polito
vederesinimicis
mibi
liaritas
polito plus peccadi accedola accelti cu Juda
amicabilis
accedola
cu
milero
Judel
potuit
pctozi/ve
focio
accelti
colloquy
latronib'traderes.
moatali
Judas
Juda
tas/ nec amicabilis ofculi ma
mibi focio totIES pctozi/ve
vederesinimicis latronib'traderes. ach Judas
ofculi
licia
qUT ouricia fuit in tel nec cene/ COUiLT fami
tel
Judel in pcto moatali cu P2o
licia potuit re reuocare. dlemili milero ocepra
P2o
liaritas nec cobrequnj bumilitas colloquy luauio
bumilitas
tas/
ach
qUT
cene/
totIES
cobrequnj
ocepra
re
dlemili
COUiLT
luauio

Google

vederes
inimicist
Judas
ouricia
fuir
in
te/onec
cene/neccouiun
fami
suaui
tas/necamicabilis
poruittereuocare.
Jude/
qtoties
pzo
peccadiaccedo/zacceffi
cu
Juda
ad
onilad
facramet.
Elemibimiferrimo
boi:imo
iniufte
faciedo
primü
bonissuis
ecipie
vederes inimicist latronib'traderes.Bcb Judas quata ouricia fuir in te/onec cene/neccouiun fami liaritas/necobfequn bumilitas/neccolloqui suaui tas/necamicabilis ofculi/mulcebzitasapcepta ma licia poruittereuocare. emibimifero pctozi/ve mibisocio Jude/ qtoties in pcto moztali/z ci pzo pofito plus peccadiaccedo/zacceffi cu Juda ad me las onilad cena agnipafcalis facratiffimi facramet. Elemibimiferrimo boi:imo peioziJuda veditoze dtotles iniufte faciedo primü in bonissuis ecipie
latronib'traderes.Bcb
quata
liaritas/necobfequn
bumilitas/neccolloqui
ofculi/mulcebzitasapcepta
ma
licia
emibimifero
pctozi/ve
mibisocio
pcto
moztali/z
ci
pofito
plus
me
las
cena
agnipafcalis
facratiffimi
peioziJuda
veditoze
dtotles