Professional Documents
Culture Documents
CompAI - Learning Algorithms For A Neural Network With Laterally Inhibited Receptive Fields - 1998 - Neural Networks Proceedings, IEEE
CompAI - Learning Algorithms For A Neural Network With Laterally Inhibited Receptive Fields - 1998 - Neural Networks Proceedings, IEEE
ally I ~ ~ i b ~ ~ e ~
Qiang Gan*#,Jun Yao' and K.R.Subramanian*
1. Introduction
Neural networks have been established as a general tool
for approximation and classification by fitting
inputloutput data effectively into nonlinear models. The
multilayer perceptron, in which a neuron receives inputs
from all the neurons in the adjacent pre-layer, is widely
used for function approximation and signal classification.
On most occasions it performs quite satisfactorily.
However, when the network input is characterized by
time-frequency localized features, the generally used
multilayer perceptron with unconstrained global
connections between the adjacent layers does not work
well. In the human visual system there exist example
models for dealing with this problem [l]. That is the
conception of receptive field, the shape of which can be
adapted with the visual input under certain constraints. In
the human visual system there are various receptive fields
of different shapes. For example, there are Gauss function
shaped receptive fields for local smoothing, and Gabor
1156
i = 1,2,......, NOL.
s( t ) = (1 - e-') /
where, y f L and
X,
(1 + e-.' )
network respectively,
represent the weights between
output and hidden layers, h ( ( j - b 1 ) / u , ) produce the
weights between hidden and input layers, and NOL, NHL,
NIL are respectively the number of nodes in output,
hidden, and input layers.
3. Learning algorithms
-0.5
-5
1157
parameters
(14)
=nlboal
1158
where, f* and A,, are the centre and the radius of the
mother wavelet h(t), respectively, while "and A, are
those of the Fourier transform i ( w ) , respectively.
Actually, t * , A h , w ' , a d Ah can be determined by
w, and CT which are parameters in the Gabor function.
Selecting suitable values for parameters a, and bo is
important. From the point of view of function
reconstruction, we hope that suitable selection of a, and
bo can make h,(t) constitute a tight frame [3]. On the
other hand, from the point of view of filter banks, we hope
that the windows defined by h,, (t) can properly cover the
interesting areas in the time-frequency plane. Because we
are interested in extracting useful time-frequencylocalized
features, we will select the values of a, and bo from the
point of view of filter banks. If a, and bo are not properly
selected, the windows will be too sparse to cover the whole
( n + l)boar+ a r t * - arA,
= nboa," + art" + a,"Ah ,
Le., bo = 2Ah
(18)
w*
fmin
5%
or
t8
xa'*
-- >n>---
bo
a30
t*
bo
(if bo c0)
(23)
4. Simulation studies
To test the classification performance of the neural
network with laterally inhibited receptive fields and the
corresponding learning algorithms, we apply the network
to ECG signal classification. The hidden layer consists of
three subnetworks, each receiving one period of the ECG
signal respectively. All the outputs of the subnetworks are
connected to an output layer where the final classification
is accomplished. The network size is set as follows:
NOL=4, NIL=460x3, and the size of the hidden layer is
determined by the learning algorithm. Three subnetworks
are needed because generally at least three periods of ECG
signals are required for diagnosing some cardiac disease
[5]. Because the page length of the paper is limited, the
details of the network architecture are not fully discussed
here. The input-output function of the network is given as
follows:
f max
0 5 nb,a," + a r t * 5 T,,
Hence, the ranges of m and
follows:
(20)
should be constrained as
1159
i = 42,. .....,NOL
where, k is the subnetwork index. In the case of applying
continuous wavelets, a, and b, are directly trained
according to (4)-(13). If discrete wavelets are used,
a, and b, are calculated according to (14), with
ao,bo,m, undn, determined by (17)-(18) and (21)-(23).
Normal
Infarct
1160
References
1161