Professional Documents
Culture Documents
tions. Exact and approximate forms of bound are presented. The ap- Also
proximation error is of second order in the number of measurements.
-
%" = cos ($,+,(n)); -
a v n = sin ( # , ( n ) )
ab0 ab0
I. INTRODUCTION
The purpose of this correspondence is to derive the Cramer-Rao = -Amnmbo sin (4u(n)); aY, = A"'nmboCOS ( $ M ( n ) ) .
dam dam
lower bound (CRLB) for complex signals with constant amplitude
and polynomial phase, measured in additive Gaussian white noise. (9)
The signal model is Substitution of (8) and (9) into (7) yields
2N
Jh.h = a'L
The corresponding sampled signal, with added noise, is given by
0 5 m l , m 2 IM
where S, is defined by
where A is the sampling interval, and { w,} is an i.i.d. sequence N
of com lex Gaussian random variables with zero mean and vari-
P
ance U . The unknown parameters are assumed to be the amplitude S, = C nm.
b,, and the phase coefficients { ao, a , , ---
, a M } .The CRLB de-
In= I
11. DERIVATION
OF THE CRLB
Let s, and zn be as in ( 2 ) , and denote
zn = x, + jy,; s, = pn + jv,; 1 5 n IN (3) As we see, the CRLB for bo is decoupled from that of the other
M parameters, and we get
4,+,(n) = mC ambmnm. (4) IS2
=O var { b o } 2 -.
2N
Then
pn = bo COS (4dn)); = bo sin (4dn)). We now turn our attention to the CRLB for the phase parameters.
vn (5)
Equation (19) is exact for all N , and can be used for numerical
The logarithm of the joint probability density function of { z n } is computation of the CRLB. The entries of are given by [ 2 , p.
given by 1071
continue to derive an approximation for the CRLB, assuming that Also, the vector h is just the first column of H i : I, so its kth entry
N is moderately large compared to the degree of the phase poly- is given by
nomial M. This approximation will be more practical to compute,
+ k + 1)(M + 1 ) M +k
and also more instructive, as we shall see in the sequel.
We get from ( 1 8 ) and ( 2 1 ) hk =
(-l)k(M
( k + 1) ( )(:)'
k (31)
where 1k.l
l
-N-'Eiil[8;:I + - (1 h h ' -
2N
gg') + O(N-')
I
EiYl
(26)
Substitution of (17), ( 2 3 ) , ( 2 4 ) , and ( 3 3 ) into (19) yields the
following approximate bound:
where ,
1
var Id,,,}L
g = H i ! +le; h = A i : I f. (27) 2N( T ) 2 m* SNR
In [ 3 , p. 341, the following formula is derived for the entries of
the inverse of :
(&I ) =
(-l)k+/(M k 1)(M + + + 1 + 1)
M+l k.1 (k+l+l)
M
(-l)k+/(M k 1)(M + + +1 + 1) This expression may be useful in interferometry or time delay ap-
gl. =
/=0 (k+l+ 1) plications, where one is interested in the constant part of the phase.
The CRLB for 8 , is given by
-
- [ M ( M+ l ) ( M
+ O(N-2)
+ 2)12
1
2NT2 * SNR
152 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 39, NO. 3. MARCH 1991
TABLE I [3] R. T. Gregory and D.L. Kamey, A Collection of Matrices for Testing
THEhfAXIMUM RELATIVE
ERRORAS A FUNCTION
OF M A N D N Computational Algorithms. New York: Wiley, 1969.
[4] J. Riordan, Combinatorial Identities. New York: Wiley, 1968.
M N = 32 N = 64 N = 128 N = 256 N = 512 N = 1024 [ 5 ] S. Peleg and B. Porat, “Estimation and classification of polynomial-
phase signals,” IEEE Trans. Inform. Theory, vol. 37, no. 2, Mar.
1 0.15% 0.04% 0.01% 0.002% 0.0005% 0.0001% 1991.
2 1.0% 0.25% 0.06% 0.02% 0.004% 0.001%
3 3.3% 0.87% 0.22% 0.06% 0.01% 0.004%
4 7.8% 2.1% 0.56% 0.14% 0.04% 0.009%
5 15.0% 4.3% 1.2% 0.3% 0.08% 0.02%
A System Identification Algorithm Using Orthogonal
Functions
This expression is of interest for estimating the linear phase term
(initial frequency), e.g., for estimating the target velocity from Hector Perez and Shigeo Tsujii
Doppler measurements.
The CRLB for dM is given by
Absfruef-A new adaptive filter (ADF) structure is proposed for ap-
plications in which large order ADF’s are required. It is based on mod-
eling the impulse response of the system to be indentified as a linear
combination of a set of discrete orthogonal functions. Computer sim-
ulations using actual acoustio echo path impulse responses show that
the proposed ADF structure has better convergence performance than
This expression is of interest when using the received signal for FIR transversal ADP when they are required to identify systems with
identifying the degree of the phase polynomial, see [5] for details. long impulse responses.
Note that the first-order term is identically zero in (37).
111. NUMERICAL
RESULTS I. INTRODUCTION
In order to test the accuracy of the approximate CRLB derived Over the last decade, IIR adaptive filtering (IIR ADF) has been
in this paper, we computed both the exact and the approximate actively researched. However, several problems still remain un-
bounds for several representative values of N and M, in the range solved. These include potential instability of the filter, the possi-
32 5 N 1024 and 1 5 M 5 5. The exact bound was computed bility of local minimums of the mean-squared error (MSE) surface,
by numerical inversion of H,,,. It was found that, for M > 5 or and slow convergence.
for N > 1024, this matrix was so ill conditioned that numerical Although IIR ADF based on the equation error method can over-
inversion was impossible. For each case, we computed the relative come some of above problems, such as slow convergence and local
percent errors of the approximations for all 0 5 rn 5 M and picked minimums of MSE surface, this structure is not without problems
the largest one. Table I shows the results of these computations. It and it does not seem to be an attractive alternative to FIR ADF in
was found that the relative error is always the largest for rn = 0, applications such as acoustic echo cancellation, in which large fil-
and decreases monotonically with m. Hence, the numbers in the ters order are required to maximize the echo return loss enhance-
table always correspond to the relative error of the bound for ao. ment (ERLE) and convergence rate, etc. [4]. In addition, a stability
We can conclude from these results that the approximation is test is required during “double talk periods”-simultaneous talk
excellent whenever N is at least, say, 20 times the value of M. between the near and far end speakers-in which, in order to avoid
distortion, the adaptive filter is changed into a fixed structure.
In this correspondence, a new adaptive filter structure is pro-
IV. CONCLUSIONS posed for applications in which large order FIR ADF’s are re-
We have derived explicit formulas for the Cramer-Rao lower quired. It is based on modeling the impulse response of the system
bound on the variance of estimated parameters of signals with con- to be identified as a linear combination of a set of discrete Legendre
stant amplitude and polynomial phase. The exact bound requires orthogonal functions. The proposed adaptive filter structure has the
numerical inversion of an ill-conditioned matrix, while its O ( N ) -’ desirable stability features and unimodal mean-square error surface
approximation is free of matrix inversion. The approximation was as well as a modular structure that permits an easy increase of the
tested for several typical parameter values, and was found to be filter order without changing the previous stages. Computer simu-
excellent in most cases. lations, in which the proposed structure is used to identify actual
The formulas derived in this correspondence are of practical value acoustic echo path impulse responses, show that Legendre ADF
in several radar applications, such as ELINT for special pulse- has better convergence performance than transversal ADF when it
compression radars, and motion estimation from Doppler measure- is required to identify systems with long impulse response.
ments. In many applications, the desired estimation accuracy is
known (or assumed). The formulas given in this paper can be used 11. SYSTEMIDENTIFICATION
ALGORITHM
to determine the required SNR, or the number of samples, or the
observation time, depending on the specific application. Yet an- Orthogonal polynomials such as Laguerre, Legendre, Hermite,
other application of the CRLB is as a benchmark against which and Chebyshev orthogonal functions have been widely used in the
candidate algorithms can be tested. Examples of such algorithms derivation of several system identification algorithms, most of them
are given in [ 5 ] . involving matrix operations 161. However, since the proposed
adaptive filter structure is intended to be used when large order
REFERENCES
Manuscript received December 14, 1988; revised May 8. 1990.
[ I ] A. W. Rihaczek, Principles of High-Resolution R u h r . Los Altos, The authors are with the Department of Electrical and Electronic Engi-
CA: Peninsula Publishing, 1985. neering, Tokyo Institute of Technology. 0-okayama, Meguro-ku Tokyo
[2] M. R. Spiegel, Mathemarical Handbook of Formulus and Tables 152 Japan.
(Schaum Outline Series). New York: McGraw-Hill, 1968. IEEE Log Number 9041615