Professional Documents
Culture Documents
NOMENCLATURE
854 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 38, NO. 3 JULY 2002
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
¾d2 , ¾h2 , ¾dh Variance of measurement errors in
Cartesian coordinates (abscissa,
ordinate) and their
cross-covariance, respectively
§k = fsk (i) : i = Set of random samples
1, : : : ng (particles)
Jk+1 Information matrix, dim(4,4) Fig. 1. Coordinate reference system.
ªk , Fk Jacobians, dim(4,4) and dim(2,4),
respectively
»kjk (i), ³kjk (i), Wi Sigma points and weights for UKF. and consistency tests are presented in Section VI.
Our conclusions are collected in Section VII. The
contribution of this work to the state of the art is to
II. INTRODUCTION have compared the performance of two popular (the
EKF and the CADET) and two modern (the PF and
The problem of tracking ballistic objects in the the UKF) trackers to the CRLB. Recommendations
reentry phase has attracted much attention of the to select the best filter in terms of performance and
researchers for both theoretical and practical reasons. computational cost are also given. A note on the
Technically speaking we need to set up a stochastic mathematical symbols; bold capitol letters represent
nonlinear filter due to the nonlinearity of the dynamic matrices, bold lower case letters denote vectors; the
state equation of the target; tracking filters have been apex T in [²]T stands for transposition of either a
conceived for this purpose since the early days of the matrix or a vector; Ef²g, (²) denote the expectation
invention of the Kalman filter [12]: see for instance operator; x[i] and A[i, j] are, respectively, the ith entry
[13, 18, 3]. More recently, the following papers of vector x and the ijth entry of matrix A.
have been published on this subject: [4, 11, 15].
Practical applications are in the fields of surveillance
III. MODELS OF TARGET MOTION AND OF RADAR
for defense and for safety against the reentry of old
MEASUREMENTS
satellites. In relation to the second application, it is
known that the number of objects orbiting the Earth Consider an object which is launched from one
has been continuously increasing since the launch point on Earth to another point along a ballistic flight.
of the first satellite in 1957. They are old satellites, The kinematics of the ballistic object in the reentry
pieces of satellites due to explosion and erosion, upper phase is derived under the following hypotheses.
stages of missiles, etc. It is relevant to have means The forces acting on the target are gravity, and drag.
to detect, classify, and track these pieces of debris The effects of centrifugal acceleration, Coriolis
[2]; big objects that reenter the atmosphere should be acceleration, wind, lift force, and spinning motion
accurately tracked to anticipate their landing points are ignored, due to their small effect on the trajectory.
on Earth. The aim of our study is to formulate the Another simplifying assumption is related to flat Earth
nonlinear tracking filtering problem and to discuss approximation.
the application of several approximate filters. Having assumed a flat Earth, an orthogonal
Section III provides the models of kinematics coordinate reference system can be used with the
of the target and of the radar measurements. The following variables (Fig. 1):
Cramer—Rao lower bound (CRLB) for nonlinear x is the abscissa,
discrete-time filtering problems is discussed in y is the ordinate,
Section IV. The four tracking filters to compare are x0 and y0 are the target coordinates at time t0 ,
as follows. v is the velocity module,
1) the extended Kalman filter (EKF), ° is the angle between the horizontal axis and the
direction of motion.
2) the statistical linearization also referred to as
The target motion is described by the following
CADET (Covariance Analysis DEscribing function
discrete-time nonlinear dynamic state equation
Technique) developed in the past by The Analytic
· ¸
Sciences Corporation (TASC) [9], 0
sk+1 = Ãk (sk ) + G + wk (1)
3) the recently conceived unscented Kalman filter ¡g
(UKF) [15],
where the state vector is
4) the particle filter (PF) [10].
¢
These approximate techniques are discussed in Section sk =[xk x_ k yk y_ k ]T (2)
V. Every filter needs to be compared with the CRLB. and
Results concerning the simulation of the tracking
filters, error analysis, comparison with the CRLB Ãk (sk ) = ©sk + Gfk (sk ) (3)
FARINA ET AL.: TRACKING A BALLISTIC TARGET: COMPARISON OF SEVERAL NONLINEAR FILTERS 855
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
Fig. 2(a). Example of target trajectory.
2 3
1 T 0 0 By exploiting the following identities
6 0 07 ³ ³ y ´´
¢ 60 1 7 x
©=6 7 (4) cos arctg =p
40 0 1 T5 x x + y2
2
0 0 0 1 ³ ³ y ´´ (7)
y
2 3 sin arctg =p
T2 x x + y2
2
0
6 2 7
6 7 (6) can be rewritten as follows
¢6 T 0 7
G=6
6
7 (5)
6 0 T2 7
7 q · ¸
4 g sk [2]
2 5 fk (sk ) = ¡0:5 ½(sk [3]) s2k [2] + s2k [4] : (8)
¯ sk [4]
0 T
where T is the time interval between the radar Process noise wk in (1) is modeled as a zero-mean
measurements. The drag is a force directed in white Gaussian process with nonsingular covariance
opposition to the target speed and with an intensity matrix
equal to 12 (g=¯)½v2 [25]; being: g the gravity 2 T3 T2 3
acceleration, ¯ 1 the ballistic coefficient, ½ the air · ¸
µ 0 6 3 2 7
density (typically it is an exponentially decaying Q=q , with µ = 4 5 (9)
0 µ 2
T
function of height, ½ = c1 e¡c2 y where c1 = 1:227, T
c2 = 1:09310¡4 for y < 9144 m, and c1 = 1:754, 2
c2 = 1:4910¡4 for y ¸ 9144 m) and v the module of where q is a parameter related to process noise
target velocity. In terms of state vector components, intensity [1, p. 262]. The process noise accounts for
the drag is all forces that have not been considered in the model
g and possible deviations of the model from the reality.
fk (sk ) = ¡0:5 ½(sk [3])(s2k [2] + s2k [4])
¯ An example of a target trajectory is shown in
2 µ µ ¶¶ 3 the following figure; the relevant parameters are:
sk [4]
cos arctg ¯ = 40000 Kg ¢ m¡1 ¢ s¡2 , q = 1 m2 ¢ s¡3 , T = 2 s,
6 sk [2] 7
£6 µ µ ¶¶ 7 y0 = 88 km, x0 = 232 km, °0 = 190± , v0 = 2290 m/s,
4 sk [4] 5: (6)
sin arctg number of path samples N = 60. Fig. 2(a) shows the
sk [2] trajectory in the x-y plane, while Fig. 2(b) depicts
the speed and acceleration of target versus time; the
1 It depends on the target mass, the body shape, and the
strong target deceleration due to drag is apparent.
cross-sectional area of the target perpendicular to the direction The measurements, collected by the radar for
of motion. It is constant for high super-sonic speed, while due
to the formation of shock waves, it diminishes when target
target tracking, are the range r and elevation "; the
velocity approaches Mach 1. In our study case (see Fig. 2(a)) radar is located at xR = 0, yR = 0 in all the numerical
the speed tends to Mach 1 just at the end of the trajectory, so the evaluations here. The error standard deviations of
approximation done (i.e.: ¯ = constant) is quite good. these measurements are denoted as ¾r (for range)
856 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 38, NO. 3 JULY 2002
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
Fig. 2(b). Speed and acceleration of target versus time for trajectory of Fig. 2(a).
and ¾" (for elevation). Radar measurements are A. General Framework for CRLB Derivation
transformed to the Cartesian coordinates d = r cos "
and h = r sin " (for measured target abscissa and The general framework for derivation of CRLB
ordinate) so that the measurement equation is linear of an unbiased estimator for non linear discrete-time
system is described in [23]. The sequence of
zk = Hsk + vk (10)
information matrices obeys the following recursion
where 11 ¡1 12
µ ¶ Jk+1 = D22 21
k ¡ Dk (Jk + Dk ) Dk (12)
T
1 0 0 0
zk = [dk hk ] , H= :
0 0 1 0 where for the case of additive Gaussian noise, as in
(1), and for the linear measurement equation as in
vk is the noise on the measured Cartesian coordinates; (10), we have that
it is independent of the process noise wk ; it is
T ¡1
zero-mean white Gaussian with covariance matrix Rk D11
k = Efªk Q ªk g (13)
[8, p. 155] with elements:
D12
k = ¡EfªkT gQ¡1 = [D21
k ]
T
(14)
¾d2 = ¾r2 cos2 (") + r2 ¾"2 sin2 (") ¡1
D22
k =Q + EfHT R¡1
k+1 Hg (15)
¾h2 = ¾r2 sin2 (") + r2 ¾"2 cos2 (") (11)
with Jacobian ªk defined as
¾dh = (¾r2 ¡ r2 ¾"2 ) sin(") cos("):
ªk = [rsk ÃkT (sk )]T (16)
For all practical purposes this is a good
approximation2 which greatly simplifies the tracking where [rsk ÃkT (sk )] indicates the matrix of the first
algorithm; otherwise one would also have to take into partial derivatives of the vector ÃkT (see (3)) with
consideration the nonlinearity of the measurement respect to the state vector sk . Note that Jacobian ªk
equation. is evaluated at the true target state. Substitution of
(13)—(15) into (12) yields the following recursion
IV. CRAMER—RAO LOWER BOUND FOR BALLISTIC
TARGET TRACKING Jk+1 = Q¡1 + EfHT R¡1 ¡1
k+1 Hg ¡ Q Efªk g
The objective of this section is to derive the ¢ [Jk + EfªkT Q¡1 ªk g]¡1 ¢ EfªkT gQ¡1 : (17)
theoretical CRLB of the variance of estimation error
The CRLB of an unbiased estimate of the state vector
for the nonlinear dynamic system described by (1) to
at time index k is then [24]
(11). The optimal estimator for this problem cannot
be built and hence we resort to approximate filters CRLBfsk [j]g = J¡1
k [j, j], for j = 1, 2, 3, 4:
described in Section V. The theoretical lower bound,
(18)
which defines the best achievable performance,
plays an important role in algorithm evaluation and In the absence of process noise, the recursive equation
assessment of the level of approximation introduced in for computation of information matrix Jk follows from
the filtering algorithms. [22]
Jk+1 = (ªk¡1 )T Jk ªk¡1 + HT R¡1
k+1 H: (19)
2 The unbiased and consistent conversion of measurements is
FARINA ET AL.: TRACKING A BALLISTIC TARGET: COMPARISON OF SEVERAL NONLINEAR FILTERS 857
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
Fig. 3. Influence of process noise intensity q on CRLB for target position sk [1] = xk and sk [3] = yk .
the true target state, while in the covariance matrix are as follows
propagation of the EKF it is evaluated at the estimated
target state. Fk [1, 1] = 0
The initial information matrix J0 is calculated as
the inverse of initial covariance matrix Fk [2, 1] = 0
B. Derivation of Jacobian and an Example Jacobian ªk depends on the target state vector, hence
the expectations in (17) are taken over ensemble
From (16) and (3) it follows that Jacobian ªk can of sk (which is random due to process noise). The
be written as implementation of recursion (17) is based on Monte
ªk = © + GFk (23) Carlo averaging over multiple realizations of the target
trajectory. Fig. 3 displays in the log-scale the square
where the elements of root of the CRLB p for the target position
p sk [1] = xk ,
sk [3] = yk , i.e., CRLBfsk [1]g, CRLBfsk [3]g in
Fk = [rsk fTk (sk )]T (24) absence and in presence of process noise wk in the
858 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 38, NO. 3 JULY 2002
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
state equation (1). The parameters are as for Fig. 2, general, when the filtering problem is highly nonlinear
and in addition ¾r = 100 m and ¾" = 0:017 rad. The and the local linearity assumption breaks down, the
CRLB in the presence of process noise (q = 1 case) EKF may introduce large estimation errors due to
was obtained by averaging over 100 Monte Carlo filter divergence.
runs. In absence of process noise the CRLB was
calculated using recursion of (19), where no averaging
B. Application of CADET
is required. Observe from Fig. 3 that the CRLB on the
target position coordinates x and y, in the presence of With this approach, instead of calculating the
a modest amount of process noise, is practically equal derivative (24) once (as in the EKF), the coefficients
to the CRLB in absence of noise; only at the end of of the linear expression
the observation period the two curves differ a little
bit. f(s) »
= Nf s + f0 (30)
are found by minimizing the mean of the squared
V. TRACKING FILTERS error [9], [8, pp. 117—121]
e = [f(s) ¡ f0 ¡ Nf s]T [f(s) ¡ f0 ¡ Nf s] (31)
In this section we describe four recursive
estimators (filters) to be used for tracking a ballistic at each iteration of the filter. CADET tries to
object. These filters determine in approximate way approximate the nonlinearity fk (sk ) of (3) with a
the mean and covariance matrix of the probability of linearity whose slope depends upon the variance of
target state conditioned to the measured radar data: input stochastic process sk . By doing the calculations
p(sk j Zk ) which is the probability density function the following expressions are found
¢
(pdf) of the vector sk given the set Zk =fz1 , z2 , : : : , zk g
fk (sk ) = Effk (sk )g + Nf,k (sk ¡ Efsk g)
of all measurements up to kth time instant. These
filters are the EKF, the CADET, the KF, and the PF. = fk (sk ) + Nf,k (sk ¡ sk ) (32)
All of them are based on approximations and our goal with
is to assess the influence of a particular approximation
on the tracking accuracy. The filters are initialized Nf,k = [Effk (sk )skT g ¡ Effk (sk )gEfsk g]cov¡1 (sk )
using the same two-point differencing method [8, p.
= [fk (sk )skT ¡ fk (sk )sk ]cov¡1 (sk ) (33)
228], [1, p. 253], to match the computation of the
CRLB. being cov¡1 (s) the inverse of the covariance matrix
of the vector s. To design a suboptimal filter, it is
A. Application of EKF necessary to specify how the following quantities:
Effk (sk )sTk g, Effk (sk )g and Efsk g are computed. In
See, for instance, [8, pp. 113—116] for details. principle, they could be obtained by the knowledge
The prediction at time instant k + 1 given all the of posterior density p(sk j Zk ) which is not known.
measurements up to time instant k is carried out as The approximation made is to assume that this pdf
follows is Gaussian so that only the mean and covariance
µ ¶ matrix are needed; these, in turn, are substituted by
0
ŝk+1jk = Ãk (ŝkjk ) + G ŝkjk and Pkjk provided by the filter. Thus, the CADET
¡g (27) approach is similar in some aspect to the EKF, but
Pk+1jk = (© + G ¢ Fk )Pkjk (© + G ¢ Fk )T + Q more accurate and complex. In fact, it requires the
calculation of the four-fold integrals
where © and G are given by (4) and (5), while Fk is Z ¯
¯
the Jacobian (see equations (25)) calculated at the fk (ŝkjk ) ´ f(s)pN (s; ŝkjk , Pkjk )ds¯¯ and
estimated state ŝkjk . The estimation at time instant ŝkjk
k + 1 given all the measurements up to time instant Z ¯ (34)
¯
k + 1 can be done after calculating the Kalman fk (ŝkjk )ŝTkjk ´ f(s)s pN (s; ŝkjk , Pkjk )ds¯¯
T
gain ŝkjk
Kk+1 = Pk+1jk HT (HPk+1jk HT + Rk )¡1 (28) where pN (s; ŝkjk , Pkjk ) is the multidimensional Gaussian
by the equations pdf with mean ŝkjk and covariance matrix Pkjk
calculated in the value s.
ŝk+1jk+1 = ŝk+1jk + Kk+1 (zk+1 ¡ Hŝk+1jk ) The prediction equations of the filter take the form
(29) · ¸
Pk+1jk+1 = (I ¡ Kk+1 H)Pk+1jk : 0
ŝk+1jk = Ãk (ŝkjk ) + G
¡g (35)
The EKF only uses the first order terms in the Taylor
series expansion of the nonlinear state equation. In Pk+1jk = (© + G ¢ Nf,k )Pkjk (© + G ¢ Nf,k )T + Q
FARINA ET AL.: TRACKING A BALLISTIC TARGET: COMPARISON OF SEVERAL NONLINEAR FILTERS 859
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
¡p ¢
with where · is a scaling parameter and (nx + ·)Px i
Nf,k = [fk (ŝkjk )ŝTkjk ¡ fk (ŝkjk ) ŝkjk ]P¡1
kjk : is the ith row or column of the matrix square root of
(nx + ·)Px . The weights are normalized (i.e., add up
ŝkjk and Pkjk are given by the equations (29); the to 1).
equation (28) provides the Kalman gain Kk . 2) Propagate each sigma point through the
The four-fold integrals in (34) have been nonlinear function
calculatedh asqfour-fold summations
q iover a four-fold
interval ¡5 Pk=k [i, i], 5 Pk=k [i, i] for i = 1, 2, 3, 4 yi = g(Âi ), i = 0, : : : 2nx : (37)
q
with step of 0:5 Pk=k [i, i]. This means that we 3) Estimated mean and covariance of y are
computed as
need to calculate 21 points for each variable of
2nx
X
the integral; overall for the four variables the
number of summations to calculate is 214 = y= Wi yi
i=0
195000. (38)
2nx
X
C. Application of Unscented KF (UKF) Py = Wi (yi ¡ y)(yi ¡ y)T :
i=0
Same as the EKF, the UKF is a recursive MMSE
Next we describe the implementation of the UKF
(minimum mean square error) estimator. But unlike
assuming that at time k the state estimate and its
the EKF, the UKF [14] does not approximate
covariance are ŝkjk and Pkjk , respectively.
the nonlinear state and measurement equations.
It uses the true nonlinear model of state and/or 1) Using (36) compute sigma points »kjk (i)
measurement equation but approximates the pdf and weights Wi (i = 0, : : : , 8) corresponding to ŝkjk
of the state vector. This density is still Gaussian, and Pkjk .
but is specified by a set of deterministically chosen 2) Propagate sigma points using state equation (1)
sample (or sigma) points. The sigma points completely as follows
capture the true mean and covariance of the Gaussian µ ¶
0
density and when propagated through the nonlinear »k+1jk (i) = Ãk [»kjk (i)] + G : (39)
system, capture the posterior mean and covariance ¡g
accurately to the second order for any nonlinearity 3) Compute the mean and covariance of the
[15]. predicted state ŝk+1jk and Pk+1jk using predicted sigma
The unscented transform (UT) is a method for points »k+1jk (i), weights Wi and (38) as follows
calculating the statistics of a random vector that
8
X
undergoes a nonlinear transformation. Let x be the nx
dimensional random vector, g : R nx 7! R ny a nonlinear ŝk+1jk = Wi »k+1jk (i)
function and y = g(x). Assume the mean and the i=0
Â0 = x W0 = ·=(nx + ·) i=0
³p ´
Âi = x + (nx + ·)Px Wi = 1=[2(nx + 1)] i = 1, : : : , nx (36)
i
³p ´
Âi = x ¡ (nx + ·)Px Wi = 1=[2(nx + 1)] i = nx + 1, : : : , 2nx
i
860 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 38, NO. 3 JULY 2002
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
4) Predict measurement sigma points using (10), (particles) §k = fsk (i) : i = 1, : : : ng from the posterior
that is density at time k, i.e. p(sk j Zk ). The PF is an
&k+1jk (i) = H» k+1jk (i): (41) algorithm for propagating and updating the set of
random samples §k to a new set of random samples
5) Predict measurement and covariances at time k + 1, §k+1 = fsk+1 (i) : i = 1, : : : ng, which are
8
X approximately distributed as the posterior density
ẑk+1jk = Wi &k+1jk (i) p(sk+1 j Zk+1 ).
i=0 There are several different schemes for carrying
8 out this propagation of random samples, and hence
X
Pzz = Rk+1 + Wi [&k+1jk (i) ¡ ẑk+1jk ] different particle filtering algorithms [7]. In this work
i=0
we use the sequential importance resampling (SIR)
(42) or the bootstrap algorithm [10]. The bootstrap filter
¢ [&k+1jk (i) ¡ ẑk+1jk ]T propagates the random sample set by the following
steps.
8
X 1) Prediction: Each sample in §k is passed
Psz = Wi [»k+1jk (i) ¡ ŝk+1jk ]¢[&k+1jk (i) ¡ ẑk+1jk ]T through the state equation (1) to obtain samples from
i=0
the prior density at time step k + 1
where Pzz , Psz are, respectively, the covariance matrix · ¸
0
of the measurement and the cross-covariance of the s¤k+1 (i) = Ãk [sk (i)] + G + wk (i) (44)
measurement and the state variable. ¡g
6) Compute the UKF gain and update state and where wk (i) is a sample drawn from the pdf of process
covariance noise p(wk ) = pN (wk ; 0, Q).
Kk+1 = Psz P¡1 2) Update: 1) Calculate the likelihood function
zz
p(zk+1 j s¤k+1 (i)) for each sample in the set §k+1¤
=
ŝk+1jk+1 = ŝk+1jk + Kk+1 (zk+1 ¡ ẑk+1jk ) ¤
(43) fsk+1 (i) : i = 1, : : : ng. 2) Calculate the normalized
weights for each sample
Pk+1jk+1 = Pk+1jk ¡ Kk+1 Pzz KTk+1 :
p(z j s¤ (i))
Note that the UKF requires computation of a matrix qk+1 (i) = Pn k+1 k+1¤ : (45)
j=1 p(zk+1 j sk+1 (j))
square root in (36) which can be done using Cholesky
factorisation. The weights qk+1 (i) represent the probability mass
¤
associated with element i of §k+1 . 3) Resample n
¤
times from the discrete distribution defined by §k+1
D. Application of Particle Filter and fqk+1 (i) : i = 1, : : : ng to generate samples §k+1 =
fsk+1 (i) : i = 1, : : : , ng so that for any j, Prfsk+1 (j) =
The optimal recursive Bayesian filter of the state
s¤k+1 (i)g = qk+1 (i).
vector in the MMSE sense is the mean of the posterior
The MMSE estimate of sk+1 is computed as the
pdf p(sk j Zk ). The PF is a computer-based method
mean of particles in §k+1 :
for implementing an optimal recursive Bayesian
n
filter by Monte Carlo simulations. Instead of analytic 1X
solution or numerical approximation of a given ŝk+1jk+1 = sk+1 (i): (46)
n
nonlinear and/or non-Gaussian problem, it performs i=1
a considerable amount of computations in order to The choice of the number of particles n is very
approximate the posterior pdf. The central idea is to important in the PF design. Note that the SIR
represent the required pdf by a set of random samples algorithm is not particularly efficient (requires
(particles). As the number of particles is increased, large n), because it is resampling from the discrete
the representation of the required pdf becomes more approximation of the posterior density p(sk+1 j Zk+1 ).
accurate. Some more recent PF schemes (see [7]) can operate
The PF in general requires the knowledge of: 1) with a smaller number of particles without a
the initial state pdf p(s0 ); 2) the likelihood function significant loss in the estimation accuracy. One such
p(zk j sk ), and 3) the statistics of process noise wk . The scheme even employs the UT in the prediction step of
initial pdf is p(s0 ) = pN (s0 ; ŝ0j0 , P0j0 ), where ŝ0j0 and the PF [19].
P0j0 are obtained by two-point differencing method
[8, p. 228], [1, p. 253]. From measurement (10),
VI. NUMERICAL RESULTS
it follows that the likelihood function is Gaussian,
p(zk j sk ) = pN (zk ; Hsk , Rk ). As described in Section
A. Error Analysis
III, the pdf of process noise is p(wk ) = pN (wk ; 0, Q).
The PF algorithm can be described as follows. This subsection reports the mean and the
Assume that we have a set of random samples standard deviation of the estimation error
FARINA ET AL.: TRACKING A BALLISTIC TARGET: COMPARISON OF SEVERAL NONLINEAR FILTERS 861
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
Fig. 4. Mean estimation error of EKF. Fig. 5. Errors standard deviation of EKF (solid line) versus
square root of theoretical CRLB (dashed line).
ek = ŝkjk ¡ sk (47)
this heuristic one would need to use · = ¡1. Negative
for the four filters described above (EKF, CADET, ·, however, can cause the calculated covariance to
UKF, and PF, respectively). All performance curves be nonpositive semi-definite. As a compromise we
were obtained by averaging over 100 independent adopted · = 0 which produced good results for this
Monte Carlo runs. The ballistic target trajectories application. Figs. 8 and 9 show the UKF error mean
were generated with the parameters as described in and standard deviation, respectively. Similarly to the
Section III, with q = 1. The radar parameters used in EKF and CADET, the UKF appears to be statistically
simulations were: T = 2 s; ¾r = 100 m and ¾" = efficient (unbiased and attains the CRLB) target state
0:017 rad, detection and false alarm probabilities of estimator.
radar equal to 1 and 0, respectively. As discussed in Section V-D, the PF approximates
First we present the results obtained using the the optimum recursive Bayesian nonlinear filter; as the
EKF: the mean of estimation error in target position number of particles is increased the approximation
x and y and velocity vx = x_ and vy = y_ is shown in
is more accurate. There are many traps in the
Fig. 4. The standard deviation of error is displayed in
implementation of the PF mainly due to the sample
Fig. 5.4
impoverishment problem (the number of distinct
The Monte Carlo error analysis suggests that
particles monotonically decreases with time). A
the EKF is approximately unbiased with standard
simple though costly solution is to use a large number
deviation just on top of the square root of the
CRLB. of particles, which is what has been done here:
Next we present the results on the application of n = 25000 particles has been used to obtain the
CADET. Figs. 6 and 7 depict the mean and standard error curves shown in Figs. 10 and 11. These error
deviation of the filtering errors, respectively. As usual, curves are similar to those obtained by EKF, CADET,
the curves are compared with the CRLB. and UKF. In summary all four filters show similar
In this case the filter is also approximately error performance: it appears that nonlinearity of the
unbiased with standard deviation close to the square dynamic state equation is not severe for the case when
root of the CRLB. The comparison of Figs. 4, 5 with ballistic coefficient ¯ is known.
6, 7 demonstrates that EKF and CADET have very
similar performance at least for this study case. B. Consistency Tests
Application of the UKF first requires to select
the value of parameter ·. This parameter scales the All nonlinear filters considered in this study
sigma points of the unscented transformation towards provide, in addition to the state estimates ŝkjk , a
or away from the mean of the prior distribution. If self-assessment of their estimation errors. For the
this distribution is Gaussian, Julier, et al. [15] propose EKF, CADET, and UKF this self-assessment is given
to select · using the following heuristic: ns + · = 3 in the form of the covariance matrix Pkjk . The PF
(because it minimizes the difference between the provides an estimate of the entire posterior density,
moments of the standard Gaussian distribution and from which one can compute both the state estimate
the sigma points up to fourth order). By following as in (46) and its covariance matrix as
n
1 X
4 We started the figures from time = 10 s because of the limited Pkjk = (sk (i) ¡ ŝkjk )(sk (i) ¡ ŝkjk )T : (48)
performance of the filter initialization. n¡1
i=1
862 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 38, NO. 3 JULY 2002
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
Fig. 6. Mean estimation error of CADET.
Fig. 7. Errors standard deviation of CADET (solid line) versus square root of theoretical CRLB (dashed line).
FARINA ET AL.: TRACKING A BALLISTIC TARGET: COMPARISON OF SEVERAL NONLINEAR FILTERS 863
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
Fig. 10. Mean estimation error of PF.
A filter is referred to as consistent (or credible) if its Fig. 12. Average NEES. (a) EKF. (b) CADET. (c) UKF. (d) PF.
covariance matrix is equal to the actual mean square
error (MSE) matrix [17]. The most common statistical
with probability 0.95) as follows [17]
test for filter consistency is the one based on the
average normalized estimation error squared (NEES) 1 ³ p ´2
r1,2 ¼ §1:96 + 2ns M ¡ 1 : (50)
defined as [1, 17] 2ns M
M
1 X j T j ¡1 j The results of the consistency test for EKF,
"¯k = [ek ] [Pkjk ] ek (49) CADET, UKF and the PF are shown in Fig. 12(a),
M ¢ ns
j=1 (b), (c), and (d), respectively. The number of
Monte Carlo runs is M = 100 and ® = 0:05, which
where ejk is the error vector defined in (47), with
corresponds to the acceptance limits r1 = 0:865 and
index j = 1, : : : M denoting the Monte Carlo run, ns r2 = 1:1421, indicated in Fig. 12 by horizontal dashed
the dimension of the error vector, and M the number lines. The mean of the estimation error has been
of Monte Carlo runs. The consistency test assumes removed prior to the calculation of the average NEES
that estimation errors are zero-mean Gaussian. The [17]. The ballistic target trajectories were generated
average NEES of (49) then should be Â2ns M random with the parameters as described in Section III, with
variable with ns M degrees of freedom: its mean value q = 1. The radar parameters used in simulations as
is 1 and its variance is 2=ns M. The filter is accepted in Sec. VI-A were: T = 2 s; ¾r = 100 m and ¾" =
as being consistent (credible) at level ® if "¯k 2 [r1 , r2 ] 0:017 rad. Since the total number of scans is 60, the
with probability 1 ¡ ®. The limits of the acceptance average NEES of a consistent filter is expected to
interval, r1 and r2 , are calculated at level ® = 0:05 (i.e., be outside the acceptance interval 5% of time, which
Fig. 11. Errors standard deviation of PF (solid line) versus square root of CRLB (dashed line).
864 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 38, NO. 3 JULY 2002
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
TABLE I the radar measurements; 4) study the possibility to
Relative Computational Load estimate the launching and landing points of the target
from the segment of the ballistic trajectory measured
Filter Relative Computational Load
by the radar; it is a matter of how the model of target
EKF 1 trajectory fits the reality; if the model is enough
CADET 300
accurate and enough measured data are available,
UKF 3
PF (n = 25000) 440 in principle it is possible to estimate backwards and
ahead of the target trajectory.
FARINA ET AL.: TRACKING A BALLISTIC TARGET: COMPARISON OF SEVERAL NONLINEAR FILTERS 865
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
[13] Jazwinski, A. H. (1970) [19] van der Merwe, R., Doucet, A., de Freitas, N., Wan, E.
Stochastic Processes and Filtering Theory. (2000)
New York: Academic Press, 1970. The unscented particle filter.
[14] Julier, S. Uhlmann, J. (1997) Technical report CUED/F-INFENG/TR 380, Cambridge
A new extension of the Kalman filter to nonlinear University, Eng. Dept, 2000.
systems. [20] Ristic, B., Farina, A., Benvenuti, D. (2002)
In The Proceedings of AeroSense: The 11th International Tracking a ballistic re-entry object: Performance bounds
Symposium on Aerospace/Defense Sensing, Simulation and comparison of non-linear filters.
and Controls, Orlando, FL, 1997; (Multi Sensor Fusion, IDC-2002, Adelaide, Australia, 11—13 February, 2002,
Tracking and Resource Management II, SPIE vol. 3068, 259—264.
pp.182—193). [21] Schmidt, G. C. (1993)
[15] Julier, S. Uhlmann, J., Durrant-Whyte, H. F. (2000) Designing nonlinear filters based on Daum’s theory.
A new method for the non linear transformation of means Journal of Guidance, Control and Dynamics, 16, 2
and covariances in filters and estimators. (Mar.—Apr. 1993), 371—376.
IEEE Transactions on Automatic Control, AC-45, 3 (Mar. [22] Taylor, J. H. (1979)
2000), 477—482. The Cramer-Rao estimation error lower bound
[16] Lerro, D., Bar-Shalom, Y. (1993) computation for deterministic nonlinear systems.
Tracking with debiased consistent converted IEEE Transactions on Automatic Control, AC-24, 2 (Apr.
measurements vs. EKF. 1979), 343—344.
IEEE Transactions on Aerospace and Electronic Systems, [23] Tichavsky, P., Muravchik, C. H., Nehorai, A. (1998)
29, 3 (July 1993), 1015—1022. Posterior Cramer-Rao bounds for discrete-time nonlinear
[17] Li, X. R., Zhao, Z., Jilkov, V. P. (2001) filtering.
Practical measures and test for credibility of an estimator. IEEE Transactions on Signal Processing, 46, 5 (May
In Proceedings of the Workshop on Estimation, Tracking 1998), 1386—1395.
and Fusion: A Tribute to Y. Bar-Shalom, Monterey, CA, [24] Van Trees, H. (1968)
May 2001, 481—495. Detection, Estimation and Modulation Theory.
[18] Mehra, R. (1971) New York: Wiley, 1968.
A comparison of several non-linear filters for re-entry [25] Zarchan, P. (1997)
vehicle tracking. Tactical and Strategic Missile Guidance (3rd ed.).
IEEE Transactions on Automatic Control, AC-16, 4 (Aug. AIAA, Progress in Astronautics and Aeronautics, vol.
1971), 307—319. 176, 1997.
866 IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS VOL. 38, NO. 3 JULY 2002
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.
Branko Ristic received his first two degrees in Yugoslavia: B.Eng. from the
University of Novi Sad in 1984 and M.Sc. from Belgrade University in 1991,
both in electrical engineering. He received the Ph.D. degree from the Signal
Processing Research Centre at QUT in Brisbane, Australia, in 1995.
Between 1984 and 1988 he was a Research Assistant at The University
of Novi Sad. In February 1989 he was initially a Senior Research Assistant
at The Queensland University (1989—1991) and then at QUT (1991—1993).
During 1995 he was a Senior DSP Engineer in GEC Marconi Systems (Sydney,
Australia) and in 1996 he joined Defence Science and Technology Organisation
(DSTO) as research scientist. Currently he is a Senior Research Scientist in the
Surveillance Systems Division of DSTO responsible for algorithm development
and performance analysis of tracking and multi-sensor integration systems. His
main research interests currently include estimation theory, target tracking and
non-linear filtering.
FARINA ET AL.: TRACKING A BALLISTIC TARGET: COMPARISON OF SEVERAL NONLINEAR FILTERS 867
Authorized licensed use limited to: INDIAN INSTITUTE OF TECHNOLOGY BOMBAY. Downloaded on December 15,2021 at 15:52:39 UTC from IEEE Xplore. Restrictions apply.