Professional Documents
Culture Documents
4
Hyatt Regency Riverfront, St. Louis, MO, USA
June 10-12, 2009
Abstract— A discrete-time robust extended Kalman filter for which we consider the discrete-time system dynamics
(REKF) formulation for uncertain systems expressed in terms of reverse in time. This defines the contribution in the paper.
a set-valued state estimator is described in this paper. The robust The set-valued state estimation problem in this case will
filter and Riccati equations are derived as an approximate
solution to a reverse-time optimal control problem defining this be solved by obtaining an approximate solution to the
set-valued state estimator. As presented, the uncertainties are optimal control problem in terms of a forward-time dynamic
modeled by a sum quadratic constraint (SQC) that takes into programming equation. The discrete-time uncertain system
account both modeling uncertainties as well as uncertainties dynamics is considered in reverse-time with an SQC-based
introduced from exogenous noise sources. uncertainty description.
I. INTRODUCTION The remainder of this paper is organized as follows: Sec-
tion II describes the formulation of the reverse-time discrete-
The family of Kalman filters have been applied for state time nonlinear uncertain system and introduces the concept
as well as parameter estimation for numerous linear as of set-valued state estimation. This set-valued state estima-
well as nonlinear systems. Though the standard Kalman tion problem is then expressed in terms of a corresponding
filter is considered an optimal estimator in case of linear optimal control problem. Section III provides an approximate
systems with Gaussian noise characteristics, its nonlinear solution to this optimal control problem which leads to
suboptimal counterpart, the extended Kalman filter (EKF) is the Riccati and filter equations that define the discrete-time
known to diverge under influences of severe nonlinearities REKF. Finally, Section IV presents an illustrative example
and uncertainties [1], [2]. As a solution to this problem and compares results obtained by applying the discrete-time
robust forms of the filter have been formulated for a wide REKF and the discrete-time EKF to a spring-mass-damper
class of uncertainties [3]–[9]. A popular approach developed system.
for state estimation of uncertain systems is the set mem-
bership state estimation approach. Such approaches, with
a deterministic interpretation of the Kalman filter in terms II. P ROBLEM F ORMULATION
of a set-valued state estimator, are described in [10], [11].
In this section, we consider a reverse-time discrete-time
The set membership state estimation approach of [10] was
uncertain nonlinear system which is derived from a forward-
extended by Savkin and Petersen in [4], [12] in order to
time continuous-time uncertain nonlinear system. The un-
accommodate uncertainties in continuous-time linear systems
certainties in the discrete-time uncertain system are de-
based on an integral quadratic constraint (IQC). A discrete-
scribed by an SQC, which is derived from the corresponding
time equivalent was presented in [12], [13] where the uncer-
continuous-time uncertainty description in the form of an
tainties were modeled by a sum quadratic constraint (SQC).
IQC. Furthermore, the concept of set-valued state estimation
As a nonlinear extension to the robust linear filter in [4],
is introduced and related to a corresponding optimal control
James and Petersen proposed a robust extended Kalman filter
problem.
(REKF) for continuous-time uncertain systems in [6].
In this paper, we present a discrete-time REKF for an
uncertain discrete-time nonlinear system. The formulation of A. Reverse-time Discrete-time Uncertain Nonlinear System
such a discrete-time filter is motivated by the fact that most
We begin with a forward-time continuous-time uncertain
modern-day sensors provide data in the discrete domain.
nonlinear system of the form,
The set-valued state estimation filtering approach of [6] is
derived as an approximate solution to a reverse-time optimal
ẋ(t) = ac (t, x(t), u(t)) + Dc (t) w(t),
control problem obtained by applying the method of dynamic
programming to a set of forward-time system equations. z(t) = kc (t, x(t), u(t)),
This, however, is not straightforward in the discrete-time case y(t) = cc (t, x(t)) + v(t), (1)
A. Kallapur and S. Anavatti are with the School of Aerospace, where x(·) ∈ Rn is the state, u(·) ∈ Rm is the known
Civil and Mechanical Engineering, University of New South Wales at
the Australian Defence Force Academy, Canberra, ACT 2600, Australia control input, w(·) ∈ R p and v(·) ∈ Rl are the process and
a.kallapur@adfa.edu.au, agsrenat@adfa.edu.au measurement uncertainty inputs respectively, z(·) ∈ Rq is the
I. Petersen is with the School of Information Technology and uncertainty output and y(·) ∈ Rl is the measured output. ac (·),
Electrical Engineering, University of New South Wales at the Aus-
tralian Defence Force Academy, Canberra, ACT 2600, Australia kc (·) and cc (·) are given nonlinear functions and Dc (·) is a
i.petersen@adfa.edu.au given matrix function of time.
x(k) = A(k, x(k + 1), u(k)) − B(k) w(k), ZT [x0 , u0 (·)|T1 , y0 (·)|T1 , d]
z(k + 1) = K(k, x(k + 1), u(k)), n
= xT ∈ R : inf VT [xT , w(·)] ≤ d . (9)
y(k + 1) = C(k, x(k + 1)) + v(k + 1), (4) w(·)
where A(·), K(·) and C(·) represent discrete-time nonlinear The optimization problem
functions. inf VT [xT , w(·)] (10)
The uncertainty associated with the reverse-time discrete- w(·)
time system (4) can be obtained by discretizing the IQC (2) for the system (4), defines a nonlinear optimal control
to obtain an SQC, problem with a sign indefinite quadratic cost function. The
(x(0) − x0 )T N(x(0) − x0 ) discrete-time REKF will be derived by finding an approxi-
T −1
mate solution to this optimal control problem.
+ ∑ (w(k)T Q(k) w(k) + v(k + 1)T R(k + 1) v(k + 1)) III. D ISCRETE - TIME ROBUST E XTENDED K ALMAN
k=0
T −1 F ILTER
≤d+ ∑ k z(k + 1) k2 , (5) The optimal control problem (10) for the reverse-time
k=0
discrete-time system (4) can be solved via dynamic program-
where v(k + 1) = [y(k + 1) − C(k, x(k + 1))], z(k + 1) = ming. Indeed, the corresponding discrete-time (forward-time)
K(k, x(k +1), u(k)), and the admissible uncertainties w(·) and Hamilton-Jacobi-Bellman (HJB) equation for this optimal
v(·) are described as, control problem is given by,
∗
w(k) Vk+1 (x(k + 1))
= ψ (k, x(·)) (6)
v(k + 1) = min{Vk∗ [A(k, x(k + 1), u0 (k)) − B(k) w(k)]
w(k)
and ψ (·) is a nonlinear time-varying dynamic uncertainty (11)
function. + w(k)T Q(k) w(k) + v(k + 1)T R(k + 1) v(k + 1)
The uncertain system (4), with the corresponding SQC − z(k + 1)T z(k + 1)}
uncertainty description (5) will be used to derive the robust with initial condition
filter and Riccati equations, which define the discrete-time
REKF. V0∗ (x(0)) = (x(0) − x0 )T N (x(0) − x0 ). (12)
3820
As a first step towards obtaining an approximate solution Substituting the linearized terms from (17) into (15) and
to the nonlinear optimal control problem (10), (4) we ap- comparing coefficients of various time-dependent variables
proximate Vk∗ (·) as: we obtain the following set of recursive equations,
Riccati Difference Equation
Vk∗ (x(k)) ≈ (x(k) − x̂(k))T X(k)(x(k) − x̂(k)) + Φ(k), (13)
∇x A(k, x̂(k), u0 (k))T Ξ(k) ∇x A(k, x̂(k), u0 (k))
where x̂(k) is a vector representing the robust state estimate X(k + 1) = + ∇xC(k, x̂(k))T R(k + 1) ∇xC(k, x̂(k)) ,
and X(k) is a symmetric matrix. − ∇x K(k, x̂(k), u0 (k))T ∇x K(k, x̂(k), u0 (k))
Applying the approximate solution (13) to the HJB equa- X(0) = N. (18)
tion (11), we obtain,
Filter State Equation
(x(k + 1) − x̂(k + 1))T X(k + 1)(x(k + 1) − x̂(k + 1))
x̂(k + 1) = x̂(k) + X(k + 1)−1 Λ,
+ Φ(k + 1)
n x̂(0) = x0 , (19)
= min [A(k, x(k + 1), u0 (k)) − B(k) w(k) − x̂(k)]T X(k)
w(k) where,
∇x A(k, x̂(k), u0 (k))T Ξ(k) x̂(k)
[A(k, x(k + 1), u0 (k)) − B(k) w(k) − x̂(k)]
− ∇x A(k, x̂(k), u0 (k))T Ξ(k) A(k, x̂(k), u0 (k))
+ v(k + 1)T R(k + 1) v(k + 1)
o Λ= + ∇xC(k, x̂(k))T R(k + 1) y0 (k + 1) .
+ Φ(k) + w(k)T Q(k) w(k) − z(k + 1)T z(k + 1) .
T
(14) − ∇xC(k, x̂(k)) R(k + 1)C(k, x̂(k))
T
+ ∇x K(k, x̂(k), u0 (k)) K(k, x̂(k), u0 (k))
Furthermore, comparing (12) and (13), the initial condi-
tions become x̂(0) = x0 , X(0) = N and Φ(0) = 0. (20)
Solving the minimization problem in (14), the following Filter Constant Equation
nonlinear difference equation is obtained,
Φ(k + 1)
(x(k + 1) − x̂(k + 1))T X(k + 1)(x(k + 1) − x̂(k + 1)) − ∇x A(k, x̂(k), u0 (k))T Ξ(k) A(k, x̂(k), u0 (k))
3821
IV. I LLUSTRATIVE E XAMPLE where,
The effectiveness of the discrete-time REKF over the x(k) = [x1 (k) x2 (k)]T ,
discrete-time EKF is illustrated by applying both methods
to a spring-mass-damper system in which the total energy in Ad = eAc h ,
Z kh
the system is measured. The total energy can be indirectly
Bd = eAc τ d τ Bc ,
measured using available inertial or motion sensors, and 0
applied to structural health monitoring and vibration analysis Kd (k, x(k + 1)) = [1 1] x(k + 1),
of aircrafts, spacecrafts and missiles. Computing the energy w(k) = ωn2 w̃(k) + ∆1 z(k + 1) ,
also aids in understanding the total energy profile during
1
mx1 (k + 1)2 + kx2 (k + 1)2 ,
various phases of a missile trajectory with the aim of Cd (k, x(k + 1)) =
improving range and accuracy. 2
We are interested in estimating the velocity x1 (t) and v(k) = (ṽ(k + 1) + ∆2 z(k + 1)) . (26)
position x2 (t) of such a system in the presence of modeling Here, k = t/h and the sample time is chosen as h = 10 ms.
uncertainties as well as exogenous disturbances. Consider The system of equations (25)-(26) was used to simulate
a continuous-time uncertain spring-mass-damper system de- the discrete-time spring-mass-damper system with initial
scribed by the state equations, conditions x(0) = [0 0]T . The uncertainty in the system is
ẋ(t) = Ac x(t) + Bc w(t), defined by the SQC,
y(t) = Cc (t, x(t)) + v(t), 10/h
∑ 0.05 w(k)2 + 0.5 v(k + 1)2 ≤ d + |z(k + 1)|2 .
z(t) = Kc (t, x(t)), (23) (27)
k=0
where, As described in Section III, the dynamics of the discrete-
x(t) = [x1 (t) x2 (t)]T , time uncertain system under consideration needs to be mod-
−2ζ ωn −ωn2
eled in reverse-time in order to construct the corresponding
Ac = , Riccati and filter equations. This can be calculated using the
1 0
forward-time continuous-time dynamics as,
Bc = [1 0]T ,
Kc (t, x(t)) = [1 1] x(t),
x(k) = Ak x(k + 1) + Bk w(k),
w(t) = ωn2 w̃(t) + ∆1 z(t) ,
3822
1)2 ) = 6.23e − 5. Also, the uncertain parameters were taken EKF for an uncertain spring-mass-damper system. The new
as ∆1 = 2.68 and ∆2 = 0.85. These values are consistent filter can be applied to nonlinear discrete-time systems with
with the SQC (27). Fig. 1 compares the absolute velocity uncertainties modeled by a sum quadratic constraint (SQC)
errors whereas Fig. 2 compares the absolute position errors uncertainty description.
obtained by applying the discrete-time REKF and EKF meth-
R EFERENCES
ods to the uncertain spring-mass-damper system. It is evident
from these plots that the discrete-time REKF estimates states [1] Y. Theodor, U. Shaked, and C. E. de Souza, “A game theory approach
to robust discrete-time H∞ estimation,” IEEE Transactions on Signal
of the uncertain spring-mass-damper system accurately with Processing, vol. 42, pp. 1486–1495, June 1994.
a steady decrease in absolute error, whereas the EKF shows [2] B. Ristic, S. Arulampalam, and N. Gordon, Beyond the Kalman Filter:
clear signs of divergence. Particle Filters for Tracking Applications. Boston/London: Artech
House Publishers, 2004.
3
[3] L. Xie, Y. Soh, and C. E. de Souza, “Robust Kalman filtering for
REKF: absolute velocity error uncertain discrete-time systems,” IEEE Transactions on Automatic
EKF: absolute velocity error
Control, vol. 39, pp. 1310–1314, June 1994.
2.5 [4] A. V. Savkin and I. R. Petersen, “Recursive state estimation for uncer-
tain systems with an integral quadratic constraint,” IEEE Transactions
on Automatic Control, vol. 40, no. 6, pp. 1080–1083, June 1995.
2 [5] ——, “Model validation for robust control of uncertain systems with
|velocity error| (m/s)
0.1
0.05
0
0 1 2 3 4 5 6 7 8 9 10
time (s)
3823