2003book Notes

Adaptive Control Design and Analysis
(Supplemental Notes)
Gang Tao
Department of Electrical and Computer Engineering
University of Virginia
Charlottesville, VA 22903
A Wiley-Interscience Publication
John Wiley & Sons, Inc.

New York - Chichester - Brisbane - Toronto - Singapore
Contents
Matrix Theory 1
Radial Unboundedness Condition on V (x) for Asymptotic Stability 2
Passivity of A Mass-Damper-Spring System 3
Positive Real Functions 4
Parameter Projection Properties 6
Explicit Swapping Lemma 7
Discrete-Time Swapping Lemma 9
Additional Lemmas 10
Plant Zeros and Controller Order for MRAC 13
Parameter Convergence of MRAC 16
Higher-Order Tracking Performance of MRAC 25
Convergence of θ̃T (t)ω(t) 30
Higher-Order Convergence of ε(t) = θ̃T (t)φ(t) 32
Higher-Order Convergence of Indirect MRAC 34
Analysis of “Bursting Phenomenon” in Robust Adaptive Control 37
Robust MRAC with Switching σ-Modification 39
i
ii Notes on Adaptive Systems and Control, Gang Tao (Copyright 2023)
A Discrete-time MRAC System Example 40
Indirect Observer Based Adaptive Control 42
Adaptive Control of ẋ(t) = Ax(t) + BΛu(t) + BΘ∗ φ(x) 45
Parameters of u(t) = Θ∗T

1 ω1 (t) + Θ2 ω2 (t) + Θ20 y(t) + Θ3 ξ(z)y(t)
∗T ∗ ∗ 47
Parametrization of (9.102) 50
Plant Signal Identities for MIMO Cases 51
Proof of limt→∞ e(t) = 0 in (9.187C) 54
Adaptive Robot Control for Time-Varying Parameters 55
Derivation of (10.152) 61
Backstepping Design with Nonsmooth Inverse Signal 62

Notes on Adaptive Systems and Control, Gang Tao (Copyright 2023) 1
Matrix Theory
Symmetric Matrices
For a matrix M = M T , we have M = ∑ni=1 λi ei eTi where λi and ei are the eigen-
values and eigenvectors of M such that eTi ei = 1 and eTi e j = 0 with i 6= j. With
P = [e1 , e2 , . . . , en ] and Λ = diag{λ1 , λ2 , . . . , λn }, it follows that M = PΛPT , where
PPT = PT P = I, and, in addition, for M nonsingular, that M −1 = PΛ−1 PT .
√
For M = M T ≥ 0, we define M 1/2 = ∑ni=1 λi ei eTi = PΛ1/2 PT and express
M = M 1/2 M 1/2 , where (M 1/2 )T = M 1/2 . It also follows that for M nonsingular,
(M 1/2 )−1 = ∑ni=1 √1λ ei eTi = PΛ−1/2 PT . On the other hand, for Q = PΛ1/2 , we have
i
M = QQT (as compared with M = M 1/2 M 1/2 for (M 1/2 )T = M 1/2 = PΛ1/2 PT ).
Singular Values and Eigenvalues of A Matrix

Let the singular values of a square matrix M ∈ Rn×n be σ1 ≥ σ2 ≥ · · · ≥ σnθ ≥ 0
and the absolute eigenvalues of M be |λ1 | ≥ |λ2 | ≥ · · · ≥ |λnθ | ≥ 0. Then, from page
347 of Horn and Johnson (2013) (Horn, R. A. and C. R. Johnson, Matrix Analysis,
2nd Ed., Cambridge University Press, 2013), we have that |λ1 | ≤ σ1 , and that if M
is nonsingular, then |λn | ≥ σn > 0.
2 Notes on Adaptive Systems and Control, Gang Tao (Copyright 2023)
Radial Unboundedness Condition on V (x) for Asymp-

totic Stability
One can draw the surface plots of V (x) = c, for different values of c, with
x12
V (x) = 2
+ x22 . (1)
1 + x1
For this V (x), such surface plots are closed curves for c < 1 but are open curves for
c > 1, as V (x) is not radially unbounded.
One can draw the phase-plane plot of ẋ = f (x), by obtaining its numerical solu-
tions for some typical initial conditions, for
6x1 2(x1 + x2 )
ẋ1 = − 2
+ 2x2 , ẋ2 = − . (2)
(1 + x1 )2 (1 + x12 )2
For some initial conditions, the solution trajectories do not converge to the origin.
(Are there any trajectories going to ∞?)
6x1 2(x1 +x2 )
One can draw the vector field of ẋ1 = − (1+x 2 )2 + 2x2 , ẋ2 = − (1+x2 )2 .
1 1
2√
The solution x = [x1 , x2 ]T of this system on the hyperbola x2 = x1 − 2
satisfies
ẋ2 1
g1 (x) = =− √ , (3)
ẋ1 1 + 2 2x1 + 2x12
while the slope of this hyperbola is

dx2 1
g2 (x) = =− √ . (4)
dx1 x2
1 − 2 2x1 + 21
√
It follows that 0 > g1 (x) > g2 (x) for x1 > 2 so that the trajectories to the right of
the hyperbola branch in the first quadrant cannot cross the branch.
This example shows that for asymptotic stability, the radial unboundedness of
V (x) is a crucial condition [179], [351], [426].
Passivity of A Mass-Damper-Spring System

Consider a mass-damper-spring mechanical system with equation of motion
M ẍ + Dẋ + Kx = F, (5)
where M is the mass, D is the damping constant, K is the spring constant, x is the
mass position, and F is the force acting on the mass.
The system energy is
1 1
V (x, ẋ) = M ẋ2 + Kx2 (6)
2 2
whose time derivative is
d
V (x, ẋ) = F ẋ − Dẋ2 . (7)
dt
Over any time interval [0, T ], it follows that
Z T Z T
V (x(T ), ẋ(T )) = V (x(0), ẋ(0)) + F(t)ẋ(t) dt − Dẋ2 (t) dt. (8)
0 0
Since D ≥ 0, we have
Z T
− F(t)ẋ(t) dt ≤ V (x(0), ẋ(0)), (9)
0
which means that the energy extracted from the system is less than or equal to the
initial system energy. From (7), the term F ẋ clearly represents the system absorbed
power from the input force F. For passivity analysis, the product of system input
and output is defined as such power. In this sense we consider the velocity v = ẋ as
system output. Then, the system admittance (the reciprocal of impedance) is
V (s) s
G(s) = = 2
, (10)
F(s) Ms + Ds + K
which is positively real (the mechanical-electric analogy pairs are “force vs. volt-
age” and “velocity vs. current”).
If we consider x as system output, the term Fx does not represents system power
(i.e., 0T F(t)x(t) dt does not represents system energy) so that the passivity analysis
R
is not applicable. In other words, the system transfer function for passivity analysis
in terms of positive realness is defined in terms of system impedance (or admit-
tance) relating current (velocity) to voltage (force) (or voltage (force) to current
(velocity)).
Without the passivity property, the transfer function from the input force to the
1
output position, Ms2 +Ds+K , cannot be positive real.
Positive Real Functions

A popular definition of positive real (PR) functions is that a function h(s) of the
complex variable s = σ + jω is positive real if (i) h(s) is real for real s, and (ii)
Re[h(s)] ≥ 0 for all s such that Re[s] > 0.
One may “induce” a definition of strictly positive real (SPR) functions as: a
function h(s) of the complex variable s = σ + jω is strictly positive real if (i) h(s) is
real for real s, and (ii) Re[h(s)] > 0 for all s such that Re[s] > 0. This definition was
once used in the early literature for SPR functions. It turns out that, like some other
definitions of SPR functions, this definition does not capture the physical meaning
of strictly positive realness, as indicated by the following example.
It is well-understood that a proper definition of strictly positive functions, which
captures the physical meaning of strictly positive realness, is that h(s) is strictly
positive real if h(s − ε) is positive real for some ε > 0. Based on this definition,
s+1
h(s) = (11)
s2 + s + 1
is only positive real but not strictly positive real. From the expressions
σ + jω + 1
h(s) =
(σ + jω)2 + σ + jω + 1
σ + 1 + jω
=
σ − ω + σ + 1 + j(ω + 2σω)
2 2
(σ + 1 + jω)(σ2 − ω2 + σ + 1 − j(ω + 2σω))

= (12)
(σ2 − ω2 + σ + 1)2 + (ω + 2σω)2
(σ + 1)(σ2 − ω2 + σ + 1) + ω(ω + 2σω)
Re[h(s)] =
(σ2 − ω2 + σ + 1)2 + (ω + 2σω)2
σ3 + 2σ2 + σω2 + 2σ + 1
= , (13)
(σ2 − ω2 + σ + 1)2 + (ω + 2σω)2
we see that h(s) satisfies the above “induced” definition of SPR functions: (i) h(s)
is real for real s, and (ii) Re[h(s)] > 0 for all s such that Re[s] = σ > 0. Hence, the
conclusion is that this “induced” definition for SPR functions is not proper.
Note that this h(s) is not SPR, because
1
Re[h( jω)] = (14)
(1 − ω2 )2 + ω2
does not satisfy the necessary condition for SPRness: limω2 →∞ ω2 Re[h( jω)] > 0,
or because for any chosen ε > 0,
−ε3 + 2ε2 − εω2 − 2ε + 1
Re[h( jω − ε)] = <0 (15)
(ε2 − ω2 − ε + 1)2 + (ω − 2εω)2
whenever ω2 > (−ε3 + 2ε2 − 2ε + 1)/ε, that is, h(s − ε) cannot be positive real
for any ε > 0. (P(ε) = −ε3 + 2ε2 − 2ε + 1 = (ε − 1)(−ε2 + ε − 1) > 0 for ε ∈
(0, 1) and P(ε) < 0 for ε > 1. For h(s − ε) to be stable, ε ∈ [0, 0.5) is needed as
(s − ε)2 + s − ε + 1 = s2 + (1 − 2ε)s + 1 − ε + ε2 and 1 − ε + ε2 > 0 for any ε.)
Parameter Projection Properties

The property (3.183) follows from the observation: if θ j (t) = θaj and g j (t) < 0, then
f j (t) = −g j (t) > 0 and θ j (t) − θ∗j = θaj − θ∗j ≤ 0, so that (θ j (t) − θ∗j ) f j (t) ≤ 0; and
if θ j (t) = θbj and g j (t) > 0, then f j (t) = −g j (t) < 0 and θ j (t) − θ∗j = θbj − θ∗j ≥ 0,
so that (θ j (t) − θ∗j ) f j (t) ≤ 0.
Similarly, the property (3.214) follows from the observation: if θ j (t) + g j (t) >
θbj , then f j (t) = θbj − θ j (t) − g j (t) < 0 and θ j (t) − θ∗j + g j (t) + f j (t) = θbj − θ∗j ≥
0, so that f j (t)(θ j (t) − θ∗j + g j (t) + f j (t)) ≤ 0; and if if θ j (t) + g j (t) < θaj , then
f j (t) = θbj − θ j (t) − g j (t) > 0 and θ j (t) − θ∗j + g j (t) + f j (t) = θaj − θ∗j ≤ 0, so that
f j (t)(θ j (t) − θ∗j + g j (t) + f j (t)) ≤ 0.
In the case when a parameter component θ∗j is known, we have θaj = θbj . This
means that we can simply set θ j = θ∗j if θ∗j is known, but still with the use of a
diagonal Γ > 0 or Γ = diag{Γ1 , γ j , Γ2 } = ΓT > 0 with Γ1 ∈ R( j−1)×( j−1) , γ j ∈ R
and Γ2 ∈ R(nθ − j)×(nθ − j) , if θ j is the only component to be projected.
Explicit Swapping Lemma

The swapping lemma (5.331) was an important lemma in the development of a
stable model reference adaptive control system. It states that for a stable and proper
rational function h(s) with a minimal realization h(s) = c(sI − A)−1 b + d and two
vector signals θ(t) and ω(t), it follows that
θT (t)h(s)[ω](t) − h(s)[θT ω](t) = hc (s)[hb (s)[ωT ]θ̇](t), (16)
where hc (s) = c(sI − A)−1 and hb (s) = (sI − A)−1 b. Here we derive an alternative
form of this lemma, explicitly in terms of the parameters of the function h(s).
∗ ∗
Denoting Pm (s) = sn + an∗ −1 sn −1 + · · · + a1 s + a0 , for vector signals θ(t) and
ω(t), from (5.138) and with an∗ = 1, we have
1 1
θT (t) [ω](t) − [θT ω](t)
Pm (s) Pm (s)
∗ −i ∗ !
n∗ ∑nj=0 an∗ − j sn −i− j T s
i−1
= ∑ Pm (s)
θ̇
Pm (s)
[ω] (t). (17)
i=1
∗
Introducing F(s) = fn∗ −1 sn −1 + · · · + f1 s + f0 , we express

1
F(s) θ (t)
T
[ω] (t)
Pm (s)
∗ −2
1 s

f0
= fn∗ −1 s n
+ · · · + f1 θ̇ T
[ω] + θT
[ω] (t) + θT (t) [ω](t)
Pm (s) Pm (s) Pm (s)
∗ −2
1

= fn∗ −1 s n
+ · · · + f1 θ̇ T
[ω] (t)
Pm (s)
∗ −3
s s2

+ fn∗ −1 s n
+ · · · + f2 θ̇ T
[ω] + θT
[ω] (t)
Pm (s) Pm (s)
f1 s + f0
+ θT (t) [ω](t) = · · ·
Pm (s)
!
n∗ −1 n∗ −i
si−1 F(s)
= ∑ ∑ fn∗ − j s
∗
n −i− j
θ̇ T
[ω] (t) + θT (t) [ω](t) (18)
i=1 j=1 Pm (s) Pm (s)
and use it to derive

F(s) T F(s)
[θ ω](t) − θT (t) [ω](t)
Pm (s) Pm (s)
!
n∗ −1 n∗ −i
si−1
= ∑ ∑ fn∗ − j s
∗
n −i− j
θ̇T
[ω] (t)
i=1 j=1 Pm (s)
" −i ∗ ∗ ∗ −i− j #
∑nj=0n∗
an − j sn s i−1
− F(s) ∑ θ̇T [ω] (t)
i=1 Pm (s) Pm (s)
n∗ −i ∗
!
n∗ −i− j
n∗ −1 n∗ −i F(s) ∑ a − s si−1
= ∑ ∑ fn∗ − j s
∗ −i− j j=0 n j
n
− θ̇T
[ω] (t)
i=1 j=1 Pm (s) Pm (s)
" #
F(s) n∗ −1
T s
− θ̇ [ω] (t)
Pm (s) Pm (s)
" #
n∗ −1 n∗ −1
αi (s) T si−1 F(s) T s
= ∑ θ̇ [ω] (t) − θ̇ [ω] (t). (19)
i=1 Pm (s) Pm (s) Pm (s) Pm (s)
Hence, we obtain the explicit swapping lemma:

n∗
F(s) T F(s) αi (s) T si−1
[θ ω](t) − θ (t)
T
[ω](t) = ∑ θ̇ [ω] (t), (20)
Pm (s) Pm (s) i=1 Pm (s) Pm (s)
where
n∗ −i n∗ −i
∑ n∗ −i− j
∑ an∗− j sn −i− j , i = 1, 2, . . . , n∗ − 1,
∗
αi (s) = Pm (s) fn∗ − j s − F(s) (21)
j=1 j=0
△
are polynomials of degrees n∗ − 1 or less, and αn∗ (s) = −F(s).
For a proper transfer function h(s) = fn∗ + PF(s)
m (s)
, it follows that
n∗
αi (s) T si−1
h(s)[θ ω](t) − θ (t)h(s)[ω](t) = ∑
T T
θ̇ [ω] (t). (22)
i=1 Pm (s) Pm (s)
Discrete-Time Swapping Lemma

Let a stable and proper rational function h(z) have a minimal realization h(z) =
c(zI − A)−1 b + d and θ(t) and ω(t) be two vector signals, and denote hc (z) = c(zI −
A)−1 and hb (z) = (zI − A)−1 b. Then,
θT (t)h(z)[ω](t) − h(z)[θT ω](t) = hc (z)[(hb (z)z)[ωT ](z − 1)[θ]](t). (23)
Proof: Using the discrete-time convolution: y(t) = C ∑t−1 i=0 A

t−i−1 Bu(i) for y(t) =
C(zI −A)−1 B[u](t), and its modification: w(t) = C ∑ti=0 At−1 Bu(i) for w(t) = C(zI −
A)−1 Bz[u](t) = C(zI − A)−1 B[u](t + 1), we express
hc (z)[(hb (z)z)[ωT ](z − 1)[θ]](t)

t−1 τ
= c ∑ At−τ−1 ∑ Aτ−i b ωT (i)(θ(τ + 1) − θ(τ))
τ=0 i=0
t−1
= c ∑ At−i−1 b ωT (i)θ(t)
i=0
t−2 τ t−1 τ
+ c ∑ At−τ−1 ∑ Aτ−i b ωT (i)θ(τ + 1) − c ∑ At−τ−1 ∑ Aτ−i b ωT (i)θ(τ)
τ=0 i=0 τ=0 i=0
t−1 σ−1
= θT (t)h(z)[ω](t) + c ∑ At−σ ∑ Aσ−i−1b ωT (i)θ(σ)
σ=1 i=0
t−1 t−1 τ−1
−c∑A t−τ−1
b ω (τ)θ(τ) − c ∑ A
T t−τ−1
∑ Aτ−ib ωT (i + 1)θ(τ)
τ=0 τ=1 i=0
= θ (t)h(z)[ω](t) − h(z)[θ ω](t),
T T
(24)
where, by definition,
t−1
c ∑ At−i−1 b ω(i) = h(z)[ω](t) (25)
i=0
t−1
c ∑ At−τ−1 b ωT (τ)θ(τ) = h(z)[θT ω](t). (26)
τ=0
This is the discrete-time version of the swapping lemma (5.331), whose explicit
version can also be derived, similar to the continuous-time case above.
Additional Lemmas
A Small Gain Lemma
Lemma 1 For kwkt = sup0≤τ≤t |w(τ)|, if
|w(t)| ≤ β(t)kwkt + γ(t) (27)
for some β(t) such that limt→∞ β(t) = 0 and some γ(t) ∈ L∞ , then w(t) is bounded,
that is, w(t) ∈ L∞ . If, in addition, limt→∞ γ(t) = 0, then limt→∞ w(t) = 0.
Proof: Assume that w(t) is not bounded. Then there exists a subsequence {tn } such
that limtn →∞ |w(tn )| = ∞ and |w(t)| ≤ |w(tn )| for t ≤ tn , that is, kwktn ≤ |w(tn )|, and
it follows that
|w(tn )| ≤ β(tn )kwktn + γ(tn ) ≤ β(tn )|w(tn )| + γ(tn ). (28)
Since limtn →∞ β(tn ) = 0 and γ(t) ∈ L∞ , the above inequality implies that w(tn ) is
bounded, a contradiction to the assumption that limtn →∞ w(tn ) = ∞ or w(t) is un-
bounded. Hence, w(t) is bounded, and so is kwkt .
If limt→∞ γ(t) = 0 also holds, then from (27), the boundedness of w(t) and the
condition that limt→∞ β(t) = 0, it follows that limt→∞ |w(t)| = limt→∞ (β(t)kwkt +
γ(t)) = 0. ∇
This result can be generalized to the vector signal case.
Lemma 2 For kwkt = sup0≤τ≤t kw(τ)k with kw(t)k being a vector norm of w(t) ∈
Rn , if
kw(t)k ≤ β(t)kwkt + γ(t) (29)
for some β(t) such that limt→∞ β(t) = 0 and some γ(t) ∈ L∞ , then w(t) is bounded,
that is, w(t) ∈ L∞ . If, in addition, limt→∞ γ(t) = 0, then limt→∞ w(t) = 0.
A Signal Convergence Lemma
Lemma 3 If ë(t) ∈ L∞ and limt→∞ e(t) = 0, then limt→∞ ė(t) = 0.
Proof: We need to show that for any given η > 0, there exists a T > 0 such that
|ė(t)| < η for any t > T .
The proof makes use of two related fictitious filters with a virtual parameter
1 a
a > 0: H(s) = s+a and K(s) = s+a such that 1 = sH(s) + K(s). Operating this
identity on ė(t), we have
ė(t) = H(s)s[ė](t) + sK(s)[e](t) = H(s)[ë](t) + sK(s)[e](t).
Under the condition that ë(t) ∈ L∞ , for any given η > 0, H(s)[ë](t) can be made
smaller than η2 by a choice of a sufficiently large and finite a. Under the condition
that limt→∞ e(t) = 0, for the chosen value of a, there exists a T > 0 such that for
any t > T , |sK(s)[e](t)| < η2 .
This derivation means that for any given η > 0, there exists a T > 0 such that
|ė(t)| < η for any t > T , which is equivalent to the convergence of ė(t) to 0 as
t → ∞. ∇
Remark 1 There are three possible situations:

(i) The signal ė(t) converges to a constant: such a constant must be 0, otherwise
e(t) does not converge to 0 (leading to a contradiction to limt→∞ e(t) = 0); (ii) ė(t)
does not converge when ë(t) is bounded: e(t) does not converge either (leading
to a contradiction to limt→∞ e(t) = 0); and (iii) ė(t) does not converge when ë(t)
2 sint 2 2t cost 2
is unbounded: e(t) may converge to 0 (e.g., e(t) = sint t+1 , ė(t) = − (t+1)2 + t+1 ,
2
2 sint
ë(t) = (t+1)
2
2t cost 2
2 cost 2 2
4t sint ∞
3 − (t+1)2 + (t+1)2 − t+1 ) (but this is not the case, as ë(t) ∈ L by
assumption).
Hence, if ë(t) ∈ L∞ and limt→∞ e(t) = 0, then limt→∞ ė(t) = 0. 2
Remark 2 This result also follows from the Barbalat Lemma: If a scalar function
f (t) is uniformly continuous such that limt→∞ 0t f (τ) dτ exists and is finite, then e
R
limt→∞ f (t) = 0. In this case, f (t) = ė(t), limt→∞ 0t f (τ) dτ = limt→∞ 0t ė(τ) dτ =
R R
limt→∞ (e(t) − e(0)) = −e(0) exists and is finite, and f (t) is uniformly continuous,
as f˙(t) = ë(t) is bounded. 2
Lemma (Barbalat): If a scalar function f (t) is uniformly continuous such that

limt→∞ 0t f (τ) dτ exists and is finite, then limt→∞ f (t) = 0.
R
⋄ Convergence of e(t) (which can be a tracking error signal e(t) = y(t) − ym (t)):
With f (t) = e2 (t), we have that f˙(t) = 2e(t)ė(t) is bounded, i.e., f (t) is uniformly
Rt
continuous, so that, with e(t) ∈ L2 (that is, limt→∞ 0 f (τ) dτ exists and is finite),
limt→∞ f (t) = 0, that is, limt→∞ e(t) = 0.
Proposition 1: If limt→∞ e(t) = e0 being a constant and ë(t) is bounded, then
limt→∞ ė(t) = 0.
• Barbalat lemma based proof
⋄ Convergence of ė(t) with limt→∞ e(t) = 0: For f (t) = ė(t), ë(t) being bounded
means f (t) being uniformly continuous, and limt→∞ 0t f (τ) dτ = e(∞) − e(0) =
R
−e(0) exists and is finite, so that limt→∞ f (t) = 0, that is, limt→∞ ė(t) = 0.
⋄ Convergence of ė(t) with limt→∞ e(t) = e0 ∈ R: For f (t) = ė(t), ë(t) being
bounded means f (t) being uniformly continuous, and limt→∞ 0t f (τ) dτ = e(∞) −
R
e(0) = e0 − e(0) exists and is finite, so that limt→∞ ė(t) = 0.

• Direct proof
1 a
⋄ Convergence of ė(t) with limt→∞ e(t) = 0: For H(s) = s+a and K(s) = s+a
such that 1 = sH(s) + K(s), we have
ė(t) = sH(s)[ė](t) + K(s)[ė](t) = H(s)[ë](t) + sK(s)[e](t)
whose first term can be virtually made arbitrarily small by a virtually large a > 0
and the second term converges to zero, that is, for any given η > 0, there exists a
T > 0 such that |ė(t)| < η for any t > T . This implies that ė(t) converges to zero.
⋄ Convergence of ė(t) with limt→∞ e(t) = e0 for any constant e0 : For f (t) =
e(t)−e0 , limt→∞ f (t) = 0, which, with f¨(t) = ë(t) bounded, implies that f˙(t) = ė(t)
goes to zero.
d i e(t)
Proposition 2 (the general case): For any j > 0, if limt→∞ e(t) = 0 and dt i
are
d j e(t)
bounded, i = 2, . . . , j + 1, then limt→∞ dt j
= 0.
⋄ Proof based on Proposition 1
To use the induction method to prove this result, from Proposition 1, we first
have that the result is true for j = 1, that is, limt→∞ e(t) = 0 and boundedness of
d 2 e(t)
dt 2
imply that limt→∞ de(t)
dt = 0.
k
Suppose it is true for j = k, that is, limt→∞ d dte(t)
k = 0 (with limt→∞ e(t) = 0
d i e(t)
and dt i
bounded, i = 2, . . . , k + 1). Then, for j = k + 1, with the conditions that
k d k e(t) d i e(t)
limt→∞ d dte(t)k = 0 (or, limt→∞ f (t) = 0 for f (t) = dt k ) and that dt i is bounded for
2
i = k + 2 (or, d dtf 2(t) is bounded), we have from Proposition 1 (or the result of j = 1)
f (t) k+1 e(t)
that limt→∞ d dt = 0 (that is, limt→∞ d dt k+1 = 0). This shows that the induction
process goes through, that is, the proposition is true for any j.
Plant Zeros and Controller Order for MRAC

Consider a LTI system
ẋ = Ax + Bu, y = Cx (30)
where A ∈ Rn×n , B ∈ Rn×M , C ∈ RM×n , whose transfer matrix G(s) = C(sI − A)−1 B
is an M × M strictly proper rational matrix.
Z(s)
For SISO systems with M = 1, we have G(s) = P(s) for some nominal polyno-
mials Z(s) and P(s) with ∂P(s) = n p ≤ n (if P(s) is taken as P(s) = det[sI − A], then
n p = n). If we take n as the system order for MRAC design, that is, the controller
order is n − 1 = ∂Λ(s), then we need to assume that all zeros of Z(s) (which are
the system zeros) are stable, for a stable MRAC system. With such a full-order
representation P(s) = det[sI − A], the condition that all zeros of Z(s) are stable
implies that the realization (A, B,C) is stabilizable and detectable. The choice of
the controller order n − 1 has another interpretation in the SISO case: the output
feedback controller structure is a reparametrization of a state feedback control law
u = k1∗T x + k2∗ r, using a reduced-order (with order n − 1) state observer (see Section
4.4.2).
For SISO systems, if, due to pole-zero cancellations caused by a nonminimal
realization (A, B,C), the degree n p of P(s) is less than n: n p < n, and the controller
order is n p − 1, we need to assume that, in addition to all zeros of Z(s) being sta-
Z(s)
ble, the pole-zero cancellations leading G(s) = C(sI − A)−1 B to P(s) should be also
stable ones, that is, the nonminimal realization (A, B,C) should be stabilizable and
detectable. In this case, the system zeros include the zeros of Z(s) and those can-
Z(sz )
celed zeros in G(s), while the transfer function zeros are those sz which make P(s z)
zero and they can be a subset of the zeros of Z(s), as there may be some more
Z(sz )
zero-pole cancellations between Z(s) and P(s) in P(s z)
.
In the SISO case, a state feedback control design u(t) = K1T x(t) + K2 r(t) re-
quires that all zeros of Z(s) are stable (in this case, P(s) = det[sI − A]) which is
necessary and sufficient for stable plant-model matching: det[sI − A − BK1∗T ] =
Pm (s)Z(s)/zm (not needed for just pole placement control). An output feedback
Z(s)
control design is based on a nominal transfer function P(s) with order n p = ∂P(s),
Z(s)
and all zeros of Z(s) need to be stable for stable plant-model matching based on P(s) .
If n ≤ n p , a stable Z(s) implies that (A, B,C) is stabilizable and detectable. If n > n p ,
Z(s)
then there are zero-pole cancellations in C(sI − A)−1 B = P(s) , and (A,C) needs to
be detectable, otherwise those undetectable modes (eigenvalues of A) cannot be
stabilized (output feedback does not change unobservable modes); (A, B) needs to
be stabilizable, otherwise those unstabilizable modes (eigenvalues of A) cannot be
stabilized (output or state feedback does not change uncontrollable modes).
For MIMO systems, there are also different ways to express the system transfer
matrix G(s) = C(sI −A)−1 B (we first assume that G(s) has full rank m for an M ×M
G(s), that is, rank[G(s)] < M only for a finite number of values of s).
The first (simple) form of G(s) is
N(s)
G(s) = C(sI − A)−1 B = , d(s) = det[sI − A], ∂d(s) = n. (31)
d(s)
If we use a controller of order n − 1 = ∂Λ(s), we need to assume that all zeros of
det[N(s)] are stable, which may be thought as the system zeros (note that the zeros
of G(s), as defined in the literature, may be only a subset of those zeros if (A, B,C)
is not a minimal realization). In fact, different from the SISO case, the controller
order can be reduced to n − M in the MIMO case, because a reduced-order observer
has order n − M, so that the state feedback control law u = K1∗T x + K2∗ r can be
reparametrized using the input and output signals, leading to an (n − M)th order
output feedback controller.
Given that the observability index of a minimal realization of G(s) is ν ≤ n −
M +1, that is, ν−1 ≤ n−M, the order of the usual MRAC structure, which has been
chosen as ν − 1, is the minimal order to meet the desired plant-model matching. If
for a system, the order of a reduced-order observer can be chosen as ν − 1, the
parametrization of the output feedback controller with order ν − 1 can then be seen
as a reparametrization of a state feedback controller, using input and output signals.
If not, the controller parametrization may be considered as being one used for plant-
model matching. In MRAC for multivariable systems, we call ν the observability
index of the system transfer matrix G(s), in the sense that ν is the observability
index of a minimal realization of the system transfer matrix G(s).
The second form of G(s) is a left matrix-fraction description:
G(s) = C(sI − A)−1 B = P̄l−1 (s)Z̄l (s) (32)
where P̄l (s) and Z̄l (s) are M × M polynomial matrices with P̄l (s) row reduced (a
polynomial matrix P̄l (s) is row reduced if the elements in the ith row of P̄l (s) have
a largest degree ν̄i and the matrix Γr = lims→∞ diag{s−ν̄1 , s−ν̄2 , . . . , s−ν̄M }P̄l (D) is
nonsingular), and the ith row degree of Z̄l (s) is less than the ith row degree of P̄l (s),
i = 1, 2, . . . , q (it is denoted that ∂P̄l (s) = ν̄, that is, ν̄ = max{ν̄i }). A controller can
be designed with ∂Λ(s) = ν̄ − 1. In this case, for stable MRAC, we need to as-
sume that the zeros of det[Z̄l (s)] are stable and also that (A, B,C) is stabilizable and
detectable (as some pole-zero cancellations may occur when obtaining the system
model P̄l−1 (s)Z̄l (s) from (A, B,C)).
Note that a left matrix-fraction description G(s) = P̄l−1 (s)Z̄l (s), can always be
made to have a row reduced P̄l (s), by using elementary row operations represented
by a unimodular matrix M(s) (such a matrix is defined to have a non-zero constant

determinant) on a non-reduced P̃l (s):
G(s) = P̃l−1 (s)Z̃l (s) = (M(s)P̃l (s))−1 M(s)Z̃l (s) = P̄l−1 (s)Z̄l (s), (33)
for P̄l (s) = M(s)P̃l (s) and Z̄l (s) = M(s)Z̃l (s).
The third form of G(s) is a left co-prime matrix-fraction description:
G(s) = C(sI − A)−1 B = Pl−1 (s)Zl (s) (34)
where Pl (s) and Zl (s) are left co-prime M × M polynomial matrices (Pl (s) and Zl (s)
are left co-prime if any M × M polynomial matrix W (s) such that Zl (s) = W (s)Z(s)
and Pl (s) = W (s)P(s) for some polynomial matrices Z(s) and P(s)—such a W (s)
is called a common left divisor of Zl (s) and Pl (s), is a unimodular matrix, that is,
det[W (s)] is a non-zero constant), with Pl (s) row reduced and ∂Pl (s) = ν ≤ ν̄. A
controller can be designed with ∂Λ(s) = ν − 1. In this case, we also need to assume
that the zeros of det[Zl (s)] are stable and that (A, B,C) is stabilizable and detectable.
The situation is similar for G(s) in a right matrix-fraction description:
G(s) = C(sI − A)−1 B = Zr (s)Pr−1 (35)
with Pr (s) being column reduced (that is, PrT (s) being row reduced) and Zr (s) and
Pr (s) being right co-prime (that is, ZrT (s) and PrT (s) being left co-prime). In par-
ticular, the column degrees of Pr (s) are denoted as µi (or µ̄i for P̄r (s) if G(s) =
C(sI − A)−1 B = Z̄r (s)P̄r−1 with Z̄r (s) and P̄r (s) not right co-prime), i = 1, 2, . . . , m,
and the column degrees of Zr (s) (Z̄r (s)) are less than that of Pr (s) (P̄r (s)). If (A, B,C)
is a minimal realization, then µi , i = 1, 2, . . . , m, are the controllability indexes of
(A, B). If (A, B,C) is not a minimal realization, then one can a controllable realiza-
tion (Āc , B̄c , C̄c ) whose controllability indexes are µ̄i , for Z̄r (s)P̄r−1 (s) (or (Ac , Bc ,Cc )
whose controllability indexes are µi , for Zr (s)Pr−1 ).
Note that if (A, B,C) is a minimal realization, then ν is the observability index
of (A,C) (we may also call ν the observability index of G(s)). When (A, B,C) is not
minimal, for the second case (or the third case), we can find an observable realiza-
tion (Āo , B̄o , C̄o ) whose observability indexes are ν̄i , for P̄l−1 (s)Z̄l (s) (or (Ao , Bo ,Co )
whose observability indexes are νi , for Pl−1 (s)Zl (s)). In this sense, we may also call
ν̄ (or ν) the observability of G(s) = P̄l−1 (s)Z̄l (s) (or G(s) = Pl−1 (s)Zl (s)).
In summary, for MRAC of a system (A, B,C), a basic assumption is that (A, B,C)
is stabilizable and detectable, in addition to the assumption that all zeros of the sys-
tem transfer matrix G(s) = C(sI −A)−1 B are stable; in other words, all system zeros
are required to be stable.
For more about the definitions of the zeros and poles of G(s), see Kailath (1980)
and Rugh (1996), and also see more notes.
Parameter Convergence of MRAC

State Feedback State Tracking MRAC
Consider a linear time-invariant plant in the state-space form:
ẋ(t) = Ax(t) + Bu(t), x(t) ∈ Rn , u(t) ∈ R, (36)
where A ∈ Rn×n , B ∈ Rn are some unknown constant parameter matrix and param-
eter and vector, and assume that the state vector x(t) is available for measurement.
The control objective is to design a state feedback control law for u(t) such
that all signals in the closed-loop system are bounded and the plant state vector
x(t) asymptotically tracks a reference state vector xm (t) generated from a chosen
reference model system
ẋm (t) = Am xm (t) + Bm r(t), xm (t) ∈ Rn , r(t) ∈ R (37)
where Am ∈ Rn×n is stable, and Bm ∈ Rn , both are constant.

To meet such a state tracking control objective, we assume that there exist a
constant vector k1∗ ∈ Rn and a nonzero constant scalar k2∗ ∈ R to satisfy the plant-
model matching conditions:
A + Bk1∗T = Am , Bk2∗ = Bm . (38)
The adaptive controller structure is chosen as
u(t) = k1T (t)x(t) + k2 (t)r(t), (39)
where k1 (t) and k2 (t) are the estimates of k1∗ and k2∗ .
For the tracking error x(t) − xm (t) and the parameter errors
k̃1 (t) = k1 (t) − k1∗ , k̃2 (t) = k2 (t) − k2∗ , (40)
the tracking error equation can be derived as

ė(t) = Am e(t) + B k̃1T (t)x(t) + k̃2 (t)r(t) . (41)
The adaptive laws for k1 (t) and k2 (t) are chosen as
k̇1 (t) = −sign[k2∗ ]Γx(t)eT (t)PBm , (42)
k̇2 (t) = −sign[k2∗ ]γr(t)eT (t)PBm , (43)

where Γ = ΓT > 0 and γ > 0, and P ∈ Rn×n such that P = PT > 0 satisfying
PAm + ATm P = −Q (44)

for a chosen constant matrix Q ∈ Rn×n such that Q = QT > 0.

Since Γ̄ = diag{Γ, γ} = Γ̄T > 0, there exists a nonsingular matrix Γ̄1 such that
Γ̄ = Γ̄T1 Γ̄1 . With such a Γ̄1 , we introduce the overall parameter error vector
θ̄˜ (t) = (Γ̄T1 )−1 θ̃(t), θ̃(t) = [k̃1T (t), k̃2 (t)]T ∈ Rn+1 , (45)
and the corresponding regressor vector
ω̄(t) = Γ̄1 ω(t), ω(t) = [xT (t), r(t)]T ∈ Rn+1 . (46)
Since P̄ = k2∗ P = P̄T > 0, there is a nonsingular matrix P̄1 = P̄1T ∈ Rn×n such that
P̄ = P̄1 P̄1 .1 With such a nonsingular P̄1 = P̄1T , we introduce the transformed tracking
error
ē(t) = P̄1 e(t). (47)
Then, with Ām = P̄1 Am P̄1−1 and B̄ = P̄1 B, we can express the tracking error equation
(41) as
ē˙ (t) = P̄1 Am e(t) + P̄1 BωT (t)θ̃(t) = Ām ē(t) + B̄ω̄T (t)θ̄˜ (t) (48)
and, for k2∗ > 0, write the adaptive laws (42)–(43) as
˙
θ̄˜ (t) = −ω̄(t)B̄T ē(t). (49)
In a compact form, we have

" #
ē˙ (t) Ām B̄ω̄T (t) ē(t)
˙ = . (50)
θ̄˜ (t) −ω̄(t)B̄T 0 θ̄˜ (t)
Here, the matrix Ām = P̄1 Am P̄1−1 with P̄ = k2∗ P = P̄1 P̄1 and P̄1 = P̄1T has the property:
Ām + ĀTm = P̄1−1 (P̄Am + ATm P̄)P̄1−1

= k2∗ P̄1−1 (PAm + ATm P)(P̄1−1 )T = −k2∗ P̄1−1 Q(P̄1−1 )T < 0. (51)
To study the convergence properties of the parameter error θ̃(t) in (41), or equiv-
alently, that of θ̄˜ (t) in (50), we first introduce the following definition:
Definition 1 A bounded vector signal x(t) ∈ Rq , q ≥ 1, is persistently exciting (PE)

if there exist δ > 0 and α0 > 0 such that
Z σ+δ
x(t)xT (t) dt ≥ α0 I, ∀σ ≥ t0 . (52)
σ
1 In this case, there is a nonsingular matrix Q̄ ∈ Rn×n such that Q̄Q̄T = I and P̄ = Q̄Λ̄Q̄T with Λ̄
being diagonal whose diagonal elements are the eigenvalues of P̄, which are all real and positive.
Then, P̄ = P̄1 P̄1 , where P̄1 = Q̄Λ̄1 Q̄T with Λ̄1 being diagonal such that Λ̄1 Λ̄1 = Λ̄, which leads to
P̄1 = P̄1T > 0 and P̄1−1 = (P̄1−1 )T .
We now present the following results.
Result (Morgan and Narendra 1977; Narendra and Annaswamy 1989): For the
system
ż(t) A0 B0 ζT0 (t) z(t)
= , (53)
φ̇(t) −ζ0 (t)BT0 0 φ(t)
with z(t) ∈ Rn , φ(t) ∈ Rn+1 , ζ0 (t) ∈ Rn+1 , A0 ∈ Rn×n being stable (i.e., all its eigen-
values are in Re[s] < 0) such that A0 + AT0 < 0, and B0 ∈ Rn and (A0 , B0 ) being
controllable, if ζ0 (t) is bounded and PE, then limt→∞ φ(t) = 0 and limt→∞ z(t) = 0,
both exponentially.
Result: The MRAC system has been transformed to (50) (with Ām = P̄1 Am P̄1−1
stable and Ām + ĀTm < 0 as shown in (51), and ω̄(t) = Γ̄1 ω(t)) which has the same
form as that in (53).
Remark: ω(t) is PE iff and ω̄(t) is PE, for ω̄(t) = Γ̄1 ω(t).
Result (Narendra and Annaswamy (1989); Ioannou and Sun (1996)): For the sys-
tem
ẋm (t) = Am xm (t) + Bm r(t), xm (t) ∈ Rn , r(t) ∈ R (54)
where Am ∈ Rn×n is stable and (Am , Bm ) is controllable, if the input signal r(t) has
n + 1 or more frequencies, then ωm (t) = [xm
T (t), r(t)]T is PE.
Remark: r(t) = 1 has one frequency at 0, and r(t) = sin 2t has two frequencies at
2 and −2, etc.
Result: If (ω(t) − ωm (t)) ∈ L2 and ω(t) is PE, then ωm (t) is PE.

This results can be proved by using the PE and L2 signal definitions (conditions).
Result: MRAC ensures that all closed-loop system signals are bounded and (ω(t)−
ωm (t)) ∈ L2 .
Remark: (A, B) is controllable iff (Am , Bm ) is controllable iff (Ām , B̄) is control-
lable.
Remark: limt→∞ θ̃(t) = 0 and limt→∞ e(t) = 0, both exponentially iff limt→∞ θ̄˜ (t) =
0 and limt→∞ ē(t) = 0, both exponentially, for θ̄˜ (t) = (Γ̄T1 )−1 θ̃(t) and ē(t) = P̄1 e(t).
In conclusion, with the application of the result for (53) to the MRAC system
equation (50), the state feedback state tracking MRAC system, with (A, B) con-
trollable and r(t) of n + 1 or more frequencies, ensures that limt→∞ θ̃(t) = 0 and
limt→∞ e(t) = 0, both exponentially.
Output Feedback Output Tracking MRAC

Consider a linear time-invariant plant of the form
Z(s)
y(t) = G(s)[u](t), G(s) = k p (55)
P(s)
with some unknown monic polynomials P(s) and Z(s) of degrees n and m respec-
tively, and some gain k p known or unknown, and assume that Z(s) is a stable poly-
nomial for MRAC.
MRAC System with k p Known

For the case of k p known, the adaptive controller structure is
u(t) = θT1 ω1 (t) + θT2 ω2 (t) + θ20 y(t) + θ∗3 r(t), (56)
where
a(s) a(s)
ω1 (t) = [u](t), ω2 (t) = [y](t), (57)
Λ(s) Λ(s)
a(s) = [1, s, . . . , sn−2 ]T , (58)
θ1 ∈ Rn−1 , θ2 ∈ Rn−1 and θ20 ∈ R are parameters to be adaptively updated, Λ(s) is
a monic stable polynomial of degree n − 1, and θ∗3 = k−1 p .
The control objective is to design the input signal u(t) to ensure all closed-loop
signals bounded and the output y(t) asymptotically tracking the reference output
signal ym (t) satisfying
Pm (s)[ym ](t) = r(t), (59)
where Pm (s) is a monic stable polynomial of degree n∗ = n − m, and r(t) is a
bounded and piecewise continuous reference input signal.
The parameters θ1 ∈ Rn−1 , θ2 ∈ Rn−1 and θ20 ∈ R are estimates of the nominal
parameters θ∗1 ∈ Rn−1 , θ∗2 ∈ Rn−1 and θ∗20 ∈ R satisfying the matching equation
θ∗T
1 a(s)P(s) + (θ2 a(s) + θ20 Λ(s))k p Z(s) = Λ(s)(P(s) − k p θ3 Z(s)Pm (s)). (60)
∗T ∗ ∗
In this case, the regressor vector is defined as
ω0 (t) = [ωT1 (t), ωT2 (t), y(t)]T ∈ R2n−1 , (61)
the corresponding filtered regressor vector is

1
ζ0 (t) = Wm (s)[ω0 ](t), Wm (s) = (62)
Pm (s)
for a stable polynomial Pm (s) of degree n∗ , the estimation error is defined as

ε(t) = e(t) + k p ξ(t), (63)
where e(t) = y(t) − ym (t), and
1
ξ(t) = θT0 (t)ζ0 (t) − [θT ω0 ](t) (64)
Pm (s) 0
θ0 (t) = [θT1 (t), θT2 (t), θ20 (t)]T ∈ R2n−1 . (65)
The adaptive law for θ0 (t) is chosen as
ζ0 (t)ε(t)
θ̇0 (t) = −sign[k p ]Γ (66)
m2 (t)
where Γ = ΓT > 0, and
q
m(t) = 1 + ζT0 (t)ζ0 (t) + ξ2 (t). (67)
The tracking error e(t) satisfies
kp
e(t) = [θ̃T ω0 ](t), (68)
Pm (s) 0
1 , θ2 , θ20 ] ∈ R
where θ̃0 (t) = θ0 (t) − θ∗0 , with θ∗0 = [θ∗T ∗T ∗ T 2n−1 being the nominal
value of θ0 (t) and depends on the parameters of P(s) and Z(s) as the plant-model
matching parameter vector. The estimation error ε(t) can be expressed as
ε(t) = θ̃T0 (t)ζ0 (t), (69)
and the adaptive law with k p > 0 can be expressed as
ζ0 (t)ζ0 (t)θ̃0 (t)
T
θ̃˙ 0 (t) = −Γ . (70)
m2 (t)
Since Γ = ΓT > 0, there exists a nonsingular matrix Γ1 such that Γ = ΓT1 Γ1 . Hence,
we have
Γ1 ζ0 (t)ζT0 (t)ΓT1 T −1
(ΓT1 )−1 θ̃˙ 0 (t) = − (Γ1 ) θ̃0 (t). (71)
m2 (t)
Γ1 ζ0 (t)
Letting φ0 (t) = (ΓT1 )−1 θ̃0 (t) and ψ0 (t) = m(t) , we arrive at
φ̇0 (t) = −ψ0 (t)ψT0 (t)φ0 (t). (72)

MRAC ensures the desired system properties: the closed-loop signal bound-
edness (which implies that the above ψ0 (t) is bounded), the asymptotic output
tracking: limt→∞ (y(t) − ym (t)) = 0, and the L2 tracking error e(t) = y(t) − ym (t):
R∞ 2
0 e (t)dt < ∞. To study the convergence properties of the parameter error θ̃0 (t),
or that of φ0 (t), we recall the following definition:
Definition 2 A bounded vector signal x(t) ∈ Rq , q ≥ 1, is persistently exciting (PE)

if there exist δ > 0 and α0 > 0 such that
Z σ+δ
x(t)xT (t) dt ≥ α0 I, ∀σ ≥ t0 . (73)
σ
From the definition of ζ0 (t) and u(t) = G−1 (s)[y](t), we have
aT (s) aT (s)
ζ0 (t) = Wm (s)[ [u](t), [y](t), y(t)]T
Λ(s) Λ(s)
T
a (s) −1 aT (s)
= Wm (s)[ G (s)[y](t), [y](t), y(t)]T , (74)
Λ(s) Λ(s)
1
where Wm (s) = Pm (s) , In a similar structure, we introduce the signal
aT (s) −1 aT (s)
ζ0m (t) = Wm (s)[ G (s)[ym ](t), [ym ](t), ym (t)]T
Λ(s) Λ(s)
= Wm (s)H0 (s)[r](t) ∈ R2n−1 , (75)
where
aT (s) −1 aT (s)
H0 (s) = [ G (s)Wm (s), Wm (s),Wm (s)]T . (76)
Λ(s) Λ(s)
The following results are available in the literature.
Result (Anderson 1997): If ψ0 (t) in (72) is PE, then limt→∞ φ0 (t) = 0 exponentially,
that is, limt→∞ (θ0 (t) − θ∗0 ) = 0 exponentially.
Result: If the signal ζ0 (t) is PE, then ψ0 (t) is PE (which follows from the bound-
edness of m(t)).
Result: MRAC ensures that (ζ0 (t) − ζ0m (t)) ∈ L2 (which can be seen from ζ0 (t) −
ζ0m (t) = H(s)[e](t), where H(s) is strictly proper and stable, and e(t) ∈ L2 ).
Result: Given that (ζ0 (t) − ζ0m (t)) ∈ L2 , ζ0 (t) is PE iff ζ0m (t) is PE.
Result (Boyd and Satry 1983): If r(t) has 2n − 1 or more frequencies and P(s) and
Z(s) are coprime, then ζ0m (t) is PE.
In conclusion, for a MRAC system with P(s) and Z(s) coprime and k p known, if
the reference signal r(t) has 2n − 1 or more frequencies, then limt→∞ (θ(t) − θ∗0 ) = 0
and limt→∞ (y(t) − ym (t)) = 0, both exponentially.
MRAC System with k p Unknown

In this case, the adaptive controller structure is
u(t) = θT1 ω1 (t) + θT2 ω2 (t) + θ20 y(t) + θ3 r(t), (77)
the regressor vector is defined as
ω(t) = [ωT1 (t), ωT2 (t), y(t), r(t)]T ∈ R2n , (78)
the corresponding filtered regressor vector is

1
ζ(t) = Wm (s)[ω](t), Wm (s) = , (79)
Pm (s)
the estimation error is defined as
ε(t) = e(t) + ρ(t)ξ(t), (80)
where ρ(t) is the estimate of k p , and
1
ξ(t) = θT (t)ζ(t) − [θT ω](t) (81)
Pm (s)
θ(t) = [θT1 (t), θT2 (t), θ20 (t), θ3 (t)]T ∈ R2n , (82)
and the adaptive laws for θ(t) and ρ(t) are chosen as
ζ(t)ε(t)
θ̇(t) = −sign[k p ]Γ (83)
m2 (t)
γε(t)ξ(t)
ρ̇(t) = − (84)
m2 (t)
where Γ = ΓT > 0, γ > 0, and and

q
m(t) = 1 + ζT (t)ζ(t) + ξ2 (t). (85)
In this case, the tracking error e(t) satisfies

kp
e(t) = [θ̃T ω](t), (86)
Pm (s)
where θ̃(t) = θ(t) − θ∗ , with θ∗ = [θ∗T

1 , θ2 , θ20 , θ3 ] ∈ R being the nominal pa-
∗T ∗ ∗ T 2n
rameter vector. The estimation error ε(t) can be expressed as
ε(t) = ρ∗ θ̃T (t)ζ(t) + ρ̃(t)ξ(t), (87)

where ρ∗ = k p , θ̃(t) = θ(t) − θ∗ and ρ̃(t) = ρ(t) − ρ∗ . Introducing θ̄˜ (t) = θ̄(t) − θ̄∗
with
θ̄(t) = [θT (t), ρ(t)]T ∈ R2n+1 , θ̄∗ = [θ∗T , ρ∗ ]T ∈ R2n+1 (88)
and defining Γ̄ = diag{Γk−1
p , γ} (for k p > 0), and
ζ̄(t) = [k p ζT (t), ξ(t)]T ∈ R2n+1 (89)
Then, the adaptive laws with k p > 0 can be expressed as
˙ ζ̄(t)ζ̄T (t)θ̄˜ (t)

θ̄˜ (t) = −Γ̄ . (90)
m2 (t)
While this expression has the same form as that in (70), it does not render the
same procedure for the convergence analysis of θ̄˜ (t), because ζ̄(t) cannot be PE as
limt→∞ ξ(t) = 0 from MRAC.
In this case, we consider (83) and (87) with k p > 0:
ζ(t)ζ (t)
T ζ(t)ρ̃(t)ξ(t)
θ̃˙ (t) = −Γk p 2
θ̃(t) − Γ , (91)
m (t) m2 (t)
express the signal ζ(t) as
aT (s) aT (s)
ζ(t) = Wm (s)[ [u](t), [y](t), y(t), r(t)]T
Λ(s) Λ(s)
aT (s) −1 aT (s)
= Wm (s)[ G (s)[y](t), [y](t), y(t), r(t)]T , (92)
Λ(s) Λ(s)
and introduce the signal
aT (s) −1 aT (s)
ζm (t) = Wm (s)[ G (s)[ym ](t), [ym ](t), ym (t), r(t)]T
Λ(s) Λ(s)
= Wm (s)H(s)[r](t) ∈ R2n , (93)
where
aT (s) −1 aT (s)
H(s) = [ G (s)Wm (s), Wm (s),Wm (s), 1]T . (94)
Λ(s) Λ(s)
We have the following results.
Result: If r(t) has 2n or more frequencies, and P(s) and Z(s) are coprime, then
ζm (t) is PE.
Result: MRAC ensures that (ζ(t) − ζm (t)) ∈ L2 , and ξ(t) ∈ L2 and limt→∞ ξ(t) = 0.
Result: Given that (ζ(t) − ζm (t)) ∈ L2 , ζ(t) is PE iff ζm (t) is PE.
Result: If ζ(t) is PE, then the solution θ̃(t) of the homogeneous part of (91): θ̃˙ (t) =
−Γk p ζ(t)ζ
T (t)
2
m (t)
θ̃(t), has the property: limt→∞ θ̃(t) = 0 exponentially.
Result: If ζ(t) is PE, then the solution θ̃(t) of (91) has the property:
lim θ̃(t) = 0, θ̃(t) ∈ L2 . (95)

t→∞
This follows from the system signal boundedness and the ζ(t) PE condition,
which imply that
ζ(t)ζT (t)
θ̃˙ (t) = −Γk p θ̃(t) (96)
m2 (t)
is an exponentially stable system, and from the properties: limt→∞ ξ(t) = 0 and
ξ(t) ∈ L2 .
In conclusion, for a MRAC system with P(s) and Z(s) coprime and k p > 0 un-
known, if the reference signal r(t) has 2n or more frequencies, then limt→∞ (θ(t) −
θ∗ ) = 0 and (θ(t) − θ∗ ) ∈ L2 , in addition to the usual MRAC tracking error proper-
ties: limt→∞ (y(t) − ym (t)) = 0 and (y(t) − ym (t)) ∈ L2 .
Higher-Order Tracking Performance of MRAC

It has been shown that for a linear time-invariant plant y(t) = G(s)[u](t), where
Z(s)
G(s) = k p P(s) with all zeros of Z(s) stable and with relative degree n∗ = degree of
P(s)− degree of Z(s), a model reference adaptive controller to generate the plant in-
put u(t) ensures that the tracking error e(t) = y(t)−ym (t) has the desired asymptotic
convergence property: limt→∞ e(t) = 0, where ym (t) = Wm (s)[r](t) is the reference
output to be tracked by the plant output y(t), for a bounded reference input signal
r(t) and a stable transfer function Wm (s) = Pm1(s) with a stable polynomial Pm (s)
of degree n∗ . In this work, we show that the tracking error e(t) in a model refer-
ence adaptive control (MRAC) system has some stronger convergence properties as
stated in the following theorem.
Theorem 1 For a model reference adaptive control system with the plant relative
degree n∗ > 0, the tracking error e(t) = y(t) − ym (t) has the convergence property:
i
limt→∞ d dte(t) ∗
i = 0, for i = 0, 1, . . . , n − 1.
Proof: The property: limt→∞ e(t) = 0 follows directly from the established prop-
erties: 0∞ e2 (t)dt < ∞ and de(t)
R
dt is bounded. However, it is not clear whether
d i e(t) i
dt i
is square-integrable or not for i > 0. To prove the convergence of d dte(t) i , for
i = 1, . . . , n −1, we recall that for a function f (t) defined on [t0 , ∞), limt→∞ f (t) = 0
∗
if for every η > 0, there exists a T = T (η) > 0 such that | f (t)| < η, ∀t > T . Hence,
our goal now is to show that in each case of i = 1, . . . , n∗ − 1, for any given η,
i
i | < η, for all t > T . To reach this goal, we use
there exists a T > 0 such that | d dte(t)
i
a method to decompose the signal d dte(t)i into two fictitious parts: one being small
enough and one converging to zero asymptotically with time going to infinity. To
this end, we first introduce two fictitious filters K(s) and H(s) from
∗
an
K(s) = ∗ , sH(s) = 1 − K(s) (97)
(s + a)n
where a > 0 is a generic constant to be specified. The filter H(s) is given as
∗ ∗
1 1 (s + a)n − an
H(s) = (1 − K(s)) = ∗ (98)
s s (s + a)n
which is strictly proper (with relative degree 1) and stable and whose impulse re-
sponse function is
n∗ ∗
an −i n∗ −i
h(t) = L −1
[H(s)] = e −at
∑ ∗ t . (99)
i=1 (n − i)!
It can be verified that the L1 signal norm of h(t) is

Z ∞
n∗
kh(·)k1 = |h(t)| dt = . (100)
0 a
It has been established that the tracking error e(t) = y(t) − ym (t) satisfies
kp
e(t) = [θ̃T ω](t), (101)
Pm (s)
where Pm (s) is a stable polynomial of degree n∗ , and θ̃(t) is the parameter error
vector and ω(t) is the controller regressor vector, and both are bounded. Using
(97): 1 = sH(s) + K(s), we express ė(t) = de(t)
dt as
k ps T
ė(t) = [θ̃ ω](t)
Pm (s)
k p s2 T kp
= H(s) [θ̃ ω](t) + sK(s) [θ̃T ω](t)
Pm (s) Pm (s)
k ps 2
= H(s) [θ̃T ω](t) + sK(s)[e](t). (102)
Pm (s)
To demonstrate the new technique for proving the new result in Theorem 1:
i
limt→∞ d dte(t) ∗
i = 0, for i = 1, . . . , n − 1, under the previously proved properties of
MRAC: all closed-loop signals are bounded and the tracking error e(t) = y(t) −
ym (t) satisfies limt→∞ e(t) = 0, we first consider the case of n∗ = 2, where
a2 s + 2a
K(s) = 2
, H(s) = . (103)
(s + a) (s + a)2
k p s2 k p s2
Since θ̃T (t)ω(t) is bounded and Pm (s) is stable and proper, Pm (s) [θ̃ ω](t) is bounded.
T
It follows from the above L1 signal norm expression of H(s) that
k p s2 T c0
|H(s) [θ̃ ω](t)| ≤ (104)
Pm (s) a
for any t ≥ 0 and some constant c0 > 0 independent of a > 0. Since limt→∞ e(t) = 0
as established and sK(s) is stable and strictly proper (with relative degree n∗ − 1 = 1
in this case of n∗ = 2), it follows, for any a > 0 in K(s), that
lim sK(s)[e](t) = 0.2 (105)

t→∞
2 For
a stable and strictly proper transfer function W (s) and a system z(t) = W (s)[v](t), if
limt→∞ v(t) = 0, then limt→∞ z(t) = 0 (see p. 68 of Narandra and Annaswamy (1989) and and p.
263 of Tao (2003).
To show that, for every η > 0, there exists a T > 0 such that |ė(t)| < η, ∀t > T ,
we set a > a(η) = 2cη0 for the fictitious filter H(s) in (98) so that ca0 < η2 in (104),
and let T = Ta (a(η), η) = T (η) > 0 such that |sK(s)[e](t)| < η2 for all t ≥ T (which
△
is ensured by the property that limt→∞ sK(s)[e](t) = 0 for any finite a > 0 in the
other related fictitious filter K(s) in (97)) (the peak value of |sK(s)[e](t)| depends
on the parameter a, so that the above time instant T = Ta (a(η), η) also depends on
a too). Then, it follows from (102) and (104) that
η η
|ė(t)| < + = η, ∀t > T, (106)
2 2
which implies that limt→∞ ė(t) = 0. In other words, if limt→∞ ė(t) 6= 0, then there
exist an η0 > 0 and a sequence of time instants ti with limi→∞ ti = ∞ such that
|ė(ti )| > η0 for all i = 1, 2, . . ., which, from the above analysis, is impossible.
Similarly, for the case when n∗ = 3 with
a3 s2 + 3as + 3a2
K(s) = , H(s) = , (107)
(s + a)3 (s + a)3
k p s2
we see that in (102), Pm (s) is stable and strictly proper, and so is sK(s), so that
2 d 2 e(t)
limt→∞ ė(t) = 0. To show limt→∞ d dte(t)
2 = 0, from (102), we express dt 2
as
d 2 e(t) k p s3 T
= H(s) [θ̃ ω](t) + s2 K(s)[e](t), (108)
dt 2 Pm (s)
k p s3 s3
Pm (s) [θ̃ ω](t) is stable and proper and θ̃T (t)ω(t) is
in which T is bounded (as Pm (s)
bounded) and H(s) satisfies (100), and limt→∞ s2 K(s)[e](t) = 0. Hence, similar to
2 d 2 e(t)
(106), now with d dte(t)
2 replacing ė(t) in (106), it also follows that limt→∞ dt 2 = 0.
In general, for a MRAC system with an arbitrary relative degree n∗ > 0, from
i
(102), we express the ith-order time derivative d dte(t)
i of e(t) as
d i e(t) k p si+1 T
= H(s) [θ̃ ω](t) + si K(s)[e](t). (109)
dt i Pm (s)
k p si+1
Since θ̃T (t)ω(t) is bounded, and for each i = 1, 2, . . . , n∗ − 1, Pm (s) is stable and
strictly proper (proper for i = n∗ − 1), we have
k p si+1 T ci
|H(s) [θ̃ ω](t)| ≤ (110)
Pm (s) a
for some ci > 0 independent of a. For each i = 1, 2, . . . , n∗ − 1, si K(s) is stable and

strictly proper, so that, with limt→∞ e(t) = 0, we have
lim si K(s)[e](t) = 0. (111)

t→∞
Hence, with the use of the fictitious parameter a > 0 in H(s) and K(s), similar to
(106), it can be shown that for every η > 0, there exists a T = T (η) > 0 such that
i d i e(t)
i | < η for all t > T , so that limt→∞ dt i = 0, for i = 1, 2, . . . , n − 1.
| d dte(t) ∗ ∇
For a general MRAC system, the reference input signal r(t) is only required to
be bounded (which is sufficient for the result of Theorem 1). If the time-derivative
of r(t) is also bounded, we have the following additional property.
Corollary 1 For a MRAC system with relative degree n∗ > 0, if both r(t) and ṙ(t)
are bounded, then the tracking error e(t) = y(t) − ym (t) has the convergence prop-
i
erty: limt→∞ d dte(t) ∗
i = 0, for i = 0, 1, . . . , n .
n∗
Proof: We just need to show the additional convergence property: limt→∞ d dte(t)
n∗ =
0. To this end, we consider (109) with i = n∗ :
∗ ∗
d n e(t) k p sn ∗
n∗ = H(s) s[θ̃T ω](t) + sn K(s)[e](t). (112)
dt Pm (s)
T
In this case, s[θ̃T ω](t) = dt
d
(θ̃T (t)ω(t)) = θ̃˙ (t)ω(t) + θ̃T ω̇(t) is bounded, because
θ̃˙ (t) and ω̇(t) (whose last component is ṙ(t) which is bounded by assumption) are
∗
k sn ∗
bounded. Hence Pmp (s) s[θ̃T ω](t) is bounded. Since sn K(s) in (112) is stable and
proper and H(s) satisfies (100), we have, with the property: limt→∞ e(t) = 0 and an
∗ n∗
d n e(t)
inequality similar to (106) with dt n
∗ replacing ė(t), that limt→∞ d dte(t)
n∗ = 0. ∇
Remark 3 As a comparison, in the ideal case of nominal model reference control

when θ(t) = θ∗ in the controller structure, it can be shown that
Pm (s)[y − ym ](t) = −k p ε1 (t) (113)
for some exponentially decaying and initial condition related term ε1 (t), where
Pm (s) is a stable polynomial of degree n∗ . It follows from this equation that the
i
tracking error e(t) = y(t) − ym (t) has the convergence property: limt→∞ d dte(t)
i = 0,
∗
for i = 0, 1, . . . , n (under the condition that r(t) is bounded). The difference be-
tween the nominal control and adaptive control cases is that in the adaptive control
n∗
case the additional condition that ṙ(t) is bounded was used to show limt→∞ d dte(t)
n∗ =
0, which is not needed for the nominal control case. 2
i
Remark 4 For the case when ym (t) = 0, it follows that limt→∞ d dty(t) i = 0, for i =
∗
0, 1, . . . , n − 1, an output regulation result of MRAC.
For a state-space system model: ẋ = Ax + Bu, y = Cx with x(t) ∈ Rn , if n∗ = n,
i
then limt→∞ d dty(t)i = 0, for i = 0, 1, . . . , n−1, as established above, and limt→∞ x(t) =
0, as (A,C) is observable implied by the condition that n∗ = n (the system transfer
function does not have any finite zeros as its numerator is just a constant k p ). This
is the adaptive asymptotic state regulation result, guaranteed by a MRAC design.
In particular, for an nth order system with (A, B) in the controllable canonical
form and y(t) = x1 (t), the system transfer function explicitly has no finite zeros
as its numerator is a constant, leading to n∗ = n and an observable (A,C), so that
limt→∞ x(t) = 0, an inherent property of a MRAC system. 2
i
This new higher-order tracking error convergence property: limt→∞ d dte(t)
i = 0,
∗
for i = 1, . . . , n , of MRAC, is extendable to adaptive nonlinear tracking control
systems in which the controlled nonlinear plant has a defined relative degree n∗ .
Convergence of θ̃T (t)ω(t)

For a MRAC system, we have defined
θ∗ = (θ∗T
1 , θ2 , θ20 , θ3 ) ∈ R
∗T ∗ ∗ T 2n̄
(114)
θ(t) = (θT1 (t), θT2 (t), θ20 (t), θ3 (t))T ∈ R2n̄ (115)
ω(t) = (ωT1 (t), ωT2 (t), y(t), r(t))T ∈ R2n̄ (116)
θ̃(t) = θ(t) − θ∗ , e(t) = y(t) − ym (t), (117)
and derived the tracking error equation
kp
e(t) = [θ̃T ω](t)
Pm (s)
1 1
= −k p (θ∗T [ω](t) − [θT ω](t)), (118)
Pm (s) Pm (s)
where Pm (s) is a monic and stable polynomial of degree n∗ .
We also defined the estimation error
ε(t) = e(t) + ρ(t)ξ(t) (119)
where ρ(t) is the estimate of ρ∗ = k p , and

1
ξ(t) = θT (t)ζ(t) − [θT ω](t) (120)
Pm (s)
1
ζ(t) = [ω](t). (121)
Pm (s)
This estimation error ε(t), which is in its implementable (calculable) form, is in-
spired by the second equality of the tracking error equation (118):

∗T 1 1
ε(t) = e(t) − −k p (θ [ω](t) − [θ ω](t)) |θ∗ =θ,ρ∗ =ρ ,
T
(122)
Pm (s) Pm (s)
that is, ε(t) = e(t)− the estimate of −k p (θ∗T Pm1(s) [ω](t) − Pm1(s) [θT ω](t)).
The estimation error ε(t) can be expressed as its theoretical form
ε(t) = k p θ̃T (t)ζ(t) + ρ̃(t)ξ(t), ρ̃(t) = ρ(t) − ρ∗ . (123)
In the MRAC literature, it was shown that limt→∞ ε(t) = 0, and limt→∞ e(t) = 0,
kp
that is, limt→∞ k p θ̃T (t)ζ(t) + ρ̃(t)ξ(t) = 0, and limt→∞ Pm (s) [θ̃T ω](t) = 0.
How about limt→∞ k p θ̃T (t)ω(t) = 0?
Recently, some higher-order tracking properties of model reference adaptive

control systems have been established in
G. Tao and G. Song, “Higher-order tracking properties of model reference adap-
tive control systems,” IEEE Transactions on Automatic Control, vol. 63, no. 11,
pp. 3912–3918, 2018.
It is shown in this paper that a MRAC system ensures that the tracking error e(t)
i
satisfies: limt→∞ d dte(t) ∗
i = 0, for i = 0, 1, . . . , n − 1. If, in addition, ṙ(t) is bounded,
n∗
then limt→∞ d dte(t)
n∗ = 0 also holds.
kp
Pm (s) [θ̃ ω](t),
Hence, for a MRAC system with e(t) = T where Pm (s) is a monic
i
and stable polynomial of degree n∗ , if ṙ(t) is bounded, then limt→∞ d dte(t) i = 0, for
i = 0, 1, . . . , n , that is, limt→∞ k p θ̃ (t)ω(t) = limt→∞ Pm (s)[e](t) = 0.
∗ T
Higher-Order Convergence of ε(t) = θ̃T (t)φ(t)

From a linear model
y(t) = θ∗T φ(t), (124)
where θ∗ ∈ Rnθ is an unknown parameter vector and φ(t) ∈ Rnθ is a known vec-
tor signal, we can use the normalized gradient algorithm (adaptive update law) to
generate an estimate θ(t) of θ∗ :
Γφ(t)ε(t)
θ̇(t) = − , θ(0) = θ0 (125)
m2 (t)
where Γ = ΓT > 0 is a gain matrix, ε(t) is the estimation error defined as
ε(t) = θT (t)φ(t) − y(t), (126)
m(t) is the normalization signal defined as

q
m(t) = 1 + αφT (t)φ(t), (127)
with α > 0 being a design parameter, and θ0 is an initial estimate of θ∗ .

ε(t) ε(t)
This adaptive algorithm guarantees: (i) θ(t), θ̇(t), m(t) ∈ L∞ ; and (ii) θ̇(t), m(t) ∈
L2 .
If, in addition, φ(t) ∈ L∞ (⇒ m(t) ∈ L∞ ) and φ̇(t) ∈ L∞ (⇒ ε̇(t) ∈ L∞ ), then
limt→∞ ε(t) = 0.
From the expressions of ε(t):
ε(t) = θT (t)φ(t) − y(t) = θ̃T (t)φ(t), θ̃(t) = θ(t) − θ∗ , (128)
we can show that if, in addition, some order derivatives of y(t) and φ(t) are bounded,
then certain order derivatives of ε(t) also converge to 0, using the following lemma.
Lemma: If limt→∞ f (t) = f0 has a constant limit f0 and f¨(t) is bounded, then
limt→∞ f˙(t) = 0.
For example, with limt→∞ ε(t) = 0, if ε̈(t) is bounded, then limt→∞ ε̇(t) = 0.
To specify the conditions for ε̈(t) to be bounded, from ε(t) = θT (t)φ(t) − y(t),
we have
ε̇(t) = θ̇T (t)φ(t) + θT (t)φ̇(t) − ẏ(t) (129)
ε̈(t) = θ̈T (t)φ(t) + θ̇T (t)φ̇(t) + θ̇T (t)φ̇(t) + θT (t)φ̈(t) − ÿ(t). (130)
From (125), we have

φ̇(t)(1 + αφT (t)φ(t)) − 2αφT (t)φ̇(t)φ(t) φ(t)
θ̈(t) = −Γ ε(t) + ε̇ .
(1 + αφT (t)φ(t))2 1 + αφT (t)φ(t)
(131)
Hence, if φ(t), φ̇(t), φ̈(t), y(t), ẏ(t), ÿ(t) are bounded, then ε̈(t) is bounded, leading
to limt→∞ ε̇(t) = 0.
Higher-Order Convergence of Indirect MRAC

Higher-Order Tracking of Indirect MRAC
For an indirect MRAC system, the tracking error e(t) = y(t) − ym (t) also satisfies
kp
e(t) = [θ̃T ω](t), (132)
Pm (s)
where k p is the plant high frequency gain, Pm (s) is a monic and stable polynomial
of degree n∗ (the plant relative degree), and
θ̃(t) = θ(t) − θ∗ (133)
θ∗ = (θ∗T
1 , θ2 , θ20 , θ3 ) ∈ R
∗T ∗ ∗ T 2n
(134)
θ(t) = (θT1 (t), θT2 (t), θ20 (t), θ3 (t))T ∈ R2n (135)
ω(t) = (ωT1 (t), ωT2 (t), y(t), r(t))T ∈ R2n . (136)

Hence, it can also be shown that an indirect MRAC system ensures that the
i
tracking error e(t) satisfies: limt→∞ d dte(t) ∗
i = 0, for i = 0, 1, . . . , n − 1. If, in addition,
n∗
ṙ(t) is bounded, then limt→∞ d dte(t)
n∗ = 0 also holds.
Higher-Order Convergence of Signal Estimation

Consider a linear time-invariant plant described by the differential equation
P(s)[y](t) = k p Z(s)[u](t), (137)
where y(t) ∈ R and u(t) ∈ R are the measured plant input and output,
P(s) = sn + pn−1 sn−1 + · · · + p1 s + p0 , (138)
Z(s) = sm + zm−1 sm−1 + · · · + z1 s + z0 (139)
are polynomials in s with s being the time differentiation operator s[x](t) = ẋ(t), and
pi , i = 0, 1, . . . , n − 1, k p , and zi , i = 0, 1, . . . , m − 1, with n > m, are the unknown
constant parameters.
Choosing a stable polynomial Λe (s) = sn + λen−1 sn−1 + · · · + λe1 s + λe0 and defin-
ing the parameter and regressor vectors
θ∗p = [k p z0 , k p z1 , . . . , k p zm−1 , k p ,
−p0 , −p1 , . . . , −pn−2 , −pn−1 ]T ∈ Rn+m+1 , (140)

1 s sm−1 sm
φ(t) = [u](t), [u](t), . . . , [u](t), [u](t),
Λ(s) Λe (s) Λe (s) Λe (s)
T
1 s sn−2 sn−1
[y](t), [y](t), . . . , [y](t), [y](t) , (141)
Λe (s) Λe (s) Λe (s) Λe (s)
we express the plant (137) as
Λn−1 (s)
y(t) − [y](t) = θ∗T
p φ(t), (142)
Λe (s)
where Λn−1 (s) = λen−1 sn−1 + · · · + λe1 s + λe0 .

Denoting θ p (t) as the estimate of θ∗p , we define the estimation error
Λn−1 (s)
ε(t) = θTp (t)φ(t) − y(t) + [y](t), (143)
Λe (s)
which can be expressed as
ε(t) = θ̃Tp (t)φ(t), θ̃ p (t) = θ p (t) − θ∗p . (144)
From (142), we have

Λn−1 (s)
y(t) = [y](t) + θ∗T
p φ(t), (145)
Λe (s)
and define the estimate of y(t) as
Λn−1 (s)
ŷ(t) = [y](t) + θTp (t)φ(t). (146)
Λe (s)
It follows that
△ T
ỹ(t) = ŷ(t) − y(t) = θ˜p (t)φ(t) = ε(t), (147)
so that
lim (ŷ(t) − y(t)) = 0. (148)
t→∞
From (145), we have
sΛn−1 (s)
ẏ(t) = [y](t) + θ∗T
p φ̇(t), (149)
Λe (s)
and define the estimate of ẏ(t) as
sΛn−1 (s)
ẏˆ (t) = [y](t) + θTp (t)φ̇(t). (150)
Λe (s)
It follows that
△
ẏ˜ (t) = ẏˆ (t) − ẏ(t) = θ̃Tp (t)φ̇(t). (151)
From ε(t) = θ̃Tp (t)φ(t), we have
T
ε̇(t) = θ̃˙ p (t)φ(t) + θ̃Tp (t)φ̇(t) (152)
T T T
ε̈(t) = θ̃¨ p (t)φ(t) + θ̃˙ p (t)φ̇(t) + θ̃˙ p (t)φ̇(t) + θ̃Tp (t)φ̈(t). (153)
If an adaptive law without parameter projection for θ p (t):
Γφ(t)ε(t)
θ̇ p (t) = − , Γ = ΓT > 0, α > 0 (154)
1 + αφ (t)φ(t)
T
can achieve the objectives of the asymptotic tracking and signal boundedness of the
MRAC system, then it can be verified that ε̈(t) is bounded and θ̃¨ p (t) is bounded, so
that, with limt→∞ ε(t) = 0, we have limt→∞ ε̇(t) = 0. Then, since limt→∞ θ̃˙ p (t) = 0,
it follows that limt→∞ θ̃Tp (t)φ̇(t) = 0, that is, limt→∞ (ẏˆ (t) − ẏ(t)) = 0.
However, if the parameter projection applied to the adaptive law (154) (for the
estimate of k p , the (m + 1)th element of θ p (t)) is in action, then the (m + 1)th
element of θ̇ p (t) may be discontinuous at the parameter boundary of k p (its lower
bound), so that the (m + 1)th element of θ̈ p (t) may not be bounded. In this case,
ε̈(t) may not be bounded, and limt→∞ ε̇(t) = 0 may not hold. Hence, from ε̇(t) =
T
θ̃˙ p (t)φ(t) + θ̃Tp (t)φ̇(t), we may not conclude limt→∞ θ̃Tp (t)φ̇(t) = 0 for ẏˆ (t) − ẏ(t) =
θ̃T (t)φ̇(t), even if lim
p t→∞ p θ̃˙ (t) = 0 (as lim ε(t) = 0).
t→∞
Analysis of “Bursting Phenomenon” in Robust Adap-

tive Control
As illustrated in [134] that adaptive control systems with a fixed σ-modification
may show some bursting phenomenon. Consider the adaptive system analyzed on
page 232 (for Theorem 5.8) with σ1 (t) = σ0 being a constant in (5.198):
θ̇(t) = −sign[k p ]Γω(t)e(t) − Γσ1 (t)θ(t), t ≥ 0
(that is, with a fixed σ-modification). For V given in (5.43): V = e2 + |k p |θ̃T Γ−1 θ̃,
we have from (5.204) that
d¯2 (t)
V̇ ≤ −am e2 (t) + − 2|k p |σ0 θ̃T (t)θ(t)
am
d¯2 (t)
= −am e2 (t) + − 2|k p |σ0 θ̃T (t)θ̃(t) + 2|k p |σ0 θ̃T (t)θ∗
am
d¯2 (t)
2
≤ −am e (t) + − |k p |σ0 θ̃T (t)θ̃(t) + |k p |σ0 θ∗T θ∗ . (155)
am
For Γ = γI and am > γ σ0 (that is, with a small σ0 ), we have
d¯2 (t)
V̇ ≤ −γ σ0V + + |k p |σ0 θ∗T θ∗ (156)
am
¯
which, for |d(t)| ≤ d0 , leads to
d02 |k p | ∗T ∗
lim V (t) ≤ + θ θ . (157)
t→∞ am γ σ0 γ
This implies that the upper bound for the tracking error e(t) = y(t) − ym (t), for
|k |
d(t) = d0 = 0 (in the absence of disturbances d(t)), may be as large as γp θ∗T θ∗ ,
independent of σ0 . We already knew that for d(t) = 0 and σ1 (t) = σ0 = 0, the
adaptive control system ensures that limt→∞ e(t) = 0. Now from the above analysis
|k |
we know that for a small σ0 6= 0, the error bound on |e(t)| can be up to γp θ∗T θ∗ .
On the other hand, from
d¯2 (t)
V̇ ≤ −am e2 (t) + − 2|k p |σ0 θ̃T (t)θ(t) (158)
am
and the adaptive control system signal boundedness, similar to (5.204), we have
Z t2
e2 (t) dt ≤ γ0 + k0 (t2 − t1 )d¯02 + c0 (t2 − t1 )σ0 (159)
t1
for some constant c0 > 0, where the σ0 related term is due to using a fixed σ-
modification σ1 (t) = σ0 , instead of the switching σ-modification which leads to
(5.205) and in turn to (5.204). The inequality (159) implies that, when d0 = 0 (in
the absence of disturbances), we have the mean error
γ0
Z t2
1
e2 (t) dt ≤ + c 0 σ0 (160)
t2 − t1 t1 t2 − t1
which is of the magnitude of c0 σ0 , but the absolute error |e(t)|, as from (157),
|k |
could be as large as γp θ∗T θ∗ , independent of σ0 . This is the so-called “bursting
phenomenon” of robust adaptive control with a fixed σ-modification: the tracking
error e(t) may go to a large value independent of σ0 for a small interval of time
but in the mean sense the error e(t) is of the order of σ0 . This analytically explains
what was observed in the simulation results [134].
Robust MRAC with A Switching σ-Modification

To derive (5.224), for V (θ̃, ρ̃) = |ρ∗ |θ̃T Γ−1 θ̃ + γ−1 ρ̃2 , using
ε(t) = ρ∗ θ̃T (t)ζ(t) + ρ̃(t)ξ(t) + µη(t), η(t) = ∆(s)[u](t) (161)
we have
ε2 (t) ε(t)η(t)
V̇ = −2 2
+2 2 − 2σ1 (t)|ρ∗ |θ̃T (t)θ(t) − 2σ2 (t)ρ̃(t)ρ(t)
m (t) m (t)

ε (t)
2 ε(t) η(t) 2 η2 (t)
=− 2 − −µ + µ2 2
m (t) m(t) m(t) m (t)
−2σ1 (t)|ρ∗ |θ̃T (t)θ(t) − 2σ2 (t)ρ̃(t)ρ(t)
ε2 (t) η2 (t)
≤ − 2 + µ2 2 − 2σ1 (t)|ρ∗ |θ̃T (t)θ(t) − 2σ2 (t)ρ̃(t)ρ(t) (162)
m (t) m (t)
|η(t)|
which is (5.224). Since m(t) ≤ b0 for some constant b0 > 0, we have V̇ < 0 if
2σ1 (t)|ρ∗ |θ̃T (t)θ(t) + 2σ2 (t)ρ̃(t)ρ(t) > µ2 b20 . (163)
For θ̃ = θ − θ∗ and ρ̃ = ρ − ρ∗ , by definition, we have
σ1 (t)|ρ∗ |θ̃T (t)θ(t) ≥ 0, σ2 (t)ρ̃(t)ρ(t) ≥ 0, t ≥ 0 (164)
lim θ̃T θ = ∞, lim ρ̃ρ = ∞. (165)

kθk2 →∞ |ρ|→∞
This implies that there exist constants θ0 > 0 and ρ0 > 0 such that kθ(t)k2 ≥ θ0
or/and |ρ(t)| ≥ ρ0 implies that V̇ < 0. Hence, the boundedness of θ(t) and ρ(t) is
ensured. One choice of such (θ0 , ρ0 ) is
r
1 1
θ = max{2M1 ,
0
(2µ2 b20 + kθ∗ k22 + ρ∗2 ) + kθ∗ k}
4σ 2
r 10
1 1
ρ0 = max{2M2 , (2µ2 b20 + kθ∗ k22 + ρ∗2 ) + |ρ∗ |}. (166)
4σ20 2
A Discrete-time MRAC System Example

Consider the first-order plant
y(t + 1) = a p y(t) + b p u(t) (167)
with two unknown parameters a p and b p and choose the reference model
ym (t + 1) = −am ym (t) + bm r(t) (168)
with |am | < 1 for stability. We use the adaptive controller structure
u(t) = k1 (t)y(t) + k2 (t)r(t), (169)
where k1 (t) and k2 (t) are estimates of the unknown parameters
−a p − am ∗ bm
k1∗ = , k2 = . (170)
bp bp
In this case the tracking error equation becomes
e(t + 1) = −am e(t) + b p k̃1 (t)y(t) + b p k̃2 (t)r(t), (171)
where k̃1 (t) = k1 (t) − k1∗ and k̃2 (t) = k2 (t) − k2∗ .
Defining ρ∗ = b p and
θ∗ = [k1∗ , k2∗ ]T , θ = [k1 , k2 ]T , (172)
ω(t) = [y(t), r(t)]T (173)

and introducing the filtered vector signal
T
1 1 1
ζ(t) = [ω](t) = [y](t), [r](t) = [ζ1 (t), ζ2 (t)]T , (174)
z + am z + am z + am
where, as a notation, ζ1 (t) = z+a

1
m
[y](t) denotes the output of the system with trans-
fer function z+am and input y(t) (it satisfies the equation: ζ1 (t + 1) = −am ζ1 (t) +
1
y(t), for generating ζ1 (t) from y(t)), we rewrite (171) as
ρ∗
e(t) = [θT ω − θ∗T ω](t)
z + am

1
=ρ∗
[θ ω](t) − θ ζ(t) .
T ∗T
(175)
z + am
The design task is to find adaptive laws to update the parameter estimates θ(t) and
ρ(t) (which is an estimate of ρ∗ ) such that the estimation error

1
ε(t) = e(t) − ρ(t) [θ ω](t) − θ (t)ζ(t)
T T
(176)
z + am
is small in some sense. With (175), this error can be expressed as
ε(t) = ρ∗ θ̃T (t)ζ(t) + ρ̃(t)ξ(t), (177)
where
1
ξ(t) = θT (t)ζ(t) − [θT ω](t) (178)
z + am
θ̃(t) = θ(t) − θ∗ , ρ̃(t) = ρ(t) − ρ∗ . (179)
We choose the gradient adaptive laws for θ(t) and ρ(t):
sign[b p ]Γε(t)ζ(t) 2
θ(t + 1) = θ(t) − 2
, 0 < Γ = ΓT < 0 I2 , (180)
m (t) bp
γ ε(t)ξ(t)
ρ(t + 1) = ρ(t) − , 0 < γ < 2, (181)
m2 (t)
where sign[b p ] is the sign of b p , b0p ≥ |b p | is a known upper bound on |b p |, and

q
m(t) = 1 + ζT (t)ζ(t) + ξ2 (t). (182)
The stability analysis of this MRAC system is given in Section 6.3.1.

Indirect Observer Based Adaptive Control

Consider a continuous-time linear multivariable time-invariant plant
y(t) = G(s)[u](t), u(t) ∈ RM , y(t) ∈ RM , M ≥ 1, (183)
where G(s) is an M × M strictly proper rational transfer matrix which can be ex-
pressed as
G(s) = D−1 (s)N(s) = Cg (sI − Ag )−1 Bg , (184)
where, for the observability index ν of G(s) (its minimal realization),
D(s) = sν IM + Aν−1 sν−1 + · · · + A1 s + A0 , (185)

N(s) = Bm sm + · · · + B1 s + B0 , (186)
 
−Aν−1 IM 0 · · · · · · 0
 −Aν−2 0 IM 0 · · · 0 
 
 .. .. .. .. .. ..  ∈ RMν×Mν ,
Ag =  . . . . . .  (187)
 
 −A1 0 · · · · · · 0 IM 
−A0 0 ··· ··· 0 0
   
0 Bm
 ..   .. 
   
Bg =  .  ∈ RMν×M , B p =  .  ∈ RM(m+1)×M , (188)
 0   B1 
Bp B0

Cg = IM 0 · · · 0 0 ∈ RM×Mν (189)
for the M × M identity matrix IM and some M × M parameter matrices Ai , i =

0, 1, . . . , ν − 1, and B j , j = 0, 1, . . . , m, m ≤ ν − 1.
In view of (184), the plant (183) can be expressed as

0
ẋ(t) = Ax(t) + A p y(t) + u(t), y(t) = Cg x(t), (190)
Bp
where A ∈ RMν×Mν and A p ∈ RMν×M are

   
0 IM 0 · · · · · · 0 −Aν−1
 0 0 IM 0 · · · 0   −Aν−2 
   
 .. .. .. .. .. ..   .. 
A= . . . . . .  , Ap =  . . (191)
   
 0 0 · · · · · · 0 IM   −A1 
0 0 ··· ··· 0 0 −A0
Control objective. The control objective is to design an adaptive feedback con-

trol signal u(t) to make the plant output y(t) tracks the output ym (t) of the reference
model system
ym (t) = Wm (s)[r](t), Wm (s) = ξ−1m (s), (192)
where ξm (s) is the modified left interactor matrix of G(s): lims→∞ ξm (s)G(s) = K p
is finite and nonsingular.
Adaptive parameter estimation. Based on the input-output model of the plant:

D(s)[y](t) = N(s)[u](t), we can design an adaptive parameter estimation scheme
to generate adaptive estimates Âi and B̂ j of the coefficient matrices Ai and B j of
D(s) and N(s). From the parameter estimates Âi and B̂ j , we can obtain the adaptive
estimates Â p and B̂ p of the parameter matrices A p and B p , and the adaptive estimates
Âg and B̂g of the parameter matrices Ag and Bg .
Adaptive state observer. With adaptive estimates Â p and B̂ p , we construct an

adaptive state observer for the plant (190) as

˙ = Ax̂(t) + Â p y(t) + 0
x̂(t) u(t) + L(y(t) − ŷ(t)), ŷ(t) = Cg x̂(t), (193)
B̂ p
where L ∈ RMν×M is such that A − LCg is a desired stable matrix. For the state
estimation error x̃(t) = x̂(t) − x(t), it follows that

0
x̃˙ (t) = (A − LCg )x̃(t) + Ã p (t)y(t) + u(t), ỹ(t) = Cg x̃(t) (194)
B̃ p (t)
where ỹ(t) = ŷ(t) − y(t), Ã p (t) = Â p (t) − A p and B̃ p (t) = B̂ p (t) − B p .
Adaptive control law. The adaptive control law is an indirect-design (that is,
its parameters are calculated from plant parameter estimates) and explicit-observer
(that is, it uses the state estimate x̂(t) for feedback control) based control law:
u(t) = K1T (t)x̂(t) + K2 (t)r(t), (195)
where K1 (t) ∈ RMν×M and K2 (t) ∈ RM× are parameter matrices which satisfy
Cg (λI − Âg − B̂g K1T )−1 B̂g K2 = Wm (λ), (196)
point-wise in the time variable t, where Âg (t) and B̂g (t) are the on-line estimates
of Ag and Bg . It can be shown that such solutions K1 and K2 exist if the estimated
plant (Âg , B̂g ,Cg ) has ξm (s) as its modified left interactor matrix point-wise, that is,
limλ→∞ ξm (λ)Cg (λI − Âg )−1 B̂g = K̂ p is finite and non-singular, for each time t as
Âg = Â p (t) and B̂g = B̂ p (t) (note that K̂ p may be a function of time t).
In the single-input single-output case with M = 1, such a condition becomes:

B̂m (t) = b̂m (t) 6= 0 for any t, which can be easily ensured by using a parameter
projection based adaptive parameter estimator. In this case, ξm (λ) = λν−m and
K̂ p = b̂m (t), for ν = n being the plant order.
Adaptive Control of ẋ(t) = Ax(t) + BΛu(t) + BΘ∗φ(x)

Consider an M-input linear time-invariant plant
ẋ(t) = Ax(t) + BΛu(t) + BΘ∗ φ(x), x(t) ∈ Rn , u(t) ∈ RM , (197)
where (A, B) is a known and controllable pair, Λ = diag{λ1 , λ2 , . . . , λM } is an un-

known and diagonal matrix with λi 6= 0 for i = 1, 2, . . . , M, Θ∗ is an unknown matrix,
and φ(x) is a known vector.
With (A, B) known and controllable, we can find known constant matrices K10 ∈
R n×M and K20 ∈ RM×M such that
T
Am = A + BK10 , Bm = BK20 (198)
are known with Am being stable, for constructing a good reference model system
ẋm (t) = Am xm (t) + Bm r(t), xm (t) ∈ Rn , r(t) ∈ RM , (199)
where r(t) is a bounded and piecewise continuous reference input.

We first introduce the parameter matrices
K1∗T = Λ−1 K10

T
, K2∗ = Λ−1 K20 , K3∗ = −Λ−1 Θ∗ . (200)
Then, for K1 , K2 and K3 being the estimates of K1∗ , K2∗ and K3∗ , we use the adaptive
controller
u(t) = K1T (t)x(t) + K2 (t)r(t) + K3 (t)φ(x). (201)
From the definitions of K1∗ , K2∗ and K3∗ , we have
BΛ(K1∗T x(t) + K2∗ r(t) + K3∗ φ(x)) = B(K10

T
x(t) + K20 r(t) − Θ∗ φ(x)). (202)
Introducing the parameter errors
K̃1 = K1 − K1∗ , K̃2 = K2 − K2∗ , K̃3 = K3 − K3∗ (203)
we express the control signal from (201) as
u(t) = K̃1T (t)x(t) + K̃2 (t)r(t) + K̃3 (t)φ(x) + K1∗T x(t) + K2∗ r(t) + K3∗ φ(x) (204)
and, in view of (198) and (202), the closed-loop system as
ẋ(t) = Ax(t) + BΛ(K̃1T (t)x(t) + K̃2 (t)r(t) + K̃3 (t)φ(x))

+BΛ(K1∗T x(t) + K2∗ r(t) + K3∗ φ(x)) + BΘ∗ φ(x)
= Am x(t) + Bm r(t) + BΛ(K̃1T (t)x(t) + K̃2 (t)r(t) + K̃3 (t)φ(x)). (205)
Then, in view of this equation and (199), the tracking error e(t) = x(t) − xm (t)
satisfies
ė(t) = Am e(t) + BΛ(K̃1T (t)x(t) + K̃2 (t)r(t) + K̃3 (t)φ(x)). (206)
Introducing θ∗i such that θ∗T ∗T ∗ ∗
i is the ith row of [K1 , K2 , K3 ], i = 1, 2, . . . , M, letting
θi be the estimate of θ∗i and θ̃i (t) = θi (t) − θ∗i , i = 1, 2, . . . , M, and defining
ω(t) = [xT (t), rT (t), φT (x)]T , (207)
we express (206) as
 
θ̃T1 (t)ω(t)
 θ̃T2 (t)ω(t) 
 
 .. 
ė(t) = Am e(t) + BΛ  . . (208)
 T 
 θ̃M−1 (t)ω(t) 
θ̃TM (t)ω(t)
Letting P = PT > 0 satisfy
PAm + ATm P = −Q (209)
for a chosen constant matrix Q ∈ Rn×n such that Q = QT > 0, and ēi (t) be the ith
component of eT (t)PB, i = 1, 2, . . . , M, we design the adaptive law for θi (t) as
θ̇i (t) = −sign[λi ]Γi ēi (t)ω(t), (210)
where Γi = ΓTi > 0 is a chosen constant adaptation gain matrix, and sign[λi ] is the
sign of λi , i = 1, 2, . . . , M.
To analyze the adaptive control system performance, we consider the positive
definite function
M
V (e, θ̃i , i = 1, 2, . . . , M) = eT Pe + ∑ |λi |θ̃Ti Γ−1
i θ̃i (211)
i=1
and derive its time derivative along the trajectory of (208) and (210) as
M
V̇ = 2e (t)Pė(t) + 2 ∑ |λi |θ̃Ti (t)Γ−1
T
i θ̇i (t)
i=1
M M
= 2eT (t)PAm e(t) + 2 ∑ ēi (t)λi θ̃Ti (t)ω(t) + 2 ∑ |λi |θ̃Ti (t)Γ−1
i θ̇i (t)
i=1 i=1
T
= −e (t)Qe(t). (212)
From this result, it follows that x(t) and θi (t) are bounded and e(t) ∈ L2 , and in
turn, that u(t) is bounded, and so is ė(t), so that limt→∞ e(t) = 0.
Parameters of u(t) = Θ∗T

1 ω1 (t) + Θ2 ω2 (t) + Θ20 y(t) +
∗T ∗
Θ∗3ξ(z)y(t)
For multivariable MRAC, the parameters Θ∗1 , Θ∗2 , Θ∗20 and Θ∗3 of the matching equa-
tion
u(t) = Θ∗T
1 ω1 (t) + Θ2 ω2 (t) + Θ20 y(t) + Θ3 ξ(z)y(t)
∗T ∗ ∗
(213)
are the nominal controller parameters. For discrete-time MRAC where Λ(z) = znc
for generating ω1 (t) and ω2 (t), such parameters can be calculated from the follow-
ing procedure.
For a given system transfer matrix G(z) = A−1 (z−1 )B(z−1 ) and an interactor
matrix ξ(z) such that rlimz→∞ ξ(z)G(z) = K p finite and nonsingular, where
A(z−1 ) = I + A1 z−1 + · · · + Ana z−na , B(z−1 ) = B1 z−1 + · · · + Bnb z−nb (214)
ξ(z) = ξ0 zd + ξ1 zd−1 + · · · + ξd−1 z, (215)

we can solve the equation
ξ(z) = F(z)A(z−1 ) + H(z−1 ) (216)
for some matrix functions
F(z) = F0 zq + F1 zd−1 + · · · + Fd−1 z (217)
H(z−1 ) = H0 + H1 z−1 + · · · + Hnh z−nh (218)

for some nh > 0 to be determined, that is,
ξ0 zd + ξ1 zd−1 + · · · + ξd−1 z
= (F0 zd + F1 zd−1 + · · · + Fd−1 z)(I + A1 z−1 + · · · + Ana z−na )
+H0 + H1 z−1 + · · · + Hnh z−nh . (219)
The solutions Fi and H j are from the iterative procedure
F0 = ξ0 , F1 + F0 A1 = ξ1 , . . . (220)
where ng depends on na and nb .

Then, we define
α(z−1 ) = H(z−1 ) = α0 + α1 z−1 + · · · + αng z−ng (221)

with αi = Hi , and
β(z−1 ) = F(z)B(z−1 ). (222)
From ξ(z) = F(z)A(z−1 ) + H(z−1 ), we have
ξ(z) − H(z−1 ) = F(z)B(z−1 )B−1 (z−1 )A(z−1 ) = β(z−1 )G−1 (z) (223)
that is,
G(z) = (ξ(z) − α(z−1 ))−1 β(z−1 ). (224)
Since limz→∞ ξ(z)G(z) = K p finite and nonsingular, we have
lim β(z−1 ) = K p (225)

z→∞
which implies that
β(z−1 ) = β0 + β1 z−1 + · · · + βnβ z−nβ (226)
with β0 = K p and nβ determined from β(z−1 ) = F(z)B(z−1 ).

From A(z−1 )y(t) = B(z−1 )u(t), we have F(z)A(z−1 )y(t) = F(z)B(z−1 )u(t), and
from ξ(z) = F(z)A(z−1 ) + H(z−1 ), we have
ξ(z)y(t) = F(z)A(z−1 )y(t) + H(z−1 )y(t) = F(z)B(z−1 )u(t) + H(z−1 )y(t)

= α(z−1 )y(t) + β(z−1 )u(t). (227)
Comparing this equation with
ξ(z)y(t) = Θ∗−1
3 u(t) − Θ3 Θ1 ω1 (t) − Θ3 Θ2 ω2 (t) − Θ3 Θ20 y(t)
∗−1 ∗T ∗−1 ∗T ∗−1 ∗
(228)
with Λ(z) = znc , we can obtain Θ∗1 , Θ∗2 , Θ∗20 and Θ∗3 = K p−1 , from α(z−1 ) and β(z−1 ).
Example 1 Consider the system transfer matrix

" −3 #
z 3z−3
G0 (z) = 1+z−1 1+4z−1 . (229)
z−2 2z−2
1+z−1 1+3z−1
Its interactor matrix and high frequency gain matrix are

3
z 0 1 3
ξ(z) = = ξ 0 z + ξ1 z , K p =
3 2
. (230)
0 z2 1 2
It can be found that

−1 (1 + z−1 )(1 + 4z−1 ) 0
A(z ) = (231)
0 (1 + z )(1 + 3z−1 )
−1

−1 z−3 (1 + 4z−1 ) 3z−3 (1 + z−1 )
B(z ) = . (232)
z−2 (1 + 3z−1 ) 2z−2 (1 + z−1 )
Hence, na = 2, nb = 4, d = 3, and F(z) = F0 z3 + F1 z2 + F2 z in (217) with Fi ∈ R2×2 .
For this example, B1 = 0 and ξ2 = 0 are 2 by 2 zero matrices. Since the lowest
order in (F0 z3 + F1 z2 + F2 z)(I + A1 z−1 + A2 z−2 ) is z−1 , we have nh = 1, so that
(219) becomes
ξ0 z3 + ξ1 z2 = (F0 z3 + F1 z2 + F2 z)(I + A1 z−1 + A2 z−2 ) + H0 + H1 z−1 . (233)
From this equation, we can find: F0 , F1 , F2 , H0 , H1 . Then, we define
α(z−1 ) = H(z−1 ) = α0 + α1 z−1 (234)
β(z−1 ) = F(z)B(z−1 ) = (F0 z3 + F1 z2 + F2 z)(B1 z−1 + B2 z−2 + B3 z−3 + B4 z−4 ).

(235)
It should turn out that
F0 B1 = F0 B2 = F1 B1 = 0 (236)
F0 B3 + F1 B2 + F2 B1 = K p = β0 (237)
Since B1 = 0, we have F0 B2 = 0 and F0 B3 + F1 B2 = K p . It can be seen from (235)
that
β(z−1 ) = β0 + β1 z−1 + β2 z−2 + β3 z−3 , (238)
that is, nβ = 3. The term β(z−1 )u(t) has the form
β(z−1 )u(t) = β0 + β1 u(t − 1) + β2 u(t − 2) + β3 u(t − 3). (239)
For G(z) in this example, it can be found the system order is n = 5 and its
observability index ν ≤ n−1 = 4, so that the order of Λ(z) in (227) is nc = ν−1 = 3,
which means ω1 (t) depends on u(t − 1), u(t − 2) and u(t − 3), as contained in the
term β(z−1 )u(t).
Finally, with α(z−1 ) and β(z−1 ) specified, from the matching equations (227)
and (228):
ξ(z)y(t) = α(z−1 )y(t) + β(z−1 )u(t) (240)
3 u(t) − Θ3 Θ1 ω1 (t) − Θ3 Θ2 ω2 (t) − Θ3 Θ20 y(t)

ξ(z)y(t) = Θ∗−1 ∗−1 ∗T ∗−1 ∗T ∗−1 ∗
(241)
we can find the parameters Θ∗1 ∈ R6×2 , Θ∗2 ∈ R6×2 , Θ∗20 ∈ R2×2 and Θ∗3 = β−1
0 :
Θ∗1 = [β3 , β2 , β1 ]T , Θ∗2 = [α3 , α2 , α1 ]T , Θ20 = α0 . (242)
Since the term α(z−1 )y(t) does not contain y(−2) and y(−3), α3 = α2 = 0 (the
2 × 2 zero matrix), the first 4 × 2 part of Θ∗2 ∈ R6×2 is the 4 × 2 zero matrix. 2
Parametrization of (9.102)
To define the parameters Θ∗i , i = 1, 2, 20, 3, to satisfy (9.105):
Θ∗T
1 A(D)P0 (D) + (Θ2 A(D) + Θ20 Λ(D))Z0 (D)
∗T ∗
= Λ(D)(P0 (D) − Θ∗3 ξm (D)Z0 (D)), (243)
for the nominal version of the multivariable MRAC controller (9.102), we consider
an equivalent version (see (244) below) of (9.105) by dividing it from the right by
P0−1 (D) and use the left matrix-fraction description of G0 (D) = Pl−1 (D)Zl (D) such
that G0 (D) = Pl−1 (D)Zl (D) = Z0 (D)P0−1 (D) (as used in the proof of Lemma 9.3),
to obtain
Θ∗T
1 A(D) + (Θ2 A(D) + Θ20 Λ(D))Pl (D)Zl (D)
∗T ∗ −1
= Λ(D)(I − Θ∗3 ξm (D)Pl−1 (D)Zl (D)). (244)
Expressing Λ(D)Θ∗3 ξm (D)Pl−1 (D) with Θ∗3 = K p−1 as
Λ(D)Θ∗3 ξm (D)Pl−1 (D) = Ql (D) + Rl (D)Pl−1 (D) (245)
for some M × M polynomial matrices Ql (D) and Rl (D) such that ∂ci [Rl (D)] <
∂ci [Pl (D)] ≤ ν. Then, we define Θ∗1 , Θ∗2 and Θ∗20 from
Θ∗T
2 A(D) + Θ20 Λ(D) = −Rl (D),
∗
(246)
Θ∗T
1 A(D) = Λ(D)IM − Ql (D)Zl (D) (247)
(recall that ∂[Λ(D)] = ν−1 and ∂[A(D)] = ν−2 for the controller structure (9.102)).
With this definition of Θ∗2 , Θ∗20 and Θ∗1 , (244) is satisfied, and so is (9.105).
From (9.105) (that is, (244)), we have the plant–model matching equation
IM − Θ∗T
1 F(D) − (Θ2 F(D) + Θ20 )G0 (D) = Θ3Wm (D)G0 (D)
∗T ∗ ∗ −1
(248)
where Wm (D) = ξ−1 m (D). From this equation with limD→∞ Θ3Wm (D)G0 (D) = IM
∗ −1
as from the definition of ξm (D), we have
lim Θ∗T
1 F(D) = 0, (249)
D→∞
which implies that ∂[Θ∗T

1 A(D)] ≤ ν − 2, that is, (247) is solvable.
Plant Signal Identities for MIMO Cases

It has been shown that there exist Θ∗1 , Θ∗2 and Θ∗3 to satisfy the matching equation
Θ∗T
1 A(D)P0 (D) + Θ2 A(D)Z0 (D) = Λ(D)(P0 (D) − Θ3 ξm (D)Z0 (D)),
∗T ∗
(250)
which is nominally (mathematically) equivalent to
IM − Θ∗T
1 F(D) − Θ2 F(D)G0 (D) = Θ3Wm (D)G0 (D).
∗T ∗ −1
(251)
Operating this identity on u(t), we may get the plant signal identity:
1 ω1 (t) − Θ2 ω2 (t) = Θ3Wm (D)[y](t).

u(t) − Θ∗T ∗T ∗ −1
(252)
(This identity was used in deriving (9.119), and its similar version with Θ∗20 was
used in deriving (9.365).)
As an alternative procedure to obtain the plant parametrized signal identity (sim-
ilar to that in (5.30) for the SISO case with M = 1), we start by considering (9.84)
and (9.85):
Θ∗T
2 A(D) = Ql (D)Pl (D) − Λ(D)K p ξm (D)
−1
(253)
Θ∗T
1 A(D) = Λ(D)IM − Ql (D)Zl (D). (254)
and obtain the signal identities:

A(D) 1
Θ∗T [y](t) = Ql (D)Pl (D)[y](t) − K p−1 ξm (D)[y](t) (255)
2
Λ(D) Λ(D)
A(D) 1
Θ∗T [u](t) = u(t) − Ql (D)Zl (D)[u](t). (256)
1
Λ(D) Λ(D)
Using the open-loop plant signal identity: Pl (D)[y](t) = Zl (D)[u](t), and from
(255)–(256), we finally have the parametrized plant signal identity (252):
A(D) A(D)
u(t) = Θ∗T [u](t) + Θ∗T [y](t) + K p−1 ξm (D)[y](t). (257)
1
Λ(D) 2
Λ(D)
This identity holds for any input signal u(t), in a feedback structure.
Similarly, for the controller structure (9.102) with nominal parameters:
u(t) = Θ∗T
1 ω1 (t) + Θ2 ω2 (t) + Θ20 y(t) + Θ3 r(t),
∗T ∗ ∗
(258)
in which ∂[Λ(D)] = ν − 1, we have the polynomial matching equation
Θ∗T
1 A(D)P0 (D) + (Θ2 A(D) + Θ20 Λ(D))Z0 (D)
∗T ∗
= Λ(D)(P0 (D) − Θ∗3 ξm (D)Z0 (D)) (259)

and the transfer matrix matching equation
IM − Θ∗T
1 F(D) − (Θ2 F(D) + Θ20 )G0 (D) = Θ3Wm (D)G0 (D).
∗T ∗ ∗ −1
(260)
The nominal parameters Θ∗1 , Θ∗2 , Θ∗20 and Θ∗3 are defined from
2 A(D) + Θ20 Λ(D)) = −Rl (D) = Ql (D)Pl (D) − Λ(D)K p ξm (D) (261)
(Θ∗T ∗ −1
Θ∗T
1 A(D) = Λ(D)IM − Ql (D)Zl (D), (262)
that is, dividing Λ(D)K p−1 ξm (D) on the right by Pl (D) to get Rl (D) and Ql (D).
From these equations, we obtain the signal identities:
A(D) 1
(Θ∗T + Θ∗20 )[y](t) = Ql (D)Pl (D)[y](t) − K p−1 ξm (D)[y](t) (263)
2
Λ(D) Λ(D)
A(D) 1
Θ∗T [u](t) = u(t) − Ql (D)Zl (D)[u](t). (264)
1
Λ(D) Λ(D)
Using the open-loop plant signal identity: Pl (D)[y](t) = Zl (D)[u](t), we have the
plant signal identity in a feedback form:
A(D) A(D)
u(t) = Θ∗T [u](t) + Θ∗T [y](t) + Θ∗20 y(t) + K p−1 ξm (D)[y](t) (265)
1
Λ(D) 2
Λ(D)
which also holds for any input signal u(t), similar to that in (257).
Both parametrized plant signal identities (257) and (265) are useful for adaptive
control: either verify the nominal controller structure
A(D) A(D)
u(t) = Θ∗T [u](t) + Θ∗T [y](t) + Θ∗3 r(t) (266)
1
Λ(D) 2
Λ(D)
for the matching equation (250), or
A(D) A(D)
u(t) = Θ∗T [u](t) + Θ∗T [y](t) + Θ∗20 y(t) + Θ∗3 r(t) (267)
1
Λ(D) 2
Λ(D)
for the matching equation (259), where Θ∗3 r(t) = K p−1 ξm (D)[ym ](t) for the reference
output ym (t) = ξ−1
m (D)[r](t), leading to ξm (D)[y − ym ](t) = 0 exponentially, or they
motivate the adaptive controller structure
A(D) A(D)
u(t) = ΘT1 [u](t) + ΘT2 [y](t) + Θ3 r(t) (268)
Λ(D) Λ(D)
A(D) A(D)
u(t) = ΘT1 [u](t) + ΘT2 [y](t) + Θ20 y(t) + Θ3 r(t) (269)
Λ(D) Λ(D)
for the matching equation (259), leading to the desired tracking error equation:
e(t) = y(t) − ym (t) = ξ−1

m (D)K p [Θ̃ ω](t)
T
(270)
for Θ̃(t) = Θ(t) − Θ∗ with
Θ(t) = [ΘT1 (t), ΘT2 (t), Θ3 (t)]T , Θ∗ = [Θ∗T

1 , Θ2 , Θ3 ]
∗T ∗ T
(271)
ω(t) = [ωT1 (t), ωT2 (t), rT (t)]T (272)

Θ(t) = [ΘT1 (t), ΘT2 (t), Θ20 (t), Θ3 (t)]T , Θ∗ = [Θ∗T

1 , Θ2 , Θ20 , Θ3 ]
∗T ∗ ∗ T
(273)
ω(t) = [ωT1 (t), ωT2 (t), yT (t), rT (t)]T (274)

for the matching equation (259). Both tracking error equations can be used to de-
rive some desired estimation errors for designing stable adaptive laws to update the
controller parameters Θ(t).
Proof of limt→∞ e(t) = 0 in (9.187C)

To show limt→∞ e(t) = 0, we just need to prove that for any given δ > 0, there exists
a T = T (δ) > 0 such that ke(t)k < δ, for all t > T . For such a proof, we only require
the existence of T for each chosen δ which may be set to be arbitrarily small but do
not consider the limit of δ going to zero, that is, δ > 0 such that 1δ is finite.
In view of (9.187C) (for the continuous-time case), for any given δ > 0, we can
choose (think of) a pair of K3 (s) and H3 (s) to make ac43 < 2δ (that is, a3 > 2cδ4 is
finite) (recall that K3 (s) and H3 (s) are not real but fictitious filters, and they are not
employed in the control design but only used in the expression (decomposition) of
e(t) in (9.185C)), and let T > 0 such that |z1 (t)| < 2δ for any t > T (such a T = T (δ)
exists, because limt→∞ z1 (t) = 0; also note that z1 (t) depends on K3 (s)). It follows
that ke(t)k < δ for any t > T , which implies that limt→∞ e(t) = 0.
Adaptive Robot Control for Time-Varying Parameters

Consider the manipulator dynamic equation (9.586):
∂D(q,t)
D(q,t)q̈ + q̇ +C(q, q̇,t)q̇ + φ(q,t) = u. (275)
∂t
With (9.590): v = q̇d − Λ0 (q − qd ), s = q̇ − v, e = q − qd , we have (9.592):
D(q,t)ṡ +C(q, q̇,t)s

∂D(q,t)
= u − D(q,t)v̇ −C(q, q̇,t)v − φ(q,t) − q̇
∂t
△ ∂D(q,t)
= u −Y (q, qd , q̇, q̇d , q̈d ,t)θ∗ (t) − q̇, (276)
∂t
for some known function matrix Y (q, qd , q̇, q̇d , q̈d ,t) ∈ Rn×nθ and unknown param-
eter vector θ∗ (t) ∈ Rnθ which may be time-varying.
In this study, we consider the case when
θ∗ (t) = θ∗0 + δθ∗ (t) (277)
where θ∗0 is a constant vector and δθ∗ (t) is the variation of θ∗ (t) with respect to
θ∗0 (note that both θ∗0 and δθ∗ (t) are unknown). We will develop and analyze some
alternative adaptive control schemes to that presented in (9.607)–(9.608).
Adaptive Control Scheme I

As an alternative scheme to (9.607)–(9.608), we use the control law
u(t) = Y (q, qd , q̇, q̇d , q̈d ,t)θ0 (t) − m(t)ψ(t) − m1 (t)ψ1 (t) − KD s(t), (278)
m(t) = k0 kq̇(t) + v(t)k f (q), k0 > 0, ψ(t) = m(t)s(t), (279)
m1 (t) = k1 kY (q, qd , q̇, q̇d , q̈d ,t)k, k1 > 0, ψ1 (t) = m1 (t)s(t), (280)
and the update law for the estimate θ0 (t) of θ∗0 :

θ̇0 (t) = −Γ Y T (q, qd , q̇, q̇d , q̈d ,t)s + σ(t)θ0 (t) , , Γ = ΓT > 0 (281)
where σ(t) is a switching signal similar to that in (9.610), using a design parameter
σ0 > 0 and the knowledge of the upper bound M0 on kθ∗0 k:

 0
 if kθ0 (t)k < M0 ,
σ(t) = σ0 ( kθM
0 (t)k
− 1) if M0 ≤ kθ0 (t)k < 2M0 , (282)

 0
σ0 if kθ0 (t)k ≥ 2M0 .
This adaptive control scheme has the properties: all signals in the closed-loop
system are bounded, and the tracking error e(t) = q(t) − qd (t) satisfies
2
γ γ21
Z t2
ke(t)k dt ≤ α0 2 + 2 (t2 − t1 ) + β0
2
(283)
t1 k0 k1
for some constants α0 > 0, β0 > 0 and any t2 > t1 ≥ 0, where γ1 > 0 is the upper
bound on supt≥0 kδθ∗ (t)k. Moreover, e(t) ∈ L2 and limt→∞ e(t) = 0 in the absence
of parameter time variations, that is, when δθ∗ (t) = 0 and ∂D(q,t)
∂t = 0.
The proof of these properties is based on the positive definite function
1
V0 (s, θ̃0 ) = (sT Ds + θ̃T0 Γ−1 θ̃0 ), θ̃0 (t) = θ0 (t) − θ∗0 , D = D(q(t),t), (284)
2
which has the following time derivation:
V̇0 = −sT (t)KD s(t) − m2 (t)sT (t)s(t) − m21 (t)sT (t)s(t) − σ(t)θ̃T0 (t)θ0 (t)
1 ∂D(q,t)
− sT (t) (q̇(t) + v(t)) − sT (t)Y (q, qd , q̇, q̇d , q̈d ,t)δθ∗ (t)
2 ∂t

T γ 2 γ2
≤ −s (t)KD s(t) − m(t)ks(t)k − +
4k0 16k02

γ1 2 γ21
− m1 (t)ks(t)k − + 2 − σ(t)θ̃T0 (t)θ0 (t). (285)
2k1 4k1
With this adaptive control scheme, as indicated by (283), the tracking perfor-
mance can be influenced by the design parameters k0 and k1 in the feedback control
law (278)–(280) (one may increase k0 and k1 to reduce the tracking error e(t)).
Adaptive Control Scheme II

A different adaptive control scheme can be developed, employing a switching con-
trol law which uses adaptive estimates of parameter variation uncertainty bounds,
to improve system tracking performance.
To derive such a scheme, we denote the parameter variation uncertainties as
1 ∂D(q,t)
g(q, q̇, qd , q̇d ,t) = (q̇ + v) = [g1 , g2 , . . . , gn ]T (286)
2 ∂t
h(q, q̇, qd , q̇d , q̈d ,t) = Y (q, qd , q̇, q̇d , q̈d ,t)δθ∗ (t) = [h1 , g2 , . . . , hn ]T (287)
and make use of the bounding relationship
|gi (q, q̇, qd , q̇d ,t)| ≤ a∗i αi (q, q̇, qd , q̇d ,t), i = 1, 2, . . . , n (288)
|hi (q, q̇, qd , q̇d , q̈d ,t)| ≤ b∗i βi (q, q̇, qd , q̇d , q̈d ,t), i = 1, 2, . . . , n (289)
for some unknown constants a∗i and b∗i , and known functions αi (q, q̇, qd , q̇d ,t) and
βi (q, q̇, qd , q̇d , q̈d ,t), i = 1, 2, . . . , n.
If the parameters a∗i and b∗i were known, one could use the control law
u(t) = Y (q, qd , q̇, q̇d , q̈d ,t)θ0 (t) − φ∗ (t) − φ∗1 (t) − KD s(t), (290)
φ∗ (t) = [sgn[s1 (t)]a∗1 α1 , sgn[s2 (t)]a∗2 α2 , . . . , sgn[sn (t)]a∗n αn ]T , (291)
φ∗1 (t) = [sgn[s1 (t)]b∗1 β1 , sgn[s2 (t)]b∗2 β2 , . . . , sgn[sn (t)]b∗n βn ]T , (292)

where θ0 (t) is updated from (281), and the sgn function is defined as

 1
 if w > 0,
sgn[w] = 0 if w = 0, (293)


−1 if w < 0.
Form V0 defined in (284), this control law leads to
V̇0 = −sT (t)KD s(t) − sT (t)φ∗ (t) − sT (t)φ∗1 (t) − σ(t)θ̃T0 (t)θ0 (t)
1 ∂D(q,t)
2 ∂t
n n
= −s (t)KD s(t) − ∑
T
|si (t)|a∗i αi − ∑ |si(t)|b∗i βi − σ(t)θ̃T0 (t)θ0(t)
i=1 i=1
n n
− ∑ si (t)gi − ∑ si (t)hi
i=1 i=1
T
≤ −s (t)KD s(t). (294)
The last equality follows from the facts that ∑ni=1 |si (t)|a∗i αi − ∑ni=1 si (t)gi ≥ 0,
∑ni=1 |si (t)|b∗i βi − ∑ni=1 si (t)hi ≥ 0 and σ(t)θ̃T0 (t)θ0 (t) ≥ 0. From (294), one may
conclude that all signals in the closed-loop system are bounded, and the tracking
error e(t) = q(t) − qd (t) converges to zero as t goes to ∞.
When the parameters a∗i and b∗i are unknown, one can use the control law
u(t) = Y (q, qd , q̇, q̇d , q̈d ,t)θ0 (t) − φ(t) − φ1 (t) − KD s(t), (295)
φ(t) = [sgn[s1 (t)]a1 (t)α1 , sgn[s2 (t)]a2 (t)α2 , . . . , sgn[sn (t)]an (t)αn ]T , (296)
φ1 (t) = [sgn[s1 (t)]b1 (t)β1 , sgn[s2 (t)]b2 (t)β2 , . . . , sgn[sn (t)]bn (t)βn ]T , (297)
where θ0 (t) is updated from (281), and the parameters ai (t) and bi (t) are estimates
of a∗i and b∗i and updated from the adaptive laws:
ȧi (t) = κai |si (t)|αi (q, q̇, qd , q̇d ,t), κai > 0, i = 1, 2, . . . , n, (298)
ḃi (t) = κbi |si (t)|βi (q, q̇, qd , q̇d , q̈d ,t), κbi > 0, i = 1, 2, . . . , n. (299)
Consider the positive definite function

n n
1 T
V (s, θ̃0 , ãi , b̃i ) = (s Ds + θ̃0 Γ θ̃0 + ∑ κai ãi + ∑ κ−1
T −1 −1 2
bi b̃2i ), (300)
2 i=1 i=1
where θ̃0 (t) = θ0 (t) − θ∗0 , D = D(q(t),t), ãi (t) = ai (t) − a∗i , b̃i (t) = bi (t) − b∗i , i =
1, 2, . . . , n. Using (276), (295), (281), (298) and (299), we have
V̇ = −sT (t)KD s(t) − sT (t)φ(t) − sT (t)φ1 (t) − σ(t)θ̃T0 (t)θ0 (t)

1 ∂D(q,t)
2 ∂t
ai i + ∑ b̃i κbi ḃi
+ ∑ ãi κ−1 ȧ −1
i=1 i=1
n n
= −sT (t)KD s(t) − ∑ |si (t)|ai (t)αi − ∑ |si (t)|bi (t)βi − σ(t)θ̃T0 (t)θ0 (t)
i=1 i=1
n n
ai ȧi + ∑ b̃i κbi ḃi
− ∑ si (t)gi − ∑ si (t)hi + ∑ ãi κ−1 −1
i=1 i=1 i=1 i=1
n n
≤ −sT (t)KD s(t) − ∑ |si (t)|ai (t)αi − ∑ |si (t)|bi (t)βi − σ(t)θ̃T0 (t)θ0 (t)
i=1 i=1
n n
+ ∑ |si (t)|a∗i αi + ∑ |si (t)|b∗i βi + ∑ ãi κ−1 −1
i=1 i=1 i=1 i=1
= −s T
(t)KD s(t) − σ(t)θ̃T0 (t)θ0 (t)
≤ −sT (t)KD s(t). (301)
This result also implies that all signals in the closed-loop system are bounded, and
the tracking error e(t) = q(t) − qd (t) converges to zero as t goes to ∞.
However, since the adaptive control scheme (295) uses the sgn functions in φ(t)
and φ1 (t) and such switching signals are discontinuous when si (t) passes through
zero, it may lead to chattering of system response.
Remark 5 The adaptive control scheme (295) may have certain advantage for per-
formance even if when the parameters a∗i and b∗i are known. This is because the
parameters a∗i and b∗i are only the upper bounds for the parameter variation uncer-
tainties gi and hi in (286) and (287), and some smaller (and unknown) bounds may
exist and can be estimated by the adaptive laws (298) and (299). The use of smaller
bounds is desirable because it leads to smaller control signals. In this case, the
adaptive laws (298) and (299) can be modified by setting
ȧi (t) = 0, t ≥ τ if ai (τ) = a∗i , (302)
ḃi (t) = 0, t ≥ τ if bi (τ) = b∗i (303)

With this modification, we also have V̇ ≤ −sT (t)KD s(t), as desired. 2
Adaptive Control Scheme III

As mentioned above the use of the discontinuous sgn functions in φ(t) and φ1 (t)
in the adaptive control scheme (295) may cause chattering of system response. To
overcome possible chattering, we can modify the control law (295) as
u(t) = Y (q, qd , q̇, q̇d , q̈d ,t)θ0 (t) − φ̂(t) − φ̂1 (t) − KD s(t), (304)
φ̂(t) = [sat[s1 (t); ε1 ]a1 (t)α1 , . . . , sat[sn (t); εn ]an (t)αn ]T , (305)
φ̂1 (t) = [sat[s1 (t); η1 ]b1 (t)β1 , . . . , sat[sn (t); ηn ]bn (t)βn ]T , (306)
where the sat function is defined as



 1 if si > xi ,

si
sat[si ; xi ] = xi if |si | ≤ xi , (307)



−1 if si < −xi
for some chosen xi > 0 (for xi = εi or xi = ηi in (305) and (306)), i = 1, 2, . . . , n,
with the associated indicator functions
(
1 if |si | > xi ,
χ[si ; xi ] = (308)
0 if |si | ≤ xi .
Such functions have the property: χ[si ; xi ](1 − χ[si ; xi ]) = 0 (that is, χ[si ; xi ] = 0
whenever 1 − χ[si ; xi ] = 1, and χ[si ; xi ] = 1 whenever 1 − χ[si ; xi ] = 0).
The adaptive laws are also modified as
ȧi (t) = χ[si ; εi ]κai |si (t)|αi (q, q̇, qd , q̇d ,t), κai > 0, i = 1, 2, . . . , n, (309)
ḃi (t) = χ[si ; ηi ]κbi |si (t)|βi (q, q̇, qd , q̇d , q̈d ,t), κbi > 0, i = 1, 2, . . . , n. (310)
With this modification, we have
V̇ = −sT (t)KD s(t) − sT (t)φ̂(t) − sT (t)φ̂1 (t) − σ(t)θ̃T0 (t)θ0 (t)

1 ∂D(q,t)
2 ∂t
+ ∑ ãi κ−1
−1
i=1 i=1
n n
= −s (t)KD s(t) − ∑ si (t)sat[si ; εi ]ai (t)αi − ∑ si (t)sat[si ; ηi ]bi (t)βi
T
i=1 i=1
n n
ai ȧi + ∑ b̃i κbi ḃi − σ(t)θ̃0 (t)θ0 (t)
− ∑ si (t)gi − ∑ si (t)hi + ∑ ãi κ−1 −1 T
i=1 i=1 i=1 i=1
n n
≤ −sT (t)KD s(t) − ∑ si (t)sat[si ; εi ]ai (t)αi − ∑ si (t)sat[si ; ηi ]bi (t)βi
i=1 i=1
n n
ai ȧi + ∑ b̃i κbi ḃi − σ(t)θ̃0 (t)θ0 (t)
+ ∑ |si (t)|a∗i αi + ∑ |si (t)|b∗i βi + ∑ ãi κ−1 −1 T
i=1 i=1 i=1 i=1
n
= −sT (t)KD s(t) − ∑ (1 − χ[si ; εi ])si (t)sat[si ; εi ]ai (t)αi
i=1
n n
− ∑ (1 − χ[si ; ηi ])si (t)sat[si ; ηi ]bi (t)βi + ∑ (1 − χ[si ; εi ])|si (t)|a∗i αi
i=1 i=1
n
+ ∑ (1 − χ[si ; ηi ])|si (t)|b∗i βi − σ(t)θ̃T0 (t)θ0 (t). (311)
i=1
This modified scheme would ensure the closed-loop signal boundedness but not
the asymptotic convergence of the tracking error e(t) = q(t) − qd (t) to zero (only a
bounded tracking error e(t) = q(t) − qd (t) of the order εi and ηi ).
Derivation of (10.152)
In this case, the expression (5.30) also holds
a(s) a(s)
u(t) = φ∗T [u](t) + φ∗T [y](t) + φ∗20 y(t) + φ∗3 Pm (s)[y](t) (312)
1
Λ(s) 2
Λ(s)
(with θ∗i replaced by φ∗i as the new notation and the exponentially decaying term
ε1 (t) ignored). Recall (10.39):
u(t) = ud (t) + (θ − θ∗ )T ω(t) + dN (t) (313)
and (10.15) (with as (t) = 0 for simplicity):
ud (t) = −θT (t)ω(t) (314)
from which we have

u(t) = −θ∗T ω(t) + dN (t). (315)
Using (313) for u(t) in the left side of (312) and (315) for u(t) in the right side of
(312), we obtain
ud (t) + (θ − θ∗ )T ω(t) + dN (t)

a(s) a(s)
= φ∗T [−θ∗T ω + dN ](t) + φ∗T [y](t) + φ∗20 y(t) + φ∗3 Pm (s)[y](t).(316)
1
Λ(s) 2
Λ(s)
Subtracting (316) from (10.151) and recalling (10.148), we have (10.152).

Backstepping Design with Nonsmooth Inverse Signal

For an adaptive inverse control scheme using a backstepping feedback design for
the output-feedback nonlinear systems (see Section 10.6.3), the nonlinearity inverse
signal ω(t) in (10.280), defined in (10.21) or (10.35) for the case of an adaptive
dead-zone inverse DI(·)c or an adaptive backlash inverse BI(·), b is not smooth (it is
not even continuous; but it is well-defined). A backstepping-based feedback control
design needs certain smoothness condition. Will the nonsmoothness of ω(t) cause
any problem? The answer is “no”. It turns out that the use of filters in the state
observer helps to avoid the potential difficulty with nonsmoothness of such signals
in a backstepping design.
Starting from (10.277), (10.283) and (10.284), we see that the nonsmooth signal
pi j (s) pi j (s)
ω(t) passes the filters Λ(s) , where Λ(s) are the components of (sI − A0 )−1 for
A0 = A − kc with k = [k1 , k2 , . . . , kn ]T and (A, c) in (10.272). This means that only
the signals ωi j (t) in (10.285) are associated with the nonsmooth signal ω(t). In fact,
it is the signal x̂2 (t) defined in (10.128) that plays a key role in the backstepping
design procedure, that is, only those of the signals ωi j (t), for i = 0, 1, . . . , m and
j = 2, are crucial in the backstepping design.
From the canonical form of A and c, we can obtain
p02 (s) = s + k1 , p12 (s) = s(s + k1 ), p22 (s) = s2 (s + k1 ), . . . ,

pn−2,2 (s) = sn−2 (s + k1 ), pn−1,2 (s) = −k2 sn−2 − k3 sn−3 − · · · − kn−1 s − kn .(317)
This calculation can be verified by using the symbolic algebra operations in Matlab.
For example, for n = 5, we can use
a=sym(’[s+k1, -1, 0, 0, 0; k2, s, -1, 0, 0;

k3, 0, s, -1, 0; k4, 0, 0, s, -1; k5, 0, 0, 0, s]’)
b=inv(a)
c=symmul(det(a),b)
to get the numerator matrix of (sI − A0 )−1 as
[sˆ4, sˆ3, sˆ2,

s, 1]
[-sˆ3*k2-k3*sˆ2-k4*s-k5, sˆ3*(s+k1), sˆ2*(s+k1),
(s+k1)*s, s+k1]
[-s*(k3*sˆ2+k4*s+k5),-k3*sˆ2-k4*s-k5,sˆ2*(k2+sˆ2+s*k1),
s*(k2+sˆ2+s*k1), k2+sˆ2+s*k1]
[-sˆ2*(k4*s+k5), -s*(k4*s+k5), -k4*s-k5,
s*(k2*s+k3+sˆ3+sˆ2*k1), k2*s+k3+sˆ3+sˆ2*k1]
[-k5*sˆ3, -k5*sˆ2, -k5*s,

-k5, sˆ4+k1*sˆ3+k2*sˆ2+k3*s+k4]
( j)
In the backstepping design procedure, the derivatives ωi2 (t), i = 0, 1, . . . , m,
j = 0, 1, . . . , ρ − 1, are needed, where ρ = n − m. For the case of ρ = n − m = 1, no
derivative of ωi2 (t) is used. For ρ = n − m ≥ 2, the highest degree of sρ−1 pi2 (s),
i = 0, 1, . . . , m − 1, is ρ − 1 + m = n − 1, and the degree of sρ−1 pm2 (s) is n, so that
sρ−1 pi2 (s) sρ−1 pm2 (s)
Λ(s) , i = 0, 1, . . . , m − 1, are strictly proper, and Λ(s) is proper. Therefore,
( j)
the signals ωi2 (t), i = 0, 1, . . . , m, j = 0, 1, . . . , ρ − 1, are well-defined, and so all
other signals related the inverse signal ω(t) in the backstepping design procedure,
that is, the nonsmoothness ω(t) does not cause any problem for the backstepping-
based adaptive inverse control scheme.

2003book Notes

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

2003book Notes

Uploaded by

Copyright:

Available Formats

Adaptive Control Design and Analysis

John Wiley & Sons, Inc.

Radial Unboundedness Condition on V (x) for Asymptotic Stability 2

Passivity of A Mass-Damper-Spring System 3

Positive Real Functions 4

Parameter Projection Properties 6

Explicit Swapping Lemma 7

Discrete-Time Swapping Lemma 9

Plant Zeros and Controller Order for MRAC 13

Parameter Convergence of MRAC 16

Higher-Order Tracking Performance of MRAC 25

Convergence of θ̃T (t)ω(t) 30

Higher-Order Convergence of ε(t) = θ̃T (t)φ(t) 32

Higher-Order Convergence of Indirect MRAC 34

Analysis of “Bursting Phenomenon” in Robust Adaptive Control 37

Robust MRAC with Switching σ-Modification 39

A Discrete-time MRAC System Example 40

Indirect Observer Based Adaptive Control 42

Adaptive Control of ẋ(t) = Ax(t) + BΛu(t) + BΘ∗ φ(x) 45

Parameters of u(t) = Θ∗T

Plant Signal Identities for MIMO Cases 51

Proof of limt→∞ e(t) = 0 in (9.187C) 54

Adaptive Robot Control for Time-Varying Parameters 55

Backstepping Design with Nonsmooth Inverse Signal 62

Singular Values and Eigenvalues of A Matrix

Radial Unboundedness Condition on V (x) for Asymp-

while the slope of this hyperbola is

Passivity of A Mass-Damper-Spring System

Positive Real Functions

(σ + 1 + jω)(σ2 − ω2 + σ + 1 − j(ω + 2σω))

Parameter Projection Properties

Explicit Swapping Lemma

θT (t)h(s)[ω](t) − h(s)[θT ω](t) = hc (s)[hb (s)[ωT ]θ̇](t), (16)

and use it to derive

Hence, we obtain the explicit swapping lemma:

Discrete-Time Swapping Lemma

θT (t)h(z)[ω](t) − h(z)[θT ω](t) = hc (z)[(hb (z)z)[ωT ](z − 1)[θ]](t). (23)

Proof: Using the discrete-time convolution: y(t) = C ∑t−1 i=0 A

hc (z)[(hb (z)z)[ωT ](z − 1)[θ]](t)

A Small Gain Lemma

Lemma 1 For kwkt = sup0≤τ≤t |w(τ)|, if

|w(t)| ≤ β(t)kwkt + γ(t) (27)

|w(tn )| ≤ β(tn )kwktn + γ(tn ) ≤ β(tn )|w(tn )| + γ(tn ). (28)

This result can be generalized to the vector signal case.

A Signal Convergence Lemma

Lemma 3 If ë(t) ∈ L∞ and limt→∞ e(t) = 0, then limt→∞ ė(t) = 0.

ė(t) = H(s)s[ė](t) + sK(s)[e](t) = H(s)[ë](t) + sK(s)[e](t).

Remark 1 There are three possible situations:

Lemma (Barbalat): If a scalar function f (t) is uniformly continuous such that

e(0) = e0 − e(0) exists and is finite, so that limt→∞ ė(t) = 0.

Plant Zeros and Controller Order for MRAC

G(s) = C(sI − A)−1 B = P̄l−1 (s)Z̄l (s) (32)

by a unimodular matrix M(s) (such a matrix is defined to have a non-zero constant

G(s) = C(sI − A)−1 B = Pl−1 (s)Zl (s) (34)

G(s) = C(sI − A)−1 B = Zr (s)Pr−1 (35)

Parameter Convergence of MRAC

ẋ(t) = Ax(t) + Bu(t), x(t) ∈ Rn , u(t) ∈ R, (36)

ẋm (t) = Am xm (t) + Bm r(t), xm (t) ∈ Rn , r(t) ∈ R (37)

where Am ∈ Rn×n is stable, and Bm ∈ Rn , both are constant.

A + Bk1∗T = Am , Bk2∗ = Bm . (38)

The adaptive controller structure is chosen as

u(t) = k1T (t)x(t) + k2 (t)r(t), (39)

k̃1 (t) = k1 (t) − k1∗ , k̃2 (t) = k2 (t) − k2∗ , (40)