Professional Documents
Culture Documents
v
CHAPTER 1
1.1. Introduction
The simplest examples of ODEs are found in growth models such
as population growth or income growth. Denote by x(t) the quantity
of interest at time t. If the rate of growth is constant, then we have
1 dx
= c,
x dt
where c is the growth rate. The left hand side of the equation above is
the mathematical expression of growth rate. This gives us:
dx
= cx.
dt
The solution of this ODE is given by:
x(t) = x0 ect ,
where x0 = x(0). Constant growth rate leads to exponential growth
behavior.
In many cases, this unbounded exponential growth behavior is not
realistic. A better model would entail a decreasing growth rate. The
simplest such model is
1 dx
= c − kx.
x dt
This is the logistic growth model. As we will see later, this model
predicts a bounded growth behavior.
A rich sources of ODE models come from mechanics. Consider the
motion of a particle under some external force. Denote by x(t) the
position of the particle at time t. From Newton’s second law, we have
ODE1 (1.1) mẍ = F (x),
where m is the mass of the particle, F (x) is the external force acting
on the particle when its location is at x. To close the system, we need a
1
2 1. ORDINARY DIFFERENTIAL EQUATIONS
dx
= f (x, t), f : Rn × R → Rn ,
dt
An = (P −1 ΛP )(P −1 ΛP ) · · · (P −1 ΛP ) = P −1 Λn P,
and
( +∞ )
∑
+∞
1 n n ∑ 1 n −1 n
+∞ ∑ 1
eAt = t A = t P Λ P = P −1 tn Λn P = P −1 eΛt P.
n=0
n! n=0
n! n=0
n!
We note that
A = P ΛP −1 .
Thus,
eAt = P eΛt P −1
where
eΛt = diag{eλ1 t , eλ2 t , . . . , eλn t }.
6 1. ORDINARY DIFFERENTIAL EQUATIONS
Ax = λx,
or
(A − λI)x = 0.
To solve (A − λI)x = 0,
( )( ) ( )
0 1 x1 x2
(A − λI)x = = = 0,
0 0 x2 0
and
(1.7) ẍ + aẋ + bx = 0,
λ2 + aλ + b = 0.
This is called the characteristic equation for the ODE. The roots of
√
this quadratic equation are λ1,2 = 21 (−a ± a2 − 4b).
General solutions can now be constructed using the superposition
principle, which is a feature of all linear problems.
10 1. ORDINARY DIFFERENTIAL EQUATIONS
We define two special solutions ψ1 (t) = (ψ11 (t), ψ12 (t))T and ψ2 (t) =
(ψ21 (t), ψ22 (t))T to the homogeneous ODE,
dx
eqn:Atx (1.9) = A(t)x
dt
with initial conditions ψ1 (0) = (1, 0)T and ψ2 (0) = (0, 1)T . We will
see later that these solutions are uniquely defined, as long as A is
continuous and bounded. We call ψ1 and ψ2 fundmental solutions and
define the fundmental matrix,
( )
[ ] ψ11 (t) ψ21 (t)
eqn:funmat (1.10) Ψ(t) = ψ1 (t), ψ2 (t) = .
ψ12 (t) ψ22 (t)
We can also claim that there is a unique matrix Ψ(t) (which is the
fundamental matrix) such that
dΨ(d)
= A(t)Ψ(t)
dt
Ψ(0) = I, the identity matrix.
d
eqn:Abel (1.12) |Ψ(t)| = trace(A(t))|Ψ(t)|
dt
Proof.
d d ψ11 (t) ψ21 (t) ψ̇11 (t) ψ̇21 (t) ψ11 (t) ψ21 (t)
|Ψ(t)| = = +
dt dt ψ12 (t) ψ22 (t) ψ12 (t) ψ22 (t) ψ̇12 (t) ψ̇22 (t)
ψ11 ψ21
+
a21 ψ11 + a22 ψ12 a21 ψ21 + a22 ψ22
ψ11 ψ21
Á − a21 × À +
a22 ψ12 a22 ψ22
= a11 |Ψ(t)| + a22 |Ψ(t)|
= trace(A(t))|Ψ(t)|.
14 1. ORDINARY DIFFERENTIAL EQUATIONS
d dx2
Since dt
(Ψ(t)v(t)) = dt
, we must have
d
Ψ(t) v(t) = g(t).
dt
or
d
v(t) = Ψ−1 (t)g(t).
dt
Hence ∫ t
v(t) = Ψ−1 (s)g(s)ds.
0
Since x2 (0) = 0, we have v(0) = 0. Therefore, we obtain
∫ t
x2 (t) = Ψ(t)v(t) = Ψ(t) Ψ−1 (s)g(s)ds.
0
It is easy to check that this is indeed a solution to the problem
dx2
= A(t)x2 + g(t), x2 (0) = 0.
dt
In summary, the solution to the ODE (1.13) is given by
∫ t
0
x(t) = Ψ(t)x + Ψ(t) Ψ−1 (s)g(s)ds .
0
Proof. We integrate dx
dt
= f (x) from 0 to t,
∫ t ∫ t
dx
ds = f (x(s))ds
0 ds 0
to get
∫ t
0
x(t) = x + f (x(s))ds.
0
Since x1 , x2 are both solutions, then
∫ t
0
x1 (t) = x + f (x1 (s))ds,
0
and ∫ t
0
x2 (t) = x + f (x2 (s))ds,
0
Subtracting the above two equations, we have
∫ t
x1 (t) − x2 (t) = f (x1 (s)) − f (x2 (s))ds.
0
∫t
Taking the norm on both sides, and using the property that | g(s)ds| ≤
∫t 0
0
|g(s)|ds for any integrable function g, we obtain
∫ t
|x1 (t) − x2 (t)| ≤ |f (x1 (s)) − f (x2 (s))|ds.
0
∫ t ∫ t
|yn (t) − y | ≤
0
|f (s, yn−1 (s))|ds ≤ M ds ≤ M h ≤ b
t0 t0
Let rn (t) = yn+1 (t) − yn (t). The proposition below says that for
any t ∈ [t0 − h, t0 + h],
we obtain
∫ t
0
y∞ (t) = y + f (s, y∞ (s))ds.
t0
One can easily see then that y∞ (t) satisfies the requirements specified
in the theorem.
So (1.18) holds.
Examples: ( )
0 1
(1). A = .
−1 0
The general solution is
x(t) = c1 cos t + c2 sin t, y(t) = −c1 sin t + c2 cos t.
i.e.,
x(t) = cos(−t + φ), y(t) = sin(−t + φ).
Fig. 1 shows the components x(t) and y(t). If we look at the phase
plane, i.e., the (x, y)–plane, and draw the trajectory (x(t), y(t)) for
t ∈ R, we obtain Fig. 2. Since (x(t))2 + (y(t))2 ≡ (x(0))2 + (y(0))2 , for
different initial values (x(0), y(0))2 , the corresponding trajectories are
( of different
concentric circles ) radii.
−1 0
(2). A = .
0 −2
The solution is (x(t), y(t)) = (x0 e−t , y0 e−2t ). The solution (x(t), y(t))
satisfies
(x/x0 )2 = y/y0 .
They are parabolas in the phase plane (Fig. 3). All trajectories ap-
proach the origin
( (0, 0))as time goes to infinity.
−1 0
(3). A = .
0 2
The solution is given by: (x(t), y(t)) = (x0 e−t , y0 e2t ). The solution
(x(t), y(t)) satisfies
(x/x0 )−2 = y/y0 .
They are hyperbolas in the phase plane (Fig. 4). Only the trajectories
initiated on the x–axis approach the origin (0, 0) as time increases. The
other trajectories diverge and approaches the y–axis.
The origin is referred to as the “center ”, “node” and “saddle”,
respectively, (
in the three
) examples above.
λ 0
(4). A = . The corresponding solution is
0 µ
[ ] [ ]
1 0
x(t) = c1 eλt + c2 eµt .
0 1
24 1. ORDINARY DIFFERENTIAL EQUATIONS
1.5
1
x(t)
0.5
−0.5
−1
y(t)
−1.5
0 2 4 6 8 10 12
t
Figure 1. solution
in terms of t fig:traj1
1.5
0.5 (x(t),y(t))
−0.5
−1
−1.5
−1.5 −1 −0.5 0 0.5 1 1.5
Figure
2. trajectory in
phase plane fig:phase1
–3
–2
–1
x
3 2 1 0 –1 –2 –3
y
2
–3
–2
–1
x
3 2 1 0 –1 –2 –3
y
2
–3
–2
–1
x
3 2 1 0 –1 –2 –3
y
2
where δx(t) and δy(t) are functions of t and are thought to be small.
δx should satisfy:
d d
eqn:s3 (1.23) δx(t) = x(t) = f1 (x∗ + δx(t), y ∗ + δy(t)).
dt dt
Linearizing the right hand side, i.e. dropping terms that are not linear
in δx and δy, we get
∂f1 ∗ ∗ ∂f2 ∗ ∗
f1 (x∗ + δx(t), y ∗ + δy(t)) = f1 (x∗ , y ∗ ) + (x , y )δx(t) + (x , y )δy(t)
∂x ∂y
+o(δx(t), δy(t))
∂f1 ∗ ∗ ∂f2 ∗ ∗
≈ (x , y )δx(t) + (x , y )δy(t)
∂x ∂y
(note f1 (x∗ , y ∗ ) = 0). Thus, we arrive at a linearized equation for δx:
d ∂f1 ∗ ∗ ∂f2 ∗ ∗
δx(t) = (x , y )δx(t) + (x , y )δy(t).
dt ∂x ∂y
Similarly for δy(t). Together, we obtain
( ) ( )( ) ( )
∂f1 ∂f1
d δx(t) ∂x ∂y δx(t) δx(t)
(1.24) = ∂f2 ∂f2 =: A
dt δy(t) ∂x ∂y
δy(t) δy(t)
where the Jacobian matrix A is evaluated at the stationary point
(x∗ , y ∗ ). In particular, A is a constant matrix.
The expectation is that the behavior of the solutions (x(t), y(t)) is
close to that of the linearized system in the neighborhood of (x∗ , y ∗ ).
This is not always true. If all the eigenvalues λ of the matrix A satisfy
Reλ ̸= 0, then the above statement is true. But if one of the eigenvalues
is pure imaginary, then stability can not be determined by linearization,
as the following example shows:
eqn:ctex (1.25) ẍ + εx2 ẋ + x = 0
Rewrite (1.25) as a system
( ) ( )( ) ( )
d x 0 1 x 0
(1.26) = −ε .
dt y −1 0 y x2 y
We find eigenvalues of the corresponding matrix A are λ = ±i. How-
ever, unless ε = 0, the fixed point (0, 0) is not a center, as in the linear
system, but an attracting spiral sink (asymptotically stable) if ε > 0,
and a repelling source if ε < 0.
1.7. QUALITATIVE BEHAVIOR OF ODES 31
1.8
1.6
1.4
1.2
1
y
0.8
0.6
0.4
0.2
0
0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 2
x
Specifically,
ry + px = d ln y + b ln x + C
where C is an arbitrary constant. Let
V (x, y) = ry + px − d ln y − b ln x,
then the solutions of (1.27) satisfy:
V (x(t), y(t)) = constant
A straightforward calculation reveals that the stationary point (b/p, d/r)
is the local minimizer of V . The contour lines of V (x, y) are closed
curves in the phase plane as shown in Fig. 10.
In the phase plane of the linearized system, along v1 , the solution grows
exponentially like et ; while along the second direction v2 , the solution
shrinks exponentially like e−t . In the phase plane of the original system,
near the stationary point, there are two trajectories tangent to ±v1
respectively and two trajectories tangent to ±v2 respectively.
Now we perform linearization around the stationary points (±1, 0).
The Jacobian matrices are the same for the two stationary points. The
√
eigenvalues are ± 2i. See Example 2 at Page 6 for a discussion of
the linearized system. The stationary points (±1, 0) are centers of the
linearized system. However, we can not directly draw the conclusion
that (±1, 0) are also centers of the non-linear system (1.29).
To perform the global analysis, we have to use the Hamiltonian
structure. For this system, the Hamiltonian is given by, H(x, p) =
p + 41 (1 − x2 )2 . H(x, p) = c gives rise to the curve
1 2
2
√
1
p(x) = ± 2c − (1 − x2 )2 .
2
At the stationary points (±1, 0), H(x, p) = 0. If 0 < c < 14 , the contour
curves are two closed curves around the stationary points (±, 1). If
c = 41 , the contour curve crosses the origin. If c > 41 , the contour curve
is a single closed curve and crosses the p-axis. See Fig. 11 for the details
of the phase plane.
the y-label needs to be changed to p-label
If the inertial effect is negligible, i.e., m = 0, we have
dx ∂V (x)
=− ,
dt ∂x
(set γ = 1 for simplicity). System in this form are called gradient
systems.
1.7. QUALITATIVE BEHAVIOR OF ODES 35
1.4
1.2
1
V(x) 0.8
0.6
0.4
0.2
0
−1.5 −1 −0.5 0 0.5 1 1.5
x
H=C >1/4
0.5 1
H=1/4
y=x’
0
H=C2<1/4
−0.5
−1
−1.5 −1 −0.5 0 0.5 1 1.5
x
dV (x(t)) ∂V (x(t)) dx
= = −|∇V |2 ≤ 0.
dt ∂x dt
The potential energy (which is also the total energy in this case) of the
system decreases in time.
x 0
1
a
Figure 12. Bifurcation diagram. fig:bifurcation
√
Fixed points are x∗ = 0 for all a ∈ R, x∗ = ± a − 1 if a ≥ 1. Fig. 12.
dt
< 0 if r > a. Thus, all nonzero solutions spiral toward this
circular solution as t → +∞.
In contrast to the previous example in which new stationary solu-
tions occur at the bifurcation point, in this example, a new periodic
38 1. ORDINARY DIFFERENTIAL EQUATIONS
solution is born out and the existing fixed point loses its stability to
this new periodic solution. This type of bifurcation is called a Hopf
bifurcation.
Periodic solutions are the simplest kind of solutions besides the
stationary solutions. Natually we can also ask about their stability
and the behavior of solutions nearby. A limit cycle in the phase space
is a closed trajectory with the property that there is at least one other
trajectory that spirals into it either as time approaches +∞ or −∞.
In the case where all the neighboring trajectories approach the limit-
cycle as t → +∞, it is called a stable or attractive limit-cycle. In the
example above, we have a stable limit cycle.
Theorem 10 (Poincaré-Bendixson theorem). Consider the ODE
′
x = f (x) in R2 . Assume that ∃ a bounded solution x(), ˙ i.e., a constant
c and a solution x()˙ such that |x(t)| ≤ c for all t > 0. Then, either the
ODE system has a stationary solution, or it has a limit cycle Γ, such
that limt→+∞ x(t) → Γ.
1.7.6. Chaotic behavior. We end this discussion with some brief
comments about chaos.
The logistic map First we consider an example of discrete dynamical
system, the logistic map, which can be regarded as the next simplest
population growth model beyond the linear model:
xn+1 = λxn (1 − xn ),
where λ > 0 is a parameter and 0 ≤ xn ≤ 1. The dynamics of this
model is described by a simple quardratic map. Yet the behavior of
solutions can be quite complex. By varying λ, the following behavior
is observed:
• 0 < λ ≤ 1. xn → 0 as n → +∞, i.e., the population will
eventually die, independent of the initial population.
r−1
• 1 < λ ≤ 2. The population stabilizes on the value ,
r
independent of the initial population.
• 2 < λ ≤ 3. The population also eventually stabilizes on the
r−1
same value , but first oscillates around that value for
r
some time.
1.7. QUALITATIVE BEHAVIOR OF ODES 39