Professional Documents
Culture Documents
Delay Differential
Equations
This thesis introduces the concept of differential equations with delay, the so-
called delay differential equations (DDEs). These differential equations depend
on past history, and are therefore used in many models because they are more
realistic than models independent of past history.
In this thesis, simple cases and linear systems of DDEs with a single delay
will be discussed. We will look at proofs of existence and uniqueness, numerical
and analytic solutions, and the stability of the steady-state solutions. This
thesis ends with a discussion of the delayed logistic equation.
i
Contents
1 Introduction 1
2 Simple Cases 2
2.1 Simplest DDE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2.1.1 Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2.1.2 Existence and Uniqueness . . . . . . . . . . . . . . . . . . 4
2.1.3 General Equation . . . . . . . . . . . . . . . . . . . . . . . 5
2.2 Scalar DDE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.2.1 General Equation . . . . . . . . . . . . . . . . . . . . . . . 8
2.2.2 Existence and Uniqueness . . . . . . . . . . . . . . . . . . 9
3 Linear Systems 10
3.1 Preliminaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
3.2 Linear DDE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3.2.1 Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
3.2.2 General Equation . . . . . . . . . . . . . . . . . . . . . . . 13
3.3 General Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
4 Application 16
4.1 Delayed Logistic Equation . . . . . . . . . . . . . . . . . . . . . . 16
A Matlab Codes 19
A.1 Chapter 2: Simple Cases . . . . . . . . . . . . . . . . . . . . . . . 19
A.2 Chapter 4: Application . . . . . . . . . . . . . . . . . . . . . . . . 20
Bibliography 22
ii
Chapter 1
Introduction
Models including delay differential equations exist, among other things, in bi-
ology, economics, and mechanics. An example of a DDE in the biology field
is the Mackey-Glass equation for the density of certain blood cells. The delay
in this differential equation is given by the time between initiation of cellular
production in the bone marrow and release of mature cells into the blood.
Delay differential equations were introduced to create more realistic models since
many processes depend on past history. A limitation of DDEs is that they only
depend on past states and not past rates. Differential equations dependent on
past rates are the so-called neutral delay differential equations (NDDEs), but
these differential equations will not be discussed in this thesis. Furthermore,
DDEs dependent on multiple past states will also not be discussed in this thesis.
1
Chapter 2
Simple Cases
where τ > 0 is called the delay. Suppose the initial condition for (2.1) is given
by
x(t) = 1 for t ∈ [−τ, 0]. (2.2)
Following the procedure called the method of steps described in [5, p.13-14], the
solution x(t) for t ∈ [(n−1)τ, nτ ], n ∈ N, can be determined in the following way.
Therefore,
Z t
x(t) = x(τ ) + −[1 − (s − τ )] ds
τ
1
= 1 − τ + [−s + (s − τ )2 ]s=t
s=τ
2
1
= 1 − t + (t − τ )2 , t ∈ [τ, 2τ ]. (2.4)
2
2
By induction, it can be proven that
n
X [t − (k − 1)τ ]k
x(t) = 1 + (−1)k , t ∈ [(n − 1)τ, nτ ], n ∈ N. (2.5)
k!
k=1
The solution x(t) is unique. This will be proven in the next section.
Let f (a−) and f (a+) denote lims→a− f (s) and lims→a+ f (s) for a function
f and constant a, respectively. From the method of steps done above, it can
immediately be seen that x0 (0−) = 0 and x0 (0+) = −1. Therefore, x is not
differentiable at t = 0. In fact, x(n−1) is not differentiable at t = (n − 1)τ for
all n ∈ N, since x(n) ((n − 1)τ −) = 0 and x(n) ((n − 1)τ +) = (−1)n .
τ = 0.5 τ =1
1 1
0.5
x(t)
x(t)
0.5
0
0 -0.5
0 1 2 3 4 0 2 4 6 8 10 12 14
t t
τ = 1.5 τ =2
4
1
0.5 2
x(t)
x(t)
0
0
-0.5
-2
-1
0 5 10 15 20 0 2 4 6 8 10 12 14 16
t t
Figure 2.1: Numerical and analytic solutions of (2.1) with initial condition (2.2)
for different values of τ .
See Figure 2.1 for plots of numerical and analytic solutions of the initial
value problem (2.1), (2.2), for some values of τ . The analytic solution in this
figure is given by (2.5). The Matlab codes used for computing the plots in this
chapter can be found in Appendix A.1.
Using the package DDE23 in Matlab, plots can be made with on the hor-
izontal axis the time t and on the vertical axis the (numerical) solution x(t)
for different values of τ . Comparing both solutions, we can conclude that the
numerical solution approximates the analytic solution quite well. Furthermore,
the accuracy increases as t increases.
From Figure 2.1, we can also conclude that the solution x(t) for τ = 0.5 is
starting to oscillate. The solutions oscillate around the steady-state solution of
(2.1) given by x ≡ 0. Also, the oscillations increase as τ increases. According
to the plots in this figure, at least until τ = 1.5, x = 0 is stable. When τ = 2,
3
x = 0 is no longer a stable solution. Later in this chapter, it will be proven that
x(t) oscillates for values of τ > 1/e ≈ 0.37, and x = 0 is stable when τ < π/2
and unstable when τ > π/2 ≈ 1.57.
Theorem 2.1. We consider the initial value problem (2.6), (2.7), where f is
continuous in the strip S = J × R, φ is continuous in J− , and τ > 0 is a
constant in J. Then, there exists exactly one solution.
The proof of this theorem is based on the proof of Theorem 7.V. in [6], and
the method of steps used in the previous section.
Proof. Let
x0n (t) = f (t, xn (t − τ )) for t ∈ [ξ + (n − 1)τ, ξ + nτ ],
where n ∈ N.
4
So x2 is uniquely defined for t ∈ [ξ + τ, ξ + 2τ ]. We can conclude that xn
is defined by xn−1 for all n ∈ N. Therefore, xn is uniquely defined for t ∈
[ξ + (n − 1)τ, ξ + nτ ], n ∈ N. From this, we can conclude that x, defined by
φ(t) for t ∈ J− = [ξ − τ, ξ],
x(t) = Z t (2.10)
φ(ξ) + f (s, x(s − τ )) ds for t ∈ J = [ξ, ξ + a],
ξ
5
Lemma 2.1. µj eλµ , j = 0, 1, . . . , k are solutions of (2.12) if and only if λ is a
root of order at least k + 1 of h.
where Cjk = k!/j!(k − j)! are the binomial coefficients. The result follows im-
mediately from this observation.
As h is an analytic function of the complex variable λ it has the following
elementary properties. See Appendix A in [5].
(A) The set of roots can have no accumulation point in C; therefore, for each
R > 0, the set of roots satisfying |λ| ≤ R is finite. It follows that the set of
roots is a countable (possible finite) set.
(B) If the set of roots is infinite, denoted by {λn }∞
n=1 , then |λn | → ∞. Because
|β|e−<(λn ) = |λn |, it follows that <(λn ) → −∞. Consequently, for each
a ∈ R, <(λ) ≥ a for at most finitely many roots.
(C) If λ is a root, then it is a root of finite order.
(D) If λ is a root, so is its conjugate λ̄.
For (3): h has a minimum on the x-axis, hence there is exactly one real root.
Filling β = 1/e in for h gives the root λ = −1. Furthermore, h0 (−1) = 0 and
h00 (−1) = 1, hence the order of λ = −1 is two.
For (4): h has a minimum above the x-axis.
The next result summarizes important information concerning the roots in
the case β > 0.
6
Proposition 2.2. The following hold for (2.14).
1. If 0 < β < π/2, then there exists δ > 0 such that <(λ) ≤ −δ for all roots.
2. If β = π/2, then λ = ±iπ/2 are roots of order one.
3. If β > π/2, then there are roots λ = x ± iy with x > 0, y ∈ (π/2, π).
The proof of this proposition is taken from [5, p.18-20].
sin(y) ex
=
y β
must hold. As
d sin(y) y cos(y) − sin(y)
= < 0, y∈S
dy y y2
and sin(y)/y = 2/π when y = π/2, we conclude that sin(y)/y ≤ 2/π for y ∈ S.
Therefore,
1 ex sin(y) 2
≤ = ≤ .
β β y π
So it follows that β ≥ π/2. Thus, if β < π/2, then <(λ) < 0 for every root λ.
This and the last assertion in (B) above proves (1).
The second assertion follows immediately from computation.
Let’s now turn to the final assertion (3). If we write our root as λ = reiθ ,
then (2.14) becomes
Equivalently,
r = βe−x and θ − π = −y + 2kπ
for some integer k. Let’s search for a root in the first quadrant on the ray
through the origin making angle θ ∈ (0, π/2) with the positive x-axis. Then,
taking k = 0, y(θ) = π − θ > 0 and so x(θ) > 0 is determined by trigonometry
because tan(θ) = y/x.
We claim that:
x(θ) = (π − θ) cot(θ)
y(θ) = π − θ, 0 < θ < π/2
(2.16)
π − θ x(θ)
β(θ) = e
sin(θ)
is a one-parameter family of solutions of (2.14) satisfying x > 0 and π/2 < y < π.
Clearly, x(θ), y(θ), β(θ) depend continuously on θ ∈ (0, π/2). Also,
and
x(θ) → 0, y(θ) → π/2, β(θ) → π/2, θ → π/2.
Inasmuch as β(θ) is strictly decreasing on (0, π/2) it follows that the range of β
is (π/2, ∞).
7
From Theorem 4.3 in [5], we can conclude that the stability of the steady-
state solution of a delay differential equation is determined in the same way
as for an ordinary differential equation. So the steady-state solution of (2.11)
given by x ≡ 0 is asymptotically stable if <(λ) < 0 for all roots λ of (2.14),
and this solution is unstable if there is a root λ with positive real part. Using
this result, the following corollary follows immediately from Proposition 2.2 and
Lemma 2.2.
Corollary 2.3. The following hold for (2.11).
1. If α < 0, then x = 0 is unstable.
2. If 0 < ατ < π/2, then x = 0 is asymptotically stable.
3. If ατ = π/2, then x = sin(πµ/2) and x = cos(πµ/2) are solutions.
4. If ατ > π/2, then x = 0 is unstable.
The next result summarizes important information concerning oscillations.
Theorem 2.4. For every real α and τ > 0, the following are equivalent.
1. Every solution of (2.11) is oscillatory.
2. ατ > 1/e.
Proof. For every real λ, U (µ) = eλµ is either a monotonic or constant function.
Therefore, x(t) = U (µ) is not oscillatory for real λ. So x(t) is oscillatory if and
only if λ is a complex (not real) root. By Lemma 2.2, λ is a complex (not real)
root if and only if β = ατ > 1/e. This proves the theorem.
where a, b are constants, and τ > 0 is the delay. The nonhomogeneous equation
will be discussed in the next chapter.
We seek a nontrivial solution of (2.17) of the form
x(t) = eλt c, c 6= 0,
8
Solving this characteristic equation can be done in a similar way as the
characteristic equation for the simplest equation in the previous section.
We can conclude the following about the stability of the steady-state solution
given by x ≡ 0.
Theorem 2.5. The following hold for (2.17).
1. If a + b > 0, then x = 0 is unstable.
2. If a + b < 0 and b ≥ a, then x = 0 is asymptotically stable.
3. If a + b < 0 and b < a, then there exists τ ∗ > 0 such that x = 0 is asymptot-
ically stable for 0 < τ < τ ∗ and unstable for τ > τ ∗ .
The proof of this theorem can be found in [5, p.53-54].
with a single delay τ > 0. Assume that f (t, x, y) and fx (t, x, y) are continuous
on R3 . An initial condition for (2.20) is given by
As g(t, x1 ) ≡ f (t, x1 , φ(t − τ )) and gx1 (t, x1 ) are continuous, a unique solution
of this ODE is guaranteed by standard existence results from ODE theory.
For t ∈ [ξ + τ, ξ + 2τ ], x(t) must satisfy the initial value problem for the
ODE:
Again, standard existence results for such problems guarantee the existence
of a unique solution. We may repeat this process to extend the solution to
[ξ + 2τ, ξ + 3τ ], and so on.
Following this procedure, a unique solution of the initial value problem
(2.20), (2.21) can be determined.
9
Chapter 3
Linear Systems
3.1 Preliminaries
A DDE with a single delay is of the form
In this chapter, we will look at linear systems with delay. We will discuss
linear DDEs of the form
xξ = φ, (3.5)
In the next section, an example of the following linear DDE will be discussed:
10
where A, B are n × n matrices, and τ > 0 is the delay. This equation can be
rewritten in the form of (3.4) by defining the map L as
L(y) = Ay(0) + By(−τ ),
because then, using (3.3),
L(xt ) = Axt (0) + Bxt (−τ ) = Ax(t) + Bx(t − τ ),
which is precisely (3.6).
We introduce the Laplace transform:
Z ∞
F (s) := e−st f (t) dt, (3.7)
0
where f (t) is a function on [0, ∞). The domain of F (s) consists of all the values
for which the integral in (3.7) exists. The Laplace transform of f is denoted by
both F and L{f }. We let f (t) be an exponentially bounded function of order
α; that is,
|f (t)| ≤ M eαt for all t ≥ T
for some positive constants M, T . Then, if f (t) is also piecewise continuous on
[0, ∞), then L{f }(s) exists for s > α.
The key property of the Laplace transform that we exploit is that the trans-
form of a convolution is the product of the transforms. If f (t) and g(t) are
piecewise continuous on [0, ∞), then their convolution, denoted by f ∗ g, is
defined by
Z t Z t
(f ∗ g)(t) := f (s)g(t − s) ds = f (t − s)g(s) ds. (3.8)
0 0
11
Therefore, the eigenvalues of A are λ1 = 1 and λ2 = 2.
From
−1 1 0
(A − λ1 I)v1 = v1 = ,
−2 2 0
1
it follows that an eigenvector corresponding to λ1 is given by v1 = . From
1
−2 1 0
(A − λ2 I)v2 = v2 = ,
−2 1 0
1
it follows that an eigenvector corresponding to λ2 is given by v2 = .
2
Therefore, we can conclude that the solution of
x0 (t) = Ax(t)
is given by
1 1
xh (t) = c1 et + c2 e2t , (3.12)
1 2
where c1 , c2 are constants.
For t ∈ [0, τ ],
12
Therefore, c1 = 4 and c2 = −1. So the general solution of (3.9), (3.10), for
t ∈ [0, τ ], is given by
1 1 2
x(t) = xh (t) + xp (t) = 4et − e2t − . (3.15)
1 2 1
In a similar way, general solutions of the initial value problem (3.9), (3.10)
defined on other intervals of the form [(n − 1)τ, nτ ], n ∈ N, can be determined.
13
where
K(s) = (sI − A − e−sτ B)−1
is a matrix-valued function.
In order to make use of the convolution result, we need to know the inverse
transform k of K. In view of the calculations above, we see that k is a solution
of (3.16), (3.17), with f = 0, for the initial data
I for θ = 0,
ξ(θ) = (3.19)
0 for θ ∈ [−τ, 0).
Hence,
x(t) := x(t; φ, f ) = x(t; φ, 0) + x(t; 0, f ) for t ∈ [0, τ ]. (3.21)
We can conclude from (3.21) that (3.20) holds for all t ≥ 0, by uniqueness of
the solutions x(t; φ, f ), x(t; φ, 0), and x(t; 0, f ) for all t ≥ 0.
x(t) = eλt v, v 6= 0,
where λ and the elements of the vector v are complex. We will use the notation
expλ , where expλ (θ) = eλθ . Then,
14
Therefore, xt = eλt (expλ )v.
Using that L is a linear map and that eλt ∈ C for all λ, t; for x(t) = eλt v to
be a solution of (3.4), we must have
x0 (t) = λeλt v = L(xt ) = L(eλt (expλ )v) = eλt L((expλ )v).
Dividing both sides of this equation by eλt , we get
λv = L((expλ )v).
n
LetP {e1 , e2 , . . . , en } be the standard basis for C . Then,P we can write
v = j v j e j . Using this notation, we get L((expλ )v) = j vj L((expλ )ej ),
by linearity of L and the fact that vj ∈ C for all j.
Define Lλ to be the n × n matrix
Lλ = (L((expλ )e1 ) | L((expλ )e2 ) | · · · | L((expλ )en )) = (Li ((expλ )ej )),
where Li (φ) is element i of L(φ). Then,
λv = L((expλ )v)
X
= vj L((expλ )ej )
j
15
Chapter 4
Application
16
Since we may neglect higher powers of p, we end up with the following ODE:
Therefore,
p(t) = ceat ,
where c is a constant. Taking the initial condition (4.5) into account, the solution
of the initial value problem (4.4), (4.5), for x∗ = 0, is given by
Since we may neglect higher powers of p, we end up with the following DDE:
17
x(t) p1 (t) p2 (t)
x(t)
x(t)
1 1 1
0 0 0
0 5 10 15 20 0 5 10 0 5 10
t t t
τ = 1, a = 0.5 τ = 1, a=1 τ = 1, a = 1.5
3
4
2 1/b
2 1/b
x(t)
x(t)
x(t)
1 2 1/b
1
0 0 0
0 5 10 15 20 0 5 10 15 20 0 5 10 15
t t t
τ = 1.5, a = 0.5 τ = 1.5, a=1 τ = 1.5, a = 1.5
4
2 1/b 10
x(t)
x(t)
x(t)
2 1/b 1/b
1 0
0 0 -10
0 5 10 15 20 25 0 5 10 15 20 0 5 10 15
t t t
Figure 4.1: Plots of x(t), p1 (t), and p2 (t), for b = 0.5, and different values of a
and τ .
From the plots in Figure 4.1, we can conclude that p1 (t) and p2 (t) approx-
imate x(t) very well, except for the last case. For this case, aτ = (1.5)2 =
2.25 > π/2. By Corollary 2.3, it follows that x∗ = 1/b is unstable. From the
plot of this case, we can conclude that x(t) contains complex (not real) values,
and p1 (t) and p2 (t) only contain real values. Therefore, x(t) cannot be approx-
imated by p1 (t) and p2 (t). For the other cases, we can conclude from the plots,
and Corollary 2.3, that x∗ = 1/b is stable.
Furthermore, we can conclude from these plots that the cases where aτ
has the same value, the graphs look similar. For example, consider the cases
τ = 0.5, a = 1, and τ = 1, a = 0.5. Then, the plots of these cases look the same,
but the time intervals are different. The same holds for the other cases with the
same value of aτ .
18
Appendix A
Matlab Codes
Figure 2.1
1 function [ dxdt ] = SCDDE1dde ( t , x , Z )
2 % x ’ ( t ) = −x ( t−t a u ) f o r t >=0
3 % tau >0 i s t h e d e l a y
4 xlag = Z ( : , 1 ) ;
5 dxdt = [− x l a g ( 1 ) ] ;
6 end
1 function [ s ] = SCDDE1hist ( t )
2 % I n i t i a l d a t a i s g i v e n by
3 % x ( t ) = 1 f o r −tau<=t <=0
4 s = [1];
5 end
1 %A n a l y t i c S o l u t i o n
2 n = ...;
3 tau = . . . ;
4 t0 = 0 ;
5 tend = . . . ;
6 t = linspace ( t0 , tend ) ;
7 x = zeros ( length ( t ) ) ;
8 f o r i =1:n
9 f o r j =1: length ( t )
10 i f ( ( i −1)∗ tau <= t ( j ) ) && ( t ( j ) <= i ∗ tau )
11 A = zeros ( i ) ;
12 f o r k=1: i
13 A( k ) = ( −1)ˆ k ∗ ( ( t ( j )−(k−1)∗ tau ) ˆ k ) / . . .
14 factorial (k );
15 end
16 x ( j ) = 1 + sum(A ) ;
17 end
19
18 end
19 end
20
21 %Numerical S o l u t i o n
22 s o l = dde23 (@SCDDE1dde , [ tau ] , @SCDDE1hist , [ t0 , tend ] ) ;
23
24 %F i g u r e
25 figure
26 plot ( s o l . x , s o l . y , ’ C o l o r ’ , [ 2 5 5 , 1 2 8 , 0 ] . / 2 5 5 ) ; hold on
27 plot ( t , x , ’−−k ’ ) ;
Figure 4.1
1 function [ dxdt ] = APPDDE41dde ( t , x , Z )
2 % x ’ ( t ) = ax ( t )[1 − bx ( t−t a u ) ] f o r t >=0
3 % tau >0 i s t h e d e l a y
4 a = ...;
5 b = 0.5;
6 xlag = Z ( : , 1 ) ;
7 dxdt = a ∗x (1)∗[1 − b∗ x l a g ( 1 ) ] ;
8 end
1 function [ s ] = APPDDE41hist ( t )
2 % I n i t i a l d a t a i s g i v e n by
3 % x ( t ) = 0 . 0 1 f o r −tau<=t <=0
4 s = [0.01];
5 end
1 function [ s ] = APPDDE42hist ( t )
2 % I n i t i a l d a t a i s g i v e n by
3 % p1 ( t ) = 0 . 0 1 exp ( a t ) f o r t02−tau<=t<=t 0 2
4 a = ...;
5 b = 0.5;
6 s = zeros ( length ( t ) ) ;
7 f o r i =1: length ( t )
20
8 s ( i ) = 0 . 0 1 ∗ exp ( a∗ t ( i ) ) ;
9 end
10 end
1 a = ...;
2 b = 0.5;
3 tau = . . . ;
4 t01 = 0 ;
5 t02 = . . . ;
6 tend = . . . ;
7
8 % x( t )
9 s o l = dde23 (@APPDDE41dde , [ tau ] , @APPDDE41hist , [ t01 , tend ] ) ;
10
11 % p1 ( t )
12 t = linspace ( t01 , tend ) ;
13 p1 = zeros ( length ( t ) ) ;
14 p1 ( 1 ) = 0 . 0 1 ∗ exp ( a∗ t ( 1 ) ) ;
15 f o r i =1: length ( t )−1
16 i f ( p1 ( i ) <= max( s o l . y ) )
17 p1 ( i +1) = 0 . 0 1 ∗ exp ( a∗ t ( i + 1 ) ) ;
18 else
19 break
20 end
21 end
22
23 % p2 ( t )
24 s o l 2 = dde23 (@APPDDE42dde , [ tau ] , @APPDDE42hist , [ t02 , tend ] ) ;
25
26 %F i g u r e
27 figure
28 plot ( s o l . x , s o l . y , ’ k ’ ) ; hold on
29 plot ( t ( 1 : i ) , p1 ( 1 : i ) , ’ C o l o r ’ , [ 0 , 1 5 3 , 7 6 ] . / 2 5 5 ) ; hold on
30 plot ( s o l 2 . x , s o l 2 . y , ’ C o l o r ’ , [ 2 5 5 , 1 2 8 , 0 ] . / 2 5 5 ) ; hold on
31 plot ( s o l . x , 1 / b∗ o n e s ( length ( s o l . x ) ) , ’−−k ’ )
32 text ( tend +0.01∗ tend , 2 . 0 1 , ’ 1/b ’ )
21
Bibliography
[1] Dimitri Breda, Stefano Maset, and Rossana Vermiglio. Stability of Lin-
ear Delay Differential Equations: A Numerical Approach with MATLAB.
Springer Science & Business Media, 2014.
[2] Jack K. Hale and Sjoerd M. Verduyn Lunel. Introduction to Functional
Differential Equations. Springer Science & Business Media, 1993.
[3] R. Kent Nagle, Edward B. Saff, and Arthur David Snider. Fundamentals of
Differential Equations. Pearson Education, Inc., 2008.
[4] Milind M. Rao and K.L. Preetish. Stability and hopf bifurcation analysis of
the delay logistic equation, 2012.
22