Professional Documents
Culture Documents
Quantitative Methods 3
1,20
1,00
0,80
0,60
0,40
0,20
0,00
t
3
7
11
15
19
23
27
31
35
39
43
47
Bachelor
We distinguish two ways in which time can be incorporated into a model: discrete and
continuous. In a discrete dynamic model the values of the dynamic quantities are only considered
at consecutive equidistant moments in time, such as days, months, years. We call these discrete
moments. Usually they are moments at which the quantities are recalculated or adjusted. For
example, when a capital K grows by the periodic adding of interest per year, then it is natural to
consider the value of K on an annual basis. Then the model variable or model quantity K can be
seen as a function of time t, where t indicates the number of years that have passed since the
deposit of the capital into the savings account. We indicate this by using the notation Kt for the
value of the capital, t years after its deposit. The consecutive values K0 ,K1,K2,,… thus form a
sequence which represents the growth of capital. Another example: in statistics we are interested
in time series models, actually based on observations at consecutive equidistant moments in time.
In a continuous dynamic model we are interested in the value of the model quantities at all
moments of time in an interval. Such a model is appropriate when adjustment of the model’s
variables takes place continuously or at a large number of moments in time that lie very closely
together. Thus we can speak of continuous (in the sense of: uninterrupted) adding of interest in
the case of the growth of a capital. This means that interest is being added “each moment”. In
practice this will probably come down to adding interest per day. In that case we write K(t) for
the value of the capital t years after the deposit. Since t [0, ) , K is interpreted as a function
defined on the interval [0, ) . Also in the discrete situation Kt can be considered as a function,
but now the domain consists of the set of natural numbers {0,1,2,3,…}.
The equations that arise in discrete dynamic models are called difference equations and those
arising in continuous dynamic models differential equations. In order to find an analytical
solution to these equations we need advanced mathematical techniques. In this course we will
only solve some simple difference and differential equations. As the technique of integration of
functions is useful for solving differential equations, we will deal with this subject as well. We
will use chapter 9 of the book of Sydsæter and Hammond (S&H) for the integration part. Here, in
section 9.8, you will also find a first introduction to differential equations.
Obviously, in a dynamic model it is important to know how the process evolves. Does it
converge to a stable situation? Therefore we are very interested in equilibrium points, actual
candidates for such a stable situation. Fortunately, besides the analytical approach there is a
qualitative approach, which is mainly graphical. In many cases it is possible to get an idea about
the dynamic behavior by just sketching a graph. Spreadsheet software like EXCEL turns out to be
very useful for simulating solutions and plotting graphs, especially in the discrete case. We will
show the use of it in many examples and exercises.
Knut Sydsaeter, Peter Hammond and others, Further Mathematics for Economic Analysis,
The book is a continuation on a higher level of the book Essential Mathematics for Economic
Analysis by the same authors.
Chapters 5, 6 and 7 are about differential equations and chapter 11 about difference
equations. This book is available at UM library.
William E. Boyce and Richard C. DiPrima, Elementary Differential Equations and Boundary
Value Problems.
This is a more advanced mathematics book, available at UM library.
Morris W. Hirsch, Stephen Smale and Robert L. Devaney, Differential equations, dynamical
systems and an introduction to chaos.
Solid mathematical background at a rather high level that may give you insight in the
arguments behind the theory. This book is available at UM library.
1 Discrete dynamics
In a discrete dynamic model the development of a quantity, say x, is followed step by step over
the time: we are interested in the sequence x0, x1, x2, …with which we indicate the values of
the quantity at equidistant moments in time t = 0, 1, 2, … (years, months, days, etcetera).
For example let K t be the value of an amount of €10.000,- after t years with a yearly interest
of 5%.
In such a model the development of the quantity is usually described as a relation between the
quantity's value at an arbitrary moment in time is and the quantity's value at earlier moments.
We call this a recursive definition. This dependence can be expressed in an equation for the
variables xt, xt-1, xt-2 etcetera. For example, an equation like xt 12 xt 1 12 xt 2 indicates that at
each moment the value of the quantity x is the average of the values attained by that quantity
at the two preceding moments.
And the equation Kt 1.05Kt 1 informs us that the value of the quantity K is at each moment
five percent more than that quantity's value at the preceding moment.
The two above-mentioned equations are called difference equations (for x), after the
alternative representation by differences xt xt 1 xt , the difference between two subsequent
values. For example, the equation Kt 1.05Kt 1 can also be written as Kt 1 0.05Kt 1 .
In this chapter we will give a classification of different types of difference equations. For
example, in the second equation above, the value at time t is only expressed in terms of the
value at time t-1, so one period earlier. Therefore we call them equations of the first order. If
the value at time t is expressed in terms of values at time t-2 and maybe t-1, then the equation
is of the second order, and so on. The variable t is the time variable and the variable
depending on t, here xt, is often called (dynamic) state variable. The central issue will be how
to investigate the behavior of the dynamic model. In some simple cases we will solve the
equations analytically, hence solve for xt as a function of t, defining the complete sequence x0,
x1, x2, …. A solution of a difference equation is simply a sequence, or function, xt that satisfies
the equation. We are especially interested in the behavior in the long run and the question
whether there exists an equilibrium value. You will experience, that often it is not necessary to
solve the difference equation analytically in order to know the long run behavior. A graphical
approach can help to see the development of the sequence. We will show how you can use
EXCEL to calculate and graph an initial run x1,x2,x3,…,xn of the sequence.
xt 3.7 xt 1 (1 xt 1 ) describes a nonlinear equation (we will later see, that it generates
complex, even so-called chaotic behavior).
A difference equation like xt 3xt 2 xt 4 is said to be autonomous, if time t does not occur
explicitly in the equation, but only as an index of the state variable. So, the equation xt t 2 xt 1
is nonautonomous.
A final characteristic has to do with the occurrence of terms that do not contain the state
variable at all. If each term in the difference equation contains the state variable, as in
xt 3xt 2 xt 4 , then we say, that the equation is homogeneous, otherwise inhomogeneous, as
for example xt 3xt 2 xt 4 4 .
Being aware of the characteristics of an equation is especially important when you are solving
the equation analytically.
A dynamic model may consist of one difference equation or more than one. In the latter case
several state variables play a role and the equations may be coupled, which means that
equations may contain more than one state variable. Consider for example the equations
xt 0.8 yt 1
yt 0.9 xt 1 0.6 yt 1
We call this a system of difference equations. In general a dynamic model, consisting of one or
more difference equations, is also called a dynamic system.
EXERCISES 1.1
Classify the following difference equations. Give all the characteristics.
a) xt 4 xt 2
b) Kt 0.3tKt21
c) Kt Kt21 t
d) Yt Yt 1 (t Yt 3 ) 1
Check that the sequence, or function, xt 10 2t is a solution of the difference equation in part
a).
starting or initial capital can be represented by K0. After one year interest is added for the first
time, namely 5% of K0, or 0.05K0. This increases the capital to K1 K0 0.05K0 1.05K0 , so
K0 0.05K0 .
For the next years, capital will grow in a similar way. This gives rise to the sequence
K1 1.05 K 0
K 2 1.05 K1
K 3 1.05 K 2
M
Here we see a 1st order difference equation, which is also linear and homogeneous. We have
seen capital growth models in the first year, see chapter 4 of QM2. Actually this is an example
of exponential growth and the analytical solution is well-known: Kt K01.05t . The analytical
solution is an exponential function of t. As we know the initial value K0, we can easily
determine Kt at each moment in time t, so at the end of year t.
It is easy to use EXCEL to calculate an initial run of the sequence. See the printout in figure
1.1 below in which you can read off the values for the first ten years. The first table shows the
calculated outcomes and the second one the cell formulas. In the graph the exponential
behavior of the process is clearly visible.
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 5
Kt
80000
60000
40000
20000
0
0 20 40 60 t
In both examples the difference equation describes the growth of capital. By giving an initial
value, a value at t = 0, the model quantity Kt will be uniquely determined at all times by the
first order linear difference equation.
1 DISCRETE DYNAMICS 6
A first order linear difference equation for x with constant coefficients is an expression of the
form
xt a xt 1 bt (t 1,2,3,...)
where the coefficient a 0 does not depend on t.
We definitely do not exclude the possibility of dependence on t for the so-called free
coefficient bt.
If bt = 0 for all t = 1, 2, 3, …, then the equation is homogeneous, otherwise inhomogeneous.
Notice that xt 0 (for all values of t) is always a solution of a homogeneous equation, namely
the solution with x0 0 . We call this the zero solution.
The general solution actually is a collection of all possible solutions to the equation if no
initial value has been given. The behavior of this dynamic process, i.e. the behavior of the
solutions to the equation, depends on the value of the coefficient a. If this value is between 0
and 1, then the value of the state variable xt will get smaller and smaller over time and finally
converge to 0 in the limit. Also for –1 < a < 0 the solution sequence will converge to 0, but
now the values will alternately be positive and negative, so we have an oscillatory or
alternating sequence. In both cases we call this limit 0 a stable equilibrium, as it is a limit
point towards which each solution converges. If a > 1, then the sequence will get larger and
larger and tend to infinity in the limit. Also for a < -1 it will not converge, but explode over
time in an alternating way. Finally, for a = 0 or a = 1 it is constant over time, 0 and x0
respectively, and for a = -1 it is alternately x0 and –x0.
Besides the analytical solution it is often clarifying to use pictures in order to get an idea of the
behavior of the dynamic system. A graphical presentation of the various situations is shown in
figure 1.3. These graphs show initial runs of the solution sequences depending on time t and
are called time paths. Also the solution sequences, or functions, are sometimes called time
paths. They can be generated immediately, if we put the value of the parameter a in a separate
cell for reference. We took x0 = 15 and t from 0 to 10.
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 7
EXERCISES 1.2
Give the general solution of the following difference equations:
1
a) yt yt 1 b) yt yt 1 0 c) a xt xt 1 0 with a 0
3
a
Ft [(1 r )t 1] ,
r
where the amount a is the annual deposit, r is the interest rate and t the number of years,
assuming the amount a is deposited at the end of each year.
1000
In this case we have a = 1000 and r = 0.05, so we get: (1.05t 1) 20000(1.05t 1) for
0.05
the future value of the amounts deposited at the end of each year. As we had already a deposit
1 DISCRETE DYNAMICS 8
of €1000 at the start of year 1, we have to add the future value 1000(1.05) t of this amount, so
the result is
Kt 21000(1.05)t 20000 (t = 0, 1, 2, …)
As you can easily check the first part of this solution is a solution of the corresponding
homogeneous equation Kt 1.05Kt 1 and the 2nd part, the constant number -20000, is itself a
solution of the inhomogeneous equation Kt 1.05Kt 1 +1000 . This is a general rule:
The general solution of an inhomogeneous difference equation can be written as the sum of
the general solution of the corresponding homogeneous equation and a solution of the
inhomogeneous equation. The latter is often called a particular solution.
Shorthand notation:
GIS = GHS + PS
(General Inhomogeneous Solution = General Homogeneous Solution + Particluar Solution)
The general solution of the 1st order linear difference equation xt axt 1 bt is
xt c at pt for t 1,2,3,...
where c is an arbitrary number and pt a particular solution of the inhomogeneous equation
itself. If the initial value x0 is given, then the constant c is uniquely determined.
Graphs of solution sequences for inhomogeneous difference equations can be obtained in the
same way as before.
Particular solution
We know how to find solutions to a homogeneous equation. But what can we say about a
particular solution pt ? Unfortunately this is not so simple and straightforward. It is only by
trial and error that we can hope to find it. But we have an important indicator, namely the free
coefficient bt in the difference equation. It will turn out that the form of bt can be used as a
handhold for finding a particular solution:
We will only provide some simple examples and not go deeper into this issue.
Examples 1.3
Constant free coefficient.
Consider again the equation Kt 1.05Kt 1 +1000 Applying the general rule we first solve
the homogeneous equation Kt 1.05Kt 1 , with general solution c1.05t and then try the
provisional solution pt, which in this case must be a constant, say pt = d. After substitution
in the inhomogeneous equation we get d 1.05 d 1000 , which has solution d = -20000.
So the general solution is Kt c1.05t 20000 . The value of c depends on the initial value
K0. If e.g. K0 = 1000, as before, than we find after substitution
1 DISCRETE DYNAMICS 10
1000 c1.050 20000 c 20000 , so c = 21000 and the unique solution is,
Kt 21000(1.05)t 20000 , as before. With K0 = 0 we find Kt 20000(1.05)t 20000
and with K0 = 2000 we will find Kt 22000(1.05)t 20000 .
Linear free coefficient.
A slightly different situation is described by Kt 1.05Kt 1 +100 5t , where the amount
added to the account yearly increases linearly, i.e. by a linear increasing function of t. The
general solution of the corresponding homogeneous equation will not differ from the one
before, but now it is not so easy to find a particular solution. Following the recipe for
finding a particular solution we will now try a linear function of t. A linear function of t
has the form a + b t. Substitution in the equation yields
a bt 1.05[a b(t 1)] 100 5t , with t 1,2,3,... , after some rearranging:
a bt 1.05a 1.05b 100 (1.05b 5)t . As this equation should hold for all t, this
means that the linear functions on both sides must be equal, hence intercept and slope of
the left-hand side must be equal to those of the right-hand side. This will give two
equations for a and b:
with solution a = -4100 and b = -100, as can easily be checked. So the general solution is
now Kt c (1.05)t 4100 100t . If we take K0 = 100, then the unique solution is
Kt 4200(1.05)t 4100 100t
Exponential free coefficient: simple case.
The equation xt 2 xt 1 3t 1 has c2t as general solution for the corresponding
homogeneous equation. According to the structure of the free coefficient we try k 3 as a
t
t 1 t 1
particular solution. Substitution gives k 3 2 k 3 3 . After dividing both sides by
t
Now, according to the recipe for finding a particular solution, we try pt t k 2t and
substitution gives t k 2t 2(t 1)(k 2t 1 ) 2t 1 t k 2t k 2t 2t 1 , simplified
k 2t 2t 1 . So k 2 and pt t 2t 1 . Hence the complete general solution is
xt c 2t t 2t 1 .
Constant free coefficient: more complicated case.
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 11
EXERCISES 1.3
Give the general solution of the following difference equations and the unique solution
corresponding to the initial value that is given, if so:
1
a) yt yt 1 20 and y0 100 d) Kt 1.05Kt 1 10(1.1)t
3
b) yt yt 1 2 and y0 5 e) Kt 1.05Kt 1 100 5t
Now we can easily check, that the linear 1st order equation xt f ( xt 1 ) with f ( x) ax b
b
has the equilibrium point x* , which is stable if a 1 .
1 a
An alternative graph
Besides the time path we may use another way to picture a 1st order dynamic system, namely a
plot of the relation between xt and xt-1. Such a graph is sometimes called a phase diagram of
the difference equation. It differs essentially from a time path graph, because there is no t-axis.
This graph turns out to be very useful for the analysis of equilibrium points. Take again our
example xt f ( xt 1 ) 0.5xt 1 3 . In the picture below you see the graph of the function
f ( x) 0.5x 3 , as well as the graph of the auxiliary function g ( x) x (‘the line y = x’).
Suppose, that the initial value is x0 = 4. Then starting at this value we find x1 by drawing a
vertical line (arrow) until we cross the graph at xt-value 1. Now we take this value as our new
xt-1-value. In the graph this point on the xt-1-axis can be found by drawing a horizontal line
until we intersect the line y = x. The corresponding value on the horizontal axis is x1 = 1. The
next value can be found in the same way: draw vertical line until the function value
f ( x1 ) 0.5x0 3 2.5 , then horizontal line until y = x and so on. You see immediately in
the picture, that the sequence is converging to a fixed point (in the neighborhood of) 2. As you
can see the convergence does not depend on the initial value: If we had taken x0 = 5, then we
could expect the same long-run behavior. The fixed equilibrium point attracts all the solutions.
That's why it is sometimes called an attractor.
3
xt
1 2 3 4 5 6
x1 x3 x4 x 2 x0
xt 1
1
FIGURE 1.4 Phase diagram of xt 0.5xt 1 3 with x0 = 4.
Also in the time path picture in figure 1.5 the converging property can quickly be read off.
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 13
4,50
4,00
3,50
3,00
2,50
2,00
1,50
1,00
0,50
0,00
0 1 2 3 4 5 6 7 8 9 10
As we saw before, crucial for the convergence of the system xt f ( xt 1 ) axt 1 b is the
value of a: if a 1 , then the system will converge. Notice that a is the slope of the linear
function f.
In the xt 1 vs. xt graph in figure 1.6 you see what happens, if a = -1.5. No matter what the
initial value is, the solution will diverge away from the fixed point x* = 1.2. Such a fixed point
is often called a repellor. Of course, if the initial value is equal to the fixed-point value, x0 =
1.2, then the sequence 'converges', it sticks to the value 1.2. Now it is easy to understand, that
for a 1 the system will not converge (except for the initial value being equal to the fixed-
point value).
We saw an example for a = 1 before: xt xt 1 +10 has the general solution xt = x0 + 10t.
3
xt
1 1 2 3
x3 x1 x0 x2 x4
xt 1
1
FIGURE 1.6 Phase diagram of xt 1.5xt 1 3 with x0 = 1.5.
Periodic solutions
A special situation arises, when a = -1. Consider for example the equation xt xt 1 4 . As
can easily be found, the equilibrium point is x* = 2 and the general solution is xt c (1)t 2 .
1 DISCRETE DYNAMICS 14
This solution does not converge (except for x0 = 2, for then c =0). If we take x0 = 3, then the
solution function is xt (1)t 2 , so the solution sequence is 3, 1, 3, 1, 3, … It is a so-called
periodic or cyclic solution, as after some fixed number of time periods the sequence repeats
Here this number is equal to two and the solution is called a two-cycle or a two-period limit
cycle. See the figures below.
xt
3,50
3,00
2,50
2,00
1,50
1,00
0,50
0,00
0 1 2 3 4 5 6 7 8 9 10 11 t
xt 4
1 1 2 3 4 5
xt 1
1
FIGURE 1.8 Phase diagram of xt xt 1 4 with x0 = 3.
Summarizing
Suppose that xt f ( xt 1 ) axt 1 b has solution xt c at p .
If 1 a 1, then xt converges to p (p is stable equilibrium)
(if 1 a 0, then xt is oscillating but converging to p)
If a 1, then xt is divergent
If a 1, then xt is oscillating and divergent
If a 1, then xt is constant if b 0, else divergent
If a 1, then xt is alternating ( periodic solution, period 2)
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 15
b
Note 1: x* is solution of x* f ( x*) a x * b , so x* (only if a 1 )
1 a
Note 2: x* = 0 is always an equilibrium of the homogeneous system! (the case b = 0)
EXERCISES 1.4
Determine the long run behavior of the equilibrium points, if they exist, of the dynamic
systems in exercises 1.3.
D 12 P 160
S aP 40
D S
A second order linear difference equation for x with constant coefficients is an expression of
the form
xt c xt 1 d xt 2 bt (t 2,3,4,...)
The general solution of an inhomogeneous difference equation can be written as the sum of the
general solution of the corresponding homogeneous equation and a particular solution, i.e. a
solution of the inhomogeneous equation. In short:
GIS = GHS + PS
That's why we will again split up the work in solving the homogeneous equation and finding a
particular solution.
t c t 1 d t 2
2 c d 0 ,
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 17
which is a quadratic equation in . This equation is called the characteristic equation of the
system and can have two, one or no so-called real solutions, or roots. As you know these roots
can be found with the help of the "abc-formula", which here gives the result
c c 2 4d
1,2
2
(see the first one of examples 1.4 below)
The number of real roots depends on the sign of the discriminant c 4d , so two real
2
roots if 0 , one if 0 and zero if 0 . If it has only one real root, then actually the
equation has two identical roots. If there are no real roots, mathematicians say, that properly
two roots exist and they call them complex roots. We will not further deal with the subject of
complex numbers during this course.
We will see, that for every value of two essentially different solutions for the difference
equation can be found, called basic solutions. This means that these solutions cannot be
written as a multiple of each other. Solutions with this property are often called independent
solutions. An important property, which we will not prove here as it comes from “higher
mathematics”, says:
Every solution of a homogeneous 2nd order linear difference equation can be written as a linear
combination of two basic, independent solutions.
Examples 1.4
0 . The difference equation xt 5 xt 1 6 xt 2 has characteristic equation
2 5 6 0 with 1 and roots 1 2 and 2 3 . As the characteristic equation
arose from trying t as a solution, it is immediately clear that 1t 2t and 2t 3t are
solutions of the difference equation. So they are the basic solutions and because of the
aforementioned property we know that every solution is a linear combination of these
basic solutions. Hence the general solution can be written as
xt k1 1t k2 2t k1 2t k2 3t , with k1 and k2 arbitrary real numbers (parameters of
the solution).
1
0 . The difference equation xt xt 1 xt 2 has characteristic equation
4
t
2 14 0 with 0 and root 12 . It is clear that t 1
is a solution of the
2
difference equation. But the property says that there are two basic solutions. Now the
t
other basic solution turns out to be t t t 1
(this can easily be checked by
2
1 DISCRETE DYNAMICS 18
substitution into the equation). Hence the general solution can be written as
t t
xt k1 t k2 t t k1 1 k2 t 1 , with parameters k1 and k2.
2 2
possible to give two basic solutions to the equation. These solutions turn out to have
the form r t sin t and r t cos t , so the trigonometric functions sin and cos play a
role here. We will give no explanation of the origin of these solutions, but they can be
easily verified to be so (if you know your trigonometric rules). The most important
thing to notice is, that solutions show periodic behavior, and that r d 2 . Hence
the general solution can be written as
Summarizing:
The general solution of the homogeneous 2nd order linear difference equation
xt c xt 1 d xt 2 is determined by the solutions of the characteristic equation
2 c d 0
If c 4d 0 , then the characteristic equation has two solutions 1 and 2 and the general
2
solution is
xt k1 1t k2 2t
If 0 , then the characteristic equation has one solution and the general solution is
xt k1 t k2 t t
If 0 , then the characteristic equation has no real solutions and the general solution will
contain sin and cos functions:
xt k1 r t sin t k2 r t cos t , with r d
If we know the initial values x0 and x1 then the solution is uniquely determined.
The in case 0 is no simple and obvious expression and will not be given here. It can be
found in most literature about this subject. Besides, for the convergence of solutions, which is
a main issue in this course, the value of r turns out to be decisive.
Notice that we need two initial values to single out a unique solution, as the general solution
contains two parameters.
EXERCISES 1.5
Give the general solution of the following difference equations:
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 19
a) yt 3 yt 1 yt 2 b) yt 12 yt 1 36 yt 2 c) xt 2 xt 1 xt 2
EXERCISES 1.6
Give an indication of the form of the general solution of the difference equation
Kt 4Kt 1 8Kt 2
xt c xt 1 d xt 2 b
x* c x * d x * b
b
which gives x* (if 1 c d 0 ). Looking at the summary for a general solution of
1 c d
a homogeneous equation we see that for 0 the values of the roots of the characteristic
equation are crucial, whereas for 0 the value of r d is important. An obvious,
general rule is the following (no further explanation):
Consider the 2nd order difference equation with constant free coefficient xt c xt 1 d xt 2 b .
Let be the discriminant of the characteristic equation of the corresponding homogeneous
equation.
If for 0 both 1 1 and 2 1 , then solutions converge to the equilibrium point.
If for 0 we have 1 , then solutions converge to the equilibrium point.
If for 0 we have r 1 , then solutions converge to the equilibrium point.
In all cases we call the equilibrium point (globally) stable.
1 DISCRETE DYNAMICS 20
Examples 1.5
Consider the difference equation xt 5 xt 1 6 xt 2 8 . As we saw before, the
corresponding homogeneous equation has the characteristic equation 2 5 6 0 ,
with roots 1 2 and 2 3 , and the general solution xt k1 2t k2 3t , with k1 and k2
arbitrary real numbers. Now try a constant s as particular solution. Substituting and
solving gives: s 5 s 6 s 8 , so s 4 , which is also the equilibrium point. Hence,
the general solution is xt 4 k1 2t k2 3t , which is clearly not converging, as
1 2 1 and 2 3 1 . The equilibrium is unstable. A last remark: if initial values
were given, then there was only one unique solution. For example, if x0 3 and
x1 3 , then substitution gives two equations for k1 and k2
3 4 k1 k2
3 4 2k1 3k2
with solutions k1 2 and k2 1 and the unique solution of the system is
xt 4 2t 1 3t .
Consider the difference equation xt 5 xt 1 6 xt 2 2t . As we saw before, the general
solution of the homogeneous equation is xt k1 2t k2 3t , with parameters k1 and k2.
Because the free coefficient is an exponential function, at first sight we will be
tempted to try as a particular solution pt c 2t . But, you will see that this will not
work (actually because it is a solution of the homogeneous equation), so multiply by t
and try pt c t 2t . Substitution gives: c t 2t 5c(t 1)2t 1 6c(t 2)2t 2 2t .
5 6
Deviding this whole equation by 2t gives c t c(t 1) c(t 2) 1 with solution
2 4
t 1
c 2 . Hence, the general solution is xt t 2 k1 2 k2 3 , which is clearly not
t t
can also be observed in the EXCEL output below, where we took x0 4 and x1 10
t 2 t 3
(verify that this will give the solution xt 8 1 t 1 ).
2 2
1.3 SECOND ORDER LINEAR DIFFERENCE EQUATIONS 21
xt
12,00
10,00
8,00
6,00
4,00
2,00
0,00
0 1 2 3 4 5 6 7 8 9 10 11 12 13 t
1
FIGURE 1.9 Table and time-path for xt xt 1 xt 2 2 .
4
discriminant 2.24 . Now we know, that the general solution looks like
xk k1 r t sin t k2 r t cos t with r d 0.9 . A particular solution can be found
to be pt 2.46914 . Hence the general solution can be written as
xk k1 (0.9)t sin t k2 (0.9)t cos t 2.46914 . Below you can see that this
converges to the equilibrium point 2.46914 as a dampening wave.
xt
5,00
4,00
3,00
2,00
1,00
0,00
0 1 2 3 4 5 6 7 8 9 101112131415161718192021222324252627
t
EXERCISES 1.7
Give the general solution of the following difference equations, and, in a) and b), the solutions
corresponding to the initial values.
a) yt 12 yt 1 36 yt 2 50, y0 3, y1 20 c) Kt 2Kt 1 Kt 2 1
b) xt 5xt 1 6 xt 2 2 3t 1 , x0 2, x1 48 d) xt 3xt 1 xt 2 t 4
In a) and b), determine the first 10 values of the solution sequences with the help of EXCEL.
1 DISCRETE DYNAMICS 22
xt 0.95 xt 1 0.10 yt 1
yt 0.05 xt 1 0.90 yt 1
This is clearly a linear system, consisting of two 1st order linear difference equations with two
dynamic variables. Generally linear systems are presented in a short matrix and vector notation. If
we describe the situation at the end of month t by the state vector
x
st t ,
yt
st M st 1 ,
0.95 0.10
where the matrix M is called the transition matrix.
0.05 0.90
How to analytically solve linear systems in general is beyond the scope of this course. In the
theory of difference and differential equations so-called eigenvalues and eigenvectors are generally
used to solve these systems, which belong to the mathematics field of Linear Algebra.
In simple cases like our example the system can also be transformed into one difference equation
for one of the dynamic variables.
EXERCISE 1.8
Transform the transition model into one difference equation for xt , by a suitable substitution, and
determine the general solution for xt .
Also derive the general solution for yt . What is the long run behavior?
Of course, if you want to get a quick idea of the model’s behavior, you may again invoke EXCEL.
1.5 NONLINEAR EQUATIONS 23
EXERCISE 1.9
Make a table in an EXCEL worksheet of the first 25 values of the sequences for xt and yt. Also
plot both time paths. Use x0 = 500 and y0 = 2000.
Phase diagram
In the case of systems of difference equations we have, besides time paths and xt-1 vs. xt phase
diagrams, the option to plot xt against yt. These plots are also called phase diagrams, as they do not
contain a t-axis, and they can easily be produced by EXCEL (choose select scatter plot). After
some formatting the result for our transition model may look like this:
2500
yt
2000
1500
1000
500
0
0 500 1000 1500 2000
xt
f ( x) r x(1 x)
xt r xt 1 (1 xt 1 )
1 DISCRETE DYNAMICS 24
We will experience, that long run behavior depends heavily on the parameter r and the initial
value.
Let us first have a look at an example where r = 1.8 and x0 = 0.9. See figure 1.12.
0.6 xt
xt
1,00
0.4
0,80
0,60
0.2 0,40
0,20
0,00
0.2 0.2 0.4 0.6 0.8 1 1.2
xt
0 1 2 3 4 5 6 7 8 9 10 11
0.2
1 t
FIGURE 1.12 Phase diagram and time-path for r = 1.8 and x0 = 0.9.
4
The solution clearly converges to the equilibrium point x* , which is a solution of
9
x f ( x) 1.8 x(1 x)
What can generally be said about the behavior of the system at an equilibrium point?
If we try to solve x f ( x) r x(1 x) , then we will find two solutions (if r 0 ), namely x* 0
1
and x* 1 . Hence there is only a positive equilibrium point, if r > 1.
r
Recall from the linear case, that an equilibrium point turned out to be stable if the slope of the line
was between –1 and 1, with oscillating solutions for a negative slope. In the nonlinear case the
function f does not have a fixed slope, but it seems obvious, that here the relevant slope is the slope
4
of the tangent line at the equilibrium point. In our example with r = 1.8 we find f '( ) 0.2 , nicely
9
corresponding to the non-oscillatory convergence of the solution. See figure 1.13.
0.6
xt
0.4
0.2
Actually, in the nonlinear case we are investigating the linear approximation of the difference
equation around an equilibrium point x*. As you may remember the linear approximation of f
1.5 NONLINEAR EQUATIONS 25
around x* is the linear function g ( x) f ( x*) f '( x*)( x x*) with slope f '( x*) (see Section
7.4 of the S&H book).
For f ( x) r x(1 x) the slope at x* is f '( x*) r 2r x * , so at x* 0 it is f '(0) r and at
1 1
x* 1 it is f '(1 ) 2 r .
r r
However, as the slope is not constant, it may also depend on the initial value what the eventual
behavior will be. But for the smooth (differentiable) function f we may expect the obvious
behavior if the initial value x0 is close enough to the equilibrium point. As the behavior depends on
the initial value, we are talking of local properties:
If solutions, starting close to the equilibrium point x*, converge to it, then we call x* a locally
stable equilibrium point. If solutions, irrespective the initial value (excluding x*) diverge from x*,
then it is called unstable.
We cannot formulate a general statement for points that satisfy f '( x*) 1 . These points need
further investigation, which, however, is beyond the scope of this course.
For a linear function f, yielding a linear difference equation, stability of x* does not depend on the
initial value. If in this case x* is stable, it is sometimes called globally stable.
1
If f ( x) r x(1 x) , then we can discern the following cases for the equilibrium point x* 1 :
r
if 0 r 1 then 2 r 1, so x * is unstable
if 1 r 2 then 0 2 r 1, so x * is locally stable (no oscillation)
if 2 r 3 then 1 2 r 0, so x * is locally stable (oscillatory)
if r 3 then 2 r 1, so x * is unstable
The other equilibrium point x* 0 is obviously locally stable if 0 r 1 , as can be seen in the
following picture with r = 0.8 and x0 = 0.6.
xt
1 DISCRETE DYNAMICS 26
xt
0.2
0,80
0.1 0,60
0,40
0.25 0.25 0.5 0.75 1 0,20
0.1 0,00
xt 1 0 1 2 3 4 5 6 7 8 9 10 11
0.2 t
FIGURE 1.14 Phase diagram and time-path for r = 0.8 and x0 = 0.6.
An example with 2 r 3 with clear oscillatory convergence is given in the next figure.
0.8
xt
0.6 0,80
xt
0.4 0,60
0,40
0.2
0,20
0,00
0.2 0.2 0.4 0.6 0.8 1 1.2 0 1 2 3 4 5 6 7 8 9 10 11
0.2
xt 1 t
FIGURE 1.15 Phase diagram and time-path for r = 2.8 and x0 = 0.2.
The last case, with r 3 , turns out to demonstrate very interesting behavior. Look for example at
the following example, with r 3.7 and x0 0.2 .
1
1,00
0.8 0,90
0,80
0.6 0,70
xt 0,60
0,50
0.4
0,40
0,30
0.2 0,20
0,10
0,00
0.2 0.2 0.4 0.6 0.8 1 1.2
xt 1
0.2
FIGURE 1.16 Phase diagram and time-path for r = 3.7 and x0 = 0.2.
There seems to be a repeating pattern in the time-path pointing to a periodic solution, but a closer
look contradicts periodic behavior (nevertheless it may be periodic with a large number of
periods). However, periodic solutions may very well be possible. Look for example at the
following pictures, with r 3.1 and r 3.55 respectively.
1.5 NONLINEAR EQUATIONS 27
1
0,90
0.8 0,80
0,70
0.6 0,60
xt
0,50
0.4 0,40
0,30
0.2 0,20
0,10
0,00
0.2 0.2 0.4 0.6 0.8 1 1.2
xt 1
0.2
FIGURE 1.17 Phase diagram and time-path for r = 3.1 and x0 = 0.25.
1
1,00
0.8 0,90
0,80
xt 0.6
0,70
0,60
0,50
0.4
0,40
0,30
0.2 0,20
0,10
0,00
0.2 0.2 0.4 0.6 0.8 1 1.2
xt 1
0.2
FIGURE 1.18 Phase diagram and time-path for r = 3.55 and x0 = 0.53.
In both cases a periodic pattern can clearly be observed: a two-period limit cycle and a four-period
limit cycle. Hence, although solutions are not converging, they may show interesting periodic
characteristics.
If, for r 3 , solutions do not have periodic patterns, then we talk of chaos. This seems to occur for
r 3.7 , as we saw before. One final example of chaos shows that chaotic patterns may be very
strange:
1
1,20
0.8
1,00
xt 0.6 0,80
0.4 0,60
0,40
0.2
0,20
0,00
0.2 0.2 0.4 0.6 0.8 1 1.2
t
2
5
8
11
14
17
20
23
26
29
32
35
38
41
44
47
xt 1
0.2
FIGURE 1.19 Phase diagram and time-path for r = 3.94 and x0 = 0.99.
There is a lot of mathematical literature about nonlinear dynamics, especially about these kinds of
hill-shaped relations between xt and xt-1. Also in economic theory concerning dynamic models
chaotic behavior has become popular.
Pt a xt (1 xt )
If we suppose, that for the next period the firm devotes a fixed proportion b of its profit to
advertising, so xt 1 b Pt , then we will get exactly the nonlinear model described above:
Pt b Pt 1 (1 Pt 1 )
EXERCISE 1.10
Try to reproduce some of the time-path pictures in EXCEL and play around a little with the
parameter and initial values. Especially try some different initial values in a chaos situation and
experience that small differences in the initial values may have huge consequences.
EXERCISE 1.11
In a former example (see figure 1.14) we saw that a 2-cycle arises for xt f ( xt 1 ) r xt 1 (1 xt 1 ) ,
when r = 3.1. So in the long run solutions jump up and down between two values, say z1 and z2, so
that z2 f ( z1 ) and z1 f ( z 2 ) . Actually these two values are fixed points of the repeated
function h( x) f ( f ( x)) , so solutions of the equation x f ( f ( x)) . Calculate these two values.
Hint: if 𝑥 ∗ is a solution of 𝑓(𝑥) = 𝑥, then it is also a solution of 𝑓(𝑓(𝑥)) = 𝑥.
xt xt 1 (a c yt 1 ) xt 1
yt yt 1 (b d xt 1 ) yt 1
with c 0 and d 0 .
EXERCISE 1.12
Investigate this model with the help of EXCEL. For example make time path plots for xt and yt and
a phase diagram (xt vs. yt) for a 0.06, b 0.18, c 0.0006 and d 0.003 , with initial values
1.5 NONLINEAR EQUATIONS 29
x0 65 and y0 120 . In order to get nice pictures calculate a large run of values, e.g. over 250
months. Can you determine an equilibrium point, and , if so, does it seem stable?
Y C I
C cY A
Here the model quantities Y, C, I and A, expressed for example in billions of euros, have the
following meaning:
Y is national income,
C is total consumption,
I is total investment and
A is autonomous consumption (not depending on income).
Furthermore, c is a measure for the change of C resulting from a change in Y, and it is called
marginal consumption quota.
We now wish to devise a dynamic model that is based on the assumption that total consumption
reacts by a one year's delay to changes in national income. This means that we must devise a
dynamic model in which time t is measured in years from a certain initial moment t = 0.
In addition, we will assume that total investment I depends on t and that the autonomous
consumption A is constant over time.
a) Formulate the dynamic model and show that from this model a first order linear difference
equation can be derived, namely
𝑌𝑡 = 𝑐𝑌𝑡−1 + 𝐼𝑡 + 𝐴
Now suppose that the marginal consumption quota c is equal to 0.7, the yearly investment is
constant 𝐼𝑡 = 𝐼 = 60 and 𝐴 = 90. Further, take as an initial value Y0 = 600.
b) Calculate the first 20 values of Yt and Ct in an EXCEL spreadsheet. Use reference cells for
Y0 and c, so that you can directly re-use your spreadsheet later on. Make plots (time paths)
of these sequences. Do they tend to stabilize (converge)? If so, around which values they
do so? What is the influence of the initial value Y0 on the behavior of the sequences (you
may play around somewhat with the initial value).
Now suppose that investment is not a constant anymore but a function It of t increasing linearly
with time t according to the equation It 60 9t , keeping 𝑐 = 0.7, 𝐴 = 90 and 𝑌0 = 600.
e) Solve the difference equation in a). Describe the behavior of the solution with words.
Here A is again the autonomous consumption, the marginal consumption quota, and the so-
called accelerator.
.
4
f) Take 𝐴 = 100, 𝛾 = 0.9, 𝛿 = 9, I 0 20 and C0 10 . Use EXCEL to calculate values for
Yt, Ct and It for t = 0, 1, 2, 3, …, 40. Reserve separate cells for the model parameters ,
and A. Plot the sequence for Yt in a time path graph. What is the behavior of the sequence?
What happens if you take a higher value for ?
g) Show that from the accelerator-multiplier model the following 2nd order difference
equation for national income Yt can be derived:
𝑌𝑡 = 𝛾(1 + 𝛿)𝑌𝑡−1 − 𝛿𝛾𝑌𝑡−2 + 𝐴
4
Take 𝐴 = 100, 𝛾 = 0.9 and 𝛿 = 9, and as initial values Y0 1300 and Y1 1300 .
h) Determine the analytical solution of the equation at g) and check the long run behavior.
Use EXCEL to calculate the values of Yt for t = 2, 3, 4, …, 40 and plot the time path graph
for this sequence and compare to the analytical solution.
Take 𝐴 = 100, 0.75 and 3 , and initial values Y0 200 and Y1 250 .
i) Redo h) for this case. Consider only t = 2, 3, 4, …, 10 in the EXCEL calculations.
Now take 𝐴 = 100, 0.8 and 0.5 , and initial values Y0 200 and Y1 250 .
j) Repeat h) for this case, as far as possible. Consider only t = 2, 3, 4, …, 10 in the EXCEL
calculations.
Set 0.5 and leave as an unknown parameter in the model. Keep 𝐴 = 100.
k) What is the equilibrium point of the equation? For which values of do you expect the
general solution to contain trigonometric functions (sin and cos)? Do you think the
1.5 NONLINEAR EQUATIONS 31
equilibrium point is stable in this case? Determine the form of the general solution of
the difference equation at g), if we take 0.8 (see the 4th one of Examples 1.5).
We now extend the model with a role for the government. We consider a closed macro-economic
model with constant government expenditure and a tax on national income. The model equations
are as follows:
Yt Ct I t Gt
Ct A c Yt 1 (0 c 1)
b
Y b Y T
t t t
t
T Y t (0 1)
G G
t
I t I
Here Y represents national income, Yb spendable income, I investment, G government expenditure
and T tax. The model parameters A, c and respectively represent autonomous consumption,
marginal consumption and marginal tax quota.
Table of contents
2 Continuous dynamics ....................................................................................................................2
2.1 Introduction ........................................................................................................................... 2
The basic model .........................................................................................................................2
Classification of differential equations.......................................................................................5
Examples 2.1 ..........................................................................................................................5
Time paths, solutions and equilibria...........................................................................................6
Example 2.2............................................................................................................................6
Example 2.3............................................................................................................................7
2.2 First order linear differential equations ............................................................................... 9
2.3 Second order linear differential equations ............................................................................ 9
Example 2.4..........................................................................................................................10
General solution homogeneous equation .................................................................................10
What happens when D < 0?......................................................................................................11
Example 2.5..........................................................................................................................13
Inhomogeneous equations ........................................................................................................13
Example 2.6..........................................................................................................................14
Extra conditions........................................................................................................................17
Example 2.7..........................................................................................................................17
Equilibrium and stability ..........................................................................................................18
2.4 Nonlinear differential equations. ........................................................................................ 19
Simple differential equations ...................................................................................................20
Equilibria ..................................................................................................................................20
Phase diagrams and stability ....................................................................................................20
Example 2.8..........................................................................................................................20
Application 2.1 In-population dynamics .............................................................................22
Example 2.9 Linear simple differential equations ................................................................24
Application 2.2 The Solow model .......................................................................................24
Application 2.3 Logistic growth...........................................................................................27
2.5 Systems of differential equations ......................................................................................... 27
Example 2.10........................................................................................................................27
Equilibria ..................................................................................................................................28
Phase diagrams .........................................................................................................................30
2.6 Linear systems ..................................................................................................................... 32
Example 2.11........................................................................................................................33
Phase diagrams revisited ..........................................................................................................33
Convergence and stability ........................................................................................................34
The associated 2nd order equation in one variable. ...................................................................37
Example 2.12........................................................................................................................37
Application 2.4 The tâtonnement process ............................................................................39
2 2 CONTINUOUS DYNAMICS
2 Continuous dynamics
2.1 Introduction
This part on Continuous dynamics connects the part on Integration and the part on Discrete
dynamics. In this introduction, we will first have a look at the basic continuous dynamic model, the
natural growth model. We will see that a solution is easy to find, using our knowledge of
integration. Also some more realistic growth models will be solved, the limited growth model and
the logistic growth model. This is done by a clever substitution that makes it again a simple natural
growth model.
Whereas a discrete dynamic model is described by difference equations, a continuous dynamic
model is described by differential equations. Also differential equations can be divided into
different groups, a classification that is similar to the discrete case. And again we will study
solutions as well as equilibrium points.
In sections 2.2 and 2.3 we will deal with first and second order linear differential equations of one
dynamic variable. In section 2.4 we also consider nonlinear models for one variable.
In sections 2.5 and 2.6 systems of differential equations with two dynamic variables will be
studied.
𝐾 ′ (𝑡) = 𝑟 𝐾(𝑡)
Here 𝐾′(𝑡), growth of capital, is proportional to the magnitude 𝐾(𝑡) of the capital, with growth
rate r. The variable t denotes time. Time could be measured in years, hours or whatever time units,
starting from an initial time moment 𝑡 = 0, the moment that an initial amount 𝐾0 has been
deposited at a savings account.
Natural growth
The basic model is also used for a constantly growing population, and is generally referred to as
the natural growth model. Usually derivatives with regard to time are denoted with a “dot” instead
of a “prime”, so we get as the general model
𝑥̇ (𝑡) = 𝑟 𝑥(𝑡)
𝑥̇ (𝑡)
The growth rate 𝑟 = is also called relative rate of change.
𝑥(𝑡)
2.1 INTRODUCTION 3
We use our knowledge of integrals to solve this equation. We are going to take the antiderivative
of the relative rate of change on both sides of the definition.
𝑥̇ (𝑡)
∫ 𝑟 𝑑𝑡 = ∫ 𝑑𝑡
𝑥(𝑡)
Now the left hand side (LHS) is easy to find if we assume that r is a constant: ∫ 𝑟 𝑑𝑡 = 𝑟 𝑡 + 𝑐1 .
To the right hand side (RHS) we apply integration by substitution of 𝑦 = 𝑥(𝑡). Then 𝑑𝑦 = 𝑥̇ 𝑑𝑡
𝑥̇ (𝑡) 1
and the RHS is transformed into ∫ 𝑑𝑡 = ∫ 𝑑𝑦 = ln|𝑦| + 𝑐2 = ln|𝑥(𝑡)| + 𝑐2 . Here 𝑐1 and 𝑐2
𝑥(𝑡) 𝑦
are constants of integration. So we get
ln|𝑥(𝑡)| = 𝑟 𝑡 + 𝑐
Here we combined the constants of integration into c. Taking the exponential function on both
sides gives the result
|𝑥(𝑡)| = 𝑒 𝑟𝑡+𝑐 = 𝑒 𝑐 𝑒 𝑟𝑡
We observe that |𝑥(𝑡)| is a positive constant times 𝑒 𝑟𝑡 . But, then we can also write a general
constant A times 𝑒 𝑟𝑡 for 𝑥(𝑡):
𝑥(𝑡) = 𝐴 𝑒 𝑟𝑡
So we did not find one unique solution but a set of solutions. Similar to the discrete case we call
this the general solution.
The basic model of natural growth is also referred to as the exponential growth model.
The graph of a solution is given below:
Here the horizontal axis is the t-axis and the curve represents the corresponding values 𝑥(𝑡). Here
we took 𝐴 > 0 and 𝑟 > 0. Because 𝑥(𝑡) is a function of time, we call this function, and also its
graph, a time path.
4 2 CONTINUOUS DYNAMICS
Limited growth
With a positive growth rate a population that behaves according to the natural growth model will
grow exponentially to infinity. However, often we assume that there is an upper limit for the
population size, called the carrying capacity K. This can be modeled as follows:
This is called the limited growth model. The closer the population size 𝑥(𝑡) is to K, the slower is
the growth. Actually the population growth is proportional to the deviation from the carrying
capacity. Now the general solution to this model can be found by transforming the model into a
natural growth model by the smart substitution 𝑢(𝑡) = 𝐾 − 𝑥(𝑡). Then 𝑢̇ (𝑡) = −𝑥̇ (𝑡) and we have
the following equation for 𝑢(𝑡):
𝑢̇ (𝑡) = −𝑎 𝑢(𝑡)
with general solution 𝑢(𝑡) = 𝐴 𝑒 −𝑎𝑡 , so the general solution for 𝑥(𝑡) is
𝑥(𝑡) = 𝐾 − 𝐴 𝑒 −𝑎𝑡
Logistic growth
A next step in refining the growth model could be the combination of exponential growth and
limited growth. We want growth to be exponential if the population is small, and limited if the
population approaches a carrying capacity K. Consider the following dynamic model:
𝑥(𝑡)
𝑥̇ (𝑡) = 𝑟 𝑥(𝑡) (1 − )
𝐾
This model is referred to as the logistic growth model. Also this model can be transformed into a
𝐾
natural growth model by the clever substitution 𝑢(𝑡) = −1 + 𝑥(𝑡). Applying the chain rule makes
2.1 INTRODUCTION 5
𝐾
𝑢̇ (𝑡) = − 2 𝑥̇ (𝑡). From our dynamic model we know what 𝑥̇ (𝑡) is in terms of 𝑥(𝑡). So we
(𝑥(𝑡))
𝐾 𝑥(𝑡)
can rewrite 𝑢̇ (𝑡) = − 2 𝑟 𝑥(𝑡) (1 − 𝐾
), which can be simplified to 𝑢̇ (𝑡) = −𝑟 (−1 +
(𝑥(𝑡))
𝐾
𝑥(𝑡)
) = −𝑟 𝑢(𝑡), with general solution 𝑢(𝑡) = 𝐴 𝑒 −𝑟𝑡 . Finally, for 𝑥(𝑡) we find
𝐾
𝑥(𝑡) =
1 + 𝐴 𝑒 −𝑟𝑡
This is the logistic function. Parameters are the carrying capacity K, the constant of integration A
and the growth rate r. The graph for positive values of the parameters looks as follows:
x, x, x,x,
of x . It is said to be of 1st order because, besides x itself, it only involves the 1st order derivative x&
of x. And it is called homogeneous because it does not contain any expressions besides multiples
of x and its derivatives. Besides, we may observe the equation to be autonomous, as x&is given as
a function of x only: x f ( x ) r x . The time-variable t does not occur explicitly in the
differential equation, but only as an argument of the (dynamic) state variable x and its derivatives.
Examples 2.1
The differential equation
is for example a 3rd order linear differential equation. It is not homogeneous because of the
expression –5 in the equation.
The logistic equation
x (t )
x (t ) rx(t )1
K
is a 1st order homogeneous equation. The equation is not linear though because it contains a
r 2
quadratic term x (t ) as you can see when you expand the right-hand side of the equation.
K
Example 2.2
Consider the differential equation
2 x t x 2 x.
(We will often suppress the time parameter in our equations and write e.g. x instead of x(t ) ).
The time path x(t ) t 2 4t is a solution to this differential equation, since x (t ) 2t 4 and
x(t ) 2 , and indeed substitution shows that
2x 2t 2 4t 2t 2 8t
t x 2 x t 2t 4 2 2 2t 2 8t
EXERCISE 2.1
In the following exercises show that the given time path
a) x(t ) t 2 3 is a solution to the differential equation 2 x tx 3x .
b) x(t ) t 3 4t 5 is not a solution to the differential equation 3x tx x 2x .
c)
x(t ) t 1 is a solution to the differential equation x 1x 1 t 2 2t x .
d) x(t ) 1 Ae at is a solution to the equation x ax a for each value of A.
Also classify all the differential equations mentioned in a) to d).
2.1 INTRODUCTION 7
An equilibrium of a differential equation is a point x * such that the constant time path x(t ) x *
is a solution to the differential equation.
Hence, an equilibrium is a constant solution. See also the section Discrete dynamics.
Example 2.3
We already saw in exercise 2.1c) that the time path x(t ) t 1 is a solution to the differential
equation x 1x 1 t 2 2t x . But this differential equation has more solutions. Take for
example the constant time path x(t ) 1 . Since x (t ) 0 (and all its other derivatives are equal to
zero as well by the way) it is easy to check that this is indeed a solution to the differential equation.
And more can be done with this observation. If you think about it for a moment it is clear that any
constant time path will have all its derivatives equal to zero. Which automatically implies that a
point x * is an equilibrium of the differential equation x 1x 1 t 2 2t x precisely when it
satisfies the equation
x * 1x * 1 0.
The reason for this is that the right-hand side of the differential equation must necessarily be equal
to zero in an equilibrium because x 0 in such a point. So, the points x* 1 and x* 1 are the
only two equilibria of this differential equation.
Of course this insight gives us a way to find (all) equilibria of other differential equations as well,
as you will see in the next exercise.
EXERCISE 2.2
Compute all equilibria of the following differential equations.
a) x 2 xx3 2 x tx .
b) x tx x .
c) x 2 tx x .
d) x 2 xx 3 2 x t .
e) x 0 .
....
f) xx xx xx 5xx x .
An equilibrium x * of a differential equation is globally stable if for every solution x(t ) of that
differential equation we have that
lim x(t ) x *.
t
The intuition behind this definition is clear: no matter where you start, if you follow the movement
prescribed by the differential equation you will always move closer and closer towards the
equilibrium. In the figure below several time paths are shown of x(t ) 1 Aet , solutions of the
differential equation x x 1 (see also exercise 2.1 c). The convergence of these time paths can
clearly be observed.
Note: give yourself some time to have a look at this figure. It may clarify your understanding of
differential equations and their solutions, the corresponding time paths. For example the upper
time path starts at x(0) 2 , so this solution has A 1 and the time path is x(t ) 1 et . The slope
of the graph at t 0 can immediately be read from the equation: x (0) x(0) 1 1 .
2
x(t)
1.5
0.5
FIGURE 2.1 Time paths of x(t ) 1 Aet for several values of A, converging to x(t ) 1 .
EXERCISE 2.3
Suppose that a given differential equation turns out to have two equilibria. Explain why neither of
these equilibria is globally stable.
So you see that global stability is a very rare property of an equilibrium. A less ambitious notion,
and usually sufficient for such equilibria to be observed in real-life dynamical systems is the notion
of local stability.
We will not discuss the (lack of) stability any further here in this general context, but restrict the
elaborated analyses of equilibria to the several special cases that we will present in the remaining
sections.
x (t ) rx(t )
x(t ) Ae rt
Now notice that the specific choice A 0 yields the constant time path x(t ) 0 . In other words,
x* 0 is an equilibrium of this differential equation.
EXERCISE 2.4
Show that the equilibrium x* 0 is globally stable if and only if r 0 .
Now, with the solution x(t ) Aert of the 1st order equation in mind, we could try to see what
happens if we try this function as a solution for the above equation. We might get lucky and find a
solution after all. Since x (t ) Arert and x(t ) Ar 2 e rt in this case, we see that x will be a
solution to the differential equation precisely when we have that
Dividing both sides by Aert we see that this is equivalent to the requirement that
r 2 ar b.
10 2 CONTINUOUS DYNAMICS
This equation, completely analogous to the discrete time model terminology, is called the
characteristic equation of the differential equation. And because it is simply a quadratic equation
in r we may be able to find the solutions to this equation if we are lucky enough.
Example 2.4
Consider the 2nd order differential equation
x x 2x.
r2 r 2
whose solutions are r = -1 and r = 2. Now recall what we were doing. We were simply trying to
see which functions of the form x(t ) Aert are solutions to our differential equation, and
apparently the answer is that it is a solution precisely when r = -1 or r = 2. In other words, both
x(t ) Aet and x(t ) Ae2t are solutions to the equation. But, again just like in the discrete time
situation, also in this case linear combinations of solutions will again be solutions. A little thinking
leads us to conclude that all functions of the form
are solutions to the differential equation, where A and B can be chosen arbitrarily. It can be shown
that these are also all solutions to the differential equation in question. Again we sometimes refer
to the solutions x(t ) et and x(t ) e2t as the basic solutions. We call the expression
x(t ) Aet Be2t a linear combination of the basic solutions.
2 a b 0.
As you know, as soon as the discriminant a 2 4b is strictly smaller than zero, we cannot
solve this equation. But suppose we can. In other words, suppose that D a2 4b 0. Then the
roots of the characteristic equation are
a a
1 and 2 .
2 2
2.3 SECOND ORDER LINEAR DIFFERENTIAL EQUATIONS 11
Now, like in the example, the general solution to the differential equation can be expressed in
terms of the roots 1 and 2 as follows.
Suppose that 1 2 . (In other words, 0. ) In this case the general solution to the 2nd order
linear differential equation x ax bx is given by
x(t ) Ae1t Be2t .
If 1 2 (in other words 0 ), the general solution to the differential equation
x ax bx is given by
x(t ) Aet Btet .
Again, like in the example, each specific choice of the coefficients A and B yields one specific
solution and by varying A and B we find all solutions to the differential equation.
EXERCISE 2.5
Give, if possible, the general solution of the following differential equations:
a) x 4 x 4 x 0 .
b) x x .
c) x 3x 10 x 0 .
d) x x .
e) 2 x 2 x 3x.
1 1.5
x(t) 1
x(t)
0.5
0.5
2 4 6 8 10
2 4 6 8 10
0.5 t 0.5 t
1 1
1.5
FIGURE 2.2 Time paths of x(t ) cos t and x(t ) cos t sin t .
12 2 CONTINUOUS DYNAMICS
EXERCISE 2.6
Check that all functions of the form x(t ) A cos t B sin t are indeed solutions to the differential
equation x x .
Solutions to other differential equations for which 0 will in general typically involve a
combination of periodicity and exponential growth (or decline), such as a damped periodic motion
1
x(t)
0.5
2 4 6 8 10 12 14
0.5 t
1
FIGURE 2.3 A damped periodic time path: x(t ) et / 5 cos t et / 5 sin t .
4
3
x(t)
2
1
2 4 6 8 10 12 t 14
1
2
3
FIGURE 2.4 An exploding periodic time path: x(t ) et /15 cos t et /15 sin t .
However, in general the situation is still completely analogous to the discrete time case as you can
see in the next statement.
Every solution of a homogeneous 2nd order linear differential equation can be written as a linear
combination of two basic (independent) solutions.
2.3 SECOND ORDER LINEAR DIFFERENTIAL EQUATIONS 13
Now, even in the case that 0 , we are able to formulate the general solution, if only two
independent basic solutions are given.
Remark: you do not need to be able to find the basic solutions yourself in the case that 0 !
Example 2.5
Consider the differential equation
x 2 x 5x 0
Observe that D 0 . Now we can easily check, that x1 (t ) et sin 2t and x2 (t ) et cos 2t are
solutions of the equation. As you should know, sin' t cos t and cos' t sin t , so
x1 et sin 2t x2 et cos 2t
x1 et sin 2t 2et cos 2t x2 et cos 2t 2et sin 2t
x1 3et sin 2t 4et cos 2t x2 3et cos 2t 4et sin 2t
It follows immediately, that both x1 and x2 satisfy the differential equation. And they are
independent, as one is not a multiple of the other.
Hence, the general solution to the differential equation is
EXERCISE 2.7
Check in same way that the general solution to the equation x 3x 0 is
x(t ) Asin 3 t B cos 3 t
Inhomogeneous equations
Let us denote a 2nd order linear inhomogeneous differential equation by
The general solution of an inhomogeneous differential equation can be written as the sum of the
general solution of the corresponding homogeneous equation and a solution of the inhomogeneous
equation. The latter is often called a particular solution. In short:
GIS = GHS + PS
14 2 CONTINUOUS DYNAMICS
Just like in the discrete case also in the continuous case a particular solution p(t ) can be found
by trying a function that looks like the free coefficient b(t ) .
Let us repeat the rule of thumb as mentioned in the section Discrete dynamics (slightly adapted):
Example 2.6
Let us try to find all solutions to the differential equation
x 3x 2 x 2
x 3x 2 x 0
As you can check for yourself, its characteristic equation is 2 3 2 0 with roots 1 1
and 2 2. So, the general solution of the homogeneous equation is
Now we only have to find one single solution of the inhomogeneous equation and combine it
with the above solutions. In order to find a particular solution, let us try a constant, as the free
coefficient is also a constant. So, we try p(t ) k .
The aim is to find a value for k such that the above time path is a solution Substitute this into
the differential equation
x 3x 2 x 2
This gives 2k 2 , so k 1 .
Thus we find that the general solution to the differential equation x 3x 2 x 2 is
x 3x 2 x 2t
2.3 SECOND ORDER LINEAR DIFFERENTIAL EQUATIONS 15
The corresponding homogeneous equation is the same has before, so the general solution is
Again we have to find one single solution of the inhomogeneous equation and combine it with
the above solutions. In order to find a particular solution, let us try a linear function of t, as the
free coefficient is also a linear function of t. So, we try p(t ) k t l . The aim is to find values
for the parameters k and l such that the above time path is a solution to the equation. Now,
since p (t ) k and p(t ) 0 , we need to solve
3k 2 kt l 2t
(2k 2)t 3k 2l 0
Since this should hold for all t, we can find solutions for k and l by equating the coefficients of
t and the constant parts to zero.
k 1
2k 2
0
3
3k 2l 0 l
2
3
x(t ) t Aet Be2t
2
x 3x 2 x 2t 2
In order to find a particular solution, let us try to fit a quadratic function of a general form, as
the free coefficient is a quadratic function of the time variable t. So, we try
p(t ) kt 2 lt m
The aim is to find values for the parameters k, l and m such that the above time path is a
solution to the equation. Now, since p (t ) 2kt l and p(t ) 2k , we need to solve
16 2 CONTINUOUS DYNAMICS
2k 3 (2kt l ) 2 kt 2 lt m 2t 2
(2k 2)t (2l 6k )t 2k 3l 2m 0
2
Since this should hold for all t, we can find solutions for k, l and m by equating the coefficients
of t 2 , t and the constant parts to zero.
2 k 2 0 k 1
2l 6k 0l 3
2k 3l 2m 0
m 3
1
2
Thus we find that the general solution to the differential equation x 3x 2 x t 2 is
1
x(t ) t 2 3t 3 Aet Be2t
2
2k 2
k 1
6k 0
2k 0 k 0
Apparently we do not find a solution to the differential equation this way. So you see that
it is really essential to include the lower order terms lt and m as well.
Finally consider the differential equation
x 3x 2 x e2t
The general solution to the homogeneous equation is
In order to find a particular solution, we may try an exponential function of the form
p(t ) k e2t , but this will not work, because this function is itself a solution to the
homogeneous equation, so plugging it in into the equation will give right hand side 0 and
certainly not e 2t . According to our rule of thumb we “multiply by t and try it again” .So, we
try
2.3 SECOND ORDER LINEAR DIFFERENTIAL EQUATIONS 17
p(t ) kt e2t
Now we try to find a value for the parameter k such that the above time path is a solution to the
equation. Now, since p (t ) k e2t 2kt e2t and p(t ) 4k e2t 4kt e2t (product rule), we
need to solve
So k 1 and the general solution to the differential equation x 3x 2 x e2t is
EXERCISE 2.8
Find all solutions to the following differential equations (it is of course allowed to use your results
from exercise 2.5 whenever you can):
a) x 4 x 4 x 4t .
b) x 4 x 4 x t 1 .
c) x 4 x 4 x et .
d) x x 2 .
Extra conditions.
Just as in the discrete time case, also for the continuous time case, adding extra conditions for the
solution can single out a particular solution out of all the possibilities in the general solution. In
other words, these extra conditions determine the specific values of A and B for the particular
solution that satisfies the extra conditions. The extra conditions usually take the form of what are
called “initial” conditions, or “initial values”, meaning that they specify the value of the solution x
or its derivatives on time t 0.
Of course we will need two of these initial values in the 2nd order case to single out a unique
solution, because a general solution contains two parameters.
We will give an example.
Example 2.7
Determine the solution x(t ) of the differential equation
x 3x 2 x 0
If you want to solve this problem you first need to determine the general solution. As we saw
above, in this case the general solution is
x (t ) Ae t 2 Be 2t .
So, from the initial conditions x(0) 5 and x&(0) 7 we get that
A B 5 A 3
A 2B 7 B 2
So, we find that the (only) solution to the equation that satisfies the initial conditions is
EXERCISE 2.9
Determine in each case the solution to the differential equation that satisfies the initial conditions.
(It is of course allowed to use your results from exercise 2.8.)
a) x 4 x 4 x 4t such that x(0) 0 and x (0) 3 .
b) x 4 x 4 x et such that x(0) 1 and x (0) 0 .
c) x 3x 2 x et such that x(0) 2 and x (0) 3 .
EXERCISE 2.10
What are the equilibria when b 0 ? What can you say about the stability of these equilibria,
directly from the definition of stability of an equilibrium?
The question that remains is: given that b 0 , under which conditions will the equilibrium x* 0
be (globally) stable.
In order to get a feeling for the answer to this question, suppose that the characteristic equation has
two roots 1 and 2 , and that 1 2 . So, the general solution to the differential equation is
2.3 SECOND ORDER LINEAR DIFFERENTIAL EQUATIONS 19
Now, if you recall how the graph of the function t a et looks like when 0 ,
x(t)
EXERCISE 2.11
Check whether or not x* 0 is a stable equilibrium of the following 2nd order homogeneous linear
differential equations.
a) x 3x 2 x 0 .
b) x 3x 4 x 0 .
c) x 5x 6 x 0 .
d) x 4 x 0 .
EXERCISE 2.12
Show that the equilibrium x* 0 of the differential equation x x 0 is not globally stable.
(Hint: see exercise 2.5.)
x f (x).
In this reader such equations are dubbed simple differential equations by us. Simple differential
equations feature, among other properties, autonomy (i.e., the time variable t is not an explicit part
of the equation). They are also non-implicit (simply meaning that x&is a function of x) and of the
1st order. All these properties facilitate the analysis of such differential equations considerably.
Equilibria
For example, the search for equilibria now becomes very straightforward. Since we know that in
an equilibrium it holds that x 0 , we immediately get the following fact.
f ( x*) 0.
EXERCISE 2.13
Compute all equilibria of the following simple differential equations.
a) x 2 x 2 3x 2 .
b) x (2 x 3)3x 6x 56 x 1( x 100) .
c) x e5 x 2 .
d) x 2 x 2 1 .
x x 1 x 2 .
2
e)
Example 2.8
Consider the simple differential equation
x x 1x 3.
Its equilibria are obviously x* 1 and x* 3 . This can also easily be seen when we draw the
graph of the function f ( x) x 1 x 3 .
21
1 2 3 4
x
-1
The equilibria of the differential equation are simply the intersection points of the graph of f with
the horizontal axis.
However, the graph of f also tells us something about the (lack of) stability of the equilibria x* 1
and x* 3 . In order to see what we are talking about, notice that we can interpret the variable on
the vertical axis as the derivative x of x . In other words, the value of the function f in a point x
tells us something about the velocity of change in x. In particular, if f ( x) 0 , the derivative of x is
positive and x will be increasing, and conversely if f ( x) 0 , the derivative of x is negative and x
will be decreasing.
4
x
3
1 2 3 4
x
-1
In other words, the graph of f plays a double role in this story because it also enables us to
determine the phase diagram of the associated differential equation.
Actually the phase diagram consists only of the x-axis together with the arrows indicating in which
direction a solution moves when it arrives at the point in question, the so-called arrows of
movement.
Now it is clear that the equilibrium x* 3 cannot be locally stable: if we move a little to the left
or to the right when starting in x* 3 we will immediately move away from the equilibrium. So,
x* 3 is a repellent equilibrium. The equilibrium x* 1 on the other hand is locally stable,
although not globally. (Why not?)
Hence, notice that, as we just observed, local stability of an equilibrium x * of the simple
differential equation x f (x ) can be checked by looking at the behavior of f in the vicinity of
x*.
So, this is how the phase diagram should look like locally:
EXERCISE 2.14
Check for the differential equations from exercise 2.13 which of the equilibria you found are
locally stable, and which ones are repellent.
Now suppose that a fraction p of the population is of type H and a fraction 1-p of type D. In this
case the expected fitness for a bird of type H equals
QUESTION.
What is the expected fitness EF(D) for a bird of type D?
Now the average fitness AF within the population when a fraction p is of type H is given by the
formula
AF p EF(H) (1 p) EF(D).
According to evolutionary biologists the average fitness governs the change of the fraction of a
type of bird within the population: they argue that for example the fraction of Hawks will increase
over time as long as the expected fitness EF(H) of Hawks is above the average fitness AF (which
does indeed sound like a reasonable argument).
The classical way to put this into a more formal model (due to Maynard Smith in The theory of
games and the evolution of animal conflicts) is to assume that
p p( EF(H) AF).
This specific equation is called the replicator dynamics of the population. As you can see, the
fraction of Hawks within the population does indeed increase as long as EF(H) AF and grows
proportionally to the current size of the population because of the factor p (if there are relatively
many Hawks, they will produce more offspring).
Now notice that the replicator dynamics is a simple differential equation. So, the system is in
equilibrium for a certain fraction p of Hawks if for this specific value of p we have that
p(EF(H) AF) 0.
In that case after all we have that according to the replicator dynamics the change in the fraction p
of Hawks equals zero, i.e. it stays constant over time.
EXERCISE 2.15
Compute the replicator dynamics of the Hawk-Dove model and determine its equilibria. Explain
why the phase diagram of the replicator dynamics looks as follows:
24 2 CONTINUOUS DYNAMICS
p
0.1
0.05
-0.1
As you can see, if the value of p is below p * , the derivative of p is positive, which means that the
value of p increases over time. Conversely, if the value of p is above p * , the derivative of p is
negative, which means that the value of p decreases over time. Thus, p * is a locally stable
equilibrium (well, even almost globally, as p will only attain values between 0 and 1).
EXERCISE 2.16
Compute the replicator dynamics, find the equilibria, draw the phase diagram and determine the
locally stable equilibrium of the following fitness matrix:
H D
H 0 4
3
D
EXERCISE 2.17
Draw the phase diagram of the simple differential equation x rx for r 0 . Use the diagram to
locate the equilibrium and decide whether it is stable (globally or locally), repellent, or not one of
these. (Hint: treat the cases r 0 and r 0 separately.). What happens when r 0 ?
So here you see the big advantage of the use of phase diagrams. You can qualitatively analyze the
behavior of a dynamical system and its equilibria without computing any of its solutions.
Yt F ( Kt , At Nt ) Kt ( At Nt )1 0 1
It turns out to be convenient to analyze the model in terms of output and capital per effective
worker, say yt Yt / At Nt and kt Kt / At Nt . Dividing both sides of the Cobb-Douglas equation by
At Nt , you can easily derive the so called intensive production function f:
yt f (kt ) kt 0 1
This equation implies that output per effective worker depends on the amount of capital per
effective worker, which may be intuitive. The Solow model now assumes that labour N grows
exponentially at a constant rate gN, while technology A progresses at rate gA. This makes capital K
the only endogenous input. It develops according to the following first-order difference equation:
Kt 1 (1 ) Kt It
In words: next year’s capital stock is equal to this year’s stock, plus gross investment I, minus
depreciation, which is assumed to be a constant fraction δ of this year’s capital stock. Finally, we
assume that a constant fraction s of GDP is saved, and thus invested:
I t sYt
After some tedious but straightforward manipulations, we can combine the equations and the
exponential growth of A and N to get the following, approximate, key dynamic equation:
kt 1 kt sf (kt ) ( g A g N )kt
So far, following Blanchard (2003), we have developed the model in discrete time. This was done
for purposes of instruction only. In practice, the model is typically analyzed in continuous time.
The analogue of the 1st order difference equation above is the following 1st order differential
equation:
k sf (k ) ( g A g N )k
Our job is to investigate the dynamic behaviour of k as determined by this differential equation.
The intensive production function f is clearly differentiable, increasing and concave, and f (0) 0 .
This leads to the figure below.
26 2 CONTINUOUS DYNAMICS
f(k)
Additionally, you can easily check that limk 0 f '(k ) and limk f '(k ) 0 . This implies that,
apart from k 0 , the graph of s f (k ) has precisely one positive point of intersection with the
line through the origin whose slope equals g A g N . See the figure below.
l(k)
s.f(k)
EXERCISE 2.18
a) Draw the phase diagram of the Solow equation, determine the equilibrium k * , and check
whether k * is locally stable or not.
b) Which solutions to the Solow equation do not converge to k * ?
The equilibrium k * satisfies s f (k*) g A g N k * . For this reason the expression
g A g N k is called the break-even investment. It is the quantity one needs to invest
effectively to maintain the current level of capital stock per unit of effective labor.
c) Taking yt f (kt ) kt , find an explicit expression for the equilibrium k * as a function of
the parameters s, gA, gN, δ and α of the model, where 0 1 .
27
x
x rx1
K
EXERCISE 2.19
a) Draw the phase diagram of the logistic growth equation. Determine the equilibria of the
differential equation, and check whether they are repellent or stable.
b) Show that in the long run all solutions found in the introduction section 2.1 do indeed
converge to the (locally) stable equilibrium you found in a).
x f ( x, y )
y g ( x, y ),
a special type of a system of autonomous 1st order differential equations. We will refer to a system
of this format as a simple system of differential equations.
Example 2.10
In the simple system
x x2 y 2 x
y x 1
we have f ( x, y) x2 y 2 x and g ( x, y) x 1 .
Solving systems of two variables involves finding time paths of the form x(t ), y(t ) for all t 0 .
Such a time path specifies for each moment t 0 in time the precise location x(t ), y(t ) of a
solution as it moves through the plane.
x f ( x, y )
A time path x(t ), y(t ) for t 0 is a solution of the simple system
y g ( x, y )
28 2 CONTINUOUS DYNAMICS
x (t ) f ( x(t ), y (t ))
if for all t 0 it holds that
y (t ) g ( x(t ), y (t )).
In other words, whenever x(t ), y(t ) satisfies both equations of the system for all t 0 .
EXERCISE 2.20
Consider the simple system
x y
y x.
Show that the time path x(t ), y(t ) cos t ,sin t is a solution to this system. Find at least two
other solutions by yourself.
Obviously, the wilder a system of differential equations is, the harder it is to solve. It is for
example not clear at all how you could find all solutions to the system
xy xx 25 x2 y t 2
xyy x 3 1.
However, it is possible to at least partially analyze simple systems of differential equations. We
will discuss two tools you have already seen before that you can use in this context, namely the
notion of an equilibrium and phase diagrams.
Equilibria
Just like we saw for one-dimensional simple differential equations, also for a simple system of two
variables it is relatively straightforward to find its equilibria.
And just like in the one-dimensional case, also in the two dimensional case we have that on a
constant time path x(t ), y(t ) x*, y * for t 0 the derivatives are zero. In other words,
x (t ) 0 and y (t ) 0 for all t 0 . So, when such a time path solves the simple system
x f ( x, y )
y g ( x, y )
we automatically get that f x*, y * 0 and g x*, y * 0 . And also here the converse statement
is also true.
2.5 SYSTEMS OF DIFFERENTIAL EQUATIONS 29
x f ( x, y )
A point x*, y * is an equilibrium of the simple system
y g ( x, y )
f ( x*, y*) 0
if and only if
g ( x*, y*) 0.
So, this way we can find all equilibria of a simple system of differential equations. Simply solve
the system of equations you obtain when you put the derivatives x&and y& to zero. Each solution to
this system is an equilibrium of the system of differential equations and there are no other
equilibria.
EXERCISE 2.21
a) Determine all equilibria of the simple system
x xy 2
y x 1.
We will briefly discuss the notion of stability of an equilibrium for the two-dimensional case.
An equilibrium ( x*, y*) of a system of differential equations is globally stable if for every solution
( x(t ), y(t )) for t 0 of that differential equation we have that
lim( x(t ), y(t )) ( x*, y*).
t
And again, global stability is a very rare feature for a system of differential equations. More
common is the less ambitious notion of local stability.
An equilibrium ( x*, y*) of a system of differential equations is locally stable if for every solution
( x(t ), y(t )) for t 0 of that differential equation whose starting point x(0), y(0) is sufficiently
close to the equilibrium ( x*, y*) we have that lim( x(t ), y(t )) ( x*, y*).
t
30 2 CONTINUOUS DYNAMICS
Phase diagrams
Also local stability, even though more common than global stability, is difficult to verify. The
reason for this is simply that in general it is not possible to find explicit expressions for all
solutions to the system of equations, and therefore it is impossible to check the stability conditions.
There are several ways to get around this problem, for example Lyapunov functions, but these
techniques are beyond the tools we discuss in this reader. Still, it is possible to get a fairly good
insight in the behavior of a system of differential equations (and the –possible lack of– stability of
its equilibria) from studying its phase diagram.
As we have seen in the case of differential equations of one variable, also for a system of
differential equations of two variables does a phase diagram contain a lot of information about
directions of movement of solutions to the differential equations and, related to that, about the
location of equilibria and their stability. Only in the case of two variables these phase diagrams
will now be two-dimensional. Consider the simple system
x xy 2
y x 1.
The phase diagram for this system is constructed as follows. In each point in the x, y -plane we
plot the vector x, y xy 2, x 1 , which is an arrow of movement. The result looks as
follows.
3
-1
This diagram is sometimes also called the directional field. Using graphical packages these
graphics are fairly easy to produce. If you have to do this by hand though it is not an easy task as
you can easily imagine.
You can also get a bit more feeling for how a solution should behave though when you look at the
behavior of x and y separately. First consider the equation x xy 2 . From this equation it is
clear that for any solution the movement into the x-direction should be as follows:
2.5 SYSTEMS OF DIFFERENTIAL EQUATIONS 31
4
y
3
2
x = 0
1
-3 -2 -1 1 2 3 4
-1 x
x = 0
-2
-3
The curves in the figure correspond to the equation xy 2 0 , which comes from x 0 . So, on
these curves there is no movement in the x-direction. It is clear that above the right curve and
below the left curve x xy 2 0 , so the movement will be to the right. In the same way you can
see, that the movement between the curves will be to the left.
Also for the second equation y x 1 we can draw this graphical representation of the
movements in the plane it prescribes, but now into the y-direction.
5
y y = 0
4
3
2
1
-3 -2 -1 1 2 3 4
-1 x
-2
-3
5
y = 0
4
y
3
2
x = 0
1
-3 -2 -1 1 2 3 4
-1 x
x = 0
-2
-3
EXERCISE 2.22
Use the above phase diagram to explain why the equilibrium x*, y * 1, 2 cannot be locally (so
certainly not globally) stable.
Usually, like we did just now, the phase diagram helps you to establish that an equilibrium is
definitely not locally stable. In general though it does not guarantee stability (although in some
special cases it does as we shall see momentarily in the case of linear systems).
EXERCISE 2.23
Use phase diagrams to discuss the (lack of) stability of the equilibria you found for the other
systems of exercise 2.21.
x ax by
y cx dy
EXERCISE 2.24
a) Show that x*, y * 0,0 is the unique equilibrium of this system if and only if
a b
ad bc 0 . (In other words, whenever det 0 .)
c d
b) What are the equilibria when ad bc 0 ?
2.6 LINEAR SYSTEMS 33
We will only consider the case where ad bc 0 and discuss the (lack of) stability of the
unique equilibrium x*, y * 0,0 in a few examples. We will also analyze the phase diagram
for such linear systems.
Example 2.11
Consider the linear system
x ax
y dy.
So, we have set both b and c to zero (and of course assume that a and d are both not equal to zero).
This is a very trivial case, because there is no interdependence between the variables x and y, a so-
called uncoupled system of differential equations. Consequently it is very easy to deduce the
general solution of this system, based on what you know from linear differential equations of one
variable. It is given by
EXERCISE 2.25
a) Determine under which conditions on a and d the equilibrium x*, y * 0,0 is globally
stable.
b) What is the general solution if you do take a d 0 . Why doesn’t this surprise you?
x ax by
y cx dy
we want to check the (non)-stability of the equilibrium x*, y * 0,0 . So, let us first see how
phase diagrams look like in this context. Again we do not aspire to produce a veritable phase
diagram in which every direction is exactly determined, but we aim for a more humble goal,
namely to identify those regions in the plane where for example x and y are both increasing, or the
region where x is decreasing and y increasing.
Let us first check where x is increasing/decreasing. In other words, we want to find the region
where the sign of x is positive (so x is increasing) or negative (x is decreasing). And since
x ax by
34 2 CONTINUOUS DYNAMICS
at least we know that x& 0 precisely on the line given by the equation ax by 0 . The only
question is on which side of the line we find the area where x increases, and on which side we have
a decrease of x. This though is easy to establish and can be done in two different ways:
When a 0 , analysis of the level curves of the function l ( x, y ) ax by shows that we have
y y
a = -1 4 a=1 4
b=2 x = 0 b = -2 x = 0
2 2
-4 -2 2 4 x -4 -2 2 4 x
-2 -2
-4 -4
In the same way we find that when d 0 , we have a movement of y towards the line cx dy 0 ,
and when d 0 , we have a movement of y away from the line cx dy 0 .
Or, y is moving upward at e.g. (0,1), if d 0 and downward if d 0 . See the picture below.
y .
y .
c 2 4 y 0 c 2 4 y 0
d 1 d 1
2 2
4 2 2 4 x 4 2 2 4 x
2 2
4 4
y
4
.
x=0
2
-4 -2 2 4
x
-2
.
y=0
-4
FIGURE 2.19 Phase diagram of a linear system. The case a -1, b 2, c -1 and d -1 .
What will happen in the region where x increases and y decreases? Well, we move towards the line
ax by 0 and will eventually end up somewhere on this line, in a point whose y-coordinate is
less than the y-coordinate of the point we started in!
4
.
x=0
2
-4 -2 2 4
-2
.
y=0
-4
Moreover, once we are on the line ax by 0 , the increase in x has dropped to zero. In other
words, the movement on this line is vertical, downwards in this case (upwards is obviously the
only other possibility).
Iteration of this argument shows that we will slowly spiral inwards towards the equilibrium.
4
.
x=0
2
-4 -2 2 4
-2
.
y=0
-4
Thus we see that the equilibrium x*, y * 0,0 will be globally stable. (Compare this with
your results from exercise 2.25)
y
4
.
x=0
2
-4 -2 2 4 x
-2
.
y=0
-4
QUESTION.
Are you really convinced by the pictures in figures 2.19 – 2.22? Mind: a critical note could be
made! If you look carefully at these pictures then, using these rather rough phase diagrams where
only regions are given with up-down and left-right movement, it might occur that solutions move
away from the equilibrium point. Check this for yourself!
A slightly different case, when taking a 2 , b 1 , c 1 and d 1 , gives clear, convincing
convergence. Sketch the phase diagram for this problem and show that solutions must converge.
Finally, to give you some confidence that the above procedure can be really effective, below you
can see a diagram of a simulation of the system with a 1 , b 2 , c 1 and d 1 by
Mathematica, a computer algebra package. Plotted are the directional field and six solutions of the
system.
-6 -4 -2 2 4 6
-2
-4
QUESTION.
Try to guess what are the initial points that are used to generate the Mathematica solutions in the
phase diagram in Figure 2.23.
Conversely, when we had exactly the opposite values for a, b, c, and d ( a 1 , b 2 , c 1 and
d 1 ), then we would have got an almost identical picture, with the only difference that this time
we will spiral outwards, away from the equilibrium. In this case the equilibrium x*, y * 0,0
is repellent.
EXERCISE 2.26
Draw the phase diagrams and discuss the (lack of) stability of the equilibrium x*, y * 0,0 for
the following linear systems.
x 2x y
a) .
y 3x y
x 2x y
b) .
y 3x y
x 2 x y
c) .
y x 2y
Example 2.12
Consider the simple system
1
x x y
2
y 6 x y.
The trick is to derive a 2nd order differential equation in one variable (usually x, but there is no law
against eliminating x and keeping y instead) and to solve that equation first. In order to derive this
equation, we are going to eliminate the y-variable from the second equation. We do that as follows.
Notice that the first equation states that y 2 x 2 x . By taking the derivative of this equation we
get that
y 2 x 2 x
y 2 x 2 x.
38 2 CONTINUOUS DYNAMICS
Plugging these expressions for y and y into the second equation yields
2 x 2 x 6 x 2 x 2 x
2 x 8 x.
EXERCISE 2.27
a) Solve the differential equation 2 x 8 x .
b) Derive a formula for the general solution of the simple system.
c) Draw a few of these solutions in the plane. (You are free to use whatever electronic device
you feel comfortable with, or to simply figure it out by hand.)
d) What can you say about the stability of the equilibium x*, y * 0,0 ?
The phase diagram for the system in exercise 2.27, including the directional field and some
solutions, is given in the picture below. The equlibrium point (0,0) is not stable, but its instability
is of a special nature: we call this kind of equilibrium points, with these "hyperbolic shaped"
solution paths saddlepoints.
10
7.5
2.5
-8 -6 -4 -2 2 4 6 8
-2.5
-5
-7.5
-10
FIGURE 2.24 The characteristic pattern of a saddlepoint.
EXERCISE 2.28
Consider the simple system
2.6 LINEAR SYSTEMS 39
x x y
1 1
y x y.
3 6
a) Derive the associated 2nd order differential equation in x and solve it.
b) Derive a formula for the general solution of the simple system, so also give the general
solution for y.
c) What can you say about the stability of the equilibium x*, y * 0,0 ?
1 1
ui ( x, y ) x 2 y 2
while the utility for agent j is given by the Cobb-Douglas utility function
1 3
u j ( x, y ) x 4 y 4 .
Now suppose that initially prices are given for both goods. Assume that the initial price of good 1
equals p1* and that p2* is the initial price of good 2. We will assume for simplicity that p1* p2* 1
. Given these prices both agents have a budget equal to
B p1*1 p2*2 .
When the prices change to p1 and p2 the agents have the opportunity to use their budget B to
acquire different amounts of goods 1 and 2. From consumer theory you know, given the budget B
and prices p1 and p2 , how to compute the most preferred endowment for the agents. In other
words, you can compute their demands from these data.
EXERCISE 2.29
Given the budget B and prices p1 and p2 , compute the demand xi p1 , p2 , yi p1 , p2 of agent i
A price vector p1 , p2 is a Walrasian equilibrium if the total demand of the agents equals the total
supply. In this case (where the initial endowments are equal for both agents)
xi p1 , p2 x j p1 , p2 1 1 21
yi p1 , p2 y j p1 , p2 2 2 22 .
EXERCISE 2.30
Show that in any Walrasian equilibrium p1 , p2 in our example it holds that
5 p11 3 p22 .
Interpret this result. E.g., what would happen when we would double the amount of good 2 that is
initially available?
Now we will construct a procedure that, given the initial price vector p , p , generates a time
*
1
*
2
path p (t ), p (t ) for t 0 of prices that starts with the initial prices --so p (0), p (0) p p -
1 2 1 2
*
1
*
2
- and that converges to a Walrasian equilibrium. The price adjustment process is governed by the
system of differential equations
p 1 p1 xi p1 , p2 x j p1 , p2 21
p 2 p2 yi p1 , p2 y j p1 , p2 22
under the initial condition that p1 (0), p2 (0) p1* , p2* . This adjustment process is known as the
tâtonnement process.
Let us start by leaning back a bit and see what we can say about this system without any
computations. First notice that it is a simple system of differential equations, even though it will in
general not be a linear system. Furthermore, as you can see in the first equation, the price of good
1 will increase as soon as the total demand xi p1 , p2 x j p1 , p2 for good 1 is larger than the
total available amount 1 1 21 of good 1, and it will decrease otherwise. Of course the
second equation states something similar for the second good.
EXERCISE 2.31
Use exercise 2.29 to show that in our example the system of differential equations can be written
as
5 3
p1 p11 p22
4 4
5 3
p 2 p11 p22 .
4 4
2.6 LINEAR SYSTEMS 41
Determine the equilibria of this system. Draw the phase diagram of this differential equation for
the special case 1 2 4 .
Now we could try to see if solving the associated 2nd order differential equation in one variable
could be of any use to us.
EXERCISE 2.32
Use this strategy to analyze the system for 1 2 4 . So,
a) derive the associated 2nd order differential equation for p1
b) find the general solution of the associated 2nd order differential equation
c) find the general solution of the original simple system
d) analyze the long run behavior of each solution.
For arbitrary 1 and 2 this trick is not so easy to perform. Luckily there is also another trick in
this case that makes life easier. This trick basically relies on the fact that only relative prices are
important for changes in demand. We will guide you through the computations along the lines of a
few exercises.
EXERCISE 2.33
Use the system you found in exercise 2.31 to show that p1 (t ) p2 (t ) 1 , the sum of the initial
prices. (Hint: take the derivative of the function t a p1 (t ) p2 (t ) with respect to t and use the
equations from the system. Next use the assumption that p1* p2* 1 .) Thus we see that the sum of
the prices is constant over time. You may draw this assumption in the phase diagram in exercise
2.31.
So now we know that the (unique) solution p1 (t ), p2 (t ) to the differential equation that satisfies
the initial conditions p1 (0) p1* and p2 (0) p2* will satisfy the equation p1 (t ) p2 (t ) 1 . Thus we
can substitute p2 1 p1 into the first equation of the system of differential equations, and we
obtain that the solution we are looking for satisfies the equation
3 5 3
p 1 2 1 2 p1 .
4 4 4
We have found a 1st order inhomogeneous linear differential equation for the time path p1 (t ) of
the price of good 1! Notice that this trick is indeed easier than going through the process of
elimination of both p2 and p 2 from the 2nd equation.
EXERCISE 2.34
Find the solution p1 (t ) for t 0 to the differential equation
3 5 3
p 1 2 1 2 p1
4 4 4
42 2 CONTINUOUS DYNAMICS
that satisfies the initial condition p1 (0) p1* . Show that the time path p1 (t ), p2 (t ) of the price
vector converges to
32 51
p
, p2 ,
51 32 51 32
1
p1 32
p2 51
(compare with exercise 2.30). So, when there is a relatively large amount of good 2, the price of
good 1 will be relatively high compared with the price of good 2, a sound economic principle. The
3
factor comes from the fact that the utility functions of the two agents are not identical.
5
Make sure you get the picture here: it may be helpful to think of N as “raw labour” or “muscle”,
and of H as “skill” or “brains”. Again, it is convenient to analyze the model in terms of output,
physical and human capital per effective worker, say yt Yt / At Nt , kt Kt / At Nt and
ht Ht / At Nt . Dividing both sides of the Cobb-Douglas equation above by At Nt , you can derive
the generalized version of our intensive production function f:
Not surprisingly, the amount of output per effective worker now depends on both the amounts of
physical and human capital per effective worker. We still assume that A and N grow exponentially
at constant rates gA and gN. Additionally, we assume that human capital is accumulated in much the
same way as physical capital, i.e. through a process of investment and depreciation. So we now
have two endogenous inputs, K and H, obeying two very similar first-order difference equations:
Kt 1 (1 ) Kt ItK
2.6 LINEAR SYSTEMS 43
Ht 1 (1 ) Ht ItH
For simplicity, we assume that the depreciation rates of physical and human capital are the same.
Concerning investment we assume that, while a constant fraction sK of GDP is again invested in
physical capital, another constant fraction sH is invested in human capital (this would e.g. include
government’s spending on education):
I tK sK Yt ItH sH Yt
Reasoning by analogy, it will not surprise you that the model now leads to the following two key
dynamic equations:
kt 1 kt sK f (kt , ht ) ( g A g N )kt
ht 1 ht sH f (kt , ht ) ( g A g N )ht
k sK f (k , h) ( g A g N )k
h sH f (k , h) ( g A g N )h
It will be clear that these two equations constitute a simultaneous dynamic system in terms of k and
h. Let’s start with the dynamic behaviour of k. Plugging the intensive production function f into the
first of these equations, we get:
k sK k h ( g A g N )k
1/(1 )
sK
k h /(1 ) (or k 0)
gA gN
Now note that 1 implies that /(1 ) 1 . Consequently, with h along the horizontal
axis, this last equation implies a concave curve which obviously passes through the origin. See the
figure below.
44 2 CONTINUOUS DYNAMICS
k
.
k0 .
k0
.
k0
EXERCISE 2.35
a) Show that the arrows of movement in Figure 2.25 point as they do.
b) Sketch a similar figure for the dynamics of h.
c) Combine both figures and argue the stability of the equilibrium point.
h * sH
d) Show that at the equilibrium point (h*, k*) we have and give an economic
k * sK
interpretation.