Professional Documents
Culture Documents
CFD Handbook PDF
CFD Handbook PDF
Dynamics
Harvard Lomax and Thomas H. Pulliam
NASA Ames Research Center
David W. Zingg
University of Toronto Institute for Aerospace Studies
August 26, 1999
Contents
1 INTRODUCTION
1.1 Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.2 Background . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.2.1 Problem Specication and Geometry Preparation . . . . . .
1.2.2 Selection of Governing Equations and Boundary Conditions
1.2.3 Selection of Gridding Strategy and Numerical Method . . .
1.2.4 Assessment and Interpretation of Results . . . . . . . . . . .
1.3 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.4 Notation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
3 FINITE-DIFFERENCE APPROXIMATIONS
3.1 Meshes and Finite-Dierence Notation
3.2 Space Derivative Approximations . . .
3.3 Finite-Dierence Operators . . . . . .
3.3.1 Point Dierence Operators . . .
3.3.2 Matrix Dierence Operators . .
3.3.3 Periodic Matrices . . . . . . . .
3.3.4 Circulant Matrices . . . . . . .
iii
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
1
2
2
3
3
4
4
5
7
8
12
12
13
14
14
15
16
17
21
21
24
25
25
25
29
30
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
31
31
34
35
37
38
39
39
43
44
46
47
51
5 FINITE-VOLUME METHODS
71
.
.
.
.
.
.
.
.
.
52
52
53
54
54
55
57
59
61
61
62
63
65
67
68
72
73
73
74
74
75
77
78
80
5.5 Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.1 Notation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.2 Converting Time-Marching Methods to OE's . . . . . . . . . . . .
6.3 Solution of Linear OE's With Constant Coecients . . . . . . . .
6.3.1 First- and Second-Order Dierence Equations . . . . . . . .
6.3.2 Special Cases of Coupled First-Order Equations . . . . . . .
6.4 Solution of the Representative OE's . . . . . . . . . . . . . . . .
6.4.1 The Operational Form and its Solution . . . . . . . . . . . .
6.4.2 Examples of Solutions to Time-Marching OE's . . . . . . .
6.5 The ; Relation . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.5.1 Establishing the Relation . . . . . . . . . . . . . . . . . . . .
6.5.2 The Principal -Root . . . . . . . . . . . . . . . . . . . . . .
6.5.3 Spurious -Roots . . . . . . . . . . . . . . . . . . . . . . . .
6.5.4 One-Root Time-Marching Methods . . . . . . . . . . . . . .
6.6 Accuracy Measures of Time-Marching Methods . . . . . . . . . . .
6.6.1 Local and Global Error Measures . . . . . . . . . . . . . . .
6.6.2 Local Accuracy of the Transient Solution (er ; jj ; er! ) . . .
6.6.3 Local Accuracy of the Particular Solution (er ) . . . . . . .
6.6.4 Time Accuracy For Nonlinear Applications . . . . . . . . . .
6.6.5 Global Accuracy . . . . . . . . . . . . . . . . . . . . . . . .
6.7 Linear Multistep Methods . . . . . . . . . . . . . . . . . . . . . . .
6.7.1 The General Formulation . . . . . . . . . . . . . . . . . . . .
6.7.2 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.7.3 Two-Step Linear Multistep Methods . . . . . . . . . . . . .
6.8 Predictor-Corrector Methods . . . . . . . . . . . . . . . . . . . . . .
6.9 Runge-Kutta Methods . . . . . . . . . . . . . . . . . . . . . . . . .
6.10 Implementation of Implicit Methods . . . . . . . . . . . . . . . . . .
6.10.1 Application to Systems of Equations . . . . . . . . . . . . .
6.10.2 Application to Nonlinear Equations . . . . . . . . . . . . . .
6.10.3 Local Linearization for Scalar Equations . . . . . . . . . . .
6.10.4 Local Linearization for Coupled Sets of Nonlinear Equations
6.11 Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
83
85
86
87
88
89
90
91
91
92
93
93
95
95
96
97
97
98
99
100
101
102
102
103
105
106
107
110
110
111
112
115
117
121
122
123
123
123
7.3
7.4
7.5
7.6
7.7
7.8
7.9
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
123
124
124
125
125
125
128
128
132
135
135
136
137
141
141
142
143
143
146
149
149
149
151
151
152
153
154
154
154
155
158
158
159
160
160
161
9 RELAXATION METHODS
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
163
164
164
166
168
168
168
169
170
170
172
173
174
176
180
182
187
10 MULTIGRID
191
11 NUMERICAL DISSIPATION
203
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
204
205
207
209
210
212
213
214
217
12.4
12.5
12.6
12.7
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
220
221
221
223
226
226
228
229
233
233
234
234
237
238
242
242
243
243
244
245
247
Notation . . . . . . . . . .
Denitions . . . . . . . . .
Algebra . . . . . . . . . .
Eigensystems . . . . . . .
Vector and Matrix Norms
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
249
250
251
251
254
257
257
258
259
260
260
261
262
263
Chapter 1
INTRODUCTION
1.1
Motivation
The material in this book originated from attempts to understand and systemize numerical solution techniques for the partial dierential equations governing the physics
of
uid
ow. As time went on and these attempts began to crystallize, underlying
constraints on the nature of the material began to form. The principal such constraint
was the demand for unication. Was there one mathematical structure which could
be used to describe the behavior and results of most numerical methods in common
use in the eld of
uid dynamics? Perhaps the answer is arguable, but the authors
believe the answer is armative and present this book as justication for that belief. The mathematical structure is the theory of linear algebra and the attendant
eigenanalysis of linear systems.
The ultimate goal of the eld of computational
uid dynamics (CFD) is to understand the physical events that occur in the
ow of
uids around and within designated
objects. These events are related to the action and interaction of phenomena such
as dissipation, diusion, convection, shock waves, slip surfaces, boundary layers, and
turbulence. In the eld of aerodynamics, all of these phenomena are governed by
the compressible Navier-Stokes equations. Many of the most important aspects of
these relations are nonlinear and, as a consequence, often have no analytic solution.
This, of course, motivates the numerical solution of the associated partial dierential
equations. At the same time it would seem to invalidate the use of linear algebra for
the classication of the numerical methods. Experience has shown that such is not
the case.
As we shall see in a later chapter, the use of numerical methods to solve partial
dierential equations introduces an approximation that, in eect, can change the
form of the basic partial dierential equations themselves. The new equations, which
1
CHAPTER 1. INTRODUCTION
are the ones actually being solved by the numerical process, are often referred to as
the modied partial dierential equations. Since they are not precisely the same as
the original equations, they can, and probably will, simulate the physical phenomena
listed above in ways that are not exactly the same as an exact solution to the basic
partial dierential equation. Mathematically, these dierences are usually referred to
as truncation errors. However, the theory associated with the numerical analysis of
uid mechanics was developed predominantly by scientists deeply interested in the
physics of
uid
ow and, as a consequence, these errors are often identied with a
particular physical phenomenon on which they have a strong eect. Thus methods are
said to have a lot of \articial viscosity" or said to be highly dispersive. This means
that the errors caused by the numerical approximation result in a modied partial
dierential equation having additional terms that can be identied with the physics
of dissipation in the rst case and dispersion in the second. There is nothing wrong,
of course, with identifying an error with a physical process, nor with deliberately
directing an error to a specic physical process, as long as the error remains in some
engineering sense \small". It is safe to say, for example, that most numerical methods
in practical use for solving the nondissipative Euler equations create a modied partial
dierential equation that produces some form of dissipation. However, if used and
interpreted properly, these methods give very useful information.
Regardless of what the numerical errors are called, if their eects are not thoroughly understood and controlled, they can lead to serious diculties, producing
answers that represent little, if any, physical reality. This motivates studying the
concepts of stability, convergence, and consistency. On the other hand, even if the
errors are kept small enough that they can be neglected (for engineering purposes),
the resulting simulation can still be of little practical use if inecient or inappropriate
algorithms are used. This motivates studying the concepts of stiness, factorization,
and algorithm development in general. All of these concepts we hope to clarify in
this book.
1.2
Background
The eld of computational
uid dynamics has a broad range of applicability. Independent of the specic application under study, the following sequence of steps generally
must be followed in order to obtain a satisfactory solution.
The rst step involves the specication of the problem, including the geometry,
ow
conditions, and the requirements of the simulation. The geometry may result from
1.2. BACKGROUND
Once the problem has been specied, an appropriate set of governing equations and
boundary conditions must be selected. It is generally accepted that the phenomena of
importance to the eld of continuum
uid dynamics are governed by the conservation
of mass, momentum, and energy. The partial dierential equations resulting from
these conservation laws are referred to as the Navier-Stokes equations. However, in
the interest of eciency, it is always prudent to consider solving simplied forms
of the Navier-Stokes equations when the simplications retain the physics which are
essential to the goals of the simulation. Possible simplied governing equations include
the potential-
ow equations, the Euler equations, and the thin-layer Navier-Stokes
equations. These may be steady or unsteady and compressible or incompressible.
Boundary types which may be encountered include solid walls, in
ow and out
ow
boundaries, periodic boundaries, symmetry boundaries, etc. The boundary conditions
which must be specied depend upon the governing equations. For example, at a solid
wall, the Euler equations require
ow tangency to be enforced, while the Navier-Stokes
equations require the no-slip condition. If necessary, physical models must be chosen
for processes which cannot be simulated within the specied constraints. Turbulence
is an example of a physical process which is rarely simulated in a practical context (at
the time of writing) and thus is often modelled. The success of a simulation depends
greatly on the engineering insight involved in selecting the governing equations and
physical models based on the problem specication.
Next a numerical method and a strategy for dividing the
ow domain into cells, or
elements, must be selected. We concern ourselves here only with numerical methods requiring such a tessellation of the domain, which is known as a grid, or mesh.
CHAPTER 1. INTRODUCTION
Finally, the results of the simulation must be assessed and interpreted. This step can
require post-processing of the data, for example calculation of forces and moments,
and can be aided by sophisticated
ow visualization tools and error estimation techniques. It is critical that the magnitude of both numerical and physical-model errors
be well understood.
1.3
Overview
It should be clear that successful simulation of
uid
ows can involve a wide range of
issues from grid generation to turbulence modelling to the applicability of various simplied forms of the Navier-Stokes equations. Many of these issues are not addressed
in this book. Some of them are presented in the books by Anderson, Tannehill, and
Pletcher [1] and Hirsch [2]. Instead we focus on numerical methods, with emphasis
on nite-dierence and nite-volume methods for the Euler and Navier-Stokes equations. Rather than presenting the details of the most advanced methods, which are
still evolving, we present a foundation for developing, analyzing, and understanding
such methods.
Fortunately, to develop, analyze, and understand most numerical methods used to
nd solutions for the complete compressible Navier-Stokes equations, we can make use
of much simpler expressions, the so-called \model" equations. These model equations
isolate certain aspects of the physics contained in the complete set of equations. Hence
their numerical solution can illustrate the properties of a given numerical method
when applied to a more complicated system of equations which governs similar physical phenomena. Although the model equations are extremely simple and easy to
solve, they have been carefully selected to be representative, when used intelligently,
of diculties and complexities that arise in realistic two- and three-dimensional
uid
ow simulations. We believe that a thorough understanding of what happens when
1.4. NOTATION
numerical approximations are applied to the model equations is a major rst step in
making condent and competent use of numerical approximations to the Euler and
Navier-Stokes equations. As a word of caution, however, it should be noted that,
although we can learn a great deal by studying numerical methods as applied to the
model equations and can use that information in the design and application of numerical methods to practical problems, there are many aspects of practical problems
which can only be understood in the context of the complete physical systems.
1.4
Notation
The notation is generally explained as it is introduced. Bold type is reserved for real
physical vectors, such as velocity. The vector symbol ~ is used for the vectors (or
column matrices) which contain the values of the dependent variable at the nodes
of a grid. Otherwise, the use of a vector consisting of a collection of scalars should
be apparent from the context and is not identied by any special notation. For
example, the variable u can denote a scalar Cartesian velocity component in the Euler
and Navier-Stokes equations, a scalar quantity in the linear convection and diusion
equations, and a vector consisting of a collection of scalars in our presentation of
hyperbolic systems. Some of the abbreviations used throughout the text are listed
and dened below.
PDE
ODE
OE
RHS
P.S.
S.S.
k-D
~
bc
O()
CHAPTER 1. INTRODUCTION
Chapter 2
CONSERVATION LAWS AND
THE MODEL EQUATIONS
We start out by casting our equations in the most general form, the integral conservation-law form, which is useful in understanding the concepts involved in nite-volume
schemes. The equations are then recast into divergence form, which is natural for
nite-dierence schemes. The Euler and Navier-Stokes equations are brie
y discussed
in this Chapter. The main focus, though, will be on representative model equations,
in particular, the convection and diusion equations. These equations contain many
of the salient mathematical and physical features of the full Navier-Stokes equations.
The concepts of convection and diusion are prevalent in our development of numerical methods for computational
uid dynamics, and the recurring use of these
model equations allows us to develop a consistent framework of analysis for consistency, accuracy, stability, and convergence. The model equations we study have two
properties in common. They are linear partial dierential equations (PDE's) with
coecients that are constant in both space and time, and they represent phenomena
of importance to the analysis of certain aspects of
uid dynamic problems.
V (t2 )
QdV ;
V (t1 )
QdV +
Z t2 I
t1
S (t)
n:FdSdt =
Z t2 Z
t1
V (t)
PdV dt
(2.1)
In this equation, Q is a vector containing the set of variables which are conserved,
e.g., mass, momentum, and energy, per unit volume. The equation is a statement of
7
the conservation of these quantities in a nite region of space with volume V (t) and
surface area S (t) over a nite interval of time t2 ; t1 . In two dimensions, the region
of space, or cell, is an area A(t) bounded by a closed contour C (t). The vector n is
a unit vector normal to the surface pointing outward, F is a set of vectors, or tensor,
containing the
ux of Q per unit area per unit time, and P is the rate of production
of Q per unit volume per unit time. If all variables are continuous in time, then Eq.
2.1 can be rewritten as
d Z QdV + I n:FdS = Z PdV
(2.2)
dt V (t)
S (t)
V (t)
Those methods which make various numerical approximations of the integrals in Eqs.
2.1 and 2.2 and nd a solution for Q on that basis are referred to as nite-volume
methods. Many of the advanced codes written for CFD applications are based on the
nite-volume concept.
On the other hand, a partial derivative form of a conservation law can also be
derived. The divergence form of Eq. 2.2 is obtained by applying Gauss's theorem to
the
ux integral, leading to
@Q + r:F = P
(2.3)
@t
where r: is the well-known divergence operator given, in Cartesian coordinates, by
!
@
@
@
(2.4)
r: i @x + j @y + k @z :
and i; j, and k are unit vectors in the x; y, and z coordinate directions, respectively.
Those methods which make various approximations of the derivatives in Eq. 2.3 and
nd a solution for Q on that basis are referred to as nite-dierence methods.
6
6
= 666
4
7
6
7
6
7
2
u + p 77 ; 666
5 4
u(e + p)
4 @u
3 @x
4 @u
3 u @x
+ @T
@x
7
7
7
7
7
5
(2.6)
where is the
uid density, u is the velocity, e is the total energy per unit volume, p is
the pressure, T is the temperature, is the coecient of viscosity, and is the thermal
conductivity. The total energy e includes internal energy per unit volume (where
is the internal energy per unit mass) and kinetic energy per unit volume u2=2.
These equations must be supplemented by relations between and and the
uid
state as well as an equation of state, such as the ideal gas law. Details can be found
in Anderson, Tannehill, and Pletcher [1] and Hirsch [2]. Note that the convective
uxes lead to rst derivatives in space, while the viscous and heat conduction terms
involve second derivatives. This form of the equations is called conservation-law or
conservative form. Non-conservative forms can be obtained by expanding derivatives
of products using the product rule or by introducing dierent dependent variables,
such as u and p. Although non-conservative forms of the equations are analytically
the same as the above form, they can lead to quite dierent numerical solutions in
terms of shock strength and shock speed, for example. Thus the conservative form is
appropriate for solving
ows with features such as shock waves.
Many
ows of engineering interest are steady (time-invariant), or at least may be
treated as such. For such
ows, we are often interested in the steady-state solution of
the Navier-Stokes equations, with no interest in the transient portion of the solution.
The steady solution to the one-dimensional Navier-Stokes equations must satisfy
@E = 0
(2.7)
@x
If we neglect viscosity and heat conduction, the Euler equations are obtained. In
two-dimensional Cartesian coordinates, these can be written as
@Q + @E + @F = 0
(2.8)
@t @x @y
with
2 3 2 3
2
2
q1
u 3
v 3
6 7 6 7
6 u2 + p 7
6 uv 7
7
7
7
Q = 664 qq2 775 = 664 u
7; E = 6
6
7; F = 6
6 2
7
(2.9)
5
4
5
4
5
v
uv
v
+
p
3
q4
e
u(e + p)
v ( e + p)
where u and v are the Cartesian velocity components. Later on we will make use of
the following form of the Euler equations as well:
@Q + A @Q + B @Q = 0
(2.10)
@t
@x
@y
@E and B = @F are known as the
ux Jacobians. The
ux vectors
The matrices A = @Q
@Q
given above are written in terms of the primitive variables, , u, v, and p. In order
10
to derive the
ux Jacobian matrices, we must rst write the
ux vectors E and F in
terms of the conservative variables, q1 , q2, q3 , and q4 , as follows:
2
6
6
6
6
6
= 666
6
6
6
4
E1
2
3
6
6
7
6
7
6
7
6
7
6
7
6
7
7=6
6
7
6
7
6
7
7 6
5 6
6
4
3
7
7
7
2
2
q2
;1 q3 7
3
;
(
; 1)q4 + 2 q1 ; 2 q1 77
7
7
7
q3 q2
7
7
q1
7
7
7
q3 q2 q 5
;
1
2
q
q
4q12 ; 2 q212 + 3q12
(2.11)
2
6
6
6
6
6
= 666
6
6
6
4
3 2
F1 7 66
7
6
7
6
7
F2 7 66
7
7
= 666
7
F3 77 66
7 6
5 6
4
F4
3
7
7
7
7
q3 q2
7
q1
7
7
7
7
2
2
(
; 1)q4 + 3;2
qq31 ;
;2 1 qq21 77
7
7
5
q2 q
3
q
q
q
;
1
3
4q13 ; 2 2q12 + q132
(2.12)
E2
E3
E4
q2
q3
We have assumed that the pressure satises p = (
; 1)[e ; (u2 + v2)=2] from the
ideal gas law, where
is the ratio of specic heats, cp=cv . From this it follows that
the
ux Jacobian of E can be written in terms of the conservative variables as
A=
2
6
6
6
6
6
@Ei = 666
@qj 66
6
6
6
4
3
7
7
q
q
7
a21
(3 ;
) q21 (1 ;
) q31
; 1 777
7
7
q q
q
q
7
2
3
3
2
; q1 q1
0 77
q1
q1
7
q 7
5
a41
a42
a43
q21
where
a21
=
;2 1 qq3
1
!2
; 3 ;2
qq2
1
!2
(2.13)
+ qq3
1
!2
!2
a41 =
q2
q1
!3
2
6
6
6
6
6
A = 666
6
6
6
4
where
q2
q1
!3
5;
+ qq3
1
!2 3
5
11
q4
q1
q2
q1
(2.14)
a21 (3 ; )u (1 ; )v ( ; 1)
;uv
a41
a42
a43
3
7
7
7
7
7
7
7
7
7
7
7
5
(2.15)
a21 = ;2 1 v2 ; 3 ;2 u2
a42 = e ; ;2 1 (3u2 + v2 )
a43 = (1 ;
)uv
(2.16)
Derivation of the two forms of B = @F=@Q is similar. The eigenvalues of the
ux
Jacobian matrices are purely real. This is the dening feature of hyperbolic systems
of PDE's, which are further discussed in Section 2.5. The homogeneous property of
the Euler equations is discussed in Appendix C.
The Navier-Stokes equations include both convective and diusive
uxes. This
motivates the choice of our two scalar model equations associated with the physics
of convection and diusion. Furthermore, aspects of convective phenomena associated with coupled systems of equations such as the Euler equations are important in
developing numerical methods and boundary conditions. Thus we also study linear
hyperbolic systems of PDE's.
12
The simplest linear model for convection and wave propagation is the linear convection
equation given by the following PDE:
@u + a @u = 0
(2.17)
@t @x
Here u(x; t) is a scalar quantity propagating with speed a, a real constant which may
be positive or negative. The manner in which the boundary conditions are specied
separates the following two phenomena for which this equation is a model:
(1) In one type, the scalar quantity u is given on one boundary, corresponding
to a wave entering the domain through this \in
ow" boundary. No boundary condition is specied at the opposite side, the \out
ow" boundary. This
is consistent in terms of the well-posedness of a 1st-order PDE. Hence the
wave leaves the domain through the out
ow boundary without distortion or
re
ection. This type of phenomenon is referred to, simply, as the convection
problem. It represents most of the \usual" situations encountered in convecting systems. Note that the left-hand boundary is the in
ow boundary when
a is positive, while the right-hand boundary is the in
ow boundary when a is
negative.
(2) In the other type, the
ow being simulated is periodic. At any given time,
what enters on one side of the domain must be the same as that which is
leaving on the other. This is referred to as the biconvection problem. It is
the simplest to study and serves to illustrate many of the basic properties of
numerical methods applied to problems involving convection, without special
consideration of boundaries. Hence, we pay a great deal of attention to it in
the initial chapters.
Now let us consider a situation in which the initial condition is given by u(x; 0) =
u0(x), and the domain is innite. It is easy to show by substitution that the exact
solution to the linear convection equation is then
u(x; t) = u0(x ; at)
(2.18)
The initial waveform propagates unaltered with speed jaj to the right if a is positive
and to the left if a is negative. With periodic boundary conditions, the waveform
travels through one boundary and reappears at the other boundary, eventually returning to its initial position. In this case, the process continues forever without any
13
change in the shape of the solution. Preserving the shape of the initial condition
u0(x) can be a dicult challenge for a numerical method.
We now examine the biconvection problem in more detail. Let the domain be given
by 0 x 2. We restrict our attention to initial conditions in the form
u(x; 0) = f (0)eix
(2.19)
where f (0) is a complex constant, and is the wavenumber. In order to satisfy the
periodic boundary conditions, must be an integer. It is a measure of the number of
wavelengths within the domain. With such an initial condition, the solution can be
written as
u(x; t) = f (t)eix
(2.20)
where the time dependence is contained in the complex function f (t). Substituting
this solution into the linear convection equation, Eq. 2.17, we nd that f (t) satises
the following ordinary dierential equation (ODE)
df = ;iaf
(2.21)
dt
which has the solution
f (t) = f (0)e;iat
(2.22)
Substituting f (t) into Eq. 2.20 gives the following solution
u(x; t) = f (0)ei(x;at) = f (0)ei(x;!t)
(2.23)
where the frequency, !, the wavenumber, , and the phase speed, a, are related by
! = a
(2.24)
The relation between the frequency and the wavenumber is known as the dispersion
relation. The linear relation given by Eq. 2.24 is characteristic of wave propagation
in a nondispersive medium. This means that the phase speed is the same for all
wavenumbers. As we shall see later, most numerical methods introduce some dispersion; that is, in a simulation, waves with dierent wavenumbers travel at dierent
speeds.
An arbitrary initial waveform can be produced by summing initial conditions of
the form of Eq. 2.19. For M modes, one obtains
u(x; 0) =
M
X
m=1
fm (0)eimx
(2.25)
14
where the wavenumbers are often ordered such that 1 2 M . Since the
wave equation is linear, the solution is obtained by summing solutions of the form of
Eq. 2.23, giving
u(x; t) =
M
X
m=1
fm (0)eim(x;at)
(2.26)
Dispersion and dissipation resulting from a numerical approximation will cause the
shape of the solution to change from that of the original waveform.
Diusive
uxes are associated with molecular motion in a continuum
uid. A simple
linear model equation for a diusive process is
@u = @ 2 u
(2.27)
@t
@x2
where is a positive real constant. For example, with u representing the temperature, this parabolic PDE governs the diusion of heat in one dimension. Boundary
conditions can be periodic, Dirichlet (specied u), Neumann (specied @u=@x), or
mixed Dirichlet/Neumann.
In contrast to the linear convection equation, the diusion equation has a nontrivial
steady-state solution, which is one that satises the governing PDE with the partial
derivative in time equal to zero. In the case of Eq. 2.27, the steady-state solution
must satisfy
@2u = 0
(2.28)
@x2
Therefore, u must vary linearly with x at steady state such that the boundary conditions are satised. Other steady-state solutions are obtained if a source term g(x)
is added to Eq. 2.27, as follows:
"
@u = @ 2 u ; g(x)
@t
@x2
(2.29)
@ 2 u ; g(x) = 0
@x2
(2.30)
15
We now consider a series solution to Eq. 2.27. Let the domain be given by 0 x
with boundary conditions u(0) = ua, u() = ub. It is clear that the steady-state
solution is given by a linear function which satises the boundary conditions, i.e.,
h(x) = ua + (ub ; ua)x=. Let the initial condition be
u(x; 0) =
M
X
m=1
(2.33)
satises the initial and boundary conditions. Substituting this form into Eq. 2.27
gives the following ODE for fm :
dfm = ;2 f
(2.35)
m m
dt
and we nd
fm(t) = fm(0)e;2m t
(2.36)
Substituting fm(t) into equation 2.34, we obtain
u(x; t) =
M
X
m=1
(2.37)
The steady-state solution (t ! 1) is simply h(x). Eq. 2.37 shows that high wavenumber components (large m) of the solution decay more rapidly than low wavenumber
components, consistent with the physics of diusion.
16
The Euler equations, Eq. 2.8, form a hyperbolic system of partial dierential equations. Other systems of equations governing convection and wave propagation phenomena, such as the Maxwell equations describing the propagation of electromagnetic
waves, are also of hyperbolic type. Many aspects of numerical methods for such systems can be understood by studying a one-dimensional constant-coecient linear
system of the form
@u + A @u = 0
(2.38)
@t
@x
where u = u(x; t) is a vector of length m and A is a real m m matrix. For
conservation laws, this equation can also be written in the form
@u + @f = 0
(2.39)
@t @x
@f is the
ux Jacobian matrix. The entries in the
where f is the
ux vector and A = @u
ux Jacobian are
@fi
aij = @u
(2.40)
j
The
ux Jacobian for the Euler equations is derived in Section 2.2.
Such a system is hyperbolic if A is diagonalizable with real eigenvalues.1 Thus
= X ;1AX
(2.41)
where is a diagonal matrix containing the eigenvalues of A, and X is the matrix
of right eigenvectors. Premultiplying Eq. 2.38 by X ;1 , postmultiplying A by the
product XX ;1, and noting that X and X ;1 are constants, we obtain
@X ;1u
z }| {
;
1
@ X AX X ;1u
=0
(2.42)
@t +
@x
With w = X ;1u, this can be rewritten as
@w + @w = 0
(2.43)
@t
@x
When written in this manner, the equations have been decoupled into m scalar equations of the form
@wi + @wi = 0
(2.44)
i
@t
@x
1
See Appendix A for a brief review of some basic relations and denitions from linear algebra.
2.6. PROBLEMS
17
2.6 Problems
1. Show that the 1-D Euler equations can be written in terms of the primitive
variables R = [; u; p]T as follows:
@R + M @R = 0
@t
@x
where
2
3
u 0
M = 64 0 u ;1 75
0
p u
18
2.6. PROBLEMS
19
where ! = 0 for irrotational
ow. For isentropic and homenthalpic
ow, the
system is closed by the relation
;1 1
;
1
2
2
= 1; 2 u +v ;1
Note that the variables have been nondimensionalized. Combining the two
PDE's, we have
@f (q) + @g(q) = 0
@x
@y
where
u
;
u
;
v
q = v ; f = v ; g = ;u
One approach to solving these equations is to add a time-dependent term and
nd the steady solution of the following equation:
@q + @f + @g = 0
@t @x @y
(a) Find the
ux Jacobians of f and g with respect to q.
(b) Determine the eigenvalues of the
ux Jacobians.
(c) Determine the conditions (in terms of and u) under which the system is
hyperbolic, i.e., has real eigenvalues.
(d) Are the above
uxes homogeneous? (See Appendix C.)
20
!"$#&%%'#&)(+*-,/.
,/.1003254768,9*:#&1;=<&#?>&0$@91*-1<A411;B,/0C68DFE
G141*:DHG1#I(KJL#&41@M%'#ND103OP03254768,9*:#&F;
"3#5,/6*:MQ76@R,9*S6OND10$@9*->868,9*->03;L(+*T,/.U@R03;9QV03"W,X,/#ZYV#,/.[;RQ76"$0+61DU,/*-%08\^]Z10_"C6`6QFQ1@9#Cab*:%68,/0
,/.F03;90c;9*:%M41O-,/6103#41;9OTE'61Dd,9.103e;R#&O->0c,/.10f@90$;941OT,/*:F<MD1*Tgh0$@903F"30Z0$2N4168,/*-#&1;3\jifO-,903@9168,/*T>&03OTE&J
#&10M"C6k6QFQ1@9#Cab*:%68,/0K,/.F0U;9Q76l,/*S68OmD10$@9*T>6l,/*->03;cn1@9;R,3Jh,/.F03@90$YoEQ1@R#bD14F"3*:F<e6d;REN;B,/03%p#qX#&@Br
D1*-76@RE`DF*-gs03@90$o,/*S68OV0$254768,/*-#&1;$\jtu.10f,9*:%'0fD10$@9*T>6l,/*->03;v6@90c6Q1Q1@R#CaF*-%d6l,/03D10WaN,3JFO:036D1*-1<w,9#
6kxzy|{d}W~!{'/Ny|N{d}Wx|73'(+.1*-".HQ1@R#bD14F"303;M6;R0$,M#qD1*Tgh0$@90$1"30'03254768,9*:#&F;w(+.1*-"."C68HYV0
;9#O->&0$D\tu.1*-;+*:;u,/.10=6Q1QF@9#o6".03%'Q1.76;R*:$03D.F03@908\!,/.1*-;f".768QF,/0$@3J7,/.10w"3#1"30$QF,Z#qmn71*T,/0Wr
D1*Tgh0$@903F"3068Q1Q1@9#Cab*:%68,9*:#&1;Z,9#Q768@R,/*:6OjD10$@9*->868,9*->03;M*-;KQ1@90$;903o,903D\tu.103;R0"C6HYs06Q1Q1O-*:0$D
03*T,/.10$@f,9#d;9Q168,/*:6OmDF03@9*T>868,/*T>&03;f#&@+,/*:%'0wD103@R*->868,/*T>&0$;3\c]4F@c03%'Q1.768;9*:;f*:,/.1*-;_.76Qb,/03@c*:;#&
;9Q168,/*:6OhD10$@9*T>6l,/*->03;$F,/*-%0fD103@R*->868,/*T>&0$;u6@90Z,9@90368,/0$De*:_.76Qb,/03@+b\PN,/@968,/0$<&*:0$;_q#&@u6QFQ1O-EN*:F<
,/.F03;90Kn71*T,/0r!D1*Tgh0$@903F"30K6Q1QF@9#Cab*:%68,/*-#&1;_(+*-O:OhYV0KD1*:;R"341;R;90$D*:_.768QF,/0$@f1\
icO-OL#qj,9.10[%d6l,/03@R*S6OYV03O-#I(*-;ZQ1@90$;90$5,903D)*:A668@R,/0$;9*:6A;REN;R,903%\w
0U0$%Q1.16;9*-30U,/.F0
q6"W,,9.768,+2541*T,/0K<&03F03@/68O"3OS68;9;90$;f#8qL%'03;R.103;0WabQ1@R03;9;R03DA*-<0310$@/6O"$41@R>N*:O-*:1036@"$#b#&@RD1*:168,/0$;
*:A7N?Wy9L!FN}"C68HYV0',9@/61;Bq#&@9%'03D),/#641F*-q#&@R%6@R,903;R*S6
%0$;9.
(+*T,/.
032541*:;RQ76"$03D
*:o,903@R>86O-;*:K6u;R#8r!"36O:O-03Dl{cVNxxylV8!FN}WJI6;;R.1#?(+M*-KL*:<&4F@90^b\-&\tu.10Zl{cVNxxylV
!FN}h*:;411*Tq#&@9%68O:O,9.10v<03#&%'0$,9@9*:"^>86@R*S68,9*:#&*-;6Y1;9#@9YV03DM*-o,/#+>68@9*S68Y1O:0^"$#b0W'"3*:0$o,/;L#8qF,/.F0
,/@961;Bq#&@9%'03D)03254768,9*:#&F;3\e7#&@,/.F*:;w@90C68;9#&J*:)%U41".
#q,9.10'q#O:O:#?(+*-1<6"3"$41@/68"$E
676OTEN;9*:;
(v041;R06032541*:;RQ76"$03D6@B,/0$;9*S68;REN;B,/03% (+*-,9.1#&4F,'YV03*-1<H41FD141O-E@R03;B,/@9*-"$,9*->&0#&@'O:#&;R*:1<
Q1@96"$,9*:"C68O6Q1Q1O-*:"368,/*-#&\
?
^MA
CA$Lfh$jA
`L=^3'
tu.10;R*:%'Q1O:0$;R,%'03;R.*:o>&#&OT>N*:1<UYV#,9.,/*:%'0Z681De;9Q768"30K*:;v;9.1#?(+*:L*-<&41@90cF\ \jice*-1;9QV03"r
,/*-#&#q,/.1*-;Un7<&41@R0Qs0$@9%'*-,/;M41;[,/#kD10$n110,9.10e,/0$@9%';`61D1#,/68,/*-#&1030$D103D,/#kD10$;9"3@R*:YV0
&
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
y
x
L*:<41@90KF\T&
j.oEN;9*:"36O61D"3#%Q14b,68,9*:#&768Oh;9Q16"30$;3\
n71*T,/0ZDF*-gs03@90$1"30K68Q1Q1@9#Cab*:%68,9*:#&1;$\^!<&03F03@/68OJb,9.10D10$Qs0$1D103o,+>86@9*:6Y1O-03;3JbJbq#&@0aF6%QFO:0J
6@R0q41F"$,/*-#&1;v#q,/.F0c*:FD103QV031DF03o,>86@9*:6Y1O-03;jJF681Dd/VF\j7#&@j,9.10fn7@R;R,_;90$>03@96Oh".768QF,/0$@9;
(v0["3#&1;R*:D10$@Q1@9*-%d68@9*:OTEd,9.10e$r"36;90[Am9R\K.F03k#&1OTE#&F0M>86@9*:6Y1O:0w*:;cD1031#8,/03DhJ
D10$Qs0$1D103F"30U#&,/.F0w#8,/.10$@f*-;+6;9;R41%0$D\_tu.F0=%'03;R.*:FD10Waeq#@+*:;wP?X7J61D,/.768,uq#@
*-;wPI_L\jtu.F03#60$2N4F*:;9Q16"30$D<&@R*:D
Nu5U
F\-?
!=UP
F\
(+.10$@90[Uk*:;u,9.10M;RQ76"3*-1<d*-)6FDUu,/.10=;9Q768"3*:F<d*:Js6;c;R.1#?(+A*:L*:<&4F@90wF\ \f#,90
,/.168,ce[_,/.1@R#&41<&.1#4F,C\v68,/0$@Z61Dj6@90K41;R03Dq#@61D*:6`;9*:%'*:O:6@v(_6CE&\_.F03
L&s6@R04F;903Dq#&@#8,/.10$@Q14F@9QV#&;90$;A(+.F*:".*-;;R#&%0W,/*-%0$;'F03"30$;9;96@REFWJ+O-#b"36Ou"3#&o,90WaN,
;9.F#&41O:D%60,9.10K%0361*:F<[#&Yo>b*-#&41;$\
tu.10w"3#&o>&0$o,/*:#q#&@u;R41Y1;9"$@9*-QF,f61D;941QV03@R;9"3@R*:QF,*-1D10Wab*-1<`*:;+6;uq#&O-O:#?(+;3
mFV
L|[Us
m|[[RFV
mR'N|X7C1
mR c:[sXNR
?1
R
F\ &
#8,/*:"$0Z,/.76l,u(+.10341;90$D6O-#&108JFYV#,/.e,/.F0K,9*:%'061D;RQ76"30w*:FD1*:"$03;u6QFQs036@6;+6[;941Y1;R"3@R*:QF,3J
f
Y14F,[(+.F0341;90$D,9#&<&0W,/.10$@3Jj,/*-%0*-;[6OT(6CEN;`6;941QV03@R;9"$@9*:Qb,'61D*:;U4F;9476O-O-E
031"$O:#&;R03D(+*-,9.
Q76@R03o,/.F03;90$;f,9#'DF*:;R,9*:1<41*:;R.*T,q@9#% 60WabQV#&103o,3\
N&vbcPccLf3mXZL^XfXU^
M=1cWu
t
Grid or
Node
Points
n+1
n-1
L*-<&41@R0F\
j-2
j-1
j+1
j+2
bQ76"$0Wr,/*:%'0<&@R*:D6@R@/61<03%'03o,C\
Z03@R*->868,/*T>&0$;68@900WabQ1@R03;9;R03D 68"3"3#@9D1*-1<),9#A,/.1041;R476O+"3#&o>03o,/*-#&1;3\tu.541;q#&@[Q16@R,9*S6O
D10$@9*->868,9*->03;+*:e;RQ76"30w#&@,9*:%'0c(_0w41;R0=*-5,903@R".761<&036Y1OTE
e
0$,9"\
F\ o
7#&@,/.F0w#@9D1*-76@RE,/*-%0ZDF03@9*T>868,/*T>&0*:e,9.10K;R,/4FDFE#q^]K ;u(_0K41;R0
b
F\
!,/.F*:;+,/0WaN,;R41Y1;R"3@9*-QF,/;#D103QV03FD103o,>86@9*:6Y1O-03;f6@90=10$>03@41;R03D,/#d0WabQ1@90$;9;KD10$@9*->868,9*->03;3\
tu.541; (+*-O:OhF#,Ys041;R03D,/#`@90$Q1@90$;903o,f,/.10n7@R;R,D103@R*->868,9*->&0#8qL(+*-,/.@90$;9QV03"W,,9#'\
tu.10cF#,68,9*:#&[q#&@XD1*Tgh0$@90$1"30c6Q1Q1@R#?ab*-%d68,9*:#&F;^q#&O:O-#I(+;^,9.10;/6%'0fQF.1*:O-#&;9#&QF.5EUY14F,Z(+*-,9.
#&10P0Wab"$03QF,9*:#&*-,*-;F#,L4F1*:254108
\ vE,9.1*:;(v0_%'0C6K,/.76l,m,9.10v;BEN%UYs#
O u*-;4F;903D=,/#@903QF@903;R03o,
6[D1*-gs03@R031"$0M68Q1Q1@9#Cab*:%68,9*:#&d,9#'6`DF03@9*T>868,/*T>&0K;941".,/.76l,CJFq#&@u0aF6%QFO:0J
!
F\ &
Y14F,u,9.10KQ1@90$"3*-;90K768,941@90'61D#&@9D10$@_#q,/.F0K6Q1Q1@R#?ab*-%d68,9*:#&d*:;u1#,+"36@9@R*:0$D*-,/.10K;BEb%MYs#&O
5\U]c,/.F03@Z(_6?EN;w6@R0[41;90$Dk,9#D10$,903@9%'*:F0U*-,9;ZQ1@90$"3*-;90[%'0C61*-1<1\Ktu.10[#&F0[0Wab"30$QF,/*-#&k*:;Z,/.F0
;REN%UYV#&OeJ1(+.1*-".*-;uD10$n7F03D;R41".,9.768,
U!=
!?#"%$H!1
UN+NR#"$HNI
[=7?#"&$7b
.10$,9.103@R0=*-;u1#`;941Y1;R"3@R*:QF,f#&U#&@+UJ7,/.10K;RQ76"3*-1<`*:;u41F*-q#&@R%\
0$,9"\
F\'
)(
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
*,+M
X.-wwj.-'
/0+1+Aj3254
=j$A
iD1*-gs03@R031"$06Q1QF@9#Cab*:%68,/*-#&K"C6UYV0P<&0310$@/68,903DU#@m0W>68O:4768,903D=Y5Ew%'0C6F;L#q6;9*-%Q1O-0jtL6CENO:#@
;90$@9*-03;0aFQ161;9*-#&\ #@0a168%Q1O-0Ju"$#&1;9*-D103@m9R[(+*-,/.[nFab03D\tu.F03Juq#&O-O:#?(+*:1<k,/.F0
1#,/68,/*-#&A"3#5>03o,/*-#&)<&*->03k*:6j25;3\F\TU,/#F\ FJ
5U6FD)m|b[sc mTNU
FUsXN91I7
\ LaFQ161D1*-1<',9.10KOS68,R,/0$@_,/0$@9%6YV#&4F,u<&*->03;
N91+bL zFUs
8
zFUs 8
;=;=;?
<
FUs 8
;=;=;mF@\ ?&
<
9
9
9
>
%
#b"36OoD1*Tgh0$@903F"30P6Q1Q1@R#CaF*-%d6l,/*:#1;,/#6+<&*->03wQ76@R,9*S6OD103@R*->868,/*T>&0X"C68=YV0jq#&@9%'03DKq@9#&%
"3#%UY1*:168,/*-#&1;#qmNZ61DN91fq#&@BA`&A 5;=;=;T\
7#&@u0WaF6%'Q1O:08J1"3#1;9*-D103@u,/.F0wtm6CENO:#&@u;R03@9*-03;0WabQ76F;9*:#q#&@uNR#"
[s 8
Us 8
NR#
"jN^ Us
8
;=;=;I
C
;=;=;
<
9
9
9
&>
f#?(
O:*:F0C6@
F\@D&
;941YF,9@/6"W,bc61DD1*->N*:DF0Y5Ee[,/#'#&YF,/6*:
bR#"&$N
E8
F9
[
Us8
9
<;=;=;
zF\T
tu.541;L,9.100WabQ1@R03;R;9*:#N9#"G$=N3IHU*-;L6f@90C68;9#&768Y1O:0v6Q1Q1@R#CaF*-%d6l,/*:#wq#&@JLKN
M O 6;LO-#&1<Z68;
K
UA*:;u;R%d68O:O\X0WaN,f"3#&1;R*:D10$@,9.10K;9Q768"30wD1*-gs03@R031"$0M6QFQ1@9#Cab*:%68,/*-#&)NR#
"%$N P"BQHF UsW\
LabQ761D,/.10A,/0$@9%';*: ,/.10k541%'03@968,/#&@6YV#&4F,'61D@903<@9#&41Q,/.F0)@R03;R41O-,e,9#q#&@R% ,/.F0
q#&O-O:#?(+*:1<M03254768,9*:#&
N9#"R$NP"
$S8
9
U
[ 8
T
T 9
V
UU8
V 9 &WNWNW
8
zF\T&I
.10$0WabQ1@R03;R;903DA*-e,/.1*-;%61F03@3J7*T,+*:;+"3O-0C6@,9.768,+,/.F0=D1*-;9"$@90$,90,/03@R%;+#&,/.F0=O-0$q|,+;9*-D10K#q
,/.F0f0$2N4168,/*-#&@R03Q1@R03;R03o,u6n7@9;B,PD103@R*->868,/*T>&0u(+*-,9.d6K"30$@R,/6*:6%'#&41o,X#q0$@9@R#&@j(+.1*:".d6Q1QV0C6@R;
#&,/.10@R*:<&.o,[;R*:D10#q,/.100$2N416O+;9*:<\,'*:;`6O-;9#k"3O-0C6@U,9.768,[,/.F00$@9@R#&@`D103QV031DF;#&,/.F0
<&@R*:DH;RQ76"$*:1<,9#6"$03@B,6*-H#&@RD103@$\tu.100$@9@R#&@w,903@R%"$#&o,6*-1*:1<,/.F0d<&@R*:DH;RQ76"$*:1<,9#,/.F0
O:#?(v03;B,jQs#?(v03@j<&*T>&0$;L,/.10u#@9D10$@L#q,/.F0%0W,/.1#ND\L@R#&X
% j2V\&F\- J8(v0u;90$0,/.768,m,/.10u0abQ1@90$;9;9*-#&
NR#
"!$'b$Q H8[*:;X6cn1@9;R,Br!#&@RD103@X68Q1Q1@9#Cab*:%68,9*:#&M,9Y
# JZKN M O \^b*:%'*:O:6@9OTE&[J j2\5F\-u;9.1#?(+;j,/.76l,
K
NR#
"$kN) P"Q H1 Usv*:;_6M;90$"3#&1DNr!#&@RD103@+6QFQ1@9#Cab*:%68,/*-#&,9#[6Mn7@R;R,uD10$@9*T>6l,/*->0\^tu.F0OS68,R,/03@
*:;X@R0$q03@R@90$D,/#=6;X,/.10+,/.F@9030r!QV#&*:o,X"$03o,/0$@903DeDF*-gs03@90$1"30f6Q1QF@9#Cab*:%68,/*-#&Jo6FD#&F0f#q|,903';90$03;
,/.F0w;R41%'%d6@BE@R03;94FO-,+Q1@R03;90$o,/03D*:e,/.10q#&@R%
bR#"R$N)P"
]\dzU
U
zF\T
N Nmf3mXZ^LPXU^
CAW^fh
`ab`aIc
uXXc_uf
$jA+
^_+HZXw^'X
dfehgIikjml gonqpsrpRiutvpxwzy{psr|%jehr}
0$@9.768Q1;c,/.F0=%'#&;R,"$#&%%'#&0WaF6%'Q1O:0$;f#8q^n71*T,/0WrD1*-gs03@R031"$0q#&@9%U4FOS6;6@R0w,9.10=,9.1@90$0Wr!QV#&*-5,
m
"
"30$o,/03@R03DbrD1*-gs03@R031"$0U6QFQ1@9#Cab*:%68,/*-#&1;_q#@,/.10n7@R;R,f61D;90$"3#&FDD10$@9*->868,9*->03;3
8
8
9
NR#"%$HbP"B~\zU
U
bR#"&$
U
N^bP"B~\zU
zF\T?o
zF\TC5
tu.10$;906@R0f,9.10cY768;9*:;Xq#&@j7ly|7xXy Z}W/}Wh}7}WRxl/X;R*:1"$0f,/.F0$E'<&*->0Z6d6Q1Q1@R#CaF*-%d6l,/*:#`,9#
6=DF03@9*T>868,/*T>&0f68,_#10cD1*-;9"$@90$,90cQV#&*:o,v*:6=%'03;R.*:',/03@R%;P#q;R41@9@R#&411DF*:1<=Qs#&*-o,/;3
\ #?(_0W>&03@$J
10$*-,/.F03@w#q_,9.103;R0d0WabQ1@R03;R;9*:#1;=,903O:Oj4F;=.1#?( #8,/.10$@=QV#&*:o,9;w*-),9.10'%0$;9.68@90'D1*-gs03@R031"$03DH#@
.1#?( YV#&411D768@RE"3#1D1*-,9*:#&F;c6@R0=0$Fq#&@R"303Dh\cN41".A6D1DF*-,/*-#&76O*-Fq#&@R%d68,9*:#&e@R032541*-@903;c6%'#&@90
;9#Q1.1*:;B,/*-"C68,903Deq#&@9%M41OS68,9*:#&h\
`ab`ao
|%jrgolBgn{pRrpRiutvpxwmypRr|%je7r}
_#&1;R*:D10$@u,/.10K@90$OS68,9*:#&
sz
N9#"&$
U
bLN)P"B
zF\TG&
(+.1*-".e*:;u6MQV#&*-5,_D1*-gs03@R031"$06Q1QF@9#Cab*:%68,/*-#&,9#[6U;90$"3#&1DD10$@9*T>6l,/*->0\j#?(O-0$,_41;uD103@R*->06
{'xWy w#&QV03@/6l,/#&@+@90$Q1@90$;90$5,/68,/*-#&q#@+,9.10K;/6%'0=6Q1Q1@R#?ab*-%d68,9*:#&h\P_#&1;9*-D103@+,/.F0wq#&4F@QV#&*-5,
%'03;9.(+*T,/.YV#&41FD76@REQV#&*:o,/;Z68
, 61D6K;9.1#?(+kYV03O:#?(K\#,/*-"30M,9.768,f(+.103A(v0[;9QV0C6#q
,9.10=541%MYs0$@#8q^QV#&*:o,/;+*-6`%0$;9
. FJ(v0w%036,9.10wN4F%UYs0$@f#8qy|7x!}WWyl_Qs#&*-o,/;+0Wab"3O-41D1*-1<
,/.F0wYV#&41FD76@9*-03;$\
e
[
$
;
#41@uQs#*:o,u%'03;9.h\vURH1
ov@@=@%GI[=I@@.ZI)G@
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
6@R@9*->0K68,+,/.10q#&4F@u03254768,9*:#&1;$
s "
s
s
s
k$
v"
"&$
T
$
T U
T $
!
zF\T?o
@9*-,9*:1<U,9.103;R0K03254768,9*:#&1;+*-,9.10K%#@90;94F<&<&03;B,/*T>&0Kq#&@9%
h "
h
h
T
h
"
"$
Z
T
$ T
T
Z
IHU
IHU
IHU
IHU
zF\TG'&
*-,w*-;w"$O:036@,/.768,K(v0d"36H0aFQF@903;R;M,/.F03% *:
6>03"W,/#&@r!%68,/@R*TaAq#&@R%J6FD)q41@B,/.10$@3J,/.768,w,/.F0
@90$;941OT,/*-1<`%d68,9@9* a.768;f6U>03@RE;RQs0$"3*:6Oq#&@9%\^!o,/@R#bDF41"3*-1<
U
"
J O
zF\T=?o
61D
U
zF\T=Do
(v0="36@90$(+@R*-,90j2\VF\TG'U6;
,[
J ) O
e
zF\
t .1*:;0aF6%QFO:0U*-O:O:4F;R,/@968,/0$;c6%68,9@9*TaD1*Tgh0$@90$1"30[#&QV03@968,/#@3\X6".
O-*:10=#qv6%d6l,/@9* aD1*-qSr
u
q03@R031"$0Z#&QV03@968,/#&@X*-;vY768;903Dd#&e6=QV#&*-5,PD1*Tgh0$@90$1"30f#&Qs0$@/68,9#&@3JNY14F,P,/.F0cQV#&*:o,v#&Qs0$@/68,9#&@9;P41;R03D
q@9#% O:*-10,/#KO-*:10+6@R0u1#,P10$"303;R;/6@R*:OTEU,/.10+;96%08\j7#&@j0WaF6%'Q1O-0JoYV#&411D768@RE["$#&1D1*T,/*:#1;j%d6CE
D1*-"$,6l,/0Z,/.168,,/.F0wO-*:10$;u68,u#@u10C6@,9.10KYs#8,9,/#% #&@,9#&Q#q,/.10K%68,/@R*TaYV0%#ND1*-n103D\^!,/.F0
0WaN,9@903%'0M"36;90=#qL,9.10M%68,9@9*TaD1*-gs03@R031"$0M#&QV03@968,/#@@R03Q1@R03;R03o,/*-1<e6;RQs0$"$,9@/6O%0W,/.1#NDJ71#10
#qX,/.F0[O:*:F03;Z*-;c,/.10[;96%'0\wtu.10`%d68,9@9* a#Qs0$@/68,9#&@9;Z@R03Q1@R03;R03o,/*-1<,9.10U,/.F@9030r!QV#&*:o,"$03o,/@96OTr
D1*Tgh0$@903F"306Q1Q1@R#?ab*-%d68,9*:#&F;Zq#&@w6n7@R;R,M61DH;R03"$#&1DD10$@9*T>6l,/*->0[(+*-,/.
Z*:@R*:".1O-0$,KYV#&411D16@RE
"3#1D1*-,9*:#&F;u#&6[q#41@BrQs#&*-o,u%0$;9.6@90
N Nmf3mXZ^LPXU^
$
w
$
w
'
uXXc_uf
$
w
U
zF\ I
ic;6q41@R,9.103@0WaF6%'Q1O:08Jc@R03Q1O:6"30k,/.10kq#&41@B,/.O:*-10A*:<j2\fb\-?YoE ,/.10kq#&O-O:#?(+*:1<QV#&*-5,
#&QV03@968,/#&@q#@+6'0341%61YV#&411D768@REe"$#&1D1*T,/*:#)b0$0MN03"$,9*:#&F\ F\ W
s
8
$
U
9
$H
T
[
U
zF\ &
zF\ o
(+.10$@90K,/.10KYV#&411D768@REe"$#&1D1*T,/*:#e*:;
h9
8
tu.10$,/.10%d68,9@9* a#&Qs0$@/68,9#&@`q#&@d6),/.1@R030WrQs#*:o,d"$03o,/@96OTrD1*-gs03@R031"$*:1<
;9".10$%068,d*-o,/03@R*:#&@
QV#&*:o,/;'6FDk?}lV~9lRN}WWoV/. &y|{'xylAq#&@'6)0341%61"3#1D1*-,9*:#&#&,/.F0@R*:<&.o,`*-;
<&*T>&03YoE
[
H
H
zF\ 5
X6".H#qP,/.F03;90'%68,/@R*TaADF*-gs03@90$1"30`#&QV03@968,/#@9;K*:;K6e;9254768@90'%d68,9@9* a(+*-,9.k03O:0$%0$o,/;,/.76l,
6@R06O-O$03@R#&;0Wab"$03QF,q#@,/.F#&;90A68O:#&1<)Y76FD1;d(+.1*-".6@90"3O:4F;R,/0$@90$D6@9#&4F1D,/.F0"30$o,/@/68O
D1*:6<&#&768O\m
0K"C6O-O;94F".6[%d6l,/@9* ae6VN}9'{'xyM6FD*-o,/@9#ND141"$0,/.10K1#,/68,/*-#&
I3j
\\
\
zF\ &
\\
\
( .10$@9041;R0Z#q& *:,/.10c6@9<&4F%0$5,_*:;v#&QF,/*-#&76OV6FD,/.10f*:O:O-41;R,9@/68,9*:#&`*-;_<&*T>&03q#@_6M;R*:%'Q1O:0
+
xWyy?NlVW%68,/@R*TaK68O-,/.F#&41<&.=6oEK541%UYV03@#q1Y7681D1;*:;6fQV#&;9;R*:Y1*-O:*T,!E&\i,/@R*:D1*:6<&#&768O%68,/@R*Ta
(+*-,9.1#&4F,"3#&1;B,6o,9;f68O:#&1<=,/.10ZY161D1;+"C68eYs00aFQF@903;R;90$D6
; ? 3 \jtu.10K6@R<&41%'03o,/;_q#@
6dY7681D103DA%68,9@9*Ta6@90[68O-(_6?EN;f#bD1D*:541%UYV03@c61D,9.10U"$03o,/@96OL#&F0eP?@90$q0$@9;c,9#d,/.F0
"30$o,/@/68OD1*S6<#&76Oz\
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
H0K"36F#I(
68;
<&03F03@/68O:*:$0#&41@+Q1@R0$>N*:#&4F;0aF6%QFO:03;$\XZ0$n7F*:1<
"
T
\\\
zF\ o
YoE
(v0="366Q1Q1@R#?ab*-%d68,90Z,/.10K;R03"3#1DD10$@9*T>6l,/*->0#q
e&N$
U
e
J ) O
CI M
zF\ '&
(+.10$@90~J ) O ;B,6FD1;Mq#&@w,/.10d>03"W,/#&@[.1#O:D1*-1<,9.10eZ*-@9*:".FO:0$,=YV#&411D768@RE
"3#&1DF*-,/*-#&1;w#&,/.F0
O:0Wq|,61D@9*-<&.o,+;9*-D103;$
I 5;=;=;$ /
U
J ) O
zF\ ?o
q^(v0MQ1@R03;R"3@9*-Ys0Mf0$41%d681YV#&411D16@RE"3#1D1*-,9*:#&F;#,/.F0=@R*:<&.o,f;9*:DF0JV6;c*-fj25;3\sF\ 681D
F\ & JF(v0Kn71D
e 7 l 3 I M
J ) O
U
zF\ Do
(+.10$@90
J O
&3&N;=;=;W H8
I N;=;=;
[
N$
N$
N;=;=;$N$
H8
U
I F[ kuG[@v@k[q@[:I.b@5IZ.[G3GLIL:[@
@NI.
N Nmf3mXZ^LPXU^
uXXc_uf
*:F"30v(v0_%680v"$#&1;9*-D103@96Y1O-0v41;R0#qFYs#,9.M%68,/@R*Taw681DUQV#&*:o,#&QV03@/6l,/#&@R;3J*T,*:;*:%'Qs#&@B,6o,
b
,/#'03;B,6YFO:*:;R.6'@R03OS6l,/*:#eYs0W,!(_0$03,9.103%\vi QV#&*:o,#&QV03@968,/#&@u*-;+<&0310$@/6O-O-E(+@9*-,R,/0$q#&@u;R#&%'0
D10$@9*->868,9*->0c68,v,/.10f@90Wq03@90$1"30QV#&*-5,LU*:,/03@R%;P#q10$*:<&.5YV#&@9*-1<K>68O:410$;_#q,9.10cq41F"$,/*-#&\j7#&@
0WaF6%'Q1O-0
hu N)P
~"BbP"h]Nj]N"BN9#"
zF\
%'*:<&.o,XYV0+,9.10Qs#&*-o,v#Qs0$@/68,9#&@^q#&@P6Kn1@9;R,vD10$@9*->868,9*->0\Ltu.F0c"3#@9@90$;9QV#&1D1*-1<w%d68,9@9* a[#&QV03@968,/#&@
.76;q#@u*-,/;6@9<&4F%0$5,9;u,/.10"$#b0W"$*:0$5,9;+<&*->N*:F<U,/.10Z(v03*-<&.o,/;u,/#[,/.F0Z>68O:410$;u#qm,9.10Zq411"W,/*-#&
68,w,/.10'>86@9*-#&41;wO:#N"C68,9*:#&1;$\ei r;9.1*Tq|,M*-),9.10dQV#&*:o,=#&QV03@/6l,/#&@w"3#&@R@90$;9QV#&1D1;M,9#6D1*S6<#&76O
;9.F*-q|,+*:e,9.10K%d68,9@9* a#&QV03@968,/#@3\jtu.541;+,/.10K%68,/@R*Tad032541*->86O-03o,+#%
q j2V\VF\ *:;
Be "W?="
#
zF\ FI
#8,/0d,9.10e6D1DF*-,/*-#&H#8qc6303@R#A*:H,9.10n1q|,9.03O:0$%0$o,M(+.1*-".%6803;U*T,U"3O-0C6@w,/.76l,'*-;M,/.F0
f
"3#N0$'"$*:03o,#qmNI\
`ab`ab`
dfpsrge:3gt
|%jrgtvpR}
tu.10f6YV#I>0f*-O:O-41;R,9@/68,903D["C68;903;P*:[(+.1*-".',9.10Ys#&4F1D76@BE["3#&FD1*-,9*:#&1;X68@90unFab03D\jqs,/.10+YV#&411DNr
6@BEA"3#&FD1*-,9*:#&1;w6@R0U7}WWy3yWJ,9.10'q#@9% #qv,/.10`%68,/@R*Ta#&Qs0$@/68,9#&@K".761<03;3\e_#&1;9*-D103@K,/.F0
03*-<&.o,RrQs#&*-o,LQV03@R*:#ND1*:"P%0$;9.`;9.F#I(+`YV03O-#I(K\mtu.1*:;L"C6[0$*-,/.F03@^YV0Q1@R03;90$o,/03D'#&`6cO-*:1036@L%'03;R.
(+*-,9.`@903QV0C6l,/03D'03o,9@9*:0$;3J5#&@j%'#&@90_;941<&<03;R,9*->03O-EU#&'6K"$*:@R"341O:6@^%'03;9.6;j*-m*:<&41@R0uF\ F\m.F03
,/.F0[%0$;9.A*:;cOS6*-D#&4F,Z#&,/.10[QV03@R*:%'0$,903@c#8q_6"$*:@R"3O:08J*-,cD1#N03;9 ,K@R0C6O-O-E%d6l,9,/0$@f(+.10$@90[,/.F0
541%UYV03@R*:1<K;R,/6@R,9;_68;PO-#&1<w6;X*-, 031D1I; M6l,P,9.10+Qs#*:o,R41;R,vQ1@R03"30$D1*:F<=*T,/;j;R,/6@R,9*:1<KO-#b"368,/*-#&\
;=;=;
e
[
'
$
?
$
;
$
;
'
$
;
?
;
j*:<&.o,+QV#&*:o,9;u#&6[O-*:1036@QV03@9*-#bDF*:"Z%'03;R.\P[e
;=;=;
sHN
tu.10%d68,9@9* aU,/.168,X@90$Q1@90$;903o,9;D1*-gs03@R031"$*:1<K;R".103%'03;Pq#&@j;9"36OS6@X0$2N4168,/*-#&1;X#&6wQV03@R*:#ND1*:"
% 03;9.w*:;@R0$q03@R@90$D=,/#f6;67}WWy3yh%68,/@R*Tas\i,!ENQ1*-"C6O5QV03@R*:#ND1*:"L,9@9*-D1*S6<#&76O8%d68,9@9* a#&QV03@968,/#&@
'
(+*-,9.1#&5411*Tq#&@9% 03o,/@R*:03;*:;u<*->&0$eq#&@+6Ir!QV#&*:o,u%'03;R.YoE
koz` V I 3 j
5 "
"
N"
T
T
U
U
V
V
zF\
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
1
8
6
5
m*:<&41@R0KF\ F
`ab`a
grts|ijm
j*:<&.o,+QV#&*:o,/;u#6["3*-@9"$41OS6@_%0$;9.\
|%jrgtvps}
!A<&0$103@96OJ68;Z;9.1#?(+)*:,9.10U0a168%Q1O-0Jh,9.10U0$O:03%'03o,9;K6O:#&F<,/.F0[D1*S6<#&76O-;f#qv6QV03@R*:#ND1*:"
%68,/@R*TaK68@90X1#,"3#1;R,/6o,C
\ #?(_0W>&03@$J56;RQs0$"3*:6Oo;941YF;90$,L#qF6QV03@R*:#ND1*:"j%68,/@R*Tac*:;,/.F0v"$*:@9"$41OS685,
%68,/@R*TasJq#&@9%'03DA(+.10$
,9.10`03O:0$%0$o,/;w6O:#1<e,/.10[>86@9*-#&41;Y7681D1;=6@90["$#&1;R,/6o,C\_*:@9"$41OS685,
%68,/@R*:"30$;XQ1OS6CE'6w>N*T,6O7@R#&O:0+*:'#&41@v6768O-EN;9*-;3\L
0(+*-O:O7.76C>0c%U41".d%#&@R0u,/#M;96CEd68Ys#&4b,P,9.103%
OS6l,/03@$\jtu.10K%#;R,+<&0$103@96O"3*-@9"34FOS6o,+%68,/@R*Tad#qL#@9D10$@`*-;
5" T
5"
T
T N"
5" T )
zF\ &o
kN
7?$X
\\
\
\\
zF\ 5
.103,/.10f;R,681D76@RD,/.F@9030r!QV#&*:o,P"30$o,/@/68OTr!DF*-gs03@90$1"3*-1<=6Q1Q1@R#?ab*-%d68,9*:#&F;^q#&@_6n7@R;R,u681D
NNuucm_{
Z^^XfXMLq
^fvv
uc
ufX
9; 0$"3#&FDD10$@9*T>6l,/*->0J&;R030:j2\oF\ &Jo6@R0u41;90$D[(+*-,/.[QV03@R*:#ND1*:"vYs#411D76@BEU"$#&1D1*T,/*:#1;3J,9.10$E=,680
,/.F0Kq#@9%
$
w
$
w
$=
$w
kN$w& 3I
U
61D
U
kNB&5$
U
3I
zF\ !&
O:036@9OTE&Jh,9.103;R0`;9QV03"3*:6OL"36;90$;K#qPQs0$@9*:#ND1*-"M#&QV03@968,/#&@R;K6@90U6O:;R#e"3*:@R"341O:6o,#&QV03@968,/#&@R;3\=68,/0$@
_
#&(v0e,6806DF>86o,6<0#q+,/.1*-;U;9QV03"$*S6OvQ1@9#Qs0$@R,!E&\
f#8,/*:"$0d,/.168,U,/.F03@9068@901#kYV#&411D16@RE
"3#1D1*-,9*:#&>03"W,/#&@R;f;R*:1"$0K,9.1*:;u*-Fq#&@R%d68,9*:#&d*:;+6O-Oh*:o,903@9*-#&@,/#[,9.10K%d68,9@9*-"303;,9.103%';90$O->03;3\
'AmjAujC$jAC
*_4
Z/
Z
`aaIc
|ve7rC|ps}
tu.10etm6CEbO-#&@U;R03@9*-03;[0aFQ161;9*-#&#q+q411"W,/*:#1;`6YV#&4F,`6nFab0$DQV#&*-5,UQ1@9#?>N*:D10$;`6%0361;Mq#@
"3#1;R,9@941"W,/*:F<n11*-,90Wr!DF*-gs03@90$1"30Qs#&*-o,Rr!#Qs0$@/68,9#&@9;#q=6oE #&@9DF03@3\i ;9*-%QFO:0681D;R,/@96*:<.5,
q#&@B(6@RD(_6CE',9#="36@9@BE[,/.1*-;v#4F,P*:;X,/#w"3#&1;B,/@R41"$,6 tm6CENO:#&@X,6YFO:0J K(+.1*:".%6803;P0WaN,/0$1;9*T>&0
41;R0#qZ,9.100aFQ161;9*-#&<&*T>&0$Yoz
E j2\b@\ ?F\if;60aF6%QFO:0J_"3#&1;R*:D10$@dtm6Y1O-0F\T(+.F*:".
@90$Q1@90$;90$5,9;6Htm6?ENO-#&@,/6Y1O:0q#&@6 6QFQ1@9#Cab*:%68,/*-#&#qK6H;R03"3#1D D103@R*->868,9*->&041;9*-1<
,9.1@90$0
>86O:4F03;#qM,9.10)q4F1"$,9*:#&"303o,903@90$D 6YV#&4F,,/.10)QV#&*:o,68,(+.1*:".,/.10)D103@R*->868,9*->&0)*:;e,9#YV0
0$>86O-4768,903D\
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
{;3bP"
k;?N
k?; NR#"
JLKNM O
K
{;5|r/Ih; "
"
h;NBIh; "
U U ;
JLKM O
K
JLK)M O
K
"
;NSrI ;
"
kN; BI ;
"
;N|r9I T ;
"
U T ;
U ;
U;
N
[ ; J KM O
K
5NP"h]Nj]N9#"BX
U
9
k;oBI T ;
"
JZK)b M O
K
"
;N|r9I U ;
;5BI U ;
U
"
U
tm6Y1O-0F\T&\tL6CENO:#&@U,/6Y1O-0q#&@["30$5,903@R03DIr!QV#&*:o,`6<&@961<&*:66Q1QF@9#Cab*:%68,/*-#&H,/#
6A;90$"3#&1D
DF03@9*T>868,/*T>&0\
t .10,6Y1O-0e*:;["$#&1;R,9@941"W,/0$D;9#k,/.76l,;R#&%'0e#qf,9.106O:<&0$Y1@/6*-;`;9*:%'Q1O-*-n70$D\i,`,/.10e,9#&Q
u
#qP,/.10[,/6Y1O:0=(_0';90$068
0aFQF@903;R;9*-#&)(+*T,/.)6e254103;B,/*:#
%6@9\[tu.1*-;@90$Q1@90$;903o,9;M#&10`#qP,/.F0
254103;B,/*-#&1;j,/.76l,P6Z;R,/4FDFE`#q,/.1*-;^,6YFO:0"36'61;R(v03@$F768%0$O-E&J8(+.768,X*:;^,9.10uO:#N"C68OF03@R@9#&@j"3641;R03D
YoE`,/.1041;90f#qh,9.1*:;P6QFQ1@9#Cab*:%68,/*-#&ef#8,/*:"$0,9.768,v6O-O7#qh,9.10f,903@9%';X*:`,/.10f03254768,9*:#&6Q1QV0C68@
*:6"$#&O:41%'68,f,9.10MO-0$q|,#q^,9.10=,/6Y1O-06O-,9.1#&41<&.hJ7*:,9.1*:;"C68;90JhU .76;fYs0$03%U4FO-,/*-Q1O:*-03D
*:o,9#
036".,/0$@9% (+.1*-".;R*:%'Q1O:*Tq03;U,/.F0,903@9%';`,/#)Ys0Q14F,*:o,/#k,/.F0,/6Y1O:08\ \tu.10$1#,9*:"$0
,/.168,+68,u,9.10.10C68D#8qm036"."3#&O-41%,9.103@R0K6Q1QV0C6@R;,/.10"$#&%'%#&q6"$,9#&@,/.76l,u#b"$"341@R;+*:,/.F0
0WabQ7681;9*-#qL036".,903@9% 6Ys#4F,u,/.10KQV#&*:o,P7JF,9.768,+*:;$J
U
;8
C& N;=;=;
t .10+"3#O:41%'1;^,/#,9.10+@9*:<.5,^#qs,9.10+O:0Wq|,/%'#&;R,j#10J5411DF03@j,/.10+.1036D1*-1<&;3Jo%6804FQ',9.10utL6CENO:#@
u
,68Y1O:08\X6".`03o,/@BE[*:;m,/.10u"$#b0W"$*:0$5,X#8qV,9.10,/0$@9% 68,^,/.F0,/#&Q[#q,9.10u"3#&@R@90$;9QV#&1D1*-1<"3#&O-41%'
*:,/.10Utm6CENO:#&@Z;R03@R*:03;c0WabQ761;R*:#&A#8qP,9.10M,903@9% ,/#,9.10UO-0$q|,Z#8qj,/.10U"$#&@9@R03;RQs#&FD1*:1<e@R#?(K\=7#&@
0WaF6%'Q1O-0J&,/.F0uOS6;B,j@9#?(*:U,/.F0,6Y1O-0"3#@9@90$;9QV#&1D1;X,/#Z,9.10utm6?ENO-#&@j;90$@9*:0$;j0WabQ76F;9*:#'#8
q N9#
"
bR#"
~k;NB? ; U ;R8
F9
9
T
k;NBI T ; U
T ; 8
]o
; BI U ;
U U ; 8
;=;=;zF\ &o
<
T 9
U 9
WNL]k;NIh;
U;R8
tm6?ENO-#&@c,68Y1O:0U*-;Z;9*-%QFO-E6"3#&o>031*-03o,K(6CEA#qXq#&@R%*-1<dO-*:1036@c"$#&%UY1*-768,9*:#&1;f#qPtL6CENO:#@
;90$@9*-03;+#&6[,903@R% YoEe,/03@R% Y76;R*:;$\
NNuucm_{
Z^^XfXMLq
^fvv
uc
&
ufX
#&1;R*:D10$@w,9.10`;941% #8q0C68".
#qv,/.10$;90'"3#&O-41%'1;3\[t#%6lab*:%'*:$0=,9.10#@9D10$@#qu6"$"341@96"$E
_
#qm,/.10w%0W,/.1#NDJ7(v0MQ1@R#b"$0303Dq@9#&%O-0$q|,+,/#'@9*-<&.o,f61Dq#@9"308JY5E,9.10=QF@9#&QV03@".1#&*-"30w#qj6FJYJ
61D)"J,9.103;R0;R41%;K,/#YV0`303@R#1\]Z10"36)0C6;R*:O-E;9.1#?(,9.768,,9.10`;941%';K#q_,9.10[n7@9;B,w,9.1@90$0
"3#O:41%'1;+6@R0303@R#*Tqm(v0K;/68,9*:;Bq|E,/.10K0$2N4168,/*-#&
$w
tu.10w;9#&O-4F,/*-#&e*:;u<*->&0$Y5E
7?sX$M &5$ 33\
tu.10w"3#&O-41%F;,/.768,+DF#1#8,+;941%,9#$03@R#"$#&1;R,9*-,94F,/0Z,9.10K03@9@R#&@3\
,9#dYV0N
JV61D@90$q0$@,9#
0=D10$;9*-<&768,90K,9.10Kn7@9;B,c1#5>86F*:;9.F*:1<';941%
*-,68;,/.10Ktm6?ENO-#&@+;903@R*:0$;0$@9@R#&@3\
!,9.1*:;'"C68;90N
#N"3"34F@9;6l,',9.10nFq|,/."$#&O:4F%*:,/.10,68Y1O:0
q#@',9.1*:;`0WaF6%'Q1O-068O:Ou0$>03
"3#O:41%'1;(+*:O-Os>861*-;9.YoE;REN%'%0W,/@REFu61D#&F0Kn11D1;
U
U U#8
U 9
[
U
8
U 9
zF\ !'&
f#8,/0K,/.768,+,9.10UU .16;cYV030$D1*T>b*-D103D,/.F@9#&41<.,/#%d680,/.10=03@R@9#&@u,/0$@9%"$#&1;9*-;R,903o,C\u
0
.76C>&0R41;R,uDF03@9*T>&0$D,/.10q6%*-O:*:6@jlrQs#&*-o,_"$03o,/@96OhD1*Tgh0$@90$1"3*-1<MQV#&*:o,_#&Qs0$@/68,9#&@Xq#&@6M;R03"$#&1D
D10$@9*->868,9*->0
$
b P"R$ N^bR#
"BX
\dzU
zF\
?o
8
9
U
t .10tm6?ENO-#&@_,68Y1O:0q#&@u6UlrQs#*:o,Y768"5(_6@RDbr!D1*Tgh0$@90$1"3*-1<[#&QV03@/6l,/#&@@R03Q1@R03;R03o,/*-1<'6=n7@9;B,
u
D10$@9*->868,9*->0*:;u;9.F#I(+*:tm6Y1O:0Kb\ \
8
N
Uf; J KN M O
K
;?NP
"%;?NP"
k?; N
tm6Y1O-0kF\ \
DF03@9*T>868,/*T>&0\
N)P ]"BN)P"h~b$XB
U
[;
J NK M O
K
"
"
;5Sr 7; "
"
";5SrI7; "
tL6CENO:#&@,/6Y1O-0q#&@eY76"o(_6@9D
U ;
J K M O
K
U T ;
J )K b M O
K
U U ;
J )K b M O
K
"
;N|r ;
"
"&;N|r? ;
"
;NSr T ;
"
";NSr/I T ;
"
;N|r U ;
"
"%;N|r9I U ; U
U
lr!QV#&*:o,6<@/61<*S66QFQ1@9#Cab*:%68,/*-#&,9#6n7@R;R,
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
tu.1*-;+,9*:%'0c,/.F0Kn1@9;R,+,9.1@90$0w"$#&O:4F%1;u;R41%
"
,/#`$03@9#'*-q
"
T
?
"
$
[ T 8
T 9
$
U
T
8
T 9
zF\ Do
tu.541;`(_0.76C>&0D10$@9*->03D6);R03"$#&1Dbr#&@9D10$@`Y76"o(68@9DDF*-gs03@90$1"306QFQ1@9#Cab*:%68,/*-#&#qc6n7@9;B,
D10$@9*->868,9*->0
8
`aao
N)P $&NP"hNWjB\U
U
zF\
p&iupsr|gv|%jgekie,lBgn{pRrpRiutvp
ue7r|}
!)<&0310$@/6OzJ6eD1*-gs03@R031"$0d6QFQ1@9#Cab*:%68,/*-#&,9#,9.10`,/.)D103@R*->868,9*->&0`6l,K<&@9*-D)QV#&*-5,u"C6)YV0
"C68;R,*:e,/0$@9%';u#
q +
UK10$*:<&.5YV#&@9*-1<[Qs#*:o,/;+6;
P[
NR
BN
zF\ 1I
(+.10$@90d,9.10 6@R0d"$#b0W"$*:0$5,9;M,/#Ys0D10$,903@9%'*:F03DH,9.1@9#&4F<&.H,/.F041;90d#qutm6?ENO-#&@Mtm6Y1O-03;=,9#
Q1@R#bD14F"30e6QFQ1@9#Cab*:%68,/*-#&1;K#q6<*->&0$#&@9DF03@3\_O:036@9OTE),9.1*:;=Q1@9#N"30$;9;U"36YV0d41;R03D,/#n71D
q#&@B(6@RDJ5Y76"o(_6@9DJN;980$(v03DJF#&@j"30$5,9@/6OQV#&*:o,j#Qs0$@/68,9#&@9;X#qh6oE[#&@RD103@jq#&@X6oE[DF03@9*T>868,/*T>&0\
,m"3#&41O-DMYV0_"$#&%QF4F,/0$@L64b,/#&%68,/0$DM681DM0ab,9031DF03D[,/#f.1*:<&.F03@D1*:%'03F;9*:#1;3
\ #&@R0_*:%'QV#&@R,/6o,CJ
.1#?(v0$>&0$@3Jv*:;U,/.F0q6"$,U,9.768,`*T,U"C68YV0q41@B,/.10$@[<&0310$@/6O-*:$03D\)!#&@9D10$@U,/#AD1#A,9.1*:;$JjO:0$,U41;
6Q1QF@9#o6".,/.F0;R41
Y R03"W,d*-6);RO:*:<.5,9O-E
D1*-gs03@R03o,`(6CEJ_,/.76l,`*:;[q@9#&%,/.10QV#&*:o,`#q>N*:0$(#q
*:o,903@9QV#&O:68,/*-#&q#&@9%U4FOS6;$\tu.10$;90q#&@R%U41O:6;'6@90D1*:;R"341;R;903D*-%6oE,90WaN,/;d#&541%'03@9*-"C6O
6768O-EN;9*-;3\
`aab`
|hr|i7p|iupsr
gojp
ijpsry{eh|%jgehidfehiueg|}
tu.10=6<&@/681<&*S68*:o,/0$@9QV#&OS6l,/*:#Qs#O-EN1#&%'*S6OV*:;u<*->&0$YoE
msj
5&sV
zF\
NNuucm_{
Z^^XfXMLq
^fvv
uc
ufX
!
(+.10$@905&su6@R0wQV#&OTEbF#&%*:6O:;P*:eA#8qLD10$<&@90$0\vtu.10K"$#&1;R,9@941"W,/*-#qL,/.F0o&s"C6YV0
,6803q@9#&% ,/.10w;9*-%Q1O-0K6<&@/681<&*S68q#@9%U41O:6Mq#&@+25476D1@968,/*-"w*-o,/03@RQs#OS68,9*:#&)#&@u0WaN,/@96QV#&OS6lr
,/*-#&P(+*T,/.1#&br032541*-;9Q76"$03DQs#*:o,/;
"%$Hs3| $Hs
7$s3| $s
"
"%$
W3| H
$
W
7
"R3| $"9
$
7$s3|"$s
Z
7$ 3|
"$
m|sP
zF\ oo
f#8,/*:"$0d,/.168,U,/.F0e"3#N0$'"3*-03o,`#q0C6".d*-;U#&10(+.10$ JP6FD303@R#A(+.103,/60$;
6oE#,/.10$@ZD1*-;9"3@R0$,90M>86O:410=*:,/.10U;R0$,3\qj(_0U,/60M,9.10Mn7@R;R,c#&@Z;90$"3#&FDAD103@R*->868,/*T>&0=#qXmsWJ
*:%'QV#&;90d6032541*-;9Q76"$03D%'03;9.hJv681D0$>86O-4768,/0,/.10$;90eD10$@9*->868,9*->03;[68,M,/.106QFQ1@9#&QF@9*S6l,/0dDF*:;Br
"3@R0$,90eQs#&*-o,CJL(v0@903DF03@9*T>&0,9.10dn71*T,/0DF*-gs03@90$1"3068Q1Q1@9#Cab*:%68,9*:#&1;R41;B,[Q1@90$;90$5,903D\L*:1*T,/0
D1*Tgh0$@903F"30';9".10$%0$;=,/.168,w"C6)Ys0'D10$@9*->03D)q@9#&
% j2\F\ 6@90`@90Wq03@R@903D
,/#6;=68<&@/6F<&*S6
6Q1QF@9#Cab*:%68,/*-#&1;3\
i<&0310$@/6O-*:368,/*-#&[#qh,9.106<&@/681<&*S6868Q1Q1@9#&6".*-;XY1@9#&4F<&.o,_68Ys#&4b,XY5E`4F;9*:F<{03@9%'*-,9*S6
*:o,903@9QV#&O:68,/*-#&\tm#="3#&F;R,/@R41"$,_6KQs#&OTEN1#&%'*S6O5q#&@XmsW
J 03@9%'*-,90q#&@9%M41OS6;j4F;90+>68O:410$;P#8qh,/.F0
q411"W,/*-#&AVUy|x|wN}Wy lxzy "} !z$ #u68,v<&*->03dQV#&*-5,9;_*-;RQ76"308\v]4F@v*-O:O:4F;R,/@968,/*-#&[*:;Xq#&@X,/.10f"C6;R0
*:k(+.1*-".D1*:;R"3@R0$,/0`>86O:4F03;w#q,/.F0'q41F"$,/*-#&681DH*T,/;Kn7@9;B,MD10$@9*T>6l,/*->0d68@90'41;90$DJ^Q1@R#bD14F"3*:F<
,/.F0w0abQ1@90$;9;9*-#&
L|sj
oosP
os 8
zF\ &5
] Yo>b*-#&41;RO-EU.F*:<&.10$@Br#&@9D10$@^D10$@9*->868,9*->03;^"$#&41O:D`YV0u*:1"$O:41DF03D`6;^,9.10uQ1@9#Y1O:0$%;^DF*:"$,/68,/08\Li "$#&%`r
Z
Q1O-0$,/0MD1*:;R"341;R;9*:#A#qj,/.10$;90[QV#&O-EN1#%*:6O:;+"C68AYs0Mq#411DA*:%d6oE@90Wq03@90$1"30$;K#&541%'03@9*-"C6O
%'0$,/.F#bD1;$J7Y14F,+.10$@90K(_0K10$03D#&1O-E,/.10K"$#&1"30$QF,C\
tu.10MQF@90$>N*-#&41;c0aF6%QFO:03;#q^6tm6?ENO-#&@u,6Y1O-0="$#&1;B,/@94F"$,/0$DI} $VyWy|xQs#*:o,D1*-gs03@R031"$0M#&Qbr
03@968,/#@9;q@9#&%p6<&@/681<&*S68*:o,/0$@9QV#&OS6l,/*:#q#&@9%M41OS6;$\`_#&1;R*:D10$@K10WaN,K,/.10`tm6CEbO-#&@Z,68Y1O:0Mq#@
6y|{cVyWy|x^;9Q16"30'D1*-gs03@R031"$*:1<;R".103%'0'q#@K6n7@R;R,wD10$@9*->868,9*->0`6@9*-;9*:F<q@9#&%p,9.10`41;90'#q_6
f0$@9%'*-,90[*:o,/0$@9QV#&OS68,9*:#&q#&@9%M41OS6Fq
\ 6;90$D
# j2\F\ &1J6e<&03F03@/68O:*:368,/*-#&#k
q j2\mb\ 1`"36
*:F"3O:4FD10D103@R*->868,9*->&0$;68,+103*-<&.5Ys#@9*:F<[Qs#&*-o,/;3JF*\ 0\TJ
%
P'&
8
9 R
P[
N9
<N
zF\ &
&
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
7\=tu.F*:;@90$2541*:@R03;Z,/.F0Uq#&O:O-#I(+*-1<d<0310$@/6O-*:C6l,/*:##qX,/.10[tm6CENO:#&@Z;R03@R*:03;0abQ761;R*:#&k<&*T>&03k*j2\F@\ ?b
9 R1
(
)
+ *
8
b[s
9-,
%>
zF\ oo
tu.10D103@R*->868,9*->&0,903@R%;[1#?(.76C>&0"3#N0$'"3*-03o,/;,9.10"3#N0$'"3*-03o,'#&,9.10'
QV#&*:o,`*-;U,6803
6;`#&10,/#);9*-%QFO:*-q|Ek,9.1068O:<&0$Y1@/6o=(+.F*:".%U41;R,YV0DF0$,/0$@9%'*:10$D4F;9*:F<),9.10tL6CENO:#&@`tm6Y1O-0
6Q1QF@9#o6".6;+#&4F,9O:*-103DeYV03O-#I(K\
9 )P"
8
U;
J NK
M O
K
J KNM
K O )P"
M O
[; JZNK
K
U;GJLKN
M O
K R#"
?; N)P"
h;?N
k?; N9#"
] 8
9
9 9 #"
[;
{;5|r/Ih; "
"
h;NBIh; ""
5NP"~bLzbR#"Bj
U
U ;
J K M O
K
;N|r9Ih; ""
U T ;
J )K M O
K
;N|r9I ; "
U U ;
J )K b M O
K
"
;N|r? T ;
U V ;
J /K .M O
K .
;NSr/? U ; "
U
"
;NB?h; "
F
"
;NSrI ;
"
kN; BI ;
"
;NI ;
:
"
;N|r9I T ;
"
;NBI T ;
F
"
;N|r9I U ;
U
"
5; BI U ;
U
"
;5BI U ;
:
U"
{;5|r/I V ; "
"
h;NBI V ; "
k;NI T ; "
tm6Y1O-0KF\ F\XtL6CENO:#&@,/6Y1O-0Zq#&@u"30$5,9@/6OIr!QV#&*:o,F03@9%'*-,9*S66Q1Q1@R#?ab*-%d68,9*:#&,9#'6[n1@9;R,D10$@9*T>6l,/*->0\
t#%6lab*:%'*:$0f,/.F0w#@9D10$@#8q^6"$"341@96"$EJ1(_0w%U41;B,;/68,9*:;Rq|E,/.10K@R03OS6l,/*:#
$
w
$
w
. 6C>N*:1<,/.10;9#&O-4F,/*-#&7?I 3_
7
"3#O:41%'e;941%';u,/#
"
$
w
F N$fFC&C$\101D10$@M,/.10$;90"3#&1DF*-,/*-#&1;K,/.10;9* ab,9.
U U
V
8
V 9
8
zF\ '&
NNuucm_{
Z^^XfXMLq
^fvv
uc
ufX
!'
61D,/.F0w%'0$,9.1#ND"36Ys0K0aFQF@903;R;90$Dk6;
9 )P"
9 R#"
$fNP"N9#"BXB\dzUUW
[
zF\ !?o
tu.1*-;*-;+6O:;R#[@90Wq03@9@R03D,/#'6;632uo5}P
4 q#&@R%U41OS6b\
`aa
d r|tjgtv|36<yyIgtv|%jgehiEe,df|8p
7 ue7r|}
,f*:;+#&10K,/.1*-1<`,/#d"$#&1;B,/@94F"$,f%0W,/.1#ND1;41;9*-1<,9.10{03@R%*T,/*S68e"3#&1"$03QF,Z61D2N4F*-,/0=61#8,/.10$@
,/#w*:%'Q1O-03%'03o,L,9.103% *-6K"3#%Q14b,/03@X"$#bD108\^!`,/.10uq#&@R%#qh6wQV#&*:o,X#&QV03@968,/#@j*-,X*:;jQF@9#&Y768Y1O-E
1#,+0W>N*:D10$5,6l,n7@9;B
, R41;R,+.1#?(Bj2V\1F\ ?U"C6YV0K6Q1Q1O-*:03Dh\f#?(v0$>&0$@3J,/.10;R*-,94768,/*-#&*-;2541*-,90
0C68;REd,9#U"3#%Q1@R03.10$1De*-qh(_00aFQF@903;R;u,/.10Z;96%'0c%'0$,/.F#bD*-d,/.F0cq#&@9% #q6U%68,9@9*Ta'#Qs0$@/68,9#&@3\
i Y761DF03D%d68,9@9* a1#8,68,9*:#&q#&F
@ j2\VF\ !
?[*:;
$w& C? M
[
e&/1C?I e
J ) O
zF\ !Do
*:(+.1*:".kZ*-@9*-".1O:0W,fYV#&41FD76@RE"$#&1D1*T,/*:#1;f.16?>0UYV0303A*-%QV#&;R03D\ T
68,9.103%68,9*:"C68O:O-Ed,/.1*-;f*-;
032541*T>86O:0$5,u,9#
P"
7B&/FCI
e$w& 3I M
J ) O
U
zF\@
(+.1*-"."36YV0K@90$0WabQ1@90$;9;R03DYoEe,/.F0 Q1@90$D1*:"W,/#&@r!"3#@9@90$"$,9#&@Q`;90$2541031"$0
9
$w& C? M
J ) O
U
P"
f e&/1C? 9
zF\@bI
*-,9.@903;RQs0$"$,`,/#Q1@/6"W,/*-"C6Ov*:%'Q1O:0$%0$5,/68,/*-#&J,/.10%'0C681*:1<#q+,/.10eQ1@R03D1*-"$,9#&@U*:
,/.1*-;
J+D1*Tgh0$@90$1"30*T,CJ
;90$2541031"$0k;9.1#&4FO:DYV0"3O-0C6@$\ ,d;9*:%'Q1OTE;/6CEN;;:,680,/.F0>&0$"$,9#&@6@9@96CE
9 \ctu.10
6D1D,9.10UYV#&411D16@RE"3#1D1*-,9*:#&F;3J681D;R,9#&@90=,/.10U@R03;R41O-,*-,9.10U*:o,903@9%'03DF*S68,90U6@R@/6CE
%'0C61*-1<U#q,/.F0;903"$#&1D@9#?(*:;%'#&@90c;941YF,9O:08J7;9*:F"30*-,*:;D10$%d681D1*:F<U,/.100W>68O:4768,9*:#&d#qm6
*:o>03@9;R0M#&QV03@968,/#@3J7Y14F,f*-,+;B,/*-O:O"36YV0K<&*->036`;9*-%QFO:0*:o,903@9QF@90$,/68,/*-#&\Pic*:o>&0$@9;90w%68,/@R*Ta
#&QV03@968,/#&@w*:%'Q1O-*:03;Z,9.10d;R#&O:4b,/*:#
#qu6"3#&4FQ1O:0$DH;90W,[#quO-*:1036@K03254768,9*:#&F;3\tu.103;R0#&QV03@/6l,/#&@R;
6@R0+>03@BE"$#&%'%#&`*-`n11*-,90DF*-gs03@90$1"30f6Q1QFO:*:"368,/*-#&1;$\mtu.10WE6Q1QV0C6@X*:`,/.F0+q#@9%#qhY761DF03D
%68,/@R*:"30$;.16?>N*-1<6H;R%d68O:OuY76FDF(+*:DF,9.Ju*:,/.1*-;"36;906),/@R*:D1*:6<&#&16O\tu.F00$>86O-4768,/*-#&#q
P"
eB&91CI!
*-;Mq#&411DYoEH%0361;[#qf6,/@R*:D1*:6<&#&16O ;9#&OT>&0$Q@ 1Jj(+.1*-".*-;U;9*-%QFO:0`,/#k"3#ND10J
0$'"$*:03o,,/#'@941hJs681D(+*-D103OTEe41;90$D\!<&0310$@/6Oz
J f0$@9%'*-,/*:6#&@L6
D 0M
< 6QFQ1@9#Cab*:%68,/*-#&1;u"36
YV0wQF@/6"W,/*:"36Oh(+.10$,9.10$Ee"36Ys0K*:%'Q1O-03%'03o,/0$DeY5Ed,/.10K41;R0=#qm0$'"$*:03o,Y76FD103D;9#&OT>&03@R;3\
=> [@&GQoR5G@@?GBALGZG)[G.[vGuZ@[=7GQsCAL)
D FE DHG )IZA ZA .G[G@II
`aa$J
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
f0$@9%'*-,9*S6)q#&@9%';M#qu,9.10;R03"3#1DD103@R*->868,/*T>&0"366O-;9#YV00C68;9*:OTE)D103@R*->&0$DYoE%'0C61;M#q6
tm6?ENO-#&@,6YFO:0\X7#&@u0aF6%QFO:0
P"
J ) O
e&N$ CI U
zF\@
U
*:;h\U U P681Dd%60$;_41;R0c#qh#&1OTE[,/@9*-D1*S68<&#&76OF#&Qs0$@/68,9*:#&F;3\L,v;9.F#&41O:DYs0%'03o,/*-#&103D',/.76l,
,/.F0f;RQ1O:*-10c68Q1Q1@9#Cab*:%68,9*:#&`*:;X#&F0q#&@R% #q6wL6
D 0c
< %68,/@R*Ta`D1*Tgh0$@90$1"30f#&Qs0$@/68,9#&@3\m,_*-;v<*->&0$
YoE
eB/1CI! P" eBN $ CI M
J O
e
zF@\ o
U
Y14F,M*-,9;=#&@RD103@=#q+6"$"341@96"$E
*:;w#&1OTE \zU f
\ #?( %U41".H,9.1*:;=@903DF41"$,9*:#&*-6"$"341@96"$E)*-;
#gs;90W,+Y5E,/.10*-1"3@R0C6;R03D<&O-#&Y76OV"3#&o,9*:541*-,!EdY141*-O-,v*:o,/#`6U;RQ1O:*-10cn1,u*-;1#,NF#I(+h\P
01#,90
,/.168,=,9.10';9Q1O-*:10[n1,=#qu6n7@9;B,MDF03@9*T>868,/*T>&0`*:;K*:DF03o,/*-"C6Oj,/#6oEk#q,9.10'0WabQ1@90$;9;R*:#&1;M*: X25;$\
F\ !
?U,/#'F@\ b&\
in176O(v#&@9D#&f03@R%*T,/*S686Q1Q1@R#?ab*-%d68,9*:#&F;3\v_O:036@9OTE,/.10WE.76C>&0=668DF>86o,6<&0K#?>&0$@
lrQs#&*-o,[6<&@961<&*:6H;R".103%'03;`YV03"C6841;90#q+,/.F03*:@=*:1"$@9036;90$D68"3"34F@/6"WE&\ #?(_0W>&03@$J6%'#&@90
;94FYF,/O-0UQs#*:o,c*-;f,9.768,c,9.10$E<&0W,c,/.F*:;c*-1"3@R0C6;R0U*:6"3"$41@/6"WE4F;9*:F<*:Fq#@9%68,/*-#&e,/.768,c*:;f;R,/*-O:O
O:#N"C68Oh,/#[,/.F0wQV#&*-5,u(+.F03@90K,/.F0wDF03@9*T>868,/*T>&03;6@R0KYs0$*:1<`0$>86O-4768,903D\X!6Q1Q1O-*:"C6l,/*:#JN,9.1*:;+"36
YV0c6Db>685,/6<&0$#&41;v68,PYs#&4F1D76@R*:03;P6FDd*:`,/.F0>N*:"$*:1*T,!EU#qh;R,90303Qd<&@/6DF*:03o,9;3\^,v*:;X#&Yo>N*:#&4F;3J5#q
"3#41@9;R0JF,9.768,Pn1>&0ZQV#&*-5,v;9".F03%'03;u41;R*:1<M68<&@/6F<&*S66Q1QF@9#Cab*:%68,/*-#&1;X"C6dYs0fD103@R*->&0$D,/.76l,
.76C>&0,/.10+;96%0#&@RD103@X#q6"3"$41@/6"WE'6;X,/.10%0W,/.1#ND1;X<&*T>&03'*:j25;3\bF\
?w681DF@\ JoYF4F,v,9.10$E
(+*:O-O1.76C>&0c6K(+*-D103@X;RQ1@9036Dd#qh;9Q768"30c*-1D1*-"303;$\L!Q76@R,9*:"$41OS6@$J&,!(_#M6<&@/681<&*S68[;9".10$%0$;v(+*-,9.
,/.F0Z;/6%'0c#@9D10$@#q6"$"341@96"$E6@90U.10$@90c(v0*:<&F#&@90,/.10ZQF@9#&Y1O-03% "3@R0C68,903DeYoEd,9.10ZYV#&411D16@RE
"3#1D1*-,9*:#&F;3J76OT,/.1#41<&.,/.F*:;u*:;u#10K#qm,9.10KQ1@9*-1"3*-Q76O*-;9;R4103;+*:6QFQ1O-EN*:F<`,9.103;R0K;9".10$%0$;W
UT
eBC C?
kNB&5$?F ?FN$wI d
\J9UU O
<
kN$w&C?bN$c C?F5$=I
\J9UU O
[
eAP$WVXX'E/
zF\@85
zF\@&
YX^C
! #@9D10$@f,/#';90$O:0$"$,6`n71*T,/0WrD1*-gs03@R031"$0=;R".103%'0=q#@c6'<&*->0368Q1Q1O:*-"C68,9*:#&#&F0=%U4F;R,fYs0M6Y1O:0
,/#=6;R;903;R;v,9.106"3"$41@/6"WE'#qs,9.10"C61DF*:D768,90+;9".10$%0$;3\Xtu.10f6"3"$41@/6"WE`#q68#&QV03@968,/#@j*:;X#q|,/0$
0WabQ1@R03;R;903DH*:,/0$@9%';#qP,/.10[#&@RD103@#8qv,9.10[O:036D1*:F<e03@9@R#&@c,903@9%pD10$,903@9%'*:F03DAq@9#&%p6tL6CENO:#@
,68Y1O:08\L.1*:O-0,9.1*:;P*:;_6M41;R0$q41Os%036;941@R0JN*-,vQ1@9#?>N*:DF03;u6=q68*:@9OTE[O:*-%*T,/0$D'DF03;9"$@9*-QF,/*-#&\j741@B,/.10$@
*:bq#&@9%68,/*-#&
6Ys#4F,U,/.F0e03@9@R#&@UYV03.76C>N*:#@U#qf6n71*T,/0WrD1*-gs03@R031"$0;9".F03%'0e"C6YV0#&YF,/6*:10$D
41;R*:1<'7#&41@R*:03@u0$@9@R#&@+676OTEN;9*:;$\
N[Z5Pm+XXfZ+cf]\RXNB
`a$JaIc
6yygtv|%jgekije ^
| Qyu|%jg|,wzy{psr|%je7r
ic`68@9Y1*T,/@/68@RE=Qs0$@9*:#ND1*-"Pq41F"$,/*-#&["C68[Ys0uD10$"3#&%'QV#&;90$D[*:o,/#*T,/;^7#&4F@9*:0$@L"$#&%QV#&10$o,/;3J&(+.F*:".
6@R0*-',9.10uq#&@9% [_ Jo(+.103@R
0 `d*-;^,/.10+(6C>03541%UYV03@$\P,v*:;^,9.103@R0$q#&@R0f#8q*:o,903@90$;R,P,/#K0WaF6%'*:F0
.1#?( (_0$O:OL6<&*->03n71*T,/0r!D1*Tgh0$@903F"30U#&QV03@968,/#@Z6Q1QF@9#Cab*:%68,/0$;cD10$@9*->868,9*->03;Z#7
q a_ \ZH0M(+*-O:O
"3#1"30$5,9@/68,90Jb.103@R0JF#n7@R;R,DF03@9*T>868,/*T>&0f6Q1Q1@R#?ab*-%d68,9*:#&F;3J56OT,/.1#&4F<&.',9.10Z6876O-EN;R*:;P*:;P0325476O-O-E
6Q1QFO:*:"36Y1O-0c,/#`.1*-<&.103@uDF03@9*T>868,/*T>&03;$\
tu.10w0WaF6"$,+n7@R;R,D10$@9*->868,9*->0#
q [_ *:;
[_
cb$`
[_
zF\@o
q(v0d68Q1Q1O-EJq#@w0aF6%QFO:0Jm6;903"$#&1Dbr#&@9DF03@M"$03o,/0$@90$DD1*-gs03@R031"$0d#&QV03@968,/#@K,9#N[
(+.10$@90KNu5UJ1(_0w<&0$,
V
N9#"R$N)P"
U
[_Ue 9# "
a_/e
$ P
[_Ue
[_Ue
I
[_ d
P"
a_
T"3#;S`U'8bo;9*-f`Us$"3#&;S`7U $gbo;R*:f`7Us
U
;R*:f`7U
[_
U
b$`Lh [_
[_
zF\@'&
(+.10$@905` h *-;,9.10_%'#ND1*-n70$Dw(_6C>&0$N4F%UYs0$@3\jtu.10v%#ND1*Tn703DK(6C>03541%UYV03@j*-;m;R#Z76%'03D=Ys0$"C641;R0
*-,m6QFQs036@9;(+.103@R0v,9.10P(_6C>&0$N4F%UYs0$@3Ji`J86Q1QV0C6@R;m*-w,9.10v0aF6"$,L0WabQ1@90$;9;R*:#&\Ltu.N4F;m,/.F0vD10$<&@90$0
,/#f(+.1*:".[,/.F0%#ND1*Tn703Dw(6C>&0$541%UYV03@P6Q1Q1@R#CaF*-%d6l,/03;,/.106"$,9476Ob(_6C>&0$N4F%UYs0$@X*:;^6Z%'0C68;941@R0
#q,/.10w6"$"341@96"$E#8qm,9.10w6Q1Q1@R#?ab*-%d68,9*:#&h\
7#&@,/.10A;R03"$#&1Dbr#&@9D10$@"$03o,/0$@90$D D1*Tgh0$@903F"30k#&QV03@/6l,/#&@d,9.10k%#ND1*Tn703D(_6C>&03541%MYs0$@*-;
<&*T>&03YoE
`Lhv
f#8,/0,/.76l,j`
;9*-f`U
[
zF\@L?o
6Q1QF@9#Cab*:%68,/0$;f`,/#`;90$"3#&FDbr!#&@RD103@f6"$"341@96"$EJ6;+*:;,/#'YV00WabQs0$"$,903DJV;9*-1"30
;R*:f`7U
U
k`$
T [
W5WNW
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
2.5
* x
th
4 Pade
1.5
th
4 Central
1
nd
2 Central
0.5
0
0
0.5
1.5
2.5
#bD1*Tn703De(_6C>&03541%MYs0$@fq#&@>86@R*:#&41;u;R".103%'03;$\
L*-<&41@90Kb\ 1
0WabQ1@R03;R;9*:#q#@M,/.10d%#ND1*-n103DH(_6C>&03541%MYs0$@'QF@9#?>N*:D10$;U,/.10e68"3"34F@/6"WEH(+*-,9.(+.1*:".6<*->&0$
(_6?>03541%UYV03@K"$#&%QV#&10$o,#qj,/.F0U;9#&O-4F,/*-#&*-;c@90$;9#&OT>&0$Dkq#@f,/.F0U03o,/*-@90M(_6C>&0$N4F%UYs0$@K@/61<0
6C>86*:O:6Y1O:0f*:6[%0$;9.#qL6`<*->&0$;R*:$0J m
l `U l j\
!<0310$@/6OzJFn71*T,/0WrD1*-gs03@R031"$0K#&Qs0$@/68,9#&@9;u"36Ys0(+@9*T,9,903*:e,/.F0Kq#@9%
z^ % z
+
su
61D
% sz
/Nj
U
"WN9#"hbP"B
N9 NP
N9 T NP T
T
tu.10w"3#&@R@90$;9QV#&1D1*-1<`%#ND1*-n103D(_6?>03541%UYV03@f*:;
b$`Lh
L
"N"$#&;n`U[
"3#&; `7UU
"3#&;F`7Us
[
T
b "b;R*:j`7[[] ;9*- `7[[] T ;9-* fo`Us
zF\@LDo
E/{
N[Z5Pm+XXfZ+cf]\RXNB
.10$w,9.10^n71*T,/0WrD1*-gs03@R031"$0j#&QV03@/6l,/#&@*-;6o,/*-;REN%'%0W,/@9*-"u"303o,903@90$DWJl,/.10j%'#ND1*-n70$Dc(_6?>03541%[r
YV03@_*-;vQF41@90$O-E'@9036O\.103,9.10c#&QV03@968,/#@v*-1"3O-41D103;_6=;BEb%'%'0$,/@R*:""3#&%'QV#&103o,3JN,9.10c%'#bDF*-n70$D
(_6?>03541%UYV03@*:;`"3#%Q1O-0WasJj(+*-,9.,9.10*:%6<&*:16@RE)"3#%QV#&10$5,'YV03*-1<k03o,/*-@903OTE03@R@9#&@$\tu.10
q#&41@B,/.br#&@9DF03@+L68
D 0=
< ;R".103%'0K*:;+<&*T>&03YoE
NR#"R$bP"B
U
tu.10w%#ND1*Tn703D(_6C>&03541%MYs0$@fq#&@,9.1*:;u;R".103%'0=;968,/*-;Rn70$; V
b`h P a _/e
ob$`Lhmb`hQ
(+.1*-".<&*T>&0$;
b`h_
[_Ue
[_Ue
[_Ue
H bo;9*-f`7[
"3#&;S`7UsRU
tu.10[%'#bD1*Tn703D(6C>03541%UYV03@KQ1@R#I>N*-D103;K6d4F;90$q4FOL,/#N#&Oq#&@Z6;R;90$;9;9*-1<eD1*Tgh0$@903F"30`6Q1QF@9#Ca5r
*:%68,9*:#&1;$\!),/.10'"3#5,90WaN,U#8q,/.10'O:*-10C68@"3#&o>&0$"$,9*:#&0$254768,/*-#&J,/.1003@R@9#&@R;="36HYV0<*->&0$
6dQ1.oEN;9*-"C6O*:o,903@9QF@90$,/68,/*-#&\c_#&1;R*:D10$@c#&1"$0[6<o68*:,/.10=O:*:F0C6@"3#&o>03"$,9*:#&A0$254768,/*-#&*-,/.F0
q#&@R%
]
#&6DF#&%d68*:H0aN,/03FD1*:1<Aq@R#&% $ ,/
#
\ +03"36O:OXq@9#%N03"$,9*:#&
\ F\ ,9.768,`6;R#&O:4b,/*:#
*:F*-,/*:68,/0$DYoE6[.76@9%'#&1*-"cq411"W,/*-#&e(+*-,/.e(_6C>&03541%MYs0$
@ `*-;
L|9Rj^|RI
(+.10$@90^R_;968,/*-;Rn70$;+,9.10=]
[_
zF\
$fbbi`
b#&OT>N*:1<Uq#&@fLRu61D;94FY1;R,9*-,/4b,/*:F<'*-o,/#j2V\b\ <&*T>&0$;+,9.10K0WaF6"W,c;R#&O:4F,9*:#&68;
L|9Rj^ I
a_
P
qj;90$"3#&FDbr!#&@RD103@"30$o,/03@R03DAD1*Tgh0$@90$1"30$;c6@R0M68Q1Q1O:*-03De,/#',/.10w;9Q168,/*:6Oh,/0$@9%J7,/.10Kq#&O:O-#?(+*:1<
]*-;u#&YF,68*:10$Dq#f
@ ^R
;9*-f`U
[
X$fbbi` h
I [7[b5u zN )[[=@IYAN@@@? 38 "$ L
G s@5Z
X$fbb
[q[)@@?u[
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
#&OT>N*:1<,/.F*:;v]
0WaF6"W,/OTE;9*-1"30u(v0Z6@R0+"3#&1;R*:D10$@9*-1<,/.1003@R@9#&@jq@9#%
b
*:%68,9*:#O-EF61D;R41Y1;R,9*-,94F,/*-1<`*:o,/#j2\sb\ JF(_0K#&Yb,6* N4F%0$@9*:"36O RRPk^
[_
,/.10+;RQ768,/*:6O6Q1QF@9#Ca5r
P
zF\ FI
(+.10$@90 h *:;P,/.10f541%0$@9*-"C6OL#&@P%'#bD1*Tn703D7XQ1.16;90Z;RQs0$03DJb(+.1*:".e*-;v@R03OS6l,/03D,/#M,9.10c%'#bDF*-n70$D
(_6?>03541%UYV03@fYoE
7#&@,/.F0=68Ys#?>&0K0a168%Q1O-0J
` h
`
;9*-]`7U
`7U
tu.10PN4F%0$@9*:"36OQF.76;90P;9QV030$D=*-;,/.10X;RQs0$03D=68,(+.1*:".=6u.76@R%#&F*:"Lq41F"$,/*-#&*:;QF@9#&Q768<o68,/0$D
541%'03@9*-"C6O-O-E\ b*-1"30f h HZ l q#&@',/.1*-;d0WaF6%'Q1O-0J,/.F0AN4F%0$@9*:"36O;9#&O-4F,/*-#&Q1@R#&Q76<&68,/0$;
,/#N#e;9O-#?(+O-E&\[b*:1"$0 h *:;K6q41F"$,/*-#&A#qP,/.10[(_6C>&03541%MYs0$@3Jm,9.10[541%'03@9*-"C6O^6Q1Q1@R#?ab*-%d68,9*:#&
*:o,9@9#ND141"30$;dD1*-;9QV03@R;9*:#Ju6OT,/.1#&4F<&.,9.10#@9*:<*:76O+X
*-;1#1D1*:;RQs0$@9;R*->&08\if;6H@R03;R41O-,3Ju6
(_6?>0$q#&@R%"3#&1;R*:;B,/*:F<#q%d6oEADF*-gs03@90$o,=(_6C>&03541%MYs0$@U"3#&%'QV#&103o,9;=0W>&03o,9476O:OTE)O:#&;R03;K*-,9;
#&@R*:<&*-76Oq#&@9%\
L*:<41@90ub\ c;R.1#?(+;X,9.10u541%'03@9*-"C6ObQ1.76;R0+;9QV0303D[q#&@m,/.10u;R".103%'03;P"3#&F;9*:DF03@90$D`Q1@90W>b*-#&41;RO-E&\
tu.10541%MYs0$@M#q_7ly|7x|K7}WPH
}W:}WNx|
YoEk(+.1*-".6<&*T>&03
(6C>&0e*-;=@R03;R#&O->03D*-;
<&*T>&03YoE RHo`7U\
tu.10e@R03;R#&O->N*:F<A0$'"3*-031"WE#q6;9".F03%'0"36Ys0d0WabQ1@90$;9;R03D*-,/0$@9%';
#q,/.1
0
@90$2541*:@R03D,/#)Q1@9#ND141"$003@9@R#&@9;[YV03O-#?(6A;9QV03"$*-n70$DO-0$>&0$O\7#&@[0aF6%QFO:0JX,/.F0
;90$"3#&FDbr!#&@RD103@d"303o,903@90$DD1*-gs03@R031"$0;9".10$%0A@R032541*-@903
; ?
,9#HQ1@R#bD14F"30A6 0$@9@R#&@d*Q1.768;90U;RQs0$03DA#qXO-03;9;,/.768 \TUQs0$@9"$03o,C\Ztu.F
0 Ir!QV#&*-5,+q#&4F@R,/.Nr!#&@RD103@f"303o,903@90$Dk;9".10$%0[681D
,/.F0q#&41@R,9.br!#@9D10$@`L6
D 0
< ;R".103%'0@9032541*-@90AG 681D @903;RQs0$"$,9*->&0$O-E,9#k6".1*-0$>&0,/.F0
;/68%00$@9@9#@O-0$>03O\
7@9#&% ,/.10Zq#&@R%#&
q j2\F\ F&Jb(v0K;90$0K,9.768,u,9.10@9036OQ76@B,+#q,/.10%'#bDF*-n70$D(6C>&0$541%UYV03@
O:036D1;',/#6 0$@9@R#&@d*-,/.10Q1@9#&Q16<o68,9*:#&;9QV0303DhJ(+.1*-O:0,/.10*:%6<&*:16@REQ16@R,eO-0C6DF;,/#6
03@R@9#&@v*:d,9.106%'Q1O-*-,/4FD10+#q,/.10c;9#&O-4F,/*-#&\Ltu.541;,9.10Z685,9*:;BEb%'%'0$,/@R*:"Qs#@R,/*-#&d#8q,/.10Z;RQ768,9*S6O
D1*Tgh0$@903F"30+#&QV03@/6l,/#&@jD10W,/0$@9%'*:10$;^,/.10+03@R@9#&@j*-`;9QV0303Dd61D[,/.F0;BEN%%'0$,9@9*:"_Qs#&@B,/*-#&U,/.10+0$@9@9#@
*:6%'Q1O-*-,/4FD10\mtu.1*:;+*:;q4F@R,/.F03@+D1*:;R"341;R;90$D*:b0$"$,9*:#&)&&\ \
$jA+
^+
j=^'X
wW
AAMP$
NoZL^XfXU^+XX+c_+fec8mfcP
1.2
0.8
a*
_
a
nd
2 Central
th
0.6
4 Central
th
0.4
4 Pade
0.2
0
0
0.5
1.5
2.5
L*-<&41@R0KF\N
`aaIc
f41%'03@R*:"C68OhQ1.768;90w;9QV0303Dq#&@>86@9*-#&41;u;R".103%'03;$\
gKupRgIiups|r ekihpRtjgeki:u|%jgehi
+0$q03@R@9*-1<,9#eb0$"$,/*-#&
\ FJ,/.F0MYV#&411D768@RE"3#1D1*-,9*:#&F;q#&@+,/.F0MO:*-10C68@"$#&o>&0$"$,/*-#&0$2N4168,/*-#&
"C68dYV0f0$*-,/.F03@XQs0$@9*-#bD1*-"u#&@X#q*-FG7#?(r!#&4b,9G7#?(,!ENQV0\j!',/.10OS68,R,/0$@P"36;908JF6=Z*:@R*:".1O-0$,jYV#&411DNr
6@BE"3#1D1*-,9*:#&*:;Z<*->&0$)68,Z,/.F0[*:FG7#?(YV#&411D768@RE&J(+.F*:O:0=1#e"3#1D1*-,9*:#&*:;Z;RQs0$"3*-n103D)68,,/.F0
#&4F,RG7#?( YV#&41FD76@RE\q03@90U(v0'6;9;R41%'0U,/.768,c,/.10U(_6C>&0';9QV0303D *:;QV#&;9*T,/*->0,9.N4F;Z,/.10[O-0$q|,Rr
.76FD)YV#&41FD76@RE*:;c,9.10`*:FG7#?(Ys#411D76@BE&J6FDk,9.10`@9*-<&.o,Rr!.161DAYV#&411D768@RE*-;Z,/.10[#4F,9G7#?(
YV#&411D768@RE&\Xtu.541;+,/.10>03"$,9#&@#qL4F151#?(+1;f*-;
"+
e
W5WNW +=
zF\
61D+*:;u;9QV03"$*-n70$D\
_#&1;R*:D10$@^n7@9;B,^,/.10_*:FG7#?(YV#&411D768@RE&\m,j*:;m"3O-0C6@L,9.768,^6;^O:#1<6;L,9.10*-5,903@R*:#&@D1*-gs03@R031"$0
6Q1QF@9#Cab*:%68,/*-#&
DF#b0$;M1#,M0WaN,/0$1DYV0$EDb P"JL,9.103H1#;9QV03"$*S6OX,/@R0C68,9%0$o,U*:;w@90$2541*:@R03D
q#&@,9.1*:;uYV#&411D16@RE\v7#&@u0aF6%QFO:0Jb(+*-,/.;R03"3#1Dbr!#@9D10$@f"$03o,/0$@903DD1*-gs03@R031"$03;+(_0w#&YF,/6*:
J O
,[
zF\ &o
(+*-,9.
$w
$w
$
w
\\
\
J ) O
$
$w
U
\\
\
zF\ 5
&
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
f#?(v0$>03@3Jc*-q(v0)4F;90,/.F0q#&41@R,9.br!#@9D10$@*:o,/0$@9*-#&@d#&QV03@968,/#@<&*->03 *-CX2\ub\8FJ+,9.103,/.F0
6Q1QF@9#Cab*:%68,/*-#&e68,PMK@9032541*-@90$;f6U>86O-410Z#qmN)P J1(+.F*:".*:;u#&4b,/;9*-D10Z,/.F0wDF#&%d68*:\031"$0
6D1*-gs03@R03o,w#&Qs0$@/68,9#&@K*:;K@90$2541*:@R03D6l,c `(+.1*:".
0WaN,/0$1D1;=#&1O-E,/#
$ &J(+.F*:O:0[.16?>N*-1<
,/.F0Z6Q1QF@9#&Q1@R*S68,90f#@9D10$@_#q68"3"34F@/6"WE&\vb41".6#&QV03@/6l,/#&@$Jb51#?(+6;_6d7b{d}Wy9#W lNVoW
?7}W{d}WJP"C6.76C>&068#&@RD103@`#qZ6"3"$41@/6"WE(+.1*:".*:;lh}AlRN}We:l_}WM,/.768,/.168,'#qZ,/.F0
*:o,903@9*-#&@c;R".103%'0J681DA,/.10U<O:#&Y768OL6"$"341@96"$E(+*:O:O03254768OL,/.76l,#qj,/.F0[*:o,/0$@9*:#@c;9".F03%'0\U7#&@
0WaF6%'Q1O-0JF(+*T,/.q#&41@B,/.br#&@9DF03@"$03o,/0$@903DD1*-gs03@R031"$03;$J1(_0K"C684F;90,/.10Zq#O:O:#?(+*-1<=,9.1*:@RDbr!#&@RD103@
#&QV03@968,/#&@+6l,P[&
$
&U
s "
$"h
$ T
zF\ !&
(+.1*-".d*:;X036;9*-O-EUDF03@9*T>&0$Dd41;R*:1<=6wtm6CENO:#&@j,68Y1O:08\^tu.10@903;R41O-,9*:1<KD1*Tgh0$@90$1"30#&QV03@/6l,/#&@X.76;X,/.F0
q#&@R%#%
q j2V\VF\ &U(+*-,9.
$w
$f
$ ?
$?
$
$=
?
\\
\
J O
$w
U
$&
\\
zF\ &o
tu.1*-;f68Q1Q1@9#Cab*:%68,9*:#&*-;u<&O:#Y76O:OTE`q#&41@R,9.br!#@9D10$@+6"3"$41@/68,90\
i,=,9.10'#&4F,9G1#I( Ys#411D76@BE&Jm1#YV#&41FD76@RE"3#&1DF*-,/*-#&k*:;K;9QV03"$*-n70$D\d
0`%U41;R,M6Q1QF@9#Ca5r
*:%68,90
#
H
68,U1#bDF,
0 (+*-,/.H1#A*:Fq#@9%68,/*-#&H68Ys#&4b,U
#
"\ktu.541;U,/.10e;R03"$#&1Dbr#&@9D10$@
"30$o,/03@R03DbrD1*-gs03@R031"$0=#Qs0$@/68,9#&@3JN(+.1*:".@90$2541*:@R03;uN9#
"/J1"C6F1#,uYV041;90$D6l,XU \Pi Y76"&r
(_6@9DD1*-gs03@R031"$0eq#&@9%U4FOS6%U4F;R,`YV04F;903Dh\*-,/.6A;90$"3#&FDbr!#&@RD103@`*-5,903@R*:#&@U#Qs0$@/68,9#&@3Jj,/.F0
q#&O-O:#?(+*:1<=n7@9;B,Rr!#@9D10$@Y16"o(6@RDq#&@R%U41O:6U"C6YV0w4F;903Dh
s
$P"R
U
zF\ !'&
tu.1*-;QF@9#ND141"30$;6'D1*Tgh0$@90$1"30K#&QV03@968,/#&@(+*T,/.
$w
$w
$
=
\\
\
$w
J O
$=
\\
\
zF\ ?o
!d,9.10Z"C68;90Z#q6=q#&41@B,/.br#&@9D10$@_"$03o,/0$@903D*-5,903@R*:#&@X#&QV03@968,/#&@P,/.10fOS6;B,v,!(v#[@9#?(+;#8q
%'#bD1*Tn7"C6l,/*:#\
@90$2541*:@R0
NoZL^XfXU^+XX+c_+fec8mfcP
i 1#8,/.10$@=68Q1Q1@9#&6".A,/#e,/.10[DF0$>&0$O:#&QF%0$5,w#qvYV#&411D768@RE;R".103%'03;w*:;c*:,/0$@9%';#qv;9Q76"$0
c
0WaN,9@/6QV#&OS6l,/*:#\tu.10vq#&O-O:#?(+*:F<q#&@9%U4FOS6+6O:O-#?(+;#"h,/#Ys0v0WaN,/@96Qs#OS68,903DKq@9#&%,9.10v*-o,/03@R*:#&@
D768,/6U,/#'6@9YF*-,/@96@REd#&@9DF03@+#&6032541*:;RQ76"$03D<@9*:Dh
BF$8
P"
#"^
zF\ Do
(+.10$@90 *-;P,9.10Z;R.1*-q|,_#&Qs0$@/68,9#&@PD10$n7F03DYoEwbN9#"P681Dd,/.F0Z#&@9DF03@_#8q,/.1068Q1Q1@9#Cab*:%6lr
,/*-#&*:
; $&\P7#&@0aF6%QFO:0Jb(+*-,/.~d
(_0w#&YF,/6*:
BF$
P"
P
##"^#"&$
P"^
zF\@'
(+.1*-".<&*T>&0$;+,9.10q#&O:O-#?(+*:1<Mn1@9;R,Br!#&@RD103@6QFQ1@9#Cab*:%68,/*-#&d,9#'#"
#"j
$P"
zF\@'bI
b41YF;R,/*T,/4F,9*:1<,/.1*-;Z*:o,/#,/.10[;R03"3#1Dbr!#@9D10$@"303o,903@90$D
DF*-gs03@90$1"30[#Qs0$@/68,9#&@Z6QFQ1O:*-03DA68,Z1#bDF0
<&*->03;
s
$P"%$P"
[
##"&$P"R
[
#$P"B
U
zF\@'
(+.1*-".*-;u*:D10$5,9*:"36Oh,/#j2\VF\ 'b\
`aao
gKupl gonu}gehi:u|%jgehi
!e;9#O->N*:1<U,9.10ZD1*Tgh4F;9*:#03254768,9*:#&(v0%U41;B,+"3#&F;9*:DF03@uZ*-@9*:".FO:0$,_61D0341%61YV#&411D16@RE
"3#1D1*-,9*:#&F;3\Ltu.F0+,9@90368,/%'03o,j#qh6KZ*:@R*:".1O-0$,mYs#&4F1D76@BE["3#&FD1*-,9*:#&UQF@9#N"3030$D1;P6O:#1<Z,/.10u;96%'0
O:*-103;c6;c,9.10U*:bG7#?(YV#&41FD76@REq#&@,/.10U"$#&o>&0$"$,/*-#&k03254768,9*:#&ADF*:;9"$41;9;R03D)6YV#?>&0\*T,/.,/.F0
;90$"3#&FDbr!#&@RD103@"30$o,/03@R03D*:o,/0$@9*:#@#&QV03@/6l,/#&@
s
N9#"&$
U
bLN)P"B
zF\@'o
1#f%#ND1*-n1"C68,9*:#&1;6@90P@90$2N4F*:@90$DU1036@mYV#&41FD76@9*-03;$J8O-0C6D1*-1<u,/#,/.10PD1*-gs03@R031"$0_#&QV03@968,/#@<*->&0$
*:Yj2\F\ 'b\
7#&@M6f034F%d6FYs#411D76@BEH"$#&1D1*T,/*-#&J(_0e68;9;94F%0d,9.768,
H
*:;w;9QV03"$*-n70$D68,)
&JF,9.768,*:;
E8
9 #"
zF\@'85
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
tu.541;+(_0wD103;R*:<&6#&QV03@968,/#&@+6l,+1#bDF0{
h
(+.1*-".*-;u*:e,/.10q#&O-O:#?(+*:F<Mq#&@9%
o~#P"B
U
zF\@'&
9 #"
(+.10$@90JIJ681Dfc6@90K"3#1;R,/6o,/;u(+.1*:"."C68036;9*-O-EYs0KD10W,/03@R%*-103D41;R*:1<'6`tL6CENO:#@,6Y1O-0J
6;+;9.F#I(+*:etm6Y1O-0=b\ 1\
9
{;3bP"
k;?N
[ ;=; J KM O 9 #"
K
5NP"~bW
U
9 R#"
8
U T ;
U ;
U;
N
[ ; JZK M O
K
U U ;
J KNM O
K
J K M O
K
J K M O
K
J K M O
K
{;5|r/Ih; ""
;NSrI ; "
"
kN; Ih; "
"
;N|r9I T ;
;N|r9I U ; "
U
"
kN; I T ;
"
k;oBI ;
tL68Y1O:0KF\ 1\jtm6CEbO-#&@,68Y1O:0Zq#&@+0341%61YV#&411D768@REe"$#&1D1*T,/*:#\
b#&OT>N*:1<Uq#&@F7J?J61DIJF(_0w#&YF,/6*:,9.10q#&O:O-#?(+*:1<U#Qs0$@/68,9#&@3
s
P"R$
&U
[
9 #"
zF\@'o
(+.1*-".)QF@9#ND141"30$;,/.10[D1*Tgh0$@90$1"30[#&QV03@968,/#@Z<&*->03k*:6j2\F\ DF\=f#8,/*:"$0M,/.168,Z,/.F*:;#&QV03@968,/#&@
*:;=;90$"3#&1DNr!#&@RD103@[68"3"34F@/68,90\!,9.10"C68;90#q6N4F%0$@9*:"36Ov6Q1Q1@R#?ab*-%d68,9*:#&k,/#6f0$41%d681
YV#&411D768@RE"3#1D1*-,9*:#&hJF,/.1*-;u*:;+10$"303;R;/6@BE,9##YF,6*-6'<&O-#&Y76O-O-E';90$"3#&FDbr!#&@RD103@f6"$"341@968,/0Kq#&@Br
%U41O:68,/*-#&\mtu.1*:;+"3#5,9@/6;B,/;+(+*-,9.,9.10K541%0$@9*-"C6OYV#&41FD76@RE;9".10$%0$;fD10$;9"$@9*:YV03DQ1@90W>N*:#&41;RO-E
(+.1*-"."36YV0K#&10K#&@RD103@uO-#I(v03@u,9.76,/.10K*:o,903@9*-#&@;R".103%'0\
H0`"36H68O:;9#e#YF,6*-A,/.10`#&QV03@968,/#&@*-6j2V\F@\ '41;R*:1<,/.F0[;9Q76"$00aN,/@/68Qs#&O:68,/*-#&*-D10C6F\
_#&1;R*:D10$@6`;R03"$#&1Dbr#&@9D10$@fY16"o(6@RDbr!DF*-gs03@90$1"30=6Q1QF@9#Cab*:%68,/*-#&6Q1Q1O-*:0$D68,+1#ND1
0 &
9 #"
P"&$&#"R~\zU
U
zF\@''&
b#&OT>N*:1<Uq#&@u#"v<&*T>&03;
#"j
&$P"
U8
9 #"
]\dzU T
zF\@'L?o
N?X\P
'
41YF;R,/*T,/4F,9*:1<,/.1*-;*:o,/#,9.10;R03"3#1Dbr!#@9D10$@)"$03o,/0$@90$DD1*Tgh0$@90$1"30#&QV03@968,/#@q#&@A6;R03"$#&1D
b
D10$@9*->868,9*->0K6Q1Q1O-*:03D68,+F#bD10 <&*->03;
s
#"&$ P"R
U
P"&$&
&U ,
#P"&$
&U
#U
&U
zF\@'LDo
$P"
8
U8
79 #"
9 #"
zF\?
(+.1*-".*-;u*:D10$5,9*:"36Oh,/#j2\VF\'8F\
/
j;X34
&\Z0$@9*->0[6d,/.F*:@9DNr!#&@RD103@n71*-,90WrD1*-gs03@R031"$0[6Q1Q1@R#CaF*-%d6l,/*:#,/#6dn7@9;B,KD103@R*->868,/*T>&0=*:,/.F0
q#&@R%
oN)P ~NP"hzWNL
U
hu
N9#"B
L*-1De,/.10KO-0C6D1*-1<[03@R@9#&@,903@R%\
\Z0$@9*->0K6`n11*-,90Wr!DF*-gs03@90$1"30K68Q1Q1@9#Cab*:%68,9*:#&,9#6Un7@R;R,D10$@9*->868,9*->0*:e,/.10q#&@R%
V h)P"h hu
N)P"~WN^
U
bR#"B
L*-1De,/.10KO-0C6D1*-1<[03@R@9#&@,903@R%\
F\f0;9*:F<`6U*-5,903@R*:#&@/PQV#&*:o,%'03;R.JF(+@R*-,/0c#&4F,,9.10IX[%d68,9@9*-"303;_61D,9.10Ys#411D76@BEor
"$#&1D1*T,/*:#>&0$"$,9#&@Zq#&@9%'03DY5E41;9*-1<d,9.10U;9".F03%'0[D103@R*->&0$Dk*:25410$;R,/*-#&
(+.10$kYs#,9.
61D
#
H
k68@90<&*T>&0368,P[ 681D*:;u<*->&0$6l,P[ b\
1\f+03QV0C68,25410$;R,/*-#&
(+*T,/.
\
b\Z0$@9*->0K6`n11*-,90Wr!DF*-gs03@90$1"30K68Q1Q1@9#Cab*:%68,9*:#&,9#6U,9.1*:@RDDF03@9*T>868,/*T>&0*:e,9.10q#&@9%
Vu
oN)P ~NP"~WNL
T
U
L*-1De,/.10KO-0C6D1*-1<[03@R@9#&@,903@R%\
N9#"h]CNR
!?
^ZcmX5L3mPzZ^^XPM^ZXXjZBcWuZ
F\Z0$@9*->0K6["3#&%'Q76"W,=#&@+m6D0?< n71*T,/0r!D1*Tgh0$@903F"30K6Q1QF@9#Cab*:%68,/*-#&d,/#'6[;90$"3#&FDD10$@9*->86lr
,9*->&0K*-,/.10q#&@R%
5NP"~bL]N9#"R
U
L*-1De,/.10KO-0C6D1*-1<[03@R@9#&@,903@R%\
'b\L*-1D,9.10Z%'#bDF*-n70$Dd(6C>03541%UYV03@uq#&@X,/.10c#&Qs0$@/68,9#&@_DF03@9*T>&0$D*-d25410$;R,/*-#&A&\XjO:#8,_,/.F0
@R0C6O681De*:%6<&*-76@RE'Q768@R,/;_#q` h U>b;$\`7Uq#&@ ml `7U l j
\P_#&%'Q76@R0Z,/.10@R0C6O
Q768@R,u(+*-,9.e,/.768,#&Yb,6*-103Deq@9#% ,/.F0Kq#41@R,9.br!#&@RD103@u"$03o,/0$@90$D#&QV03@/6l,/#&@wX
2\F\@8 5\
?F\+ifQ1Q1O:*-"C68,9*:#&d#qm,9.10K;90$"3#&1DNr!D10$@9*->868,9*->0w#Qs0$@/68,9#&@,/#[,/.F0Kq4F1"$,9*:#& [_ <&*->03;
[_
$ ` [_
ifQ1Q1O:*-"C68,9*:#&d#q^6`D1*Tgh0$@903F"30K#&QV03@/6l,/#&@q#&@,9.10K;90$"3#&1DD103@R*->868,9*->&0<*->&0$;
a_ e
uX$]` h
[_
,9.N4F;wDF0$n71*-1<e,/.10[%'#ND1*-n70$D(6C>03541%UYV03@` h q#@K6;903"$#&1D)D103@R*->868,9*->&0`68Q1Q1@9#Cab*:%6lr
,9*:#&\L*-1D
,9.10%'#bDF*-n70$D)(_6C>&03541%MYs0$@`q#@w,9.10d;R03"3#1Dbr!#@9D10$@U"30$5,903@R03DD1*-gs03@R031"$0
#&QV03@968,/#@`q#@6k;90$"3#&FDD103@R*->868,9*->&08Jv,9.10F#&1"3#%Q768"$,'q#&41@R,9.br!#@9D10$@'#Qs0$@/68,9#&@ j2\
F@\ &J16FD,/.10"$#&%Q16"$,q#41@R,9.br!#&@RD103@_#&Qs0$@/68,9#&@_DF03@9*T>&0$D*-e254103;B,/*:#F\XjO:#f
, ` h U
>N;3S
\ `7Uq#&@ m
l `7U l j\
DF\L*-1D,9.10<&@R*:DbrQs#*:o,/;r!QV03@Br(6C>03O:0$1<,9. U@R032541*:@R03%'03o,,9#6".1*-0$>&06HQ1.76;R0
\f_#&F;9*:DF03@v,9.10fq#O:O:#?(+*-1<K#&10Wr;9*-D103DD1*-gs03@R031"$*:1<=;9".10$%0$;3JF(+.1*-".e6@R0fn7@R;R,Rr/Jb;R03"$#&1Dbr/J
6FD,9.1*:@RDbr!#&@RD103@$JF@R03;9QV03"W,/*T>&03OTEV
VuN7$bP"BHU
VzuNh$bP"hN)P H1 [s
hu
&CNh$=?N)P"h~DN)P
$
N)P T H1z[s
*-1D,/.F0e%#ND1*-n103D(_6?>03541%UYV03@`q#&@U036".#q+,/.10$;90;9".10$%0$;3\jO:#,M,/.10e@R0C6Ou681D
L
*-%d6<*:76@BEQ768@R,/;M#qf` h U>N;$\`7Uq#@ l `7[ l j\Z0$@9*->0,9.10d,!(v#AO:0C68D1*:1<
,903@9%';u*:e,9.10,/@94F1"C68,9*:#&0$@9@9#@+q#@u0C6".;9".10$%08\
Chapter 4
THE SEMI-DISCRETE
APPROACH
One strategy for obtaining nite-dierence approximations to a PDE is to start by
dierencing the space derivatives only, without approximating the time derivative.
In the following chapters, we proceed with an analysis making considerable use of
this concept, which we refer to as the semi-discrete approach. Dierencing the space
derivatives converts the basic PDE into a set of coupled ODE's. In the most general
notation, these ODE's would be expressed in the form
d~u = F~ (~u; t)
(4.1)
dt
which includes all manner of nonlinear and time-dependent possibilities. On occasion,
we use this form, but the rest of this chapter is devoted to a more specialized matrix
notation described below.
Another strategy for constructing a nite-dierence approximation to a PDE is
to approximate all the partial derivatives at once. This generally leads to a point
dierence operator (see Section 3.3.1) which, in turn, can be used for the time advance
of the solution at any given point in the mesh. As an example let us consider the
model equation for diusion
@u = @ u
@t
@x
Using three-point central-dierencing schemes for both the time and space derivatives,
we nd
2 n
n +un 3
ujn ; ujn;
u
;
2
u
j
j; 5
4 j
=
2h
x
or
2h hu n ; 2u n + u n i
ujn = ujn; +
(4.2)
j
j;
x j
51
2
( +1)
1)
( )
+1
( )
( )
1
( +1)
1)
( )
+1
( )
( )
1
52
Clearly Eq. 4.2 is a dierence equation which can be used at the space point j to
advance the value of u from the previous time levels n and n ; 1 to the level n + 1.
It is a full discretization of the PDE. Note, however, that the spatial and temporal
discretizations are separable. Thus, this method has an intermediate semi-discrete
form and can be analyzed by the methods discussed in the next few chapters.
Another possibility is to replace the value of ujn in the right hand side of Eq. 4.2
with the time average of u at that point, namely (ujn + ujn; )=2. This results in
the formula
( )
( +1)
ujn
( +1)
un
= ujn; + 2h 4ujn ; 2 @ j
x
(
1)
( )
+1
( +1)
1)
+ ujn; A n 5
+ uj ;
2
(
1)
( )
1
(4.3)
which can be solved for u n and time advanced at the point j . In this case, the
spatial and temporal discretizations are not separable, and no semi-discrete form
exists.
Equation 4.2 is sometimes called Richardson's method of overlapping steps and
Eq. 4.3 is referred to as the DuFort-Frankel method. As we shall see later on, there
are subtle points to be made about using these methods to nd a numerical solution
to the diusion equation. There are a number of issues concerning the accuracy,
stability, and convergence of Eqs. 4.2 and 4.3 which we cannot comment on until we
develop a framework for such investigations. We introduce these methods here only to
distinguish between methods in which the temporal and spatial terms are discretized
separately and those for which no such separation is possible. For the time being, we
shall separate the space dierence approximations from the time dierencing. In this
approach, we reduce the governing PDE's to ODE's by discretizing the spatial terms
and use the well-developed theory of ODE solutions to aid us in the development of
an analysis of accuracy and stability.
( +1)
53
(4.6)
Note that the elements in the matrix A depend upon both the PDE and the type of
dierencing scheme chosen for the space terms. The vector ~f (t) is usually determined
by the boundary conditions and possibly source terms. In general, even the Euler
and Navier-Stokes equations can be expressed in the form of Eq. 4.6. In such cases
the equations are nonlinear, that is, the elements of A depend on the solution ~u and
are usually derived by nding the Jacobian of a
ux vector. Although the equations
are nonlinear, the linear analysis presented in this book leads to diagnostics that are
surprisingly accurate when used to evaluate many aspects of numerical methods as
they apply to the Euler and Navier-Stokes equations.
54
In order to advance Eq. 4.1 in time, the system of ODE's must be integrated using a
time-marching method. In order to analyze time-marching methods, we will make use
of exact solutions of coupled systems of ODE's, which exist under certain conditions.
The ODE's represented by Eq. 4.1 are said to be linear if F is linearly dependent on
u (i.e., if @F=@u = A where A is independent of u). As we have already pointed out,
when the ODE's are linear they can be expressed in a matrix notation as Eq. 4.6 in
which the coecient matrix, A, is independent of u. If A does depend explicitly on
t, the general solution cannot be written; whereas, if A does not depend explicitly on
t, the general solution to Eq. 4.6 can be written. This holds regardless of whether or
not the forcing function, f~, depends explicitly on t.
As we shall soon see, the exact solution of Eq. 4.6 can be written in terms of
the eigenvalues and eigenvectors of A. This will lead us to a representative scalar
equation for use in analyzing time-marching methods. These ideas are developed in
the following sections.
Complete Systems
An M M matrix is represented by a complete eigensystem if it has a complete set
X ; AX =
1
(4.8)
55
Defective Systems
If an M M matrix does not have a complete set of linearly independent eigenvectors,
( )
56
et +
t ; et
u(t) = u(0)et + a e ;
The interesting question can arise: What happens to the solution of Eq. 4.9 when
= ? This is easily found by setting = + , solving, and then taking the limit
as ! 0. Using this limiting device, we nd that the solution to
du = u + aet
dt
(4.10)
is given by
Second-Order Equations
The homogeneous form of a second-order equation is given by
d u + a du + a u = 0
(4.11)
dt
dt
where a and a are complex constants. Now we introduce the dierential operator
D such that
D dtd
2
(D + a D + a ) u(t) = 0
2
57
, M . They are found by solving the equation P () = 0. In our simple example,
2
1
2
2
11
12
21
22
11
12
11
21
22
21
11
12
21
22
11
11
12
12
21
21
22
22
1
1
11
12
21
22
12
22
58
A Derogatory System
Eq. 4.15 is still a solution to Eq. 4.14 if = = , provided two linearly independent
vectors exist to satisfy Eq. 4.16 with A = . In this case
1
01 1
0 0 = 0
0 0 0
0 1 = 1
and
provide such a solution. This is the case where A has a complete set of eigenvectors
and is not defective.
A Defective System
If A is defective, then it can be represented by the Jordan canonical form
"
# "
#" #
u0 = 0 u
u0
1 u
1
(4.18)
whose solution is not obvious. However, in this case, one can solve the top equation
rst, giving u (t) = u (0)et . Then, substituting this result into the second equation,
one nds
du = u + u (0)et
dt
which is identical in form to Eq. 4.10 and has the solution
1
u (t) = a + bt + ct et
2
is a solution to
2 03 2
32 3
u
64 u0 75 = 64 1 75 64 uu 75
u0
1 u
1
if
(4.19)
59
d X ; ~u = X ; ~u ; X ; ~f (t)
dt
Finally, by introducing the new variables w~ and ~g such that
1
w~ = X ; ~u ; ~g(t) = X ; ~f (t)
1
(4.22)
60
4.23 are no longer coupled. They can be written line by line as a set of independent,
single, rst-order equations, thus
w0 = w ; g (t)
...
wm0 = mwm ; gm (t)
...
wM0 = M wM ; gM (t)
1
(4.24)
For any given set of gm (t) each of these equations can be solved separately and then
recoupled, using the inverse of the relations given in Eqs. 4.22:
~u(t) = X w~ (t)
=
M
X
m=1
wm(t)~xm
(4.25)
M
X
m=1
M
X
wm(t)~xm
M 1
X
gm~xm
m
m
m
M
X
=
cm em t ~xm + X ; X ; ~f
=1
cm em t ~xm +
=1
m=1
M
X
m=1
cm em t ~xm + A; ~f
1
{z
Transient
} |
{z
Steady-state
(4.26)
61
Following the semi-discrete approach discussed in Section 4.1, we reduce the partial
dierential equations to a set of ordinary dierential equations represented by the
generic form
d~u = A~u ; ~f
(4.28)
dt
The dependent variable ~u represents some physical quantity or quantities which relate
to the problem of interest. For the model problems on which we are focusing most
of our attention, the elements of A are independent of both u and t. This permits
us to say a great deal about such problems and serves as the basis for this section.
In particular, we can develop some very important and fundamental concepts that
underly the global properties of the numerical solutions to the model problems. How
these relate to the numerical solutions of more practical problems depends upon the
problem and, to a much greater extent, on the cleverness of the relator.
We begin by developing the concept of \spaces". That is, we identify dierent
mathematical reference frames (spaces) and view our solutions from within each.
In this way, we get dierent perspectives of the same solution, and this can add
signicantly to our understanding.
The most natural reference frame is the physical one. We say
If a solution is expressed in terms of ~u, it is said
to be in real space.
There is, however, another very useful frame. We saw in Sections 4.2.1 and 4.2 that
pre- and post-multiplication of A by the appropriate similarity matrices transforms A
into a diagonal matrix, composed, in the most general case, of Jordan blocks or, in the
62
simplest nondefective case, of scalars. Following Section 4.2 and, for simplicity, using
only complete systems for our examples, we found that Eq. 4.28 had the alternative
form
dw~ = w~ ; ~g
dt
which is an uncoupled set of rst-order ODE's that can be solved independently for
the dependent variable vector w~ . We say
If a solution is expressed in terms of w~ , it is said to
be in eigenspace (often referred to as wave space).
The relations that transfer from one space to the other are:
w~ = X ; ~u
~g = X ; ~f
1
1
~u = X w~
~f = X~g
The elements of ~u relate directly to the local physics of the problem. However, the
elements of w~ are linear combinations of all of the elements of ~u, and individually
they have no direct local physical interpretation.
When the forcing function ~f is independent of t, the solutions in the two spaces
are represented by
~u(t) = X cm em t ~xm + X ; X ; ~f
and
wm(t) = cm em t + 1 gm ; m = 1; 2; ; M
m
for real space and eigenspace, respectively. At this point we make two observations:
1
1. the transient portion of the solution in real space consists of a linear combination
of contributions from each eigenvector, and
2. the transient portion of the solution in eigenspace provides the weighting of
each eigenvector component of the transient solution in real space.
63
where
= ;im a
m = 0; 1; ; M ; 1
m x
m = sin
x
(4.30)
m = 0; 1; ; M ; 1
(4.31)
Next we consider the eigenvectors of the two model equations. These follow as special
cases from the results given in Appendix B.
uj =
M
X
m=1
wm sin mxj ; j = 1; 2; ; M
(4.32)
64
2 sin (x )
66 sin (2x )
64 sin (3x )
sin (4x )
sin (x )
sin (2x )
sin (3x )
sin (4x )
sin (x )
sin (2x )
sin (3x )
sin (4x )
3
3
3
3
sin (x ) 3
sin (2x ) 777
sin (3x ) 5
sin (4x )
4
4
4
4
wm =
M
X
j =1
uj sin mxj ; m = 1; 2; ; M
(4.33)
In the eld of harmonic analysis, Eq. 4.33 represents a sine transform of the function u(x) for an M -point sample between the boundaries x = 0 and x = with the
condition u(0) = u() = 0. Similarly, Eq. 4.32 represents the sine synthesis that
companions the sine transform given by Eq. 4.33. In summary,
For the model diusion equation:
~xm = ei j
m=M ) ;
(2
j = 0; 1; ; M ; 1
m = 0; 1; ; M ; 1
uj =
MX
;1
m=0
wmeimxj ; j = 0; 1; ; M ; 1
(4.34)
65
2w
66 w
64 w
w
1
2
3
4
3 21 1
1
1
77 1 66 1 e; i= e; i= e; i=
75 = 4 64 1 e; i= e; i= e; i=
1 e; i= e; i= e; i=
In general
12
12
18
32u
77 66 u
75 64 u
u
1
2
3
3
77
75 = X ; ~u
1
MX
;
1
wm = M
uj e;imxj ; m = 0; 1; ; M ; 1
j
This equation is identical to a discrete Fourier transform of the periodic dependent
variable ~u using an M -point sample between and including x = 0 and x = 2 ; x.
For circulant matrices, it is straightforward to establish the fact that the relation
~u = X w~ represents the Fourier synthesis of the variable w~ back to ~u. In summary,
1
=0
We can now combine the results of the previous sections to write the solutions of our
model ODE's.
uj (t) =
where
M
X
m=1
j = 1; 2; ; M
4 sin
m
m = ;
2(M + 1)
x
2
(4.35)
(4.36)
66
uj (t) =
M
X
m=1
(4.37)
j = 1; 2; ; M
(4.38)
This can be compared with the exact solution to the PDE, Eq. 2.37, evaluated at the
nodes of the grid:
uj (t) =
M
X
m=1
j = 1; 2; ; M
(4.39)
We see that the solutions are identical except for the steady solution and the
modied wavenumber in the transient term. The modied wavenumber is an approximation to the actual wavenumber. The dierence between the modied wavenumber
and the actual wavenumber depends on the dierencing scheme and the grid resolution. This dierence causes the various modes (or eigenvector components) to decay
at rates which dier from the exact solution. With conventional dierencing schemes,
low wavenumber modes are accurately represented, while high wavenumber modes (if
they have signicant amplitudes) can have large errors.
uj (t) =
MX
;1
m=0
cmem t eimxj ;
j = 0; 1; ; M ; 1
(4.40)
where
m = ;im a
(4.41)
with the modied wavenumber dened in Eq. 4.31. We can write this ODE solution
as
uj (t) =
MX
;1
m=0
cme;im at eimxj ;
j = 0; 1; ; M ; 1
(4.42)
67
and compare it to the exact solution of the PDE, Eq. 2.26, evaluated at the nodes of
the grid:
MX
;
uj (t) = fm (0)e;imat eim xj ; j = 0; 1; ; M ; 1
(4.43)
1
m=0
Once again the dierence appears through the modied wavenumber contained in
m. As discussed in Section 3.5, this leads to an error in the speed with which various
modes are convected, since is real. Since the error in the phase speed depends on
the wavenumber, while the actual phase speed is independent of the wavenumber,
the result is erroneous numerical dispersion. In the case of non-centered dierencing,
discussed in Chapter 11, the modied wavenumber is complex. The form of Eq. 4.42
shows that the imaginary portion of the modied wavenumber produces nonphysical
decay or growth in the numerical solution.
68
the question is: What should we use for gm(t) when the time dependence cannot be
ignored? To answer this question, we note that, in principle, one can express any one
of the forcing terms gm(t) as a nite Fourier series. For example
X
;g(t) = ak eikt
for which Eq. 4.44 has the exact solution:
X ak eikt
k ik ;
From this we can extract the k'th term and replace ik with . This leads to
w(t) = cet +
(4.45)
which can be used to evaluate all manner of time-marching methods. In such evaluations the parameters and must be allowed to take the worst possible combination
of values that might occur in the ODE eigensystem. The exact solution of the representative ODE is (for 6= ):
t
(4.46)
w(t) = cet + ae;
4.5 Problems
1. Consider the nite-dierence operator derived in question 1 of Chapter 3. Using
this operator to approximate the spatial derivative in the linear convection equation, write the semi-discrete form obtained with periodic boundary conditions
on a 5-point grid (M = 5).
2. Consider the application of the operator given in Eq. 3.52 to the 1-D diusion
equation with Dirichlet boundary conditions. Write the resulting semi-discrete
ODE form. Find the entries in the boundary-condition vector.
3. Write the semi-discrete form resulting from the application of second-order centered dierences to the following equation on the domain 0 x 1 with
boundary conditions u(0) = 0, u(1) = 1:
@u = @ u ; 6x
@t @x
2
4.5. PROBLEMS
69
70
Chapter 5
FINITE-VOLUME METHODS
In Chapter 3, we saw how to derive nite-dierence approximations to arbitrary
derivatives. In Chapter 4, we saw that the application of a nite-dierence approximation to the spatial derivatives in our model PDE's produces a coupled set of ODE's.
In this Chapter, we will show how similar semi-discrete forms can be derived using
nite-volume approximations in space. Finite-volume methods have become popular in CFD as a result, primarily, of two advantages. First, they ensure that the
discretization is conservative, i.e., mass, momentum, and energy are conserved in a
discrete sense. While this property can usually be obtained using a nite-dierence
formulation, it is obtained naturally from a nite-volume formulation. Second, nitevolume methods do not require a coordinate transformation in order to be applied on
irregular meshes. As a result, they can be applied on unstructured meshes consisting
of arbitrary polyhedra in three dimensions or arbitrary polygons in two dimensions.
This increased
exibility can be used to great advantage in generating grids about
arbitrary geometries.
Finite-volume methods are applied to the integral form of the governing equations,
either in the form of Eq. 2.1 or Eq. 2.2. Consistent with our emphasis on semi-discrete
methods, we will study the latter form, which is
(5.1)
We will begin by presenting the basic concepts which apply to nite-volume strategies.
Next we will give our model equations in the form of Eq. 5.1. This will be followed
by several examples which hopefully make these concepts clear.
71
72
The basic idea of a nite-volume method is to satisfy the integral form of the conservation law to some degree of approximation for each of many contiguous control
volumes which cover the domain of interest. Thus the volume V in Eq. 5.1 is that of a
control volume whose shape is dependent on the nature of the grid. In our examples,
we will consider only control volumes which do not vary with time. Examining Eq.
5.1, we see that several approximations must be made. The
ux is required at the
boundary of the control volume, which is a closed surface in three dimensions and a
closed contour in two dimensions. This
ux must then be integrated to nd the net
ux through the boundary. Similarly, the source term P must be integrated over the
control volume. Next a time-marching method1 can be applied to nd the value of
Z
QdV
(5.2)
(5.3)
(5.4)
for a control volume which does not vary with time. Thus after applying a timemarching method, we have updated values of the cell-averaged quantities Q . In order
to evaluate the
uxes, which are a function of Q, at the control-volume boundary, Q
can be represented within the cell by some piecewise approximation which produces
the correct value of Q . This is a form of interpolation often referred to as reconstruction. As we shall see in our examples, each cell will have a dierent piecewise
approximation to Q. When these are used to calculate F(Q), they will generally
produce dierent approximations to the
ux at the boundary between two control
volumes, that is, the
ux will be discontinuous. A nondissipative scheme analogous
to centered dierencing is obtained by taking the average of these two
uxes. Another
approach known as
ux-dierence splitting is described in Chapter 11.
The basic elements of a nite-volume method are thus the following:
1
73
rQdA = C nQdl
(5.6)
where the unit vector n points outward from the surface or contour.
@u + a cos @u + a sin @u = 0
@t
@x
@y
(5.7)
This PDE governs a simple plane wave convecting the scalar quantity, u(x; y; t) with
speed a along a straight line making an angle with respect to the x-axis. The
one-dimensional form is recovered with = 0.
74
For unit speed a, the two-dimensional linear convection equation is obtained from
the general divergence form, Eq. 2.3, with
Q = u
F = iu cos + ju sin
P = 0
(5.8)
(5.9)
(5.10)
Since Q is a scalar, F is simply a vector. Substituting these expressions into a twodimensional form of Eq. 2.2 gives the following integral form
(5.11)
where A is the area of the cell which is bounded by the closed contour C .
The integral form of the two-dimensional diusion equation with no source term and
unit diusion coecient is obtained from the general divergence form, Eq. 2.3, with
Q = u
F = ;ru
!
@u
@u
= ; i @x + j @y
P = 0
Using these, we nd
(5.12)
(5.13)
(5.14)
(5.15)
!
d Z udA = I n: i @u + j @u ds
dt A
@x @y
C
(5.16)
xj;1=2 = xj ; x=2;
xj+1=2 = xj + x=2
(5.17)
75
j+1/2
j-1/2
x
j-2
j-1
j
L
j+1
L
j+2
uj1=2 = u(xj1=2);
fj1=2 = f (uj1=2)
(5.18)
(5.19)
Z xj +1=2
d (xu ) + f
;
f
=
Pdx
(5.20)
j
j +1=2
j ;1=2
dt
xj;1=2
Now with = x ; xj , we can expand u(x) in Eq. 5.19 in a Taylor series about xj
(with t xed) to get
2
3
!
Z x=2
2 @2u ! 3 @3u !
@u
1
uj x ;x=2 4uj + @x + 2 @x2 + 6 @x3 + : : :5 d
j
j
j
!
!
2
2
4
4
x @ u + O(x6 )
= uj + 24x @@xu2 + 1920
(5.21)
@x4 j
j
or
uj = uj + O(x2)
(5.22)
where uj is the value at the center of the cell. Hence the cell-average value and the
value at the center of the cell dier by a term of second order.
76
77
(5.34)
; uj;1
b = uj+12
x
(5.35)
uj ; uj+1
c = ;uj;1 + 26
24
With these values of a, b, and c, the piecewise quadratic approximation produces
(5.36)
78
(5.37)
(5.38)
(5.39)
using the notation dened in Section 5.3.1. Recalling that f = u, we again use the
average of the
uxes on either side of the boundary to obtain
f^j+1=2 = 12 [f (uLj+1=2) + f (uRj+1=2)]
1 (;u + 7u + 7u ; u )
(5.40)
= 12
j +2
j +1
j
j ;1
and
(5.41)
Substituting these expressions into the integral form, Eq. 5.23, gives
1 (;u + 8u ; 8u + u ) = 0
x ddtuj + 12
(5.42)
j +2
j +1
j ;1
j ;2
This is a fourth-order approximation to the integral form of the equation, as can be
veried using Taylor series expansions (see question 1 at the end of this chapter).
With periodic boundary conditions, the following semi-discrete form is obtained:
d~u = ; 1 B (1; ;8; 0; 8; ;1)~u
(5.43)
dt
12x p
This is a system of ODE's governing the evolution of the cell-average data.
79
In one dimension, the integral form of the diusion equation, Eq. 5.16, becomes
;f =0
(5.44)
x duj + f
j +1=2
dt
j ;1=2
@u dx = u(b) ; u(a)
@x
(5.45)
We can thus write the following expression for the average value of the gradient of u
over the interval xj x xj+1:
1 Z xj+1 @u dx = 1 (u ; u )
(5.46)
x xj @x
x j+1 j
From Eq. 5.22, we know that the value of a continuous function at the center of a given
interval is equal to the average value of the function over the interval to second-order
accuracy. Hence, to second-order, we can write
!
@u
f^j+1=2 = ; @x
= ; 1 (uj+1 ; uj )
(5.47)
x
j +1=2
Similarly,
(5.48)
@u = @u = 2a + b
@x @
(5.51)
80
(5.52)
(5.53)
Notice that there is no discontinuity in the
ux at the cell boundary. This produces
duj = 1 (u ; 2u + u )
(5.54)
j
j +1
dt x2 j;1
which is identical to Eq. 5.49. The resulting semi-discrete form with periodic boundary conditions is
d~u = 1 B (1; ;2; 1)~u
(5.55)
dt x2 p
which is written entirely in terms of cell-average data.
d Z QdA + I n:Fdl = 0
dt A
C
(5.57)
81
2
3
0
5
where indexes a side of the hexagon, as shown in Figure 5.2. A list of the normals
for the mesh orientation shown is given in Table 5.1.
Side; Outward Normal; n
0
1
2
3
4
5
(i ; 3 j)=2
pi
(i + p3 j)=2
(;i + 3 j)=2
;pi
(;i ; 3 j)=2
82
For Eq. 5.11, the two-dimensional linear convection equation, we have for side
Z
Z `=2
;`=2
u ( )d
(5.58)
where is a length measured from the middle of a side . Making the change of
variable z = =`, one has the expression
Z `=2
Z 1=2
are no numerical approximations in Eq. 5.60. That is, if the integrals in the equation
are evaluated exactly, the integrated time rate of change of the integral of u over the
area of the hexagon is known exactly.
Side; n (i cos + j sin )
0
1
2
3
4
5
u dA = Aup
(5.61)
and the piecewise-constant approximation u = up over the entire hexagon, the approximation to the
ux integral becomes trivial. Taking the average of the
ux on
either side of each edge of the hexagon gives for edge 1:
Z 1=2
Z
u
+
u
p
a
dz
= up + ua
u
(z)dz =
(5.62)
2 ;1=2
2
1
5.5. PROBLEMS
83
u
(z)dz = up +2 ub
2
Z
Z
(5.63)
u
(z)dz = up +2 uc
3
(5.64)
u
(z)dz = up +2 ud
4
(5.65)
u
(z)dz = up +2 ue
5
(5.66)
u
(z)dz = up +2 uf
0
(5.67)
(5.69)
Substituting these into Eq. 5.60, along with the expressions in Table 5.2, we obtain
p
A ddtup + 2` [(2 cos )(ua ; ud) + (cos + 3 sin )(ub ; ue)
p
+(; cos + 3 sin )(uc ; uf )] = 0
(5.68)
or
The reader can verify, using Taylor series expansions, that this is a second-order
approximation to the integral form of the two-dimensional linear convection equation.
5.5 Problems
1. Use Taylor series to verify that Eq. 5.42 is a fourth-order approximation to Eq.
5.23.
2. Find the semi-discrete ODE form governing the cell-average data resulting from
the use of a linear approximation in developing a nite-volume method for the
linear convection equation. Use the following linear approximation:
u( ) = a + b
84
where b = uj and
; uj;1
a = uj+12
x
Chapter 6
TIME-MARCHING METHODS
FOR ODE'S
After discretizing the spatial derivatives in the governing PDE's (such as the NavierStokes equations), we obtain a coupled system of nonlinear ODE's in the form
d~u = F~ (~u; t)
dt
(6.1)
These can be integrated in time using a time-marching method to obtain a timeaccurate solution to an unsteady
ow problem. For a steady
ow problem, spatial
discretization leads to a coupled system of nonlinear algebraic equations in the form
F~ (~u) = 0
(6.2)
As a result of the nonlinearity of these equations, some sort of iterative method is
required to obtain a solution. For example, one can consider the use of Newton's
method, which is widely used for nonlinear algebraic equations (See Section 6.10.3.).
This produces an iterative method in which a coupled system of linear algebraic
equations must be solved at each iteration. These can be solved iteratively using
relaxation methods, which will be discussed in Chapter 9, or directly using Gaussian
elimination or some variation thereof.
Alternatively, one can consider a time-dependent path to the steady state and use
a time-marching method to integrate the unsteady form of the equations until the
solution is suciently close to the steady solution. The subject of the present chapter,
time-marching methods for ODE's, is thus relevant to both steady and unsteady
ow
problems. When using a time-marching method to compute steady
ows, the goal is
simply to remove the transient portion of the solution as quickly as possible; timeaccuracy is not required. This motivates the study of stability and stiness, topics
which are covered in the next two chapters.
85
86
6.1 Notation
Using the semi-discrete approach, we reduce our PDE to a set of coupled ODE's
represented in general by Eq. 4.1. However, for the purpose of this chapter, we need
only consider the scalar case
du = u0 = F (u; t)
dt
(6.3)
Although we use u to represent the dependent variable, rather than w, the reader
should recall the arguments made in Chapter 4 to justify the study of a scalar ODE.
Our rst task is to nd numerical approximations that can be used to carry out the
time integration of Eq. 6.3 to some given accuracy, where accuracy can be measured
either in a local or a global sense. We then face a further task concerning the numerical
stability of the resulting methods, but we postpone such considerations to the next
chapter.
In Chapter 2, we introduced the convention that the n subscript, or the (n) superscript, always points to a discrete time value, and h represents the time interval
t. Combining this notation with Eq. 6.3 gives
u0n = Fn = F (un; tn) ; tn = nh
Often we need a more sophisticated notation for intermediate time steps involving
temporary calculations denoted by u~, u, etc. For these we use the notation
u~0n+ = F~n+ = F (~un+; tn + h)
The choice of u0 or F to express the derivative in a scheme is arbitrary. They are
both commonly used in the literature on ODE's.
The methods we study are to be applied to linear or nonlinear ODE's, but the
methods themselves are formed by linear combinations of the dependent variable and
its derivative at various time intervals. They are represented conceptually by
(6.4)
un+1 = f 1 u0n+1; 0u0n; ;1u0n;1; ; 0un; ;1un;1;
87
With an appropriate choice of the 0s and 0s, these methods can be constructed
to give a local Taylor series accuracy of any order. The methods are said to be
explicit if 1 = 0 and implicit otherwise. An explicit method is one in which the new
predicted solution is only a function of known data, for example, u0n, u0n;1, un; and
un;1 for a method using two previous time levels, and therefore the time advance is
simple. For an implicit method, the new predicted solution is also a function of the
time derivative at the new time level, that is, u0n+1. As we shall see, for systems of
ODE's and nonlinear problems, implicit methods require more complicated strategies
to solve for un+1 than explicit methods.
un+1 = un + hu0n
(6.5)
un+1 = un + hu0n+1
(6.6)
and
u~n+1 = un + hu0n
un+1 = 21 [un + u~n+1 + hu~0n+1]
(6.7)
According to the conditions presented under Eq. 6.4, the rst and third of these are
examples of explicit methods. We refer to them as the explicit Euler method and the
MacCormack predictor-corrector method,1 respectively. The second is implicit and
referred to as the implicit (or backward) Euler method.
These methods are simple recipes for the time advance of a function in terms of its
value and the value of its derivative, at given time intervals. The material presented
in Chapter 4 develops a basis for evaluating such methods by introducing the concept
of the representative equation
du = u0 = u + aet
(6.8)
dt
written here in terms of the dependent variable, u. The value of this equation arises
from the fact that, by applying a time-marching method, we can analytically convert
1 Here we give only MacCormack's time-marching method. The method commonly referred to as
88
such a linear ODE into a linear OE . The latter are subject to a whole body of
analysis that is similar in many respects to, and just as powerful as, the theory of
ODE's. We next consider examples of this conversion process and then go into the
general theory on solving OE's.
Apply the simple explicit Euler scheme, Eq. 6.5, to Eq. 6.8. There results
un+1 = un + h(un + aehn)
or
un+1 ; (1 + h)un = haehn
(6.9)
Eq. 6.9 is a linear OE , with constant coecients, expressed in terms of the dependent variable un and the independent variable n. As another example, applying the
implicit Euler method, Eq. 6.6, to Eq. 6.8, we nd
un+1 = un + h un+1 + aeh(n+1)
or
(1 ; h)un+1 ; un = heh aehn
(6.10)
As a nal example, the predictor-corrector sequence, Eq. 6.7, gives
u~n+1 ; (1 + h)un = ahehn
(6.11)
; 21 (1 + h)~un+1 + un+1 ; 12 un = 12 aheh(n+1)
which is a coupled set of linear OE's with constant coecients. Note that the rst
line in Eq. 6.11 is identical to Eq. 6.9, since the predictor step in Eq. 6.7 is simply
the explicit Euler method. The second line in Eq. 6.11 is obtained by noting that
u~0n+1 = F (~un+1; tn + h)
= u~n+1 + aeh(n+1)
(6.12)
Now we need to develop techniques for analyzing these dierence equations so that
we can compare the merits of the time-marching methods that generated them.
89
The simplest nonhomogeneous OE of interest is given by the single rst-order equation
(6.13)
Just as in the development of Eq. 4.10, one can readily show that the solution of the
defective case, (b = ),
un+1 = un + an
is
h
i
un = u0 + an;1 n
This can all be easily veried by substitution.
Second-Order Equations
The homogeneous form of a second-order dierence equation is given by
(6.14)
Instead of the dierential operator D dtd used for ODE's, we use for OE's the
dierence operator E (commonly referred to as the displacement or shift operator)
and dened formally by the relations
b bn = bn+ = E bn
90
(6.15)
which must be zero for all un. Eq. 6.15 is known as the operational form of Eq. 6.14.
The operational form contains a characteristic polynomial P (E ) which plays the same
role for dierence equations that P (D) played for dierential equations; that is, its
roots determine the solution to the OE. In the analysis of OE's, we label these
roots 1 , 2 , , etc, and refer to them as the -roots. They are found by solving the
equation P () = 0. In the simple example given above, there are just two roots
and in terms of them the solution can be written
un = c1(1 )n + c2(2 )n
(6.16)
where c1 and c2 depend upon the initial conditions. The fact that Eq. 6.16 is a
solution to Eq. 6.14 for all c1 ; c2 and n should be veried by substitution.
(6.17)
~un+1 = C~un ; ~un = hu(1n); u(2n)iT ; C = c11 c12
c21 c22
(c ; E )
c12 u1 (n) = [ C ; E I ]~u = 0
11
n
c21
(c22 ; E ) u2
which must be zero for all u1 and u2. Again we are led to a characteristic polynomial,
this time having the form P (E ) = det [ C ; E I ]. The -roots are found from
(c ; )
c
11
12
P () = det
c21
(c22 ; ) = 0
91
Obviously the k are the eigenvalues of C and, following the logic of Section 4.2,
~
if x are its eigenvectors, the solution of Eq. 6.17 is
2
~un = X ck (k )n~xk
k=1
A Defective System
The solution of OE's with defective eigensystems follows closely the logic in Section
4.2.2 for defective ODE's. For example, one can show that the solution to
2
3 2
32 3
u
n+1
64 u^n+1 75 = 64 1 75 64 uu^nn 75
un+1
1 un
is
un = uh0n
i
u^n = u^0 + u0n;1 n
"
#
n
(
n
;
1)
;
1
;
2
un = u0 + u^0n + u0 2 n
(6.18)
"
[E ; (1 + h)]un = h aehn
(6.19)
(6.20)
1
1 E aehn
2
(6.21)
92
All three of these equations are subsets of the operational form of the representative
OE
P (E )un = Q(E ) aehn
(6.22)
which is produced by applying time-marching methods to the representative ODE, Eq.
4.45. We can express in terms of Eq. 6.22 all manner of standard time-marching methods having multiple time steps and various types of intermediate predictor-corrector
families. The terms P (E ) and Q(E ) are polynomials in E referred to as the characteristic polynomial and the particular polynomial, respectively.
The general solution of Eq. 6.22 can be expressed as
K
h
X
un = ck (k )n + aehn Q(eh)
(6.23)
P (e )
k=1
where k are the K roots of the characteristic polynomial, P () = 0. When determinants are involved in the construction of P (E ) and Q(E ), as would be the case for
Eq. 6.21, the ratio Q(E )=P (E ) can be found by Kramer's rule. Keep in mind that
for methods such as in Eq. 6.21 there are multiple (two in this case) solutions, one
for un and u~n and we are usually only interested in the nal solution un. Notice also,
the important subset of this solution which occurs when = 0, representing a time
invariant particular solution, or a steady state. In such a case
K
X
(1)
un = ck (k )n + a PQ(1)
k=1
As examples of the use of Eqs. 6.22 and 6.23, we derive the solutions of Eqs. 6.19 to
6.21. For the explicit Euler method, Eq. 6.19, we have
P (E ) = E ; 1 ; h
Q(E ) = h
(6.24)
and the solution of its representative OE follows immediately from Eq. 6.23:
eh ; 1 ; h
(6.25)
93
1 n
heh
un = c1 1 ; h + aehn
(1 ; h)eh ; 1
In the case of the coupled predictor-corrector equations, Eq. 6.21, one solves for the
nal family un (one can also nd a solution for the intermediate family u~), and there
results
#
"
E
;
(1
+
h
)
P (E ) = det ; 1 (1 + h)E E ; 1 = E E ; 1 ; h ; 12 2h2
2
2
1
E
h
Q(E ) = det ; 1 (1 + h)E 1 hE = 2 hE (E + 1 + h)
2
2
The -root is found from
1
2
2
P () = ; 1 ; h ; 2 h = 0
which has only one nontrivial root ( = 0 is simply a shift in the reference index).
The complete solution can therefore be written
1 heh + 1 + h
n
un = c1 1 + h + 21 2h2 + aehn 2
(6.26)
eh ; 1 ; h ; 12 2h2
We have now been introduced to two basic kinds of roots, the -roots and the -roots.
The former are the eigenvalues of the A matrix in the ODE's found by space dierencing the original PDE, and the latter are the roots of the characteristic polynomial
in a representative OE found by applying a time-marching method to the representative ODE. There is a fundamental relation between the two which can be used
to identify many of the essential properties of a time-march method. This relation is
rst demonstrated by developing it for the explicit Euler method.
First we make use of the semi-discrete approach to nd a system of ODE's and
then express its solution in the form of Eq. 4.27. Remembering that t = nh, one can
write
n
n
n
u(t) = c1 e1 h ~x1 + + cm em h ~xm + + cM eM h ~xM + P:S: (6.27)
94
where for the present we are not interested in the form of the particular solution
(P:S:). Now the explicit Euler method produces for each -root, one -root, which
is given by = 1 + h. So if we use the Euler method for the time advance of the
ODE's, the solution2 of the resulting OE is
(6.28)
where the cm and the ~xm in the two equations are identical and m = (1 + m h).
Comparing Eq. 6.27 and Eq. 6.28, we see a correspondence between m and em h.
Since the value of eh can be expressed in terms of the series
(6.29)
(6.30)
Now we notice that each produces two -roots. For one of these we nd
q
m = mh + 1 + 2mh2
= 1 + mh + 21 2m h2 ; 18 4mh4 +
(6.31)
(6.32)
h
3 3
This
q is 2an2 approximation to e m with an error O( h ). The other root, mh ;
1 + mh , will be discussed in Section 6.5.3.
2 Based on Section 4.4.
3 The error is O(2 h2 ).
95
We refer to the root that has the above property as the principal -root, and designate
it (m )1 . The above property can be stated regardless of
kthe
details of the time+1
marching method, knowing only that its leading
error is O h . Thus the principal
root is an approximation to eh up to O hk .
Note that a second-order approximation to a derivative written in the form
(t u)n = 1 (un+1 ; un;1)
(6.34)
2h
has a leading truncation error which is O(h2), while the second-order time-marching
method which results from this approximation, which is the leapfrog method:
(6.35)
has a leading truncation error O(h3). This arises simply because of our notation
for the time-marching method in which we have multiplied through by h to get an
approximation for the function un+1 rather than the derivative as in Eq. 6.34. The
following example makes this clear. Consider a solution obtained at a given time T
using a second-order time-marching method with a time step h. Now consider the
solution obtained using the same method with a time step h=2. Since the error per
time step is O(h3), this is reduced by a factor of eight (considering the leading term
only). However, twice as many time steps are required to reach the time T . Therefore
the error at the end of the simulation is reduced by a factor of four, consistent with
a second-order approximation.
We saw from Eq. 6.30 that the ; relation for the leapfrog method produces two
-roots for each . One of these we identied as the principal root which always
96
has the property given in 6.33. The other is referred to as a spurious -root and
designated (m )2 . In general, the ; relation produced by a time-marching scheme
can result in multiple -roots all of which, except for the principal one, are spurious.
All spurious roots are designated (m )k where k = 2; 3; . No matter whether a
-root is principal or spurious, it is always some algebraic function of the product h.
To express this fact we use the notation = (h).
If a time-marching method produces spurious -roots, the solution for the OE in
the form shown in Eq. 6.28 must be modied. Following again the message of Section
4.4, we have
un = c11 (1 )n1 ~x1 + + cm1(m )n1 ~xm + + cM 1 (M )n1 ~xM + P:S:
+c12 (1)n2 ~x1 + + cm2 (m )n2 ~xm + + cM 2 (M )n2 ~xM
+c13 (1)n3 ~x1 + + cm3 (m )n3 ~xm + + cM 3 (M )n3 ~xM
+etc., if there are more spurious roots
(6.36)
Spurious roots arise if a method uses data from time level n ; 1 or earlier to
advance the solution from time level n to n + 1. Such roots originate entirely from
the numerical approximation of the time-marching method and have nothing to do
with the ODE being solved. However, generation of spurious roots does not, in itself,
make a method inferior. In fact, many very accurate methods in practical use for
integrating some forms of ODE's have spurious roots.
It should be mentioned that methods with spurious roots are not self starting.
For example, if there is one spurious root to a method, all of the coecients (cm )2
in Eq. 6.36 must be initialized by some starting procedure. The initial vector ~u0
does not provide enough data to initialize all of the coecients. This results because
methods which produce spurious roots require data from time level n ; 1 or earlier.
For example, the leapfrog method requires ~un;1 and thus cannot be started using
only ~un.
Presumably (i.e., if one starts the method properly) the spurious coecients are
all initialized with very small magnitudes, and presumably the magnitudes of the
spurious roots themselves are all less than one (see Chapter 7). Then the presence of
spurious roots does not contaminate the answer. That is, after some nite time the
amplitude of the error associated with the spurious roots is even smaller then when
it was initialized. Thus while spurious roots must be considered in stability analysis,
they play virtually no role in accuracy analysis.
There are a number of time-marching methods that produce only one -root for each
-root. We refer to them as one-root methods. They are also called one-step methods.
97
They have the signicant advantage of being self-starting which carries with it the
very useful property that the time-step interval can be changed at will throughout
the marching process. Three one-root methods were analyzed in Section 6.4.2. A
popular method having this property, the so-called -method, is given by the formula
h
i
un+1 = un + h (1 ; )u0n + u0n+1
The -method represents the explicit Euler ( = 0), the trapezoidal ( = 21 ), and the
implicit Euler methods ( = 1), respectively. Its ; relation is
)h
= 1 +1(1; ;h
It is instructive to compare the exact solution to a set of ODE's (with a complete
eigensystem) having time-invariant forcing terms with the exact solution to the OE's
for one-root methods. These are
~u(t) = c1e1 hn ~x1 + + cm em hn ~xm + + cM eM hn ~xM + A;1~f
~un = c1(1 )n ~x1 + + cm(m )n ~xm + + cM (M )n ~xM + A;1~f
(6.37)
respectively. Notice that when t and n = 0, these equations are identical, so that all
the constants, vectors, and matrices are identical except the ~u and the terms inside
the parentheses on the right hand sides. The only error made by introducing the time
marching is the error that makes in approximating eh.
There are two broad categories of errors that can be used to derive and evaluate timemarching methods. One is the error made in each time step. This is a local error such
as that found from a Taylor table analysis, see Section 3.4. It is usually used as the
basis for establishing the order of a method. The other is the error determined at the
end of a given event which has covered a specic interval of time composed of many
time steps. This is a global error. It is useful for comparing methods, as we shall see
in Chapter 8.
It is quite common to judge a time-marching method on the basis of results found
from a Taylor table. However, a Taylor series analysis is a very limited tool for nding
the more subtle properties of a numerical time-marching method. For example, it is
of no use in:
98
(6.38)
and the solution to the representative OE's, including only the contribution from
the principal root, which can be written as
h
(6.39)
Transient error
; er! )
The particular choice of an error measure, either local or global, is to some extent
arbitrary. However, a necessary condition for the choice should be that the measure
can be used consistently for all methods. In the discussion of the - relation we
saw that all time-marching methods produce a principal -root for every -root that
exists in a set of linear ODE's. Therefore, a very natural local error measure for the
transient solution is the value of the dierence between solutions based on these two
roots. We designate this by er and make the following denition
er eh ; 1
The leading error term can be found by expanding in a Taylor series and choosing
the rst nonvanishing term. This is similar to the error found from a Taylor table.
The order of the method is the last power of h matched exactly.
99
Suppose a eigenvalue is imaginary. Such can indeed be the case when we study the
equations governing periodic convection which produces harmonic motion. For such
cases it is more meaningful to express the error in terms of amplitude and phase.
Let = i! where ! is a real number representing a frequency. Then the numerical
method must produce a principal -root that is complex and expressible in the form
1 = r + ii ei!h
(6.40)
From this it follows that the local error in amplitude is measured by the deviation of
j1 j from unity, that is
q
era = 1 ; j1 j = 1 ; (1)2r + (1 )2i
(6.41)
Amplitude and phase errors are important measures of the suitability of time-marching
methods for convection and wave propagation phenomena.
The approach to error analysis described in Section 3.5 can be extended to the
combination of a spatial discretization and a time-marching method applied to the
linear convection equation. The principal root, 1(h), is found using = ;ia ,
where is the modied wavenumber of the spatial discretization. Introducing the
Courant number, Cn = ah=x, we have h = ;iCn x. Thus one can obtain
values of the principal root over the range 0 x for a given value of the
Courant number. The above expression for er! can be normalized to give the error
in the phase speed, as follows
;1
!
= 1 + tan [(1)i =(1)r )]
(6.42)
erp = er
!h
Cnx
where ! = ;a. A positive value of erp corresponds to phase lag (the numerical phase
speed is too small), while a negative value corresponds to phase lead (the numerical
phase speed is too large).
The numerical error in the particular solution is found by comparing the particular
solution of the ODE with that for the OE. We have found these to be given by
P:S:(ODE) = aet ( ;1 )
100
and
respectively. For a measure of the local error in the particular solution we introduce
the denition
P:S:(OE) ; 1
er h P:S:
(ODE )
(6.43)
The multiplication by h converts the error from a global measure to a local one, so
that the order of er and er are consistent. In order to determine the leading error
term, Eq. 6.43 can be written in terms of the characteristic and particular polynomials
as
n
o
er = c;o ( ; )Q eh ; P eh
where
(6.44)
h( ; )
co = hlim
!0 P eh
er = c1 (h)k1+1
er = c2 (h)k2+1
where k = smallest of(k1; k2)
(6.45)
(6.46)
(6.47)
101
The reader should be aware that this is not sucient. For example, to derive all of
the necessary conditions for the fourth-order Runge-Kutta method presented later
in this chapter the derivation must be performed for a nonlinear ODE. However, the
analysis based on a linear nonhomogeneous ODE produces the appropriate conditions
for the majority of time-marching methods used in CFD.
T = Nh
(6.48)
Era = 1 ;
and
q
"
N
(6.49)
!#
(6.50)
102
Q eh
Er ( ; ) h ; 1
P e
du = u0 = F(u; t)
dt
k un+k = h
1
X
k=1;K
k Fn+k
(6.51)
where the notation for F is dened in Section 6.1. The methods are said to be linear
because the 's and 's are independent of u and n, and they are said to be K -step
because K time-levels of data are required to marching the solution one time-step, h.
They are explicit if 1 = 0 and implicit otherwise.
When Eq. 6.51 is applied to the representative equation, Eq. 6.8, and the result is
expressed in operational form, one nds
0 1
1
0 1
1
X
X
@
k E k Aun = h@
k E k A(un + aehn )
k=1;K
k=1;K
(6.52)
103
We recall from Section 6.5.2 that a time-marching method when applied to the representative equation must provide a -root, labeled 1, that approximates eh through
the order of the method. The condition referred to as consistency simply means that
! 1 as h ! 0, and it is certainly a necessary condition for the accuracy of any
time marching method. We can also agree that, to be of any value in time accuracy,
a method should at least be rst-order accurate, that is ! (1 + h) as h ! 0. One
can show that these conditions are met by any method represented by Eq. 6.51 if
X
X
X
k = 0 and
k = (K + k ; 1)k
k
Since both sides of Eq. 6.51 can be multiplied by an arbitrary constant, these methods
are often \normalized" by requiring
X
k = 1
k
6.7.2 Examples
There are many special explicit and implicit forms of linear multistep methods. Two
well-known families of them, referred to as Adams-Bashforth (explicit) and AdamsMoulton (implicit), can be designed using the Taylor table approach of Section 3.4.
The Adams-Moulton family is obtained from Eq. 6.51 with
1 = 1; 0 = ;1; k = 0; k = ;1; ;2;
(6.53)
The Adams-Bashforth family has the same 's with the additional constraint that
1 = 0. The three-step Adams-Moulton method can be written in the following form
un+1 = un + h(1u0n+1 + 0 u0n + ;1 u0n;1 + ;2u0n;2)
(6.54)
A Taylor table for Eq. 6.54 can be generated as
un
h u0n
h2 u00n
h3 u000n
h4 u0000
n
1
1
1
un+1
1
1
2
6
24
;un
;1
;h1 u0n+1
;1
;1
;1 21
;1 16
;h0 u0n
; 0
0
;1 61
;h;1 un;1
;;1
;1
;;1 21
;h;2 u0n;2
;(;2)0 ;2 ;(;2)1 ;2 ;(;2)2 ;2 21 ;(;2)3 ;2 16
Table 6.1. Taylor table for the Adams-Moulton three-step linear multistep method.
104
Explicit Methods
un+1
un+1
un+1
un+1
= un + hu0n
Euler
0
= un;1 + 2hhun
Leapfrog
i
1
0
0
= un + 2 h 3un ; un;1
AB2
h
i
h 23u0n ; 16u0n;1 + 5u0n;2
= un + 12
AB3
Implicit Methods
un+1
un+1
un+1
un+1
= un + hu0nh+1
Implicit Euler
i
1
= unh + 2 h u0n + u0n+1 i
Trapezoidal (AM2)
1
0
= 3 4un ; un;1 + 2hun+1
h 0
i 2nd-order Backward
h
0
0
= un + 12 5un+1 + 8un ; un;1
AM3
4 Recall from Section 6.5.2 that a kth-order time-marching method has a leading truncation error
term which is O(hk+1 ).
105
High resolution CFD problems usually require very large data sets to store the spatial
information from which the time derivative is calculated. This limits the interest
in multistep methods to about two time levels. The most general two-step linear
multistep method (i.e., K=2 in Eq. 6.51), that is at least rst-order accurate, can be
written as
h
i
(1 + )un+1 = [(1 + 2 )un ; un;1] + h u0n+1 + (1 ; + ')u0n ; 'u0n;1 (6.59)
Clearly the methods are explicit if = 0 and implicit otherwise. A list of methods
contained in Eq. 6.59 is given in Table 6.2. Notice that the Adams methods have
= 0, which corresponds to ;1 = 0 in Eq. 6.51. Methods with = ;1=2, which
corresponds to 0 = 0 in Eq. 6.51, are known as Milne methods.
'
0
1
0
0
0
1=2
0
;1=2
;1=2
;1=6
;1=2
0
;5=6
;1=6
0
;1=2
0
0
0
0
;1=4
;1=3
;1=2
;2=9
0
1=2
;1=3
0
1=12
;1=6
1=2
1
3=4
1=3
1=2
5=9
0
0
0
1=3
5=12
1=6
Method
Euler
Implicit Euler
Trapezoidal or AM2
2nd Order Backward
Adams type
Lees Type
Two{step trapezoidal
A{contractive
Leapfrog
AB2
Most accurate explicit
Third{order implicit
AM3
Milne
Order
1
1
2
2
2
2
2
2
2
2
3
3
3
4
Table 6.2. Some linear one- and two-step methods, see Eq. 6.59.
One can show after a little algebra that both er and er are reduced to 0(h3)
(i.e., the methods are 2nd-order accurate) if
' = ; + 21
The class of all 3rd-order methods is determined by imposing the additional constraint
= 2 ; 56
Finally a unique fourth-order method is found by setting = ;' = ;=3 = 61 .
106
There are a wide variety of predictor-corrector schemes created and used for a variety
of purposes. Their use in solving ODE's is relatively easy to illustrate and understand.
Their use in solving PDE's can be much more subtle and demands concepts5 which
have no counterpart in the analysis of ODE's.
Predictor-corrector methods constructed to time-march linear or nonlinear ODE's
are composed of sequences of linear multistep methods, each of which is referred to
as a family in the solution process. There may be many families in the sequence, and
usually the nal family has a higher Taylor-series order of accuracy than the intermediate ones. Their use is motivated by ease of application and increased eciency,
where measures of eciency are discussed in the next two chapters.
A simple one-predictor, one-corrector example is given by
0
u~n+ = un + hu
h n0
i
un+1 = un + h u~n+ +
u0n
(6.60)
where the parameters ; and
are arbitrary parameters to be determined. One
can analyze this sequence by applying it to the representative equation and using
the operational techniques outlined in Section 6.4. It is easy to show, following the
example leading to Eq. 6.26, that
h
i
P (E ) = E E ; 1 ; (
+ )h ; 2h2
Q(E ) = E h [E +
+ h]
(6.61)
(6.62)
Considering only local accuracy, one is led, by following the discussion in Section 6.6,
to the following observations. For the method to be second-order accurate both er
and er must be O(h3). For this to hold for er, it is obvious from Eq. 6.61 that
+ = 1 ; = 21
which provides two equations for three unknowns. The situation for er requires some
algebra, but it is not dicult to show using Eq. 6.44 that the same conditions also
make it O(h3). One concludes, therefore, that the predictor-corrector sequence
u~n+ = un + hu0n
2 ; 1
1
1
0
un+1 = un + 2 h u~n+ + u0n
(6.63)
107
(6.66)
(6.67)
(6.68)
6 Although implicit and multi-step Runge-Kutta methods exist, we will consider only single-step,
108
to the Taylor series expansion of eh out through the order of the method and then
truncates. Thus for a Runge-Kutta method of order k (up to 4th order), the principal
(and only) -root is given by
(6.69)
= 1 + h + 21 2h2 + + k1! k hk
It is not particularly dicult to build this property into a method, but, as we pointed
out in Section 6.6.4, it is not sucient to guarantee k'th order accuracy for the solution
of u0 = F (u; t) or for the representative equation. To ensure k'th order accuracy, the
method must further satisfy the constraint that
er = O(hk+1)
(6.70)
and this is much more dicult.
The most widely publicized Runge-Kutta process is the one that leads to the
fourth-order method. We present it below in some detail. It is usually introduced in
the form
k1 = hF (un; tn)
k2 = hF (un + k1; tn + h)
k3 = hF (un + 1k1 +
1k2; tn + 1 h)
k4 = hF (un + 2k1 +
2k2 + 2 k3; tn + 2h)
followed by
u(tn + h) ; u(tn) = 1 k1 + 2k2 + 3k3 + 4k4
(6.71)
However, we prefer to present it using predictor-corrector notation. Thus, a scheme
entirely equivalent to 6.71 is
ubn+ = un + hu0n
u~n+1 = un + 1 hu0n +
1hub0n+
un+2 = un + 2 hu0n +
2hub0n+ + 2hu~0n+1
(6.72)
un+1 = un + 1hu0n + 2hub0n+ + 3hu~0n+1 + 4hu0n+2
Appearing in Eqs. 6.71 and 6.72 are a total of 13 parameters which are to be
determined such that the method is fourth-order according to the requirements in
Eqs. 6.69 and 6.70. First of all, the choices for the time samplings, , 1, and 2 , are
not arbitrary. They must satisfy the relations
=
1 = 1 +
1
2 = 2 +
2 + 2
(6.73)
109
The algebra involved in nding algebraic equations for the remaining 10 parameters
is not trivial, but the equations follow directly from nding P (E ) and Q(E ) and then
satisfying the conditions in Eqs. 6.69 and 6.70. Using Eq. 6.73 to eliminate the 's
we nd from Eq. 6.69 the four conditions
1 + 2 + 3 + 4
2 + 31 + 42
3
1 + 4(
2 + 12 )
4
12
= 1
= 1=2
= 1=6
= 1=24
(1)
(2)
(3)
(4)
(6.74)
These four relations guarantee that the ve terms in exactly match the rst 5 terms
in the expansion of eh . To satisfy the condition that er = O(k5), we have to fulll
four more conditions
22 + 3 12 + 422
= 1=3
(3)
23 + 3 13 + 423
= 1=4
(4)
(6.75)
2
2
2
3
1 + 4(
2 + 1 2) = 1=12
(4)
31
1 + 42(
2 + 1 2 ) = 1=8
(4)
The number in parentheses at the end of each equation indicates the order that
is the basis for the equation. Thus if the rst 3 equations in 6.74 and the rst
equation in 6.75 are all satised, the resulting method would be third-order accurate.
As discussed in Section 6.6.4, the fourth condition in Eq. 6.75 cannot be derived
using the methodology presented here, which is based on a linear nonhomogenous
representative ODE. A more general derivation based on a nonlinear ODE can be
found in several books.7
There are eight equations in 6.74 and 6.75 which must be satised by the 10
unknowns. Since the equations are overdetermined, two parameters can be set arbitrarily. Several choices for the parameters have been proposed, but the most popular
one is due to Runge. It results in the \standard" fourth-order Runge-Kutta method
expressed in predictor-corrector form as
ubn+1=2 = un + 21 hu0n
u~n+1=2 = un + 12 hub0n+1=2
un+1 = un + hu~0n+1=2
h
i
un+1 = un + 16 h u0n + 2 ub0n+1=2 + u~0n+1=2 + u0n+1
(6.76)
7 The present approach based on a linear inhomogeneous equation provides all of the necessary
110
Notice that this represents the simple sequence of conventional linear multistep methods referred to, respectively, as
Euler Predictor
Euler Corrector
Leapfrog Predictor
Milne Corrector
9
>
>
=
RK 4
>
>
;
One can easily show that both the Burstein and the MacCormack methods given by
Eqs. 6.66 and 6.67 are second-order Runge-Kutta methods, and third-order methods
can be derived from Eqs. 6.72 by setting 4 = 0 and satisfying only Eqs. 6.74 and the
rst equation in 6.75. It is clear that for orders one through four, RK methods of order
k require k evaluations of the derivative function to advance the solution one time
step. We shall discuss the consequences of this in Chapter 8. Higher-order RungeKutta methods can be developed, but they require more derivative evaluations than
their order. For example, a fth-order method requires six evaluations to advance
the solution one step. In any event, storage requirements reduce the usefulness of
Runge-Kutta methods of order higher than four for CFD applications.
u0 = u + aet
(6.77)
using the implicit Euler method. Following the steps outlined in Section 6.2, we
obtained
(1 ; h)un+1 ; un = heh aehn
(6.78)
111
(6.79)
(6.80)
This calculation does not seem particularly onerous in comparison with the application of an explicit method to this ODE, requiring only an additional division.
Now let us apply the implicit Euler method to our generic system of equations
given by
where ~u and f~ are vectors and we still assume that A is not a function of ~u or t. Now
the equivalent to Eq. 6.78 is
(I ; hA)~un+1 ; ~un = ;hf~(t + h)
(6.81)
(6.82)
or
The inverse is not actually performed, but rather we solve Eq. 6.81 as a linear system
of equations. For our one-dimensional examples, the system of equations which must
be solved is tridiagonal (e.g., for biconvection, A = ;aBp (;1; 0; 1)=2x), and hence
its solution is inexpensive, but in multidimensions the bandwidth can be very large. In
general, the cost per time step of an implicit method is larger than that of an explicit
method. The primary area of application of implicit methods is in the solution of
sti ODE's, as we shall see in Chapter 8.
du = F (u; t)
dt
(6.83)
(6.84)
112
Let us start the process of local linearization by considering Eq. 6.83. In order to
implement the linearization, we expand F (u; t) about some reference point in time.
Designate the reference value by tn and the corresponding value of the dependent
variable by un. A Taylor series expansion about these reference quantities gives
!
!
@F
@F
F (u; t) = F (un; tn) + @u (u ; un) + @t (t ; tn)
n
n
2F !
2F !
1
@
@
+ 2 @u2 (u ; un)2 + @u@t (u ; un)(t ; tn)
n
!n
2
+ 21 @@tF2 (t ; tn)2 +
n
(6.87)
On the other hand, the expansion of u(t) in terms of the independent variable t is
!
2u !
@u
1
@
2
u(t) = un + (t ; tn) @t + 2 (t ; tn) @t2 +
n
n
(6.88)
If t is within h of tn , both (t ; tn)k and (u ; un)k are O(hk ), and Eq. 6.87 can be
written
!
!
@F
@F
F (u; t) = Fn + @u (u ; un) + @t (t ; tn) + O(h2)
n
n
(6.89)
113
Notice that this is an expansion of the derivative of the function. Thus, relative to the
order of expansion of the function, it represents a second-order-accurate, locally-linear
approximation to F (u; t) that is valid in the vicinity of the reference station tn and
the corresponding un = u(tn). With this we obtain the locally (in the neighborhood
of tn) time-linear representation of Eq. 6.83, namely
!
! !
!
du = @F u + F ; @F u + @F (t ; t ) + O(h2)
n
n
dt
@u n
@u n n
@t n
(6.90)
(6.91)
where we write hO(h2) to emphasize that the method is second order accurate. Using
Eq. 6.89 to evaluate Fn+1 = F (un+1; tn+1), one nds
"
@F + O(h2) + F
un+1 = un + 12 h Fn + @F
(
u
n+1 ; un ) + h
n
@u n
@t n
+hO(h2)
(6.92)
Note that the O(h2) term within the brackets (which is due to the local linearization)
is multiplied by h and therefore is the same order as the hO(h2) error from the
Trapezoidal Method. The use of local time linearization updated at the end of each
time step, and the trapezoidal time march, combine to make a second-order-accurate
numerical integration process. There are, of course, other second-order implicit timemarching methods that can be used. The important point to be made here is that
local linearization updated at each time step has not reduced the order of accuracy of
a second-order time-marching process.
A very useful reordering of the terms in Eq. 6.92 results in the expression
"
!#
1 2 @F
u
(6.93)
1 ; 21 h @F
n = hFn + h
@u n
2 @t n
which is now in the delta form which will be formally introduced in Section 12.6. In
many
uid mechanic applications the nonlinear function F is not an explicit function
114
of t. In such cases the partial derivative of F (u) with respect to t is zero and Eq. 6.93
simplies to the second-order accurate expression
"
1 ; 21 h @F
@u
!#
n
un = hFn
(6.94)
Notice that the RHS is extremely simple. It is the product of h and the RHS of
the basic equation evaluated at the previous time step. In this example, the basic
equation was the simple scalar equation 6.83, but for our applications, it is generally
the space-dierenced form of the steady-state equation of some
uid
ow problem.
A numerical time-marching procedure using Eq. 6.94 is usually implemented as
follows:
1. Solve for the elements of hF~n, store them in an array say R~ , and save ~un.
2. Solve for the elements of the matrix multiplying ~un and store in some appropriate manner making use of sparseness or bandedness of the matrix if possible.
Let this storage area be referred to as B .
3. Solve the coupled set of linear equations
B ~un = R~
for ~un. (Very seldom does one nd B ;1 in carrying out this step).
4. Find ~un+1 by adding ~un to ~un, thus
~un+1 = ~un + ~un
The solution for ~un+1 is generally stored such that it overwrites the value of ~un
and the process is repeated.
un+1 = un + hFn+1
(6.95)
if we introduce Eq. 6.90 into this method, rearrange terms, and remove the explicit
dependence on time, we arrive at the form
"
1 ; h @F
@u
!#
n
un = hFn
(6.96)
115
We see that the only dierence between the implementation of the trapezoidal method
and the implicit Euler method is the factor of 21 in the brackets of the left side of
Eqs. 6.94 and 6.96. Omission of this factor degrades the method in time accuracy by
one order of h. We shall see later that this method is an excellent choice for steady
problems.
Newton's Method
Consider the limit h ! 1 of Eq. 6.96 obtained by dividing both sides by h and
setting 1=h = 0. There results
or
!
@F
; @u un = Fn
n
un+1 = un ;
"
@F
@u
! #;1
n
(6.97)
Fn
(6.98)
This is the well-known Newton method for nding the roots of a nonlinear equation
F (u) = 0. The fact that it has quadratic convergence is veried by a glance at Eqs.
6.87 and 6.88 (remember the dependence on t has been eliminated for this case). By
quadratic convergence, we mean that the error after a given iteration is proportional
to the square of the error at the previous iteration, where the error is the dierence
between the current solution and the converged solution. Quadratic convergence is
thus a very powerful property. Use of a nite value of h in Eq. 6.96 leads to linear
convergence, i.e., the error at a given iteration is some multiple of the error at the
previous iteration. The reader should ponder the meaning of letting h ! 1 for the
trapezoidal method, given by Eq. 6.94.
!21
df A = 0
(6.99)
dt
Here f represents a dimensionless stream function, and is a scaling factor.
d3f + f d2f + @1 ;
dt3
dt2
116
First of all we reduce Eq. 6.99 to a set of rst-order nonlinear equations by the
transformations
2
u1 = ddtf2 ; u2 = df
dt ; u3 = f
(6.100)
(6.101)
d~u = F~ (~u)
dt
(6.102)
(6.103)
Now we seek to make the same local expansion that derived Eq. 6.90, except that
this time we are faced with a nonlinear vector function, rather than a simple nonlinear
scalar function. The required extension requires the evaluation of a matrix, called
the Jacobian matrix.8 Let us refer to this matrix as A. It is derived from Eq. 6.102
by the following process
For the general case involving a third order matrix this is
2
66
66
A = 666
66
4
@F1
@u1
@F2
@u1
@F3
@u1
@F1
@u2
@F2
@u2
@F3
@u2
@F1
@u3
@F2
@u3
@F3
@u3
3
77
77
77
77
75
(6.104)
The expansion of F~ (~u) about some reference state ~un can be expressed in a way
similar to the scalar expansion given by eq 6.87. Omitting the explicit dependency
on the independent variable t, and dening F~ n as F~ (~un), one has 9
2.2
8 Recall that we derived the Jacobian matrices for the two-dimensional Euler equations in Section
9 The Taylor series expansion of a vector contains a vector for the rst term, a matrix times a
vector for the second term, and tensor products for the terms of higher order.
6.11. PROBLEMS
117
F~ (~u) = F~ n + An ~u ; ~un + O(h2)
(6.105)
where t ; tn and the argument for O(h2) is the same as in the derivation of Eq. 6.88.
Using this we can write the local linearization of Eq. 6.102 as
(6.106)
\constant"
which is a locally-linear, second-order-accurate approximation to a set of coupled
nonlinear ordinary dierential equations that is valid for t tn + h. Any rst- or
second-order time-marching method, explicit or implicit, could be used to integrate
the equations without loss in accuracy with respect to order. The number of times,
and the manner in which, the terms in the Jacobian matrix are updated as the solution
proceeds depends, of course, on the nature of the problem.
Returning to our simple boundary-layer example, which is given by Eq. 6.101, we
nd the Jacobian matrix to be
2
3
;
u
2u2 ;u1
3
0
0 75
A = 64 1
(6.107)
0
1
0
The student should be able to derive results for this example that are equivalent to
those given for the scalar case in Eq. 6.93. Thus for the Falkner-Skan equations the
trapezoidal method results in
2
h (u3)n ;h(u2)n h (u1)n 32 (u ) 3 2 ; (u u ) ; (1 ; u2) 3
1
+
1 3n
2
2
66
776 1 n 7 6
2n7
h
(u1)n
64 ; 2
5
1
0 754 (u2)n 5 = h 4
(
u
)
(
u
)
h
3n
2n
0
;2
1
We nd ~un+1 from ~un + ~un, and the solution is now advanced one step. Re-evaluate
the elements using ~un+1 and continue. Without any iterating within a step advance,
the solution will be second-order-accurate in time.
6.11 Problems
1. Find an expression for the nth term in the Fibonacci series, which is given
by 1; 1; 2; 3; 5; 8; : : : Note that the series can be expressed as the solution to a
dierence equation of the form un+1 = un + un;1. What is u25 ? (Let the rst
term given above be u0.)
118
2. The trapezoidal method un+1 = un + 21 h(u0n+1 + u0n) is used to solve the representative ODE.
(a) What is the resulting OE?
(b) What is its exact solution?
(c) How does the exact steady-state solution of the OE compare with the
exact steady-state solution of the ODE if = 0?
3. The 2nd-order backward method is given by
h
i
un+1 = 31 4un ; un;1 + 2hu0n+1
(a) Write the OE for the representative equation. Identify the polynomials
P (E ) and Q(E ).
(b) Derive the - relation. Solve for the -roots and identify them as principal
or spurious.
(c) Find er and the rst two nonvanishing terms in a Taylor series expansion
of the spurious root.
(d) Perform a -root trace relative to the unit circle for both diusion and
convection.
4. Consider the time-marching scheme given by
un+1 = un;1 + 23h (u0n+1 + u0n + u0n;1)
(a) Write the OE for the representative equation. Identify the polynomials
P (E ) and Q(E ).
(b) Derive the ; relation.
(c) Find er .
5. Find the dierence equation which results from applying the Gazdag predictorcorrector method (Eq. 6.65) to the representative equation. Find the - relation.
6. Consider the following time-marching method:
u~n+1=3 = un + hu0n=3
un+1=2 = un + hu~0n+1=3 =2
un+1 = un + hu0n+1=2
6.11. PROBLEMS
119
Find the dierence equation which results from applying this method to the
representative equation. Find the - relation. Find the solution to the dierence equation, including the homogeneous and particular solutions. Find er
and er . What order is the homogeneous solution? What order is the particular
solution? Find the particular solution if the forcing term is xed.
7. Write a computer program to solve the one-dimensional linear convection equation with periodic boundary conditions and a = 1 on the domain 0 x 1.
Use 2nd-order centered dierences in space and a grid of 50 points. For the
initial condition, use
u(x; 0) = e;0:5[(x;0:5)=]2
with = 0:08. Use the explicit Euler, 2nd-order Adams-Bashforth (AB2), implicit Euler, trapezoidal, and 4th-order Runge-Kutta methods. For the explicit
Euler and AB2 methods, use a Courant number, ah=x, of 0.1; for the other
methods, use a Courant number of unity. Plot the solutions obtained at t = 1
compared to the exact solution (which is identical to the initial condition).
8. Repeat problem 7 using 4th-order (noncompact) dierences in space. Use only
4th-order Runge-Kutta time marching at a Courant number of unity. Show
solutions at t = 1 and t = 10 compared to the exact solution.
9. Using the computer program written for problem 7, compute the solution at
t = 1 using 2nd-order centered dierences in space coupled with the 4th-order
Runge-Kutta method for grids of 100, 200, and 400 nodes. On a log-log scale,
plot the error given by
v
u
M
exact 2
u
X
u
t (uj ;Muj )
j =1
where M is the number of grid nodes and uexact is the exact solution. Find the
global order of accuracy from the plot.
10. Using the computer program written for problem 8, repeat problem 9 using
4th-order (noncompact) dierences in space.
11. Write a computer program to solve the one-dimensional linear convection equation with in
ow-out
ow boundary conditions and a = 1 on the domain 0
x 1. Let u(0; t) = sin !t with ! = 10. Run until a periodic steady state
is reached which is independent of the initial condition and plot your solution
120
compared with the exact solution. Use 2nd-order centered dierences in space
with a 1st-order backward dierence at the out
ow boundary (as in Eq. 3.69)
together with 4th-order Runge-Kutta time marching. Use grids with 100, 200,
and 400 nodes and plot the error vs. the number of grid nodes, as described in
problem 9. Find the global order of accuracy.
12. Repeat problem 11 using 4th-order (noncompact) centered dierences. Use a
third-order forward-biased operator at the in
ow boundary (as in Eq. 3.67). At
the last grid node, derive and use a 3rd-order backward operator (using nodes
j ; 3, j ; 2, j ; 1, and j ) and at the second last node, use a 3rd-order backwardbiased operator (using nodes j ; 2, j ; 1, j , and j +1; see problem 1 in Chapter
3).
13. Using the approach described in Section 6.6.2, nd the phase speed error, erp,
and the amplitude error, era , for the combination of second-order centered differences and 1st, 2nd, 3rd, and 4th-order Runge-Kutta time-marching at a
Courant number of unity. Also plot the phase speed error obtained using exact
integration in time, i.e., that obtained using the spatial discretization alone.
Note that the required -roots for the various Runge-Kutta methods can be
deduced from Eq. 6.69, without actually deriving the methods. Explain your
results.
!"$#&%('*)",+-".0/&.21(3154768/&%(9".:'2.:/<;.26="$.:/&>?!#@6A.2BDC"':E"1#=F"".0G!#86&%('H%(?)I)"$CJ$")"6K1(/&>?
C-%(#L/&.:M!F"'2%(#NC">"$"1BD!"1O9J$.2"PM$1"6A.:)"!#8!)RQS<O/&>?M!%(6A31(4K/A>"3"1"':.2"!%(#UTWVWXZY[6\1(4
.2]/A!#A$68/^.:P_"F".2)`)?;a-%5Bb.:M!6!c*6L/d%(9".:'2.0/<;I.:6e1(4f/&$P)".268M!F"686A!)g.2h/A!#ABD6E1(4Z+?ij!)kCl1.2]/&6^%5")
%5/8/&#&%5M$/&1(#A6!QmS</&>"$6AK/A!#8Bb6W%b68;a68/A!Bn.:6m6A%(.2)o/&1p9le68/&%(9"':K.2%qM!$#8/&%(.2)?1Bq%5.2U.:4rcs4t#A1B
uCl1.:/A.2]/>"z.2\/Q|{}&>">"%5!/v68W)"%(1(#ABq~%(.2.:BDRc-Cl6A11(#8Bb/&%(w]/"1%5")#ABxq.:15/4yA!.:#8/A!6m6868/A1.2"'2F?K/AM!.211U."M$2!6mC?%(/A'6!u cj%z9";aF?6W/ %5/8v/&#&)"%51wM$/&"1$)o(//A)1b/&!>?'2K'l16&%5q/BbA>"@!+?Bij!.:)
/&>?.26 u 1#AsQHTvF"#y9-%(68.2M}M$1"M!$#AD.26 u .0/&>E/&.:Bb<)"$CJ$")"!]/TWVWX}u Y6*%(?)pTW^Xgu Y[6*.2 u >".2Md>^/&>?
M!1a$DM$.2!]/@Bb%5/.2M!$6=%(#A^.:")"!Cl!?)"!]/w1(49l1(/A>I%(")|6A$pa!M$/A.21"QjQE u .:'2'#8$4t$#
/&1^68F"Md>Bb%5/.2M$!6Z%(6,(l(Q>-%(C?/A!#A6~D%(")oE)"$G(!'21(CJ$)U/A>"=#A!C?#A!68!]/d%/&.:G(w4t1#8Bb6
1(4TWVWX}Y6e(!"$#&%5/A!)`4t#A1B/A>"N9-%(68.2MN*VWX}Y6K9;/&>"N68!BD.2)".:6AM$#A$/AN%(C"C?#A1]%(Md>c*%(")h/&>?!
/&>?vTW^X}Y6!"$#&%5/A!)D4t#A1B/A>"m#8!C"#8!68!]/d%5/A.:G(WTWVWX}Y6H9];q%5C"C"'2.:Mz%5/A.21E154/&.:Bb<Bb%(#AMd>?.2"
BD$/&>?1j)"6$Qy{}>"!68K$aF"%5/&.:1"6~%(#AW#8!C"#8!68!]/&$)9];
y b | 8
Q:
O
%(")
- zJ O - W
Q(
#A$6ACl!M,/&.:G(!'0;Q}-1#~%^1",68/A!CBD$/A>"1j)c"/&>"@'%5/8/&$#74t1#ABx.:6~1(9?/d%(.:"!)U9];U%(C"C"'0;a.2"b%^/A.2BD,
Bb%(#AMd>".:"pBD$/A>"1j)/A1p/&>"E(!"$#A.2MET=VWX4t1#AB.2%N4%5.2#A'0;\68/A#&%(.:>]/A4t1# u %(#8)Bq%5""!#$QK-1#
,i?%(BDC"':(c-/&>"@,ijC"':.2M$.:/mXyF"'2$#~BD$/A>"1a)'2!%()"6}/&1q =- cl%(") Q~o$/A>"1a)"6
.2]G(1':Ga.2?Z/ u 1~1#Bb1#8y68/A!C"6Mz%(w%(' u %z;a69J u #A.0/A/A!@.2W/&>"y4t1#8B1(4?XylQ Q}9;v.2]/Qj)"F?M!.2?
" u )?!Cl!")"$]/WG(%5#A.%59"'2$6!Q~m1(/Ae%(':6A1D/&>-%5/m1"'0;UBb,/&>"1a)"6.: u >".:Md>/&>?w/&.:Bbw%(")6AC-%(M$
)".:6AM!#8$/A.2z%/&.21("67%(#8m/A#Az%/&!)N68!C-%5#&%5/A!':;bMz%5N9J u #8.:/8/&!q.2N%(q.2]/&$#ABD!)".2%5/&m6A!BD.0)".268M!#8$/&
4t1#8B68F"Md>P%(6EXysQ Q:QU{}>"q4tF?'2':;])".268M!#A,/&^4t1#ABUcXysQ Q%5")I/&>?N%(6A681jM$.%5/A!)h6L/d%(9?.2'2.0/<;
)",+-".:/A.21?6Z%(")o%(-%('0;j68.26Z%(#8=%(C"C"':.2M!%(9"'2m/&1D%('2'Bb,/&>"1a)"6!Q
(
5
mv*x"r!Z}Pryv*H
p WIWWZD !^WUW
TvF"#e)",+-".0/&.21("6e1(4~68/&%(9".:'2.:/<;%(#8p9-%(68!)P!]/A.2#A$':;1h/&>?N9J$>-%zGj.:1#e1(4Z/A>"N>"1BD1$"!1F?6
C-%(#L/& 6m1(4HXya6$Q Q0e%(?) QaQ{}>"e6L/d%(9?.2'2.0/<;N1(4HXysQ Q0e)"$CJ$")"6W$/A.2#8!':;U1o/&>"w!.2(!"6L;j6r
/&$B 1(4 QD{}>"b6L/d%(9?.2'2.0/<;154}XysQ QNMz%(31(4f/A!%('2681U9lD#A!'2%5/&$)/&1\/&>"D!.:!"6L;a68/&$B1(4
.:/A6KBb%5/.0iJQ~1 u ,G!#$c.:I/&>?.26KM!%(6Ap/A>"p68.:/&F"%5/&.:1I.:6K"1(/eaF?.:/&b6A168.2BDC"'2D6A.:"M!5cy.2h1F?#
%(C"C?'2.2M!%5/&.:1"6Z/&1NC-%5#8/&.2%(')".:J!#8!]/&.2%('$F-%5/&.:1"6 !6ACl!M$.%(':':;U>];aCJ$#A9l1'2.:Me1"$6d,c%p6L/d%(9?.2'2.0/<;
)",+-".:/A.21Mz%()"$CJ$")19J15/&>/&>?e/&.2BDe%5")6AC-%5M!^)".:J!#8!"M$.2"?Q@{}>?.26v.:6v)".268M!F"686A$).:
j$M$/&.:1 Q?Qy-%('0;a6A.26Z1(4/&>?!6A@!.:!?68;a68/A!BD6m>-%56~/A>"=.2BDCJ1#L/d%(]/Z%5)")"!)o%()?G5%(]/&%(W/&>-%/
.:/e.:G(!6D%(P!6L/&.2Bb%5/AN1(4m/A>"8(re%5/ u >".:Md>%6A1('2F?/A.21P%(C?C"#A1]%5Md>"!6D%68/&!%()?;]<6L/d%5/A\.:4m%
68;a6L/&!B.26w68/d%59"'25Q1"68.2)"$#&%5/A.21 u .2':'H9lp.0G$I/&1Bb%5/A#A.2M$!6=/&>-%/e>-%zGN9l1(/A>hM!1BDC"':$/&
%(")^)",4t!M,/&.:G(}!.:!"6L;a68/&$Bb6$cj68!~j$M$/A.21^"QjQ?c u .:/A>^%W#A!BD.2?)"!#/&>-%5/H%vM$1BDC"'2,/&76L;j6L/&$B
Mz%5I9lp%(#89".:/A#&%(#8.2':;oM!':16A^/&1%o)",4t!M,/&.:G(q1?(c|.: u >?.2Md>hM!%(6AbC"#&%(M,/&.:Mz%('H%(C"C?'2.2M!%5/&.:1"6WM!%(
Bb%((W/&>?@C?#A1Cl!#L/&.2$6}1(4/&>"='%/A/&$#Z%(C"Clz%(#7/A1b)?1Bb.:-%5/A(Q
S4 %(") %(#A=68/&%5/&.:1-%(#L;c u KM!%(Rcs.2N/&>?!1#L;U%5/~'2z%568/zc-$68/A.2Bb%5/&W/&>?!.2#}4tF"?)-%(BD!]/d%('
C"#81CJ$#8/A.2!6$Q-1#@,i?%(BDC"'25c|.:`j$M$/&.:1h"Q?Q q4t1F"")4t#A1B1F"#@BD1j)"$'7TWVWX}Y[6w4t1#@)".:4
4tF"68.21o%(")oCJ$#A.21a)".:MWM!1]G$M$/A.21 u >"%5/M$1F"':)u 9lwi?Cl!M,/&$)4t1#Z/&>"@!.:!]G5%('2F?@68CJ$M$/A#AF"BD6
1(4C"#&%5M$/&.:Mz%('|C">];j68.2M!%('*C"#A19?'2!BD6WM!1(/&%(.2?.2"p/A>"!68bC">?!"1BD!"%?c68!D|.:"QR"Q0QE{}>"$6Aqi
Cl!M$/&%5/&.:1"6%(#A~#A,4t!#8#A!)b/&1@Bq%(];E/A.2BD!6H.2^/&>"Z4t1'2':1 u .2"@%(-%5':;a6A.:6H15468/&%(9".2':.:/<;KC"#A1Cl!#L/&.:!6!Q
{}>",;U%(#A=.2BDCl1#8/&%(]/7!?1F">\/&1^9l@68F"BDBq%(#8.2$!)\9];p/&>"W4t1':'21 u .2?"
#8- z 1%(#v')?%.:ijJ.:F"6!Q 6A.:1)"1BD.2-%/&!)_"1 u 6W/A>"b"!.2(!]G5%('2F"$6/&$")/&1\'2.:E%('21("q/&>?D?!]%5/A.:G(
.:- qB 1#H%((CJ.2$-%#A(.:1j#L;b)".:%MmijM$.26!1Q]G$M$/&.:1j)"1BD.2-%5/A!)D_-1 u 6/&>"W"!.2(!]G5%('2F"$6H/A!")p/A1K':.2m%('21?w/&>?
S<Bq%5;k.:/A!#8!68/A.2"`M!%(6A$6!cZ/&>"!.2(!]G5%('2F"$6q1(4W/A>"Bb%5/.2M$!6D.2Xy6!Q Q:%5") Q
(% #8p6AF?DM$.2!]/e/A1)"$/A!#8Bb.:"b/A>"p68/&%(9".:'2.:/<;(QS<`C"#8$Ga.21(F"6eMd>-%(Cj/&!#86!c u N)"!68.2-%/&!)h/A>"!68
!.:!]G5%(':F"!6o%(6-%(?)" 4t1#UXya6$Q Q:%(") QacW#A!68CJ$M$/A.:G$':;(cw%5") u u .:'2'v+-?) .:/
M!1(G(!".:!]/e/A1,i?%(BD.2?D/A>"q6L/d%(9".:'2.0/<;1(47G5%(#8.21F"6@BD$/&>?1j)"6@.29J15/&>/A>"qM$1BDC"'2iIP%5")
M!1(BbC"':,i C"'2%("$6!Q
!"#$&%'($)+*-,/. 01%2.
3!4%657&84%693
3:
% &4*&;
<?grm*~HEg?vr!Z}O$=W?>
p)A BDC*vNFEpGIH'Jz$R LKNMn
PO8
1@
QSRUTSR&V WYXDZN[]\_^U`9Z3\_^acb
S 4-%ZBb%5/.0iW>"%(6|%ZM!1(BbC"':$/AH$.2$"68;a6L/&!BUc%5'2'1(4?.:/A6$.2$]G!M,/&1#86%(#8*'2.2?z%(#8':;v.:")"$CJ$")"!]/!c
%(")\/&>?wBb%5/.0iqMz%(U9lw)".2%(1"%('2.:!!)q9;U%^6A.:Bb.:'%(#8.:/<;^/&#A%("6L4t1#ABb%5/&.:1RQS<o6AF"Md>%DM!%(6A@.:/
4t1':'21 u 6=%5/@1"M$D4t#81BXysQjQ c4t1(#@i?%(BbC?'2(c/A>-%5/=/&>"qTWVWX}Y6@%(#8b.:">"!#8!]/&'0;68/&%(9"':D.04
%(")U1"'0;p.04
w "}y x{z 4t1#Z%(':}
' |
Q]
{}>".:6b6L/d%5/A!6b/A>-%5/!c4t1#D.2">"$#A$/q68/&%(9".2':.:/<;(c%(':'}1(4v/A>" $.2$G5%(':F"!6DBeF"6L/p':.2N1Rc1#D/A1
/&>?q'2,4f/K154rc/&>?q.2Bb%(.:-%(#L;%ij.26@.23/&>"bM!1BDC"':,iI`C"'%(?(Q\S<"6ACl!M,/&.:"|.:"Q"Q0c u p6A$
/&>"%5/w/A>".26@M!#8.:/A!#A.:13.26@6&%5/A.268+"!)I4t1#=/&>?qBD1j)"$'HTWVWXZY[6K#8!C"#8!68!]/&.:"9l1(/&>h)?.:JF"6A.:1I%5")
9".:M!1]G$M$/A.21RQ}S/m6A>?1F"'2)o9J@!BDC">-%56A.2$!) %(6~.:/~.26m%(U.2BDCJ1(#8/d%5/ZC?#&%(M,/&.2M!%('M!1?6A.2)?!#&%/&.21(
.2UM!1(G(!M,/&.21(j<)"1(Bb.:-%5/&$)o6L;a68/&$Bb6&Z/A>-%5/~/&>"@6ACl!M$.%('Mz%56A=4t1# u >?.2Md> ~l .26=f 4e9a
.2D/&>"m)"1Bb%(.2D1(46L/d%(9?.2'2.0/<;QS<q/&>".:6M!%(6A.:/.26*/&#AF?m/&>"%5/ N )"1a!6"1(/)"!M!%z;N%(6H g h cj9"Fj/
"$.:/&>?!#~)"1j$6.0/m(#A1 u c681b/&>?e%(9l1GKM$1")".0/&.:1o.:6mBD$/!QZ|.2"%('2'0; u K"1(/Aw/A>-%5/~4t1#vTWVWX}Y[6
uM!#8.:.:/A/A>!#A.:M$11RQBbC?'2$/A\!.2(!"6L;j6L/&$Bb6D/&>"o!.2(!]G$M$/&1(#A6qC?'%z;P"1I#81'2\.:g/&>?o.:">"!#8!]/p6L/d%(9?.2'2.0/<;
QSRUTSR Z3)Z3`^UyZnm^pcZrbDsvt/s`Zris
S<31#A)"$#W/&1\F"")"$#A6L/d%(")3/&>"D68/&%(9".:'2.:/<;o1(47TWVWXZY[6W/&>-%/w>"%G(b)?$4t!M,/&.0GD!.2(!"6L;j6L/&$Bb6$c u
.2?6ACl!M$//&>"-%5/&F?#A154/&>"$.2#H6A1':F?/&.:1"6H.2p$.2$"6AC-%5M!(Q*-1#*/&>?.26 u v)"#A% u 1(q/&>"m#A$6AF"'0/&67.:
j$M$/&.:1"6="QjQU%5")$6ACl!M$.%(':':;1(IXy6!Q"Q0 p/&1U"Q0 N.2/&>-%/w68!M,/&.21(RQ^S<I%(3!.:!?6AC-%(M$
#A$'%5/A!)/A1N)"$4t$M$/&.0G^68;a6L/&!BD6W/&>"e4t1(#AB1(4*/&>"E#8!C"#8!6A$]/d%5/A.:GD!F-%/&.21(Md>-%("$6W4t#A1B %
6A.:"':!F-%/&.21(p/&1^% (1#A)"%(N9"'21aMdsQ*-1#i"%5BbC"':(cj.2"6L/&z%5)U154|XysQ""Q[ @e%K/<;aC".:Mz%('l4t1#AB1(4
/&>?@>?1Bb1(!"$1F"6ZC-%(#L/ZBb.:>]/}9l
-
- R -
(
mv*x"r!Z}Pryv*H
4t1# u >".:Md>o1("W+-")"6Z/&>"=681'2F?/A.21
R 8 R z]&"
8 z R zrU")
8 z] z]< R z]< & "
Q @(
S<"6ACl!M,/&.:"w/A>".26*6A1('2F?/A.21Rc u ~6A$m/&>"%5/*4t1#y6AF"Md>qMz%(68!6HM!1")?.:/&.:1 Q[wBeF?68/H9JZBD1j)?.:+-$)
/&1E/A>"W4t1#AB
w "7S z 4t1#Z%5'2
' |
Q
6A.:"M!74t1(#C"F" #8}.2Bb%(.2"%(#8;@c] %(")E u 1(F"'2)E#81 ugu .0/&>"1Fj/9l1F"") ':.2"!%(#A'0;=1#F-%()?#&%5/L
.2M!%('2'0;?y.04 z zK1#7R z]l zjQy{}>"!1#8$/A.2Mz%5'2':;E/A>".26M!1?)".:/A.21b.2668F?DM!.:!]/}4t1#6L/d%(9?.2'2.0/<;
.2D/&>"6A!?6Av1(4/d%5/A!BD!]/ QK68.2"M$m " g z@%(6y g h 4t1#7%5'2's"1j!$#A1 !Q*~1 u ,G!#$c
.2`C?#&%(M,/&.2M!%('7%5C"C"'2.:Mz%5/A.21?6w/&>?NM!#A.0/&$#A.21(hBq%z;I9J u 1#8/A>"'2$6A6E68.2"M$p/&>"$#A\Bq%z;9J\%G(!#L;
'%5#Am#A1 u /&>N154/A>"vCl1':;a"1(Bb.2%('s9J,4t1#A/A>"vi?Cl1"$]/&.%5' L/d%5(!6}1G(!# D%(?)N9"#A.:"67%59J1Fj/
/&>?N)"!M!%;(QP-F"#8/A>"!#8Bb1#8(c*1k%M!1BDC"F?/A!#E68F"Md>%#81 u /&>PBb.:>]/E)"$68/Qh/&>"N681'2Fj/&.21(
C"#81jM$!6A6~9l$4t1#8W.:/ZM!1(F"'2)\9l=/A!#8Bb.:-%5/&$)RQ
m1(/A/&>"%5//&>?768/&%(9".2':.:/<;=M$1")".0/&.21( Qb& 4eadR/&>"}.:Bq%((.2-%(#L;=%ij.26 u >".2Md>E/A!")"6/&1W9l
1aM!M!F?C".2$)b9];e/A>"Z!.2(!]G5%('2F"$6*#A!'2%5/&$)E/&1=9".2M$1]G$M$/&.:1DC"#A19?'2!BD6!Q|m1 u $G$#!cjM!1")?.:/&.:1 Q
.26*1(4'2.0/A/&':71#*"1@C"#&%5M$/&.:Mz%('-.:BbCl1#L/d%("M$}.:46A.2(".:+-M!%(]/%(Bb1(F"]/&6*1(4R)?.26A68.2C-%/&.21(b%5#AZC"#A$6A$/!Q
p l C*z GIJEp G?H" Jz$R L KnM O8
QSR$R&V WYXDZN[]\_^U`9Z3\_^acb
{}>"KTWDXgM!1BDC-%(".:1p/&1ba/&%5/&$Bb$]/ QE.26
s1(#w%,(l(^Bq%5/A#A. i cXysQ Q\.26^ q,A1ee N,f'e2W.:4rc u >"! .26 Q
M!1"6L/d%(]/!c " ^#8!Bb%(.2?679J1(F" ")"$)%(6 g h Q
~68!Z/&>-%/F"BD!#8.2M!%('"68/&%(9".:'2.:/<;K)"!Cl!?)"61("':;E1(^/A>"Z/&#&%5"6A.:!]/H6A1':F?/&.:1E1(4/A>"mTWDXgY6$Q
{}>".:6~)?$+-".0/&.:1N1(468/d%59".2':.:/<;b.26}6A1(Bb,/&.2BD!6}#8$4t$#A#A$)U/A1q%56Z%(68;aBDC?/&1(/A.2MW1#7/A.2BDW68/&%(9".2':.:/<;(Q
6 v6L/d%5/A!)N%//A>"9l!.:"".:"w154R/&>".:6Md>"%(C?/&$#!c"6L/d%(9?.2'2.0/<;E)",+-".:/A.21?6%5#A?1(/F?".2F"5Q
)?$+-".u 0/&.:1h1(4f/A!hF"68!)P.2h7V '2.0/&$#&%5/AF"#AD68/A!BD6K4t#A1B/A>"p)",G!':1C"BD!]/E1(4~*VWX6A1
'2Fj/&.21("6p/&>-%/o)?1g"15/o?!M!$6A6A%(#A.:':; 4t1':'21 u /&>"36A$Bb.:)".268M!#8$/QF?/&5Q S< 6AF?Md>Mz%(68!6U.:/\.:6
%(C"C?#A1C"#8.%5/AN/&13M!1"68.2)"$#b68.2BeF?':/d%5"!1F?6A':;/&>"U$J!M,/&6b1(4v9l1(/&>P/&>?U/A.2BD\%(")68C-%(M$%(Cj
C"#81ij.:Bq%5/A.21?6!Q/A.2BD,<68C-%(M$v)"1Bb%(.2N.:67+?ij!)o%(")\68/&%(9".:'2.:/<;b.26})?$+-"$)o.:N/&!#8Bb6}154 u >-%/
>-%(C?CJ$"6/&1K6A1BD"1(#AB1(4R/&>?v6A1':F?/&.:1 u .0/&>".:b/A>".26)"1Bb%(.2b%(6/A>"vBD!6A>q.2]/&$#8G5%('261w/A1
!$#A1b%5/Z6A1(Bb=M!1("68/&%(]/m#A%5/&.:1"Q|=)".268M!F"686~/A>".26}Cl1.2]/Z1(4Ga.2 u .2oj$M$/A.21 Q["Q
1"68.2)"$#y%68$/y1(4JTW^XPY6(1G(!#8"!)D9];e%M$1BDC"'2,/&$.2$"68;a6L/&!BUQ{}>"68/d%59".2':.:/<;=M!#8.:/A!#A.:1Rc
%(M$M!1#8)".2"U/&1U/&>"bM!1")?.:/&.:136A$/e.2X*sQ Q c4t1':'21 u 6@%5/K1("M!q4t#81B%o6L/&F")j;I1(4}X*sQ|?Q
%(").0/&6WM!1(BbC-%5".214t1(#vBeF"'0/&.2C?'2?l<#A1a1(/A6!cXysQ?Q?Q^':z%(#8':;cJ4t1#W6AF"Md>368;a6L/&!BD6w%N/A.2BD,
Bb%(#AMd>".:"EBD$/&>?1j)\.26}F"BD!#8.2M!%('2'0;q6L/d%(9"':=.:4%(")U1"'0;p.:4
"} x 4t1#Z%(':' |%(?)o
Q
{}>".:6UM$1")".0/&.:168/d%/&!6N/A>-%5/zcm4t1#NF"Bb$#A.:Mz%('W6L/d%(9".:'2.0/<;cm%('2'v154w/A>" $.2$G5%(':F"!6 9J1(/A>
C"#8.2"M$.2C-%('%(")36AC"F"#8.21F?6!c.:4H/&>"$#Ab%(#A^%5;?WBeF"6L/w':.2e1(1#=.:"6A.:)"e/&>"^F"?.:/=M!.:#AM$'2E.2/&>?
M!1(BbC"':,i J<C"'2%("5Q
{}>".26*)",+-".0/&.21(E1(46L/d%(9?.2'2.0/<;=4t1#HTWDXgY6*.26yM$1"68.268/A!]/ .:/A>^/A>"Z68/&%(9".2':.:/<;@)",+-".:/A.21e4t1(#
TWVWX}Y6$Q|%(.2v/A>"68!"68.:/A.:GHMz%56A*1jM$M!F"#864t1(#/A>"*CJ$#A.:1j)".:M,u M!1]G$M$/A.21=BD1j)"$' u >".:Md>KC"'2%(M!$6
/&>?8M!1#8#A$M$/\':1jM!%5/&.:11(4*/&>?EC"#A.:"M!.:C-%('_a#A1a1(/WC"#8!M$.26A$':;1/&>"EF"?.:/WM$.2#AM$'2 u >?!#A^/&>?
6A1('2F?/A.21=.261"'0;W"$F?/&#A%('2'0;W68/&%(9"'25Q|-F"#L/&>"$#!c4t1#%mM!1(BbC"':$/AH$.2$"68;a6L/&!BUc5/A>"H!.2(!]G$M$/&1(#A6
C"'2%;q"1D#A1':W.2p/&>?@F"BD!#8.2M!%('R68/&%(9".:'2.:/<;q%(686A!686ABD!]/zQ
QSR$R Z3)Z3`^UyZnm^pcZrbDsvt/s`Zris
{}>"*)".:6AM!F?6A6A.:1=4t1#/&>?!6AH68;a6L/&!BD6C-%(#&%5'2'2$'26l/&>"y)".:6AM$F"6A68.21=4t1#)",4t!M$/A.:G(TWVWX}Y[6!QXi?%(BD.2?
XysQjQ: U%(")3"1(/Ab.0/&6=6A.:Bb.:'%(#8.:/<; u .:/A>IXysQ
Q @jQDD6A!D/&>-%/@4t1(#@)?$4t!M,/&.0GqT=^X}Y[6w/&>?
#A$F".2#8!)UBb1a)".:+"Mz%5/A.21q/A1
Q E.:6
"7 4t1#Z%(':' |%5")
Q
6A.:"M!)"$4t$M$/&.0Gv6L;a68/&$Bb6})?1e "1(/F-%(#A%(]/&!9J1F?")"!)?"!686Z4t1(# ca4t1#i"%5BbC"':m.:NXysQ
Q
@e.:4 w%5")o$.:/A>"!#Z z]71#}R z]D z u @$/Z':.2"!%(#71#}F-%()?#&%5/A.2M=#A1 u /A>RQ
p z / E\ GeZ
Ep G?H" Jz$R
Ge D Dl Cy^WZ KoM P O8
$/UF"6U"1 u i"%5Bb.:"/&>"M!1("M!$C?/154K6L/d%(9".:'2.0/<; .2 %`)".0$#A!]/ u %;(QS</&>"C"#8$Ga.21(F"6
)".:6AM!F?6A6A.:1 u =M!1("6A.:)"!#8!).:\6A1BDW)"$/&%(.2'J/&>"W4t1':'21 u .2"e%(C"C"#81]%(Md>R
QZ{}>"w*VWX}Y6m%(#A@M!1(G(!#L/&!)o/&1qT=VWX}Y[6m9];U%(C?C"#A1zij.2Bb%5/&.:"e/&>?w68C-%(M!w)"!#8.:G5%5/A.:G$6Z1
%e+-".0/&WBD!68>RQ
jQZS<">?!#A$]/6L/d%(9".:'2.0/<;q1(4/&>?KTWVWX}Y[6~.:6}!6L/d%(9"':.268>"!)U9];NF-%(#A%(]/&$!.2?^/A>-%5// w ly x{z?Q
?QZ{}.:Bb<Bb%(#AMd>pBD$/A>"1a)"6Z%(#AW)?$G$'21Cl!) u >".:Md>oF"%(#&%(]/A!v/&>"%5/ xw%5")N/&>".:6
.:67/d%(5!o/A1^9JW/&>?@M$1")".0/&.:1p4t1#}F"BD!#A.:Mz%('68/d%59".2':.:/<;Q
1
mv*x"r!Z}Pryv*H
{}>".:6LadmF-%(#A%(]/&!w/&>-%5/W%p68/d%/&.21(-%(#8;U6L;j6L/&$Boc$"!#A%5/&$)4t#A1B %N*VWX 1681BD6rj
6AC"%(M!bBb$6A>Rc u .2'2'|>-%zGp%UF"Bb$#A.:Mz%('y681'2F?/A.21/&>"%5/@.26@9J1F?")"!)I%(6= g h Qp{}>".:6
adw(F-%(#&%5/A!K/A>-%5/)"!68.2#&%59"'2@6A1':F?/&.:1"6m%(#AK!"$#&%5/A!).:/&>?w/&.:Bb@Bb%(#AMd>C?#A1aM!!686
%(6Z9l1(/&>N/&>?=/A.2BDW%(")U6AC"%(M!@Bb$6A>\.2]/A!#8G5%(':6Z%(C"C"#81]%(Md>U!$#A1"Q
m1 '2,/F"6m)"$+""e68/&%(9".:'2.:/<;p.2o/A>"w/A.2BD,6AC-%(M$w68!"68(Q|.2#868/mM!1"6L/F"M$/=%^+-".0/&w/A.2BD,
6AC"%(M!@)"u 1Bb%(.2N'0;a.2" u .:/A>".2zLxx%(")zxyx{@Q1G$#m/&>?.26})"1Bb%(.: u .0/&>U%^ #A.:)
/&>"%5/Z.26}$aF?.26AC"%(M!$).2\9l1(/&>\/&.:Bbv%(")\6AC-%5M!w%(")\+?iN/&>?@BD!68>8(v9];N/A>"=!F-%5/A.21
E
mia/*#A!)?F"M!}1F?#*TWDX3%(C"C?#A1zij.2Bb%5/&.:1K1(4-/A>"}*VWX/&1=%/ u 15<':$G$' .Q[(Q0c(/ u 1W/A.2BD,<C?'%("$6d
4t1#8BeF"'%e.:p/&>"W4t1#8B 1(4|XylQ QjQy{}>?w>"1(Bb1(!"$1F"6ZC-%(#L/Z1(4/A>".2674t1(#ABeF"'2%e.26
- zJ -
Q0 z]
XysQ Q0 z\.26=6&%5.2)/A1o9lq6L/d%(9?'2^.:47%(];9l1F"?)"!).2".0/&.%5'G$M$/A1#!c _ zcC"#A1a)"F"M$!6K%U9l1F"")?!)
6A1('2F?/A.21G(!M$/A1#!c - ?c%(6W/A>"^Bb$6A>36A>"#8.2"6W/&1U!$#A1\4t1#=%\+ji?$) jQD{}>?.26=.26v/A>"^M!'%56A6A.:Mz%('
)",+-".:/A.21@1(4-6L/d%(9?.2'2.0/<;QS/.261(4f/&$K#A,4t!#8#A!)e/A1%56 %i@1# %iZ.2Md>]/&BK;(!#68/d%59".2':.:/<;Q':z%(#8':;
%(6}/&>?@BD!68>o.:]/&!#LG5%('26}1^/&1^$!#A1?cs/A>"=F"Be9l!#Z1(4/&.2BDW68/A!C"6$c csBeF"6L/m(1^/A1^.2?+-?.:/<;N.:
1#8)"!#H/&1eM$1G(!#7/A>"v!]/A.2#A~+?ij!)\)"1Bb%(.:Rc6A1e/&>?M!#8.:/A!#A.:1q.: Q .26%K"$M!!686&%(#L;pM$1")".0/&.21(
4t1#7/A>".26}6L/d%(9".:'2.0/<;qM$#A.:/A!#8.21RQ
{}>"~6A.2(".:+-M!%("M$}1(4J/A>".26y)?$+-".0/&.:1^1(46L/d%(9?.2'2.0/<;w%(#A.:6A!6y/A>"#A1F?> " L d-d&4 Ec >?.2Md>
68/&%5/&$6~/A>-%5/!c".:4|%EaF?Bb$#A.2M!%('RBD$/A>"1j)\.:6, f'e2 .:\/A>"=6A$"6Aw1(4 %i"}%(")Yd?,2,<,-u /&>?!
.:/.2L6 d (, a,-Q Bb,/&>"1a).2L6 d?,2,r,-.:4*.0/C?#A1a)"F"M!$6W"1N!#8#A1# .:/&>"K{|%z;a'21#m6A$#A.2$6
6A$"6Az.2D/&>"m'2.:Bb.0/*%(6*/&>"mBb$6A>p68C-%(M!.:"e%5")q/&>?m/&.:BbZ6L/&!Cq1w/A1K!$#A1 u .:/A> @+ji?$)Rc".:
/&>?~>];aCl!#A9l1':.2M}Mz%56AQy{}>".26*.:64tF"#8/A>"!#*)".:6AM!F?6A6A$)p.2bj$M$/A.21 Q ?QBD$/&>?1j)^.266 d (,+ a,-
.:4|.:/~M!1(G(!#8!6/A1D/A>"Ki?%(M$/m6A1':F?/&.:1o%(6~/A>"@Bb$6A>68C-%(M$.2"q%(")o/A.2BD=68/&$C1D/&1D!$#A1p.:
/&>?.26}Bb%(""$#!Q '2!%(#A'0;c?/A>".26}.:6Z%(\.2BDCJ1(#8/d%5/7C"#A1Cl!#L/<;Q
C"C?':;a.2"^68.2BDC"'2v#8!M$F"#A68.21\/&1DXysQ Q: zjc u W+-?)
- _
%(")^F"68.2"vG(!M,/&1#H%(")^Bb%5/.0ui ?"1#ABD6 6A$~mC"Cl!")". iEv%(")E/&>"$.2#.:"!F-%5'2.:/<;@#8!'%/&.21("6!c
u w>-%zG(
- _ x x
Q0
0 *!4 :
%6 ($+
q*
+)2+
!cD4
:
)-+0 202**+!(y+20 !*+*+."&:v+r .!1*!4'
*
"!4.01%D*&'!2:)+'
!40 %*
!4;
:
($.u
&"S+.6*!c%'&%*)*+
:
!c($.1$&*+1&%'3% (y.)&% .u
%!4'
*;0234*&4*+!:
*%" (S**!S
&)c:%"
+ !4(S:
+*
!4
&%):
+!4:
+
!4%I')!2y
+"4.+/!y
+ +
+,!4:
U+
!4!%v: ; +
!4%u!4v 3;
v)+*
:
:*+*+!y+2
j.:"M!W/&>?@.:".:/A.%('l)-%5/&%eG!M,/&1#Z.:6}9J1F?")"!)cs/A>"=6A1':F?/&.:1pG$M$/A1#m.:6}9J1(F"")"$)o.04
x
Q0
u4t1>"#}$6L#A/d %(9".: '2.0/<; Q #A$C"#A$6A$/A6K%5; ?<"1(#AB1(4 Qw{}>".26W.:6v1(4f/&$F"6A$)I%(6=%o4
,,-|M$1")".0/&.21(
m1 uu "!$)p/&1K#8!'2%5/&~/&>"m68/d%59".2':.:/<;E)",+-".0/&.21("6.0G$p.2qX*6$Q Q e%(")
Q u .:/&>D/&>-%/
.0G!I.2hXysQ Q:aQoS<PXy6!Q Q
o%(") Q?c68/d%59".2':.:/<;.:6K#A$'%5/A!)3/&1/A>"U-,81e8(]=1(4
c.Q5Q:c.:/A6W!.:!]G5%('2F?D154Bb%ij.2BeF?BnBb%(".0/&F")"5Q^S<IXysQ Q:jc68/d%59".2':.:/<;o.26=#A$'%5/A!)/&1U%
? "1#AB1(4 QwS/W.:6vM!':z%(#m/&>-%5/e d- ,f<,(&E d-K!1 q d-,I d-K - ,A1 e8 ( e2D
4 - <)
{ u 14%(M,/&6E%59J1Fj/e/&>"q#A!'2%5/&.:1I9l$/ u !$g68CJ$M$/A#&%('7#A%()".:.%(?)`Bq%5/A#A. i3"1#ABD6E%(#8 u !'2'
"1 u R
QZ{}>"@6ACl!M,/&#A%('#&%()".:F"6Z1(4y%^Bb%5/.0iN.:6Z.:/&u6 ?1#AB u >"$o/A>"wBb%5/A#A.0ip.26Z"1#8Bq%5'c?.Q5Q:c
.0/}M!1BDBeF?/A!6 u .:/A>\.:/&67/A#&%(?6ACl16A5Q
jQZ{}>"=68CJ$M$/&#A%('#&%()?.2F"6}.:67/&>"L e2 , f,2 a =1(4%('2'J"1#8Bb6$Q
-F"#8/A>"!#8Bb1(#A(c u >"$N .:6?1#ABb%('c/A>"68!M$1")N.2?!F-%(':.:/<;E.:pXysQ Q:(9l!M!1(Bb$67%(p$F-%('0
.:/<;(QS</A>".26mMz%(68(cXysQ Q0b9l!M$1Bb$69l1(/&>?!M!$6A6A%(#8;%(")6AFjbM$.2$/4t1#6L/d%(9".:'2.0/<;Q~-#A1B
/&>?!6AD#A$'%5/A.21?6 u D)"#&% u / u 1.:BbCl1#L/d%(]/WM$1"M!':F"6A.:1"6@%(9l1F?/=/&>?DF"BD!#8.2M!%('y68/&%(9".2':.:/<;o1(4
BD$/&>?1j)"6}F?6A!)U/&1^6A1(':G@*VWX}Y6$Q
{}>">"^$`/6L/d&%(>"9"p.:'2(.0/<1;G(!M$#8#A"..:/A2!"#8.%pBb.23X%5/Ay#A.0i36!Q.:6K "1Q \(#A%(Bb") %('Qo Q0{}N>".2%(6w#A^.2"M.2$)?'2!F"]/)"&$.:6eMz%(68'|;a4tBD1(#WBb68,/d/&%#8/&.2.2M(1(c-%%((68#8;a;oBD68Bb;a6L,/&/&!#ABD.:M(6 c
u%(?) M$.2#8M!F"'2%(]/NBq%/&#A.:M!$6!Q{}>"$6A3M!#8.:/&$#A.2%h%(#A9l1(/&>?!M!$6A6A%(#8;O%(")68F?DM!.2$]/U4t1(#
BD$/A>"1j)?6*/A>-%5/!?!#&%/&~6AF"Md>pBb%5/A#A.2M$!6*%(?)q)"$CJ$")p6A1('2!'0;eF"Cl1D/&>"~!.:!]G5%('2F?!6*1(4
/A>"=Bq%5/A#A.:M!!6$Q
S.:6q4/AF">""6KL/d68%(CJ9?$'2M$/A#&9]%(;'#&%5%(;)?g.2F"6~M!#81(.:/A4~!#A(.:-1=RQ1G{}$>#AF"".6p:"4tp1(#qBb%5$/&"#8.0!i\#A%(.:6m'(Bb#Az%5%//&.2!M$#Z!6!/&c}>"%(/A1>""6ACl5cl!M,/A/&>"#AK%('BD#A$%(/A)">".21aF?) 6
M$1")".0/&.21(N.26}"$M!!686&%(#L; W9"F?/~"1(/~68F?DM!.2$]/~4t1(#}68/d%59".2':.:/<;Q
r'5 &2+ 24::
l +2
3$.%
&%2&
++4
!4*+%Dl
!% %2!).3+
!4*+%?+
4:2!4*!42 *$0
01 &*0+!'*
):
* .*
42;
!) 1y:
&
+24%!*&'2):!
!#"%$
z
p(
QSR.SR&V
mv*x"r!Z}Pryv*H
lC*zGIJEpG?H" Jz$R D~Wxz y b J$* )
+ -,NJ'Ge
aua` W \4Z3s52Zrk64`^UyZ `a `XDZ87bl^U` [ ^\3kZ
/1032
>",/&>"$#1#*"1(/*/A>"m68!BD.0)".268M!#A,/&~%(C"C?#A1]%(Md> u %56H/&%(($q/&1=+-")D/&>"~)".:J!#8!"M$.2"w%(C"C?#A1zi
.2Bb%5/A.21p154%E6A,/~1(4*VWX}Y[6!c-/&>"W+-"%(')".:J!#8!"M$=!F-%5/A.21"6ZM!%(o9lW#A$C"#A$6A$/A!)9];
- zJ - W
-F"#8/A>"!#8Bb1(#A~.:4 >-%(6%wM!1(BbC"':$/A: 97$.2$"68;a68/A!BUcj/A>"681'2F?/A.21D/&1@/&>"m>"1BD1!?!1F"6C-%(#L/
Mz%5%(' u %z;a6Z9J=i?C?#A!686A$)%(6
- R q - <; ; ;
u+-")>"\$#A%w=#A/&!>"'2 %5/&".:1q9%(l#8$W/ /&>"!W$N/$.2&>"$DG5%%(':5F"")!q6Z1(/&>?4 = \QyS$4|.2/&$>?]G@(68%5!'2F"BD$.06!Qy)".2{}68M!>"#A.:,67/&6AW$%5#8GC"$C"6Z#A1%(%(6}Md%w>G(2!#LF";p68M!!1()RGc (u !w".:M!!%(]/
F".:)"W%(67/A1 u >"!#8 u u =Bb.:>]/7i?Cl!M,/Z/&>"J#A1a1(/&6/A1E'2.:#A$'%5/A.:G(v/&1e/&>?WF"".:/7M!.2#8M!':v.2N/&>?
M!1(BbC"':,i JC"'%5"(Q\-1#W/&>?.26@#Az%56A1 u u .:'2'yC"#81jM$!$)I/&1U/&#&%5M!b/A>"D'21aM!F"6@1(47/A>" J#A1a1(/&6
%(6%D4tF""M,/&.:11(4/A>"KC"%(#&%(BD$/A!# 4t1#Z/&>?K!F-%/&.21("6BD1j)?!'2.:"^)".:JF"68.21%(")Cl!#8.21a)".2M
M!1(G(!M,/&.21(>=Q
?A@CBEDGFH@JILKMONPNQRBSKTKVUR>BWN
.
+`ce2d
*&
!4%6
+ 4!) !4a&+ :
b
3f4!)4
+0 . +2u)&:v02+&
4484*
+S44(y; b 4+&&%2*h
+"gI
+&!($*A
i ,2&4.I
814: %
. !4.k*j&
&
'.2;c4:_2*+!m!({ln% 4!%2.!o%!4*y /:
:_. -!4(S2
+
!4 %L*4 %2. *
!%'8&+
!4%/&4
+&
&*+
01&+
84&:;
qpsr|*Z,|vP?vr!Z}}e*|or }Z*utN*v j
v]QCR>wyx z{N|F}@ILF:@wyN~wyNEKMO@GF
m 1 u '2,/vF"6WM$1BbC"%(#AK/A>"E,i?%(M,/J<#81j15//&#A%(M!$6 u .:/A>6A1BDK/&>"%5/=%(#8EC"#A1a)"F"M$!)9];%(M,/&F-%('
/&.:Bb<Bb%(#AMd>?.2"EBD$/A>"1j)?6!Q7{%(9"': Q0@6A>"1 u 6/A>"e?U3#A$'%5/A.21?6Z4t1(#m%^G5%(#A.:$/<;\1(4|Bb,/&>"1a)"6!Q
|.:F"#A$6 QK%5") QK.2':'2F"6L/&#A%5/&}/&>?#A$6AF"'0/&67C?#A1a)"F"M!$)N9];bG5%(#8.21F"6HBD$/&>?1j)"6 u >"!p/A>"$;q%(#8
%(C"C?'2.2$)/&1b/&>"eBD1a)"!'|TWVWXZY[64t1#)".:JF"6A.:1%5")CJ$#A.:1j)".:M,M!1]G$M$/A.21RcXya6$QR"Q[N%(")?Q@jQ
S/W.:6v.2BDC"'2.:!)U/&>-%5//&>"E9l!>-%zGa.21(#v6A>"1 u .26m/<;jC?.2Mz%5'1(4 u >-%5/ u .:'2'>-%(C"Cl!.04y/&>"EBD$/A>"1j)?6
%(#87%(C"C?'2.2$)@/A1v)".0F"68.21a 1#)".2686A.2C"%5/&.:1jLR)"1(Bb.:-%5/&$)w1(#Cl!#8.21a)".2MHM!1]G(!M$/A.21a<)"1BD.2"%5/&$)
C"#819"'2$Bb6K%(6 u !':'%(6 u >-%5/E)"1a!6K>-%(C"Cl!`.:I/&>"qBb1a)"!'HMz%56A!6$Qo168/e1(4}/&>"q.2BDCJ1#L/d%(]/
Cl16A68.29".:'2.:/A.2$67%(#8WM!1G$#A!)9;q/&>"=.2':'2F"6L/&#A%5/&.:1"6!Q
ZP z
|X ijC"'2.:M!.0/~X*F?'2!#
k z
z%(C?4t#81
U z
}
_
= 9 o z
7
_
@ GZk | z
S<BDC"'2.:!M .:/7XyF"'2$#
~ | z
{#&%5CJ$ !1.:)-%('
z
5
?)
T7(% Md u %5#A)
~
~ 9
W
z
9 9 z
_}
z ( b z
@%($)-%(
ZP z
L@
ZP > z
LW
~ | = z
o.:'2"W(/A>
{%(9"': Q0QHj1BD@b ~$'%5/A.21?6
Rv]QCxGz'BEK}vmDOz'NUTNKMO@C
mv*x"r!Z}Pryv*H
()
()
h= 0
R ()
h=
= e h , h
h= 0
- oo
a) Diffusion
R ()
=e
i h
, h
oo
b) Convection
| .2F?#A Q0*X|i?%(M$/Z/&#A%(M!$6m154J#A1a1(/&64t1#}Bb1a)"$'R!F-%5/A.21?6!Q
#A1a1(/@.26=6L/d%(9"':E4t1#@%o#&%5"^1(4Z c|9"Fj/@/A>"D6AC"F"#8.21F?6w#81j1(/@.:6@?1(/zQpS<34%(M$/!c/A>"D6AC"F"#8.21F?6
#A1a1(/W6L/d%(#L/&6W1/A>"EF"".0/WM!.:#AM$'2E%(?)4%('2':61F?/A6A.:)"E1(4H.:/m4t1#^1ee7w lz?Qe~1 u $G(!#$c4t1(#
9".:M!1]G$M$/A.21Mz%56A!6$c u >"!I3.:*6 j&^D(fl(cJ/A>"EBb,/&>"1a).26"1(/=1"'0;6L/d%(9?'2(c9"F?/=.:/
%(':6A1C"#81j)"F?M!!6^%/A>-%5/e4%(':'26wC"#A$M!.268!'0;h1h/A>"NF"".0/EM!.:#AM!':q.:h/&>"N#A%(" z x xQ
6 u %(6^CJ1(.2]/&$)k1(F?/D%(9l1G((c*/&>".:6E)"1a!6^"1(/^BDz%(c*/A>-%5/E/A>"\Bb,/&>"1a)`.26 u .0/&>"1FjY/^ !#A#81#!Q
'0/&>"1(F">o/A>"=+-F"#8K6A>?1 u 6m/&>-%5/~/&>?!#Aw.26m%b#A%("@1(4 Y .: u >".:Md>/&>?K'2!%(C?4t#81bBD$/A>"1a)
C"#81j)"F?M!!6H"1=!#8#A1#*.:b%5BbC"':.:/AF")"(c5.:/*6A%;a6H"1(/A>".2"@%(9l1F?/y/A>"Z!#8#A1#*.2d?,Qo1#8~.:6y6&%(.:)
%(9l1F?/}/A>".26}.:>"%(C?/&$u# ?Q
B>N|BW@OCHUONUkRwFRF:MOI@JUKMNEKMO@
{}>".:6E.26^%(':6A13%/ u 15#A1a1(/EBD$/A>"1j)P9"Fj/zcHF""'2.:(p/A>"\'2z%5C?4t#A168Md>"!BD(cH/&>"N68C"F"#8.21F"6^#81j1(/
68/&%(#8/A6@%5/W/&>"D1#8.2.:Rc#A%5/&>"$#W/&>-%(31/&>?DF?".:/=M$.2#AM$'25c68!D|.:"Q QjQE{}>"$#A$4t1(#A(c/&>?!#A^.:6
%o#A%("D1(4}#8z%('H"$]%5/&.0Gq 4t1(# u >".:Md>I/&>?qBD$/&>?1j) u .2':'y9Jb68/d%59"'25QN{}>"q+-F?#AD6A>"1 u 6
/&>"%5/}/&>"=#A%(" W$")"6 u >"! @W
z^6A.:"M!@%5/}/A>-%5/ZCl1.2]/7/A>"=6AC"F?#A.21(F"6Z#A1a1(/}'2!%zG!6Z/&>?
M!.:#AM$'2^%(") 9l!M$1Bb$6=#A!%5/&$#=/A>-%(31"5Qq{}>"D6A.0/&F-%5/A.21.:6=aF?.:/&^)".0$#A$/ u >"$I/&>?
?<#A1a1(/W.:6vC"F"#8^.2Bb%(.2"%(#8;(Q@S</&>"%5/=Mz%(68D%(6 Y .:"M!#8z%(68!6@% u %z;4t#81Bn$!#A1N/A>"^6AC"F"#8.21F?6
#A1a1(/K#A!Bb%(.:"6K.:"6A.:)"q/&>?pM!.:#AM!':N%(")`#8!Bb%(.2?6K68/&%(9"':q4t1#E%#A%("N154 Y Q3~1 u $G(!#$c/&>?
C"#8.2"M$.2C-%('H#A1a1(/@4%('2':6w1(F?/&68.2)"q/A>"pF"?.:/eM$.2#8M!'2D4t1#E%(':' Y z?cy%(")h4t1(#w/&>?N9".2M$1]G!M,/&.:1
qpsr|*Z,|vP?vr!Z}}e*|or }Z*utN*v (
1
1
h=-2
a) Euler Explicit
h = 1
b) Leapfrog
h=-1
c) AB2
Diffusion
| .:F"#A Qjy{#&%5M!!6Z1(4J#A1a1(/&674t1#7G5%(#8.21F?6}Bb,/&>"1a)"6!Q
BD1j)"$'R!F-%/&.21(\/A>"=Bb,/&>"1a)\.26}F"?68/d%59"'2W4t1#Z%(':' Q
AhURxN|E@'OR>z#NKMO@C
Convection
}{ >"7/A#&%(Cl!$1.2)-%5'jBD$/A>"1j)K.26%G(!#L;eCl1C"F"'2%(#|1?4t1#|#8z%(681"6/A>-%5/*%(#87C-%(#L/&.2%('2'0;W.2':'2F"6L/&#&%/&!)
.23|.:"Q Q?QES/A6J<#81j1(/A6v4%('2'131#W.2"68.2)"e/A>"^F"".0/=M!.2#8M!':e4t1#W9J15/&>/&>"^)".:6A68.2C-%5/A.2"\%5")
/&>?qCl!#A.:1j)?.2MEM!1(G(!M,/&.2?Mz%(68N%(")c|.24%(M,/zcfm2^,f'e2Lzb1ee1esdN6K zdad
ft4 e q2\f9 d-,&,-+ e , f'e2,Q (F"6L/D'2.25q/&>?U':z%(Cj4t#A1BD$/A>"1j)P.0/E>-%(6e/A>"\Mz%(C-%59".2':.:/<;31(4
C"#81j)"F?M!.2?I1"'0;`C">-%56A$#A#81#b4t1#E/A>"Cl!#8.21a)".2MNM$1]G!M,/&.:"`Mz%(68(c}9"Fj/b/A>"!#8.26b%Bb% 81#
)".0$#A!?M!~9J,/ $!p/&>?Z/ 1e68.2"M$Z/A>"Z/&#&%5CJ$!1.:)-%('-BD$/&>?1j)DC"#A1a)"F"M$!6H"1e%5BbC"':.:/AF")"7$#A#A1(#
4t1#@(- Ys u "1( / 8F"6L/%Eu ':.2BD.:/&$)p#&%5"W9l$/ u !!zLx Y xQ
mv*x"r!Z}Pryv*H
NJR>kR>NEKMO@
{#&%(M$!6\1(4=/&>"l<#A1a1(/A6q4t1#q/A>"6A!M$1")jb%5")4t1F"#8/A>j<1(#A)"$#~F?",WF?/A/&%hBb,/&>"1a)"6\%(#8
6A>?1 u .2g|.2"Q QjQ {}>"o+"F"#A$6b68>"1 u /&>-%/q9l1(/&>kBD$/&>?1j)"6b%(#8o6L/d%(9"':N4t1#D%#&%5"\1(4
>"$3 .26m#A!%('%(?)"!%5/&.0G(c9"F?/v/A>-%5//A>"e#A%("e154*68/d%59".2':.:/<;N4t16# *Wp.:6#8z%5/A!#!c
1 .:"u w%('2BD168/H%5'2'"/&>? u %;^/A1@LaQ
?c u >"$#A!%(6SL@@.26H'2.:Bb.0/&$)e/&1@rjQyTvD/&>"m1(/&>"$#>"%(")b4t1(#
9".:M!1]G$M$/A.21L@^.:6mF?"68/&%(9"'2=4t1#m%('2' Y c u >"$#Az%5l6 *Wb#A!Bb%(.:"6Z.2"68.2)"=/&>"@F"".0/M$.2#8M!'2
4t1c# zx Y x aQ*Tv"vMz%5p6A>"1 u /&>"%5//A>"l LWK68/&%(9".:'2.:/<;e'2.2BD.:/*.:6%59J1Fj/ @4t1(#
%(':'M!1(BbC"':,io 4t1(# u >".2Md> w JS x{z?Q
QSR.SRUT $ `>4Al^k^U`1tF)ac\/i4kkT
':'|M$1]G!]/A.21-%5'|/&.:Bb<Bb%(#AMd>".:"qBD$/A>"1a)"6vC"#81j)"F?M!^%NC"#A.:"M!.:C-%('#A1a1(/v/A>-%5/W.:6G$#8;M$'2168
/&1 X 4t1(#p6ABb%('2'~G5%('2F"$6\1(4E Q {}>"!#8$4t1#8(cv1(/A>"9-%(68.26N1(4@/&>"C"#8.2"M$.2C-%5'#A1a1(/!cm/&>?
68/&%(9".:'2.:/<;b1(4|%EBb,/&>"1a)N/&>-%5/Z.:6}#A$aF?.2#A$)U/A1^#A!681':G(K%e/A#&%("68.2$/Z681'2Fj/&.21(N1G(!#m%E#A!'2%5/&.0G$':;
6A>?1#8/m/&.2BD@6AC-%(Bq%z;U9JK%qBD1j1(/~.:6A6AF?(QWaF"Md>Mz%(68!6W%5#Aw/<;aC".0+-!)9];\/&>?e_ }b%(")L@
BD$/&>?1j)"6 >"$/&>",;%5#Aw%(C"C"':.2!)\/&1q%b9".:M!1]G(!M$/A.21C"#A19?'2!BUQ}|.:6!Q Q5Mw%(") Q4y6A>"1
/&>"%5/m4t1(#~9lu 1(/A>BD$/&>?1j)"6}/A>"KC"#8.2"M$.2C-%5'R#A1a1(/Z4%('2':6}1F?/A6A.2)?@/A>"wF?".:/~M!.:#AM$'2@%(")o.26~F""68/&%(9"u':
4t1#m%('2' Y QZ~1 u $G(!#$cR.:4/&>"=/&#A%("6A.:!]/v681'2Fj/&.21(U154y.2]/&$#A$68/vM!%(9l@#A!681':G(!).:%D'2.2BD.:/A!)
F"Be9l!#*1(4l/&.:Bb76L/&$C"6H/A>-%5/H%(#8}6ABb%('2'j.2E/&>?~68!"68m154J/A>"}+-F"#8(c]/&>"Z$#A#A1(#yMz%(F"68!)b9;K/&>".:6
.2?68/d%59".2':.:/<;DBq%z;N9lW#A$'%5/A.:G(!':;qF"".:BbCl1#8/&%(]/zQS4/&>?w#81j1(/7>-%()\4%('2':!N.2?6A.2)?v/&>"=M!.:#AM$'2v/&>?
BD$/&>?1j) u 1F"':)>-%zGE9l!$)"!M$'%(#8!)6L/d%(9"':e9"F?/W%(!#8#A1#1(4y/&>"K6&%(BD D (-f a u 1F"':)
>-%zG~9l!!bM!1BDBD.:/A/A!)Rc8F"68/H.2E/A>"Z1C"Cl16A.0/&})".:#A!M,/&.:1RQ-1#/A>".26y#8z%(681b/A>"Z_}=%(")^/&>?
LweBD$/A>"1j)?6~>"%G(w9l1(/A>U9l!$F"68!)o.2\6A$#A.21(F"6ZaF"%(]/&.:/&%5/&.0G=68/AF")".:!6Z.2]G1(':Ga.2"^Cl!#8.21a)".2M
M!1(G(!M,/&.21(RQ{}>".26D.2")k1(4.2"6L/d%(9".:'2.0/<;h.26^#8$4t!#8#A$)g/&1%(6DBb.:'2)P.2?68/d%59".2':.:/<;I%(").:6^"1(/b%
6A$#A.:1F"6ZC"#A1(9"'2$BF"")?!#Z/&>"=M!.:#AM$F"Bb6L/d%(?M!!6Z)".:6AM$F"6A68!)RQ
qpsr|*Z,|vP?vr!Z}}e*|or }Z*utN*v @
h=-
d) Trapezoidal
h = 2/3
e) Gazdag
h=-2
f) RK2
g) RK4
h=-2.8
Diffusion
h= 2
Convection
mv*x"r!Z}Pryv*H
]kr|oHZ,|vP"r!Z}}e*|Urm}Z*ut*vmZz
68/&%(9".:'2.:/<;=4t1#y68Bq%5'2'?$"1F"(> Qy~1 u ,G!#$cj1(^/A>"Z9-%(68.26y1(4s/&>?~Bb%(?.:/&F?)"1(4l/&>?}M!1a$DM!.:!]/
.2e/A>"}'2!%()".:"v{%;a':1#6A$#A.:!6y!#8#A1#/A!#8Boc(/A>"$;K6AF?J!#$c#A!'2%5/&.0G$':;w6AClz%(.2?"c(4t#A1(B%(M$M!F"#A%(M$;(Q
-1#\%`.:G(!O%(Bb1(F"]/\1(4KM$1BDC"F?/d%/&.21(-%(' 1#8lcm/&>"1#8)"!#\1(4K%(M!M$F"#&%5M$;1(4@/&>?/ 1
/<;aCJ$6|.:6(!"$#&%(':':;v$F".:G5%(':!]/zc5%(")@68/&%(9".2':.:/<;#A!uF".:#A$Bb$/A6.:e7|V%(C"C?'2.2M!%5/&.:1"6R(!"$#&%(u ':':;
1G$#A#A.:)"W/&>" F"6AF"%('2'0;q68Bq%(':'fy.2"M$#A!%(6A=.2\%5M!M!F?#&%(M,;NC"#A1Ga.2)?!)\9];\%EM!1a$DM!.:!]/ u .:/A>U':1 u $#
Bb%(".0/&F")"5Q
p
QSR$RUT
mv*x"r!Z}Pryv*H
bDacb_^U`^ayb_4k$`>4Al^k&^`t0$`4AlkZ8 Z`XDals
}
Q0z
Q0 @
Q0]
x
6A,/m154|Z<68/&%(9"':W.2BDC"'2.:M!.:/BD$/&>?1j)"6}.:6}6A>"1 u o.2\{|%59"'2 QjQ
o,/&>"1a)
Tv#8)"!#
zz zz
S<BD{#AC"%(':Cl.2M!!.0/7!1(Xy.2)-F"%(':!' #
]kr|oHZ,|vP"r!Z}}e*|Urm}Z*ut*vmZz
~,/&F"#8".2?p/&1p/&>?E68/d%59".2':.:/<;N/&$68/=F"68.2"NCl168.:/&.0Ge#8z%('4tF""M,/&.21("6W1"eM!%(6A>"1 u /&>-%/=%
/ u 15<6L/&!C .:6 ] <68/&%(9"':W.:4|%(")\1"'0;p.:4
}
Q0
Q0 ]
zLx
Q0 ]
-1#+-#868/L<1#8)"!#@%(M$M!F"#A%(M$;(c/A>"E.2"$F-%('2.0/&.:!6 Q0 /A1 Q: \%(#8E'2$6A6=68/A#A.2?!]/W/&>"%( Q:zp/A1
Q0?Q*-1#}68!M!1(")j<1(#A)"$#%(M$M!F"#A%(M$;(cs>"1 u ,G!#$cl/A>"=C-%(#A%(Bb,/&$#A6 | %(#A=#8!'%/&!)\9];N/&>?
M!1(")".:/A.21
%(")\/&>?=/ u 1D6A$/A6m154|.:"!F-%(':.:/A.2!6#A$)"F"M!=/&1^/&>?@6A%(BDW6A$/ u >".:Md>o.:6
Q1 z]
x
Qj
OG(!#L;pM!1(G(!".:!]/ u %;b/&1eC?#A!68!]/}/&>?68/&%(9".:'2.:/<;^C?#A1Cl!#L/&.2$61(4%@/&.2BD,Bq%5#AMd>".:"wBD$/A>"1a)
.26E/A1IC"':1(/^/&>"U'21aM!F"6^1(4/&>"UM!1BDC"':,ig 4t1# u >".2Md> c768F"Md>/A>-%5/D/&>"U#A$6AF"'0/&.2?
M!1(/A1F"#e(1j$6K/&>"#81F">/&>"pCl1.:/E k zjQm$#A #8$4t!#86e/&1/A>"pBb%ij.2BeF?B%(9"6A1('2F?/A
G5%('2F?1(4l%5;c5C"#A.:"M!.:C-%('1#|68C"F"#8.21F"6$c5/A>-%5/.:6%~#A1a1(//A1/&>?Md>-%(#A%(M$/A!#8.268/A.2MCJ1'0;a"1BD.%('(4t1(#
jSg3&
zz
mv*x"r!Z}Pryv*H
I( h)
I( h)
I( h)
Stable
Unstable
Stable
R( h)
Stable
a) Euler Explicit
Unstable
R( h)
=0
b) Trapezoid Implicit
= 1/2
Unstable
c) Euler Implicit
R( h)
=1
W>h>%
S>
W
!
W#"W%$'&)(*
+,{
-
|/.01
2
>33
4>5-6
S>3:-7
8
!9:% +>
%
;>2
>:<A8:=13?> @{:A
6<B><@
W1<51C
D6EGFHE JILK=MON PMOQR
ST >
U -7VW=>
#
9-6
X
W>:TW
,Y
@Z!U% <- T[U% :- #\
!853 WeOe6H
%><8+
-=
]>: S" 6%{
^>_
>
` :
!
a
! W#W"
P
6-@e
c
b e
d >
, f -
fgYh'igYjlkOmCn*gVk2op4qsrJtvutGixwyoi{z|g4}sm
%>~:
+3>:>
2-6
S>
W@Z!U%-<<
! ](
>
+>
2BcT@B43P46]]9\,3BPs],l\
$Y
GW> /d>%
2
W
W]
m@Z!U%-<]
!8:
I( h)
3.0
RK4
Stable
Regions
RK3
2.0
RK2
1.0
RK1
R( h)
-3.0
-2.0
-1.0
S>^b>
W>
W>W`Pm8:=CT@
<
,4
\3s,|3P46]4P3)|,|sT
I(h)
I(h)
Stable Outside
2.0
Stable Outside
2.0
1.0
1.0
Unstable
2.0
1.0
3.0
R( h)
4.0
Unstable
1.0
2.0
R( h)
b) Adams Type
Wbh>%
S>
W 8-6
e
0 [:%m[U-:58
!<
:>
A'S
0SW CW
)>5-6 L,:
+
T
|\
\S]>
a'S
0SWH
)]~S W0S W
O
Z >~| 8T
<-6,T
@
yW=8 xW
9$Y&;|
c
yW
c>% G
O
Z :
S+5
~
>:
!80107S" >]>
U :
U ::
LS _
+5
1*:eUc
U 6W
01T
@
cCT@
%>>
[C:
0 01 &, 0 01 P
& 7
O P
.
1e-<0OY
1s>6
!8S_
l>P>
US
0 01
fgYh'igYjlkOmCn*gVkLugYhl}stGi{tg'h|0rvrmisrvotJwqBrvtJutGiAwyoi{zlg}sm
WC--7S 8 %
S
8
!
~U% <- _
|698
97;018-6
e
0 W=8S
S+5
%:1
)>S9:
+ %> /9
)6}39301~PWc
W8
. :!
W
:>:3T
S
@
v>
A8<Ss% A
>:m3>}1!*
W><P>9
!S"W
2UYW
X
U <1
W
0 01
.
& 7
+
Ss% } >
. 3(*m3W=% MON0FHI W
$ v +>
6?%
.
(*W=>#
~Y
W80S: s"S:: 2S,
C0O
W71U8{
WC
v<G>/d1V
.
TxsP,|8P46al)!W
I(h)
I(h)
3.0
3.0
2.0
Stable
only on
Imag Axis
Stable
2.0
1.0
1.0
-3.0
-2.0
R( h)
-1.0
R( h)
a) AM3
S>^>
W>
W> -
>#e
0 [:m~U8-<5T@
<
2@
L[T2\A77
A\7
!#"%$&('*)+$,.-0/'*
n
7ZY\[
ZYa` E [ HF A LI K M _^b` M [ R
A C aY ` E FHA ILK ^c` M F X] W D[
X] W _^ BA C W E
W
de.fHgh\iHjkmlXn opgqsrDtujvl,tufHwh\ituxmtuxyh\g0z%g{fx\tu|=jkyt}h~nx~nfTt}fthtunrnuHj+Hkg}jgfnfTt}f=fHthjx\nzvj
|=g{nt}fZ
\3s,|3P46]4P3)|,|sT
:0e#
,] W =[ 5-
[~
x
"S:: [e< 82-7~-av-
W
W!V\(
>L6~S>>
@Z!U> 6:
6<0+h08>e::A C ` E +>-=%+1 6U> 6 \<|8:
84ADC ` E
S]><V8-:pA CDE
A C ` E
<>#]-6%7S01
R
V
S]|8T<-6W=>#
( X
n .
>U>
C
;:
"S
Wx\U>:
!-: W#"W6T@
1<~
>:- 6:S W -6
e
WW=>#
<~21Sx >C17<k>C+
W::UY
%C-6
901
sU0S T
@e<6<0-
>#e
}
. ]OeW
6_
)yv.
T@
[
O [
D[
=[
=[
]W
T> ] W c ] W ] W
n X
T@
A ILK ` M
A ILK ` M
P T>
T@
Q>
-
O*T>'%
%
n d
{
+>
-= #C-6 6S A01C
Cx+7 >y2<,><
S<)01x ;
0W
> :]W=
#
~6W7<V
-=0S :
a
8
!%
s
"W::U8U>>xWe6U8*L8:
W1 <
O88T@
v q2gHf|Hj|=fHj9x\x~txmkjJHtuk\j9|Tt}fnSLyh\tuj|=g{ntuf#h\iHjz%g{f|=t}h\tugftxmgqLh\jfHkjx\jvfJh\j9|Qnx SG
G~a
d
]]3!W|s,9
@
T
[
D[
D[
D[
] W T> ] W ] W
(
%>]-7
c
n b
T@
F F O*T>
T>
vb#"v)~#)"%'*$./%yV
b_'S"v$,.
+5}
@Z8[U .
W]U> X6
W8
3A [U a>
U :
!<- 6>> 3W
T0>>
A @E#@N0OFHQ0=
<- <- 1X~1<- 6W
:T
c U8U -71
L
s>
+5
!8
[>~
>6>
U
~< AS]>
x-=S
:- C
1~
W
>C:>
U03
:m>H0W
> :0# ! <><@W
1<
a-:- 6V)(*#
@Z8-@ >T
?h
+ _07W" _
:6 >
H%'
lW
>>
U |" S
>:- 8
<0>
8S S" 6c1]{
[-:U-<
U 6-@e#W" S
(*1
+ `Z8T
>
~>
U 6<- 6>>
@Z8[U% 6{ :
>~
" %+UYW
A
]:- %<- A1:- 6
>A 6
#*>::- @eAU>
U :
-=<> 6 83>
U 61><3
|" S
-6
-6%
: 3S]>
U:- > <:- >
2L
-=0S 8
]
8
!2U
>:- >~1#;
Z F ? ? )+>
:
%1-6-6S
>>
9
9U
U 6>Z%3<!>~1e #Z~0
U >mS S0S WH
:%W6"1 6: ,a
1
+ @W" :<
9>B-7 >@Z!U% <- )% :)
!}\
:
m [W
\>eT
`
~S -=A<--6W
:>
%>|\<>]
+7 L
8: W
] -=-
>#e
:
2
^[\7sB]
>
n
b
\3s,|3P46]4P3)|,|sT
L ? ?
T>
n
S]>
: S 3~ [+7
>
U 1e]>3
: -71YW=
#
C
l% W
8~< B>
6 5
>:- T
Z 6
38LU0<- > <68:-
<8U'
: >
%
Ch
+ 07W"
1 W@
-6
>: 60W
@Z8[U% <8h
+ e
><- 6%>_
0W
W:J#
136
c0U8:>
[
1 [
X] W X
]W
7 [
1 [
T@
X
W X
W
D[
=[
]
]
X] W
Q>
X] W a
T@
Q>
n
6S>W::~
=[
[
] W O [ pe ] W D [
W
]
]W
]]3!W|s,9
%
%
9A ILK ` M
A ILK ` M
)
-
{\_T>'
S]>
%8e
L
l>0:01-m
- GO*Q>C
O*T>
S]><[S Y
B
,+>-=yS 2
S 6 >}>Wx
S]>a710Oa>_T@
QNK=MONYEGJEMONYFGFHI9@D6F
S]>5'
"S 6 | :6[4
!
\e ><O :- )h
+ T"ST
S^-6
>
#
:%T@
} >_ {YFHEK@EG -6
A>0Oe
A
'|S W>
W
X::U'
1e
AUY
# !8
T
<
S]>_U> -:+h_07"WU0S2
W>
]
K=MON*
@E@
@NK@I +%>_
W%WX,
Ss
x>
U :
W" 6<!1
+ m`Z8UL>::~#%!: 1 L9Ss7 !
W :%68 6-
:-@
aUS:!>-: 6e>J:0Oe
x+hS-@e01
"|>_1,>T[:--6
6\"S:W
~nu0
W>eT:#"11e#"W+h07"S
T@ ] W
[
]W
1 [
W =[
E ]
T@
=[
ELELE ] W
F=F=F
6U-:>y::~~!:Jm +#
T@?~T>
\y
> 08
T@
W =[
M M ] T
ELE
>y
T>
W =[
]
M
M
M
M
T@
T@
=[
ELELELE ] W
T>!
>
+><
W =[
@
T
T>
F=F=F
n.
=213;>y1
n.
\3s,|3P46]4P3)|,|sT
:- 8R:D@MOFHEK ,!:J |/. I 0@RD@MOFHEK ,S]|8*# T@m ~8T> H%-=
!
c+7 y1 ` ` E 6~S-6
:7<)>sJ:01
y+h%-@e0 ?:
"S2 y2T@
M 7"W{:|1e
<V
3[-
P{:01e
](
c-=?[-7
!:J [+
EANMO
QN0E 7MOR
CFHI%K=MON8@E@P@N0T)EGGG0x QvEMON?_@aMOQPMxMOFH W" W
]"1>:> ~
:6U : 6< ,S]>
_ 01
] [~S : 6LSB1 ^
. )(*b
T@y [1Q>
L -=
c+7 y1 ` ` E 6~S A-
:7<\>6
2a Q@:`<)>2
-6
We6:
h
+ S" :6<l>M
6
L-6
:S X
>Ce
9We6U?+>
-= ~
:_ W" <0O
[UY
X >x:>
c-6
>
1T>x -6
W
:>:
>
W`Pm
8LT
@
?
+
L>=% S
!*
W><L8>W@
m8
Q@
_0 W:_1S6
0
WL>
` M
T@
0 Wa :6-@
+#
E
3U8U>
7Z~1e
E
s
` E
` M
S]
:@W
M
T@
Q>
M
")[6$#
8:]>
0
+#
%
&%
(
'
@
+ *
?
'
+ *
-,X,]|T
J G
2>m:%W6"16]
.% >x9: -71U0-1OSW3\>01>We68
W=1_
%8e
S<ca
+
|6]>:
!e
L-07"W^LeTD<
v02> #eC~-6
>A
e:S1{
>e4-6
>
J]0/ ? ? 2143 {
~@) ] >>#@Z!U%-<)%:<W[U-:#lA8:<X[1-
W:-1T@!
<(
B><~-6 6G
< &; W
L
C:6U<)&y^ / W
d
2:6U<]& W
d
:6U~& W
:6U<
~U03 >_-
~
U 8ec:
8
2
+ #L^`Z8-a:7! %
% 8e
v-75a>>$81
8
W9>6 %><LT@
<T+0O[S2>@Z!U6-6
YW
8
c&%W
]W=>
#
#<%]
W> 68]-
:6+%>6 _'
W8<
] ]
M
M
M
.
Q>
a9
+5
1
WeUl <(*s
8<
x+01]"1 6
.
><0<V@?' !
:JV
b /d
|6
-W
6UY
*<_
: S" x$ y 6Oe
W
a>T
@
(
_
a*:=1 1A
< %CB:
W=% <
W](*: D<
d
\3s,|3P46]4P3)|,|sT
b]> #e9W !We
8=S>6 UU# |>C !
S><a-<6e<>-: 6-<
U8U>
7Z~1e
;
>%U01]:#"11e#"W>c[
>6-
J:01
+
U :
>-YW
80S: -6
8>
< D >
x3U8U >#Z%]
\8<80%><WX"1% >6
l
:U01e
U :1
S]1Z S" 6%0O]>$8 61e
W
]> !*W
><30[W
18W
WT
@
.$Y& %
$Y&
8 : ]
]:eU~W
\>a-6
9
01
C
1
W
:>:)<- 6e<6L-::- 1
> 8!
W
:>:301~PP:8W
Wy
UU%
>~
>6,> 8
y
J:0{
\L
U 61L >
VS
>%:01 :
8:]>
+Q,
>
+><
3>>-=~@Z!U%-:#@*S:-=>[
3+5
W->#=%
S
0 R
GO
> #e 0>~1e #Z8
=1
85W#"W%>6e ~
G >?>$
61e
WL> @Z!U%-<c <
<0> ' <W"1>:16
>6 <+01#>~OZ W
9
:]1
h
+ 62W
: [U8
1e-3:=1>
%
_<
BZ!U3L+ L>]>-::{
>W1
+ <a
[
U
% 6
,*
X:
S
~ <
Chapter 8
CHOICE OF TIME-MARCHING
METHODS
In this chapter we discuss considerations involved in selecting a time-marching method
for a specic application. Examples are given showing how time-marching methods
can be compared in a given context. An important concept underlying much of this
discussion is stiness, which is dened in the next section.
150
Stable
Region
h
R( h)
Accurate
Region
Figure 8.1: Stable and accurate regions for the explicit Euler method.
the homogeneous part, we exclude the forcing function from further discussion in this
section.
Consider now the form of the exact solution of a system of ODE's with a complete eigensystem. This is given by Eq. 6.27 and its solution using a one-root, timemarching method is represented by Eq. 6.28. For a given time step, the time integration is an approximation in eigenspace that is dierent for every eigenvector ~xm . In
many numerical applications the eigenvectors associated with the small jmj are well
resolved and those associated with the large jmj are resolved much less accurately,
if at all. The situation is represented in the complex h plane in Fig. 8.1. In this
gure the time step has been chosen so that time accuracy is given to the eigenvectors
associated with the eigenvalues lying in the small circle and stability without time
accuracy is given to those associated with the eigenvalues lying outside of the small
circle but still inside the large circle.
The whole concept of stiness in CFD arises from the fact that we often do
not need the time resolution of eigenvectors associated with the large jm j in
the transient solution, although these eigenvectors must remain coupled into
the system to maintain a high accuracy of the spatial resolution.
151
For the above reason it is convenient to subdivide the transient solution into two
parts. First we order the eigenvalues by their magnitudes, thus
j1j j2j jM j
(8.1)
Then we write
p
M
X
Transient = X
t
m
~
(8.2)
cm e xm +
cmem t ~xm
Solution
m
=1
m
=
p
+1
|
{z
}
{z
}
|
Driving
Parasitic
This concept is crucial to our discussion. Rephrased, it states that we can separate
our eigenvalue spectrum into two groups; one [1 ! p] called the driving eigenvalues
(our choice of a time-step and marching method must accurately approximate the time
variation of the eigenvectors associated with these), and the other, [p+1 ! M ], called
the parasitic eigenvalues (no time accuracy whatsoever is required for the eigenvectors
associated with these, but their presence must not contaminate the accuracy of the
complete solution). Unfortunately, we nd that, although time accuracy requirements
are dictated by the driving eigenvalues, numerical stability requirements are dictated
by the parasitic ones.
The following denitions are somewhat useful. An inherently stable set of ODE's is
sti if
In particular we dene the ratio
jpj jM j
Cr = jM j = jpj
and form the categories
Mildly-sti
Cr < 102
Strongly-sti
103 < Cr < 105
Extremely-sti 106 < Cr < 108
Pathologically-sti 109 < Cr
It should be mentioned that the gaps in the sti category denitions are intentional
because the bounds are arbitrary. It is important to notice that these denitions
make no distinction between real, complex, and imaginary eigenvalues.
152
Many
ow elds are characterized by a few regions having high spatial gradients of
the dependent variables and other domains having relatively low gradient phenomena.
As a result it is quite common to cluster mesh points in certain regions of space and
spread them out otherwise. Examples of where this clustering might occur are at a
shock wave, near an airfoil leading or trailing edge, and in a boundary layer.
One quickly nds that this grid clustering can strongly aect the eigensystem of
the resulting A matrix. In order to demonstrate this, let us examine the eigensystems
of the model problems given in Section 4.3.2. The simplest example to discuss relates
to the model diusion equation. In this case the eigenvalues are all real, negative
numbers that automatically obey the ordering given in Eq. 8.1. Consider the case
when all of the eigenvalues are parasitic, i.e., we are interested only in the converged
steady-state solution. Under these conditions, the stiness is determined by the ratio
M =1. A simple calculation shows that
2
4
4
x
2
;
= ;
1 = ; x2 sin 2(M + 1)
x2 2
4
2
M ; x2 sin 2 = ; 4x2
and the ratio is
2
4
M
+
1
M =1 x2 = 4
The most important information found from this example is the fact that the
stiness of the transient solution is directly related to the grid spacing. Furthermore,
in diusion problems this stiness is proportional to the reciprocal of the space mesh
size squared. For a mesh size M = 40, this ratio is about 680. Even for a mesh of
this moderate size the problem is already approaching the category of strongly sti.
For the biconvection model a similar analysis shows that
jM j = j1j 1x
Here the stiness parameter is still space-mesh dependent, but much less so than for
diusion-dominated problems.
We see that in both cases we are faced with the rather annoying fact that the more
we try to increase the resolution of our spatial gradients, the stier our equations tend
to become. Typical CFD problems without chemistry vary between the mildly and
strongly sti categories, and are greatly aected by the resolution of a boundary layer
since it is a diusion process. Our brief analysis has been limited to equispaced
!
153
problems, but in general the stiness of CFD problems is proportional to the mesh
intervals in the manner shown above where the critical interval is the smallest one in
the physical domain.
d~u = F~ (~u; t)
dt
At every time step we must evaluate the function F~ (~u; t) at least once. This function
is usually nonlinear, and its computation usually consumes the major portion of the
computer time required to make the simulation. We refer to a single calculation of the
vector F~ (~u; t) as a function evaluation and denote the total number of such evaluations
by Fev .
154
As mentioned above, the eciency of methods can be compared only if one accepts a
set of limiting constraints within which the comparisons are carried out. The follow
assumptions bound the considerations made in this Section:
1. The time-march method is explicit.
2. Implications of computer storage capacity and access time are ignored. In some
contexts, this can be an important consideration.
3. The calculation is to be time-accurate, must simulate an entire event which
takes a total time T , and must use a constant time step size, h, so that
T = Nh
where N is the total number of time steps.
du = ;u
dt
(8.3)
from t = 0 to T = ; ln(0:25) with u(0) = 1. Eq. 8.3 is obtained from our representative ODE with = ;1, a = 0. Since the exact solution is u(t) = u(0)e;t, this makes
the exact value of u at the end of the event equal to 0.25, i.e., u(T ) = 0:25. To the
constraints imposed above, let us set the additional requirement
The error in u at the end of the event, i.e., the global error, must be < 0:5%.
We judge the most ecient method as the one that satises these conditions and
has the fewest number of evaluations, Fev . Three methods are compared | explicit
Euler, AB2, and RK4.
First of all, the allowable error constraint means that the global error in the amplitude, see Eq. 6.48, must have the property:
155
where 1 is found from the characteristic polynomials given in Table 7.1. The results
shown in Table 8.1 were computed using a simple iterative procedure.
Method N
h
1 Fev Er
Euler 193 :00718 :99282 193 :001248 worst
AB2 16 :0866 :9172 16 :001137
RK4
2 :6931 :5012 8 :001195 best
Table 8.1: Comparison of time-marching methods for a simple dissipation problem.
In this example we see that, for a given global accuracy, the method with the
highest local accuracy is the most ecient on the basis of the expense in evaluating
Fev . Thus the second-order Adams-Bashforth method is much better than the rstorder Euler method, and the fourth-order Runge-Kutta method is the best of all. The
main purpose of this exercise is to show the (usually) great superiority of second-order
over rst-order time-marching methods.
Let us use as a basis for this example the study of homogeneous turbulence simulated
by the numerical solution of the incompressible Navier-Stokes equations inside a cube
with periodic boundary conditions on all sides. In this numerical experiment the
function evaluations contribute overwhelmingly to the CPU time, and the number of
these evaluations must be kept to an absolute minimum because of the magnitude of
the problem. On the other hand, a complete event must be established in order to
obtain meaningful statistical samples which are the essence of the solution. In this
case, in addition to the constraints given in Section 8.4.1, we add the following:
156
predictor-corrector methods. The presumption is, of course, that more ecient methods will result from the omission of the second function evaluation. An example is
the method of Gazdag, given in Section 6.8. Basically this is composed of an AB2
predictor and a trapezoidal corrector. However, the derivative of the fundamental
family is never found so there is only one evaluation required to complete each cycle.
The - relation for the method is shown as entry 10 in Table 7.1.
In order to discuss our comparisions we introduce the following denitions:
Let a k-evaluation method be dened as one that requires k evaluations of
F~ (~u; t) to advance one step using that method's time interval, h.
Let K represent the total number of allowable Fev .
Let h1 be the time interval advanced in one step of a one-evaluation method.
The Gazdag, leapfrog, and AB2 schemes are all 1-evaluation methods. The second
and fourth order RK methods are 2- and 4-evaluation methods, respectively. For a 1evaluation method the total number of time steps, N , and the number of evaluations,
K , are the same, one evaluation being used for each step, so that for these methods
h = h1 . For a 2-evaluation method N = K=2 since two evaluations are used for
each step. However, in this case, in order to arrive at the same time T after K
evaluations, the time step must be twice that of a one{evaluation method so h = 2h1.
For a 4-evaluation method the time interval must be h = 4h1 , etc. Notice that
as k increases, the time span required for one application of the method increases.
However, notice also that as k increases, the power to which 1 is raised to arrive
at the nal destination decreases; see the Figure below. This is the key to the true
comparison of time-march methods for this type of problem.
0
k=1 j
k = 2 j 2h1
k=4 j
4h1
uN
j [(h1 )]84
j [(2h1)]2
j [(4h1)]
Step sizes and powers of for k-evaluation methods used to get to the same value
of T if 8 evaluations are allowed.
In general, after K evaluations, the global amplitude and phase error for kevaluation methods applied to systems with pure imaginary -roots can be written1
Era = 1 ; j1(ik!h1 )jK=k
(8.4)
1
157
(8.5)
158
Using analysis such as this (and also considering the stability boundaries) the
RK4 method is recommended as a basic rst choice for any explicit time-accurate
calculation of a convection-dominated problem.
The ability of a numerical method to cope with stiness can be illustrated quite nicely
in the complex h plane. A good example of the concept is produced by studying
the Euler method applied to the representative equation. The transient solution is
un = (1 + h)n and the trace of the complex value of h which makes j1 + hj = 1
gives the whole story. In this case the trace forms a circle of unit radius centered at
(;1; 0) as shown in Fig. 8.1. If h is chosen so that all h in the ODE eigensystem
fall inside this circle the integration will be numerically stable. Also shown by the
small circle centered at the origin is the region of Taylor series accuracy. If some h
fall outside the small circle but stay within the stable region, these h are sti, but
stable. We have dened these h as parasitic eigenvalues. Stability boundaries for
some explicit methods are shown in Figs. 7.5 and 7.6.
For a specic example, consider the mildly sti system composed of a coupled
two-equation set having the two eigenvalues 1 = ;100 and 2 = ;1. If uncoupled
and evaluated in wave space, the time histories of the two solutions would appear as a
rapidly decaying function in one case, and a relatively slowly decaying function in the
other. Analytical evaluation of the time histories poses no problem since e;100t quickly
becomes very small and can be neglected in the expressions when time becomes large.
Numerical evaluation is altogether dierent. Numerical solutions, of course, depend
upon [(m h)]n and no jm j can exceed one for any m in the coupled system or else
the process is numerically unstable.
Let us choose the simple explicit Euler method for the time march. The coupled
equations in real space are represented by
(8.6)
We will assume that our accuracy requirements are such that sucient accuracy is
obtained as long as jhj 0:1. This denes a time step limit based on accuracy
considerations of h = 0:001 for 1 and h = 0:1 for 2 . The time step limit based
on stability, which is determined from 1, is h = 0:02. We will also assume that
c1 = c2 = 1 and that an amplitude less than 0.001 is negligible. We rst run 66
time steps with h = 0:001 in order to resolve the 1 term. With this time step the
159
2 term is resolved exceedingly well. After 66 steps, the amplitude of the 1 term
(i.e., (1 ; 100h)n) is less than 0.001 and that of the 2 term (i.e., (1 ; h)n) is 0.9361.
Hence the 1 term can now be considered negligible. To drive the (1 ; h)n term to
zero (i.e., below 0.001), we would like to change the step size to h = 0:1 and continue.
We would then have a well resolved answer to the problem throughout the entire
relevant time interval. However, this is not possible because of the coupled presence
of (1 ; 100h)n, which in just 10 steps at h = 0:1 amplies those terms by 109, far
outweighing the initial decrease obtained with the smaller time step. In fact, with
h = 0:02, the maximum step size that can be taken in order to maintain stability,
about 339 time steps have to be computed in order to drive e;t to below 0.001. Thus
the total simulation requires 405 time steps.
Now let us re-examine the problem that produced Eq. 8.6 but this time using an
unconditionally stable implicit method for the time march. We choose the trapezoidal
method. Its behavior in the h plane is shown in Fig. 7.4b. Since this is also a oneroot method, we simply replace the Euler with the trapezoidal one and analyze the
result. It follows that the nal numerical solution to the ODE is now represented in
real space by
n
1
;
50
h
u1(n) = c1 1 + 50h x11 + c2
!n
1
;
50
h
u2(n) = c1 1 + 50h x21 + c2
!
1 ; 0:5h nx + (PS )
1
1 + 0:5h 12
!
1 ; 0:5h nx + (PS )
2
1 + 0:5h 22
!
(8.7)
In order to resolve the initial transient of the term e;100t , we need to use a step size
of about h = 0:001. This is the same step size used in applying the explicit Euler
method because here accuracy is the only consideration and a very small step size
must be chosen to get the desired resolution. (It is true that for the same accuracy
we could in this case use a larger step size because this is a second-order method,
but that is not the point of this exercise). After 70 time steps the 1 term has
amplitude less than 0.001 and can be neglected. Now with the implicit method we
can proceed to calculate the remaining part of the event using our desired step size
h = 0:1 without any problem of instability, with 69 steps required to reduce the
amplitude of the second term to below 0.001. In both intervals the desired solution
is second-order accurate and well resolved. It is true that in the nal 69 steps one
-root is [1 ; 50(0:1)]=[1 + 50(0:1)] = 0:666 , and this has no physical meaning
whatsoever. However, its in
uence on the coupled solution is negligible at the end
of the rst 70 steps, and, since (0:666 )n < 1, its in
uence in the remaining 70
160
steps is even less. Actually, although this root is one of the principal roots in the
system, its behavior for t > 0:07 is identical to that of a stable spurious root. The
total simulation requires 139 time steps.
8.5.3 A Perspective
un = c11 (1 )n1 ~x1 + + cm1(m )n1 ~xm + + cM 1 (M )n1 ~xM + P:S:
+c12 (1)n2 ~x1 + + cm2 (m )n2 ~xm + + cM 2 (M )n2 ~xM
+c13 (1)n3 ~x1 + + cm3 (m )n3 ~xm + + cM 3 (M )n3 ~xM
+etc., if there are more spurious roots
(8.8)
When solving a steady problem, we have no interest whatsoever in the transient portion of the solution. Our sole goal is to eliminate it as quickly as possible. Therefore,
8.7. PROBLEMS
161
the choice of a time-marching method for a steady problem is similar to that for a
sti problem, the dierence being that the order of accuracy is irrelevant. Hence the
explicit Euler method is a candidate for steady diusion dominated problems, and
the fourth-order Runge-Kutta method is a candidate for steady convection dominated
problems, because of their stability properties. Among implicit methods, the implicit
Euler method is the obvious choice for steady problems.
When we seek only the steady solution, all of the eigenvalues can be considered to
be parasitic. Referring to Fig. 8.1, none of the eigenvalues are required to fall in the
accurate region of the time-marching method. Therefore the time step can be chosen
to eliminate the transient as quickly as possible with no regard for time accuracy.
For example, when using the implicit Euler method with local time linearization, Eq.
6.96, one would like to take the limit h ! 1, which leads to Newton's method, Eq.
6.98. However, a nite time step may be required until the solution is somewhat close
to the steady solution.
8.7 Problems
1. Repeat the time-march comparisons for diusion (Section 8.4.2) and periodic
convection (Section 8.4.3) using 2nd- and 3rd-order Runge-Kutta methods.
2. Repeat the time-march comparisons for diusion (Section 8.4.2) and periodic
convection (Section 8.4.3) using the 3rd- and 4th-order Adams-Bashforth methods. Considering the stability bounds for these methods (see problem 4 in
Chapter 7) as well as their memory requirements, compare and contrast them
with the 3rd- and 4th-order Runge-Kutta methods.
3. Consider the diusion equation (with = 1) discretized using 2nd-order central
dierences on a grid with 10 (interior) points. Find and plot the eigenvalues
and the corresponding modied wavenumbers. If we use the explicit Euler timemarching method what is the maximum allowable time step if all but the rst
two eigenvectors are considered parasitic? Assume that sucient accuracy is
obtained as long as jhj 0:1. What is the maximum allowable time step if all
but the rst eigenvector are considered parasitic?
162
Chapter 9
RELAXATION METHODS
In the past three chapters, we developed a methodology for designing, analyzing,
and choosing time-marching methods. These methods can be used to compute the
time-accurate solution to linear and nonlinear systems of ODE's in the general form
d~u = F~ (~u; t)
(9.1)
dt
which arise after spatial discretization of a PDE. Alternatively, they can be used to
solve for the steady solution of Eq. 9.1, which satises the following coupled system
of nonlinear algebraic equations:
F~ (~u) = 0
(9.2)
In the latter case, the unsteady equations are integrated until the solution converges
to a steady solution. The same approach permits a time-marching method to be used
to solve a linear system of algebraic equations in the form
A~x = ~b
(9.3)
To solve this system using a time-marching method, a time derivative is introduced
as follows
d~x = A~x ; ~b
(9.4)
dt
and the system is integrated in time until the transient has decayed to a suciently
low level. Following a time-dependent path to steady state is possible only if all of
the eigenvalues of the matrix A (or ;A) have real parts lying in the left half-plane.
Although the solution ~x = A; ~b exists as long as A is nonsingular, the ODE given by
Eq. 9.4 has a stable steady solution only if A meets the above condition.
1
163
164
The common feature of all time-marching methods is that they are at least rstorder accurate. In this chapter, we consider iterative methods which are not time
accurate at all. Such methods are known as relaxation methods. While they are
applicable to coupled systems of nonlinear algebraic equations in the form of Eq. 9.2,
our analysis will focus on their application to large sparse linear systems of equations
in the form
Ab~u ; ~f b = 0
(9.5)
where Ab is nonsingular, and the use of the subscript b will become clear shortly. Such
systems of equations arise, for example, at each time step of an implicit time-marching
method or at each iteration of Newton's method. Using an iterative method, we seek
to obtain rapidly a solution which is arbitrarily close to the exact solution of Eq. 9.5,
which is given by
~u1 = A;b ~f b
(9.6)
1
CAb~u ; C~f b = 0
(9.7)
(9.8)
165
conditioning matrix C must be chosen such that this requirement is satised. A
choice of C which ensures this condition is the negative transpose of Ab.
For example, consider a spatial discretization of the linear convection equation
using centered dierences with a Dirichlet condition on the left side and no constraint
on the right side. Using a rst-order backward dierence on the right side (as in
Section 3.6), this leads to the approximation
82
>
>
66 ;01 10 1
>
<6
;1 0 1
x~u = 21 x >66
64
>
;1 0
>
:
;2
39
>
77>
>
77=
77>
5>
>
0 ;
3 2
77 66 ;0ua
77 ~ 66
77 u + 66 0
15 4 0
2
(9.9)
The matrix in Eq. 9.9 has eigenvalues whose imaginary parts are much larger than
their real parts. It can rst be conditioned so that the modulus of each element is 1.
This is accomplished using a diagonal preconditioning matrix
2
66 10
6
D = 2x 66 0
64 0
0
1
0
0
0 0
0
0
1
0
0
0
0
0
1
0
0
0
0
0
1
2
3
77
77
77
5
(9.10)
which scales each row. We then further condition with multiplication by the negative
transpose. The result is
A = ;AT A =
2
2
66 ;10 10 1
66
;1 0
66
;1
4
32
77 66 ;10 10 1
77 66
;1 0
77 66
154
;1
1
0
;1 ;1
2
66 ;10 ;20 10 1
6
= 66 1 0 ;2 0
64
1 0 ;2
1
3
77
7
1 77
1 75
1 ;2
1
0
;1
3
77
77
7
1 75
1
(9.11)
166
2
66 00
66
66 0
40
1
0
0
0
1 0
0
0
0
1
0
0
1
0
0
0
32
32
2
66 ;21 ;21 1
6
1 ;2 1
= 66
64
1 ;2
3
77
77
7
1 75
0 7 6 ;1 0 1
77 66
0 77 66 0 ;2 0 1
76
1 77 66 1 0 ;2 0 1 77 66
0 75 64
1 0 ;2 1 75 64
0
1 1 ;2
0
1
0
0
0
0
0
0
1
0
0
0
0
0
1
0
0
1
0
0
17
0 77
0 77
0 75
0
(9.12)
1 ;1
which has all negative real eigenvalues, as given in Appendix B. Thus even when
the basic matrix Ab has nearly imaginary eigenvalues, the conditioned matrix ;ATb Ab
is nevertheless symmetric negative denite (i.e., symmetric with negative real eigenvalues), and the classical relaxation methods can be applied. We do not necessarily
recommend the use of ;ATb as a preconditioner; we simply wish to show that a broad
range of matrices can be preconditioned into a form suitable for our analysis.
A~ ; ~f = 0
(9.13)
where A is symmetric negative denite. The symbol for the dependent variable has
been changed to as a reminder that the physics being modeled is no longer time
2
A permutation matrix (dened as a matrix with exactly one 1 in each row and column and has
the property that P T = P ;1 ) just rearranges the rows and columns of a matrix.
2 We use a symmetric negative denite matrix to simplify certain aspects of our analysis. Relaxation methods are applicable to more general matrices. The classical methods will usually converge
if Ab is diagonally dominant, as dened in Appendix A.
1
167
accurate when we later deal with ODE formulations. Note that the solution of Eq.
9.13, ~ = A; ~f , is guaranteed to exist because A is nonsingular. In the notation of
Eqs. 9.5 and 9.7,
1
(9.15)
@ u = g(x)
(9.16)
@x
which is the one-dimensional form of the Poisson equation. Introducing the threepoint central dierencing scheme for the second derivative with Dirichlet boundary
conditions, we nd
2
Ab = 1 B (1; ;2; 1)
x
f~b = ~g ; (b~c)
(9.18)
Choosing C = x I , we obtain
B (1; ;2; 1)~ = ~f
(9.19)
where ~f = x f~b. If we consider a Dirichlet boundary condition on the left side and
either a Dirichlet or a Neumann condition on the right side, then A has the form
A = B 1; ~b; 1
2
168
We will consider relaxation methods which can be expressed in the following delta
form:
h
i
H ~n ; ~n = A~n ; ~f
(9.21)
where H is some nonsingular matrix which depends upon the iterative method. The
matrix H is independent of n for stationary methods and is a function of n for
nonstationary ones. The iteration count is designated by the subscript n or the
superscript (n). The converged solution is designated ~1 so that
+1
~1 = A; ~f
(9.22)
+1
where
(9.23)
G I + H; A
(9.24)
Hence it is clear that H should lead to a system of equations which is easy to solve,
or at least easier to solve than the original system. The error at the nth iteration is
dened as
~en ~n ; ~1 = ~n ; A; ~f
(9.25)
1
169
where ~1 was dened in Eq. 9.22. The residual at the nth iteration is dened as
~rn A~n ; ~f
(9.26)
Multiply Eq. 9.25 by A from the left, and use the denition in Eq. 9.26. There results
the relation between the error and the residual
A~en ; ~rn = 0
(9.27)
Finally, it is not dicult to show that
~en = G~en
(9.28)
+1
Consequently, G is referred to as the basic iteration matrix, and its eigenvalues, which
we designate as m , determine the convergence rate of a method.
In all of the above, we have considered only what are usually referred to as stationary processes in which H is constant throughout the iterations. Nonstationary
processes in which H (and possibly C ) is varied at each iteration are discussed in
Section 9.5.
( )
1
( )
+1
( +1)
+1
( +1)
( +1)
1
+1
( )
+1
170
is based on the idea that if the correction produced by the Gauss-Seidel method tends
to move the solution toward ~1, then perhaps it would be better to move further in
this direction. It is usually expressed in two steps as
h
i
~j = 21 jn; + jn ; fj
h
i
jn = jn + ! ~j ; jn
(9.32)
( +1)
1
( +1)
( )
+1
( )
( )
where ! generally lies between 1 and 2, but it can also be written in the single line
jn = !2 jn; + (1 ; !)jn + !2 jn ; !2 fj
(9.33)
( +1)
( +1)
1
( )
( )
+1
The general form of the classical methods is obtained by splitting the matrix A in
Eq. 9.13 into its diagonal, D, the portion of the matrix below the diagonal, L, and
the portion above the diagonal, U , such that
A=L+D+U
(9.34)
Then the point-Jacobi method is obtained with H = ;D, which certainly meets
the criterion that it is easy to solve. The Gauss-Seidel method is obtained with
H = ;(L + D), which is also easy to solve, being lower triangular.
The particular type of delta form given by Eq. 9.21 leads to an interpretation of
relaxation methods in terms of solution techniques for coupled rst-order ODE's,
about which we have already learned a great deal. One can easily see that Eq. 9.21
results from the application of the explicit Euler time-marching method (with h = 1)
to the following system of ODE's:
~
H ddt = A~ ; ~f
(9.35)
This is equivalent to
d~ = H ; C A ~ ; ~f = H ; [A~ ; ~f ]
(9.36)
b
b
dt
1
171
~1 = A; ~f
1
(9.38)
which is the solution of Eq. 9.13. We see that the goal of a relaxation method is to
remove the transient solution from the general solution in the most ecient way possible. The eigenvalues are xed by the basic matrix in Eq. 9.36, the preconditioning
matrix in 9.7, and the secondary conditioning matrix in 9.35. The eigenvalues are
xed for a given h by the choice of time-marching method. Throughout the remaining discussion we will refer to the independent variable t as \time", even though no
true time accuracy is involved.
In a stationary method, H and C in Eq. 9.36 are independent of t, that is, they
are not changed throughout the iteration process. The generalization of this in our
approach is to make h, the \time" step, a constant for the entire iteration.
Suppose the explicit Euler method is used for the time integration. For this method
m = 1 + mh. Hence the numerical solution after n steps of a stationary relaxation
method can be expressed as (see Eq. 6.28)
172
The three iterative procedures dened by Eqs. 9.30, 9.31 and 9.32 obey no apparent
pattern except that they are easy to implement in a computer code since all of the
data required to update the value of one point are explicitly available at the time
of the update. Now let us study these methods as subsets of ODE as formulated in
Section 9.3.1. Insert the model equation 9.29 into the ODE form 9.35. Then
~
H ddt = B (1; ;2; 1)~ ; ~f
(9.40)
As a start, let us use for the numerical integration the explicit Euler method
n = n + h0n
(9.41)
with a step size, h, equal to 1. We arrive at
H (~n ; ~n) = B (1; ;2; 1)~n ; ~f
(9.42)
+1
+1
It is clear that the best choice of H from the point of view of matrix algebra is
;B (1; ;2; 1) since then multiplication from the left by ;B ; (1; ;2; 1) gives the correct answer in one step. However, this is not in the spirit of our study, since multiplication by the inverse amounts to solving the problem by a direct method without
iteration. The constraint on H that is in keeping with the formulation of the three
methods described in Section 9.2.3 is that all the elements above the diagonal (or
below the diagonal if the sweeps are from right to left) are zero. If we impose this
constraint and further restrict ourselves to banded tridiagonals with a single constant
in each band, we are led to
B (;; !2 ; 0)(~n ; ~n) = B (1; ;2; 1)~n ; ~f
(9.43)
where and ! are arbitrary. With this choice of notation the three methods presented
in Section 9.2.3 can be identied using the entries in Table 9.1.
1
+1
0
1
1
Method
1
Point-Jacobi
1
h
i Gauss-Seidel
2= 1 + sin M + 1 Optimum SOR
Equation
6:2:3
6:2:4
6:2:5
173
The fact that the values in the tables lead to the methods indicated can be veried
by simple algebraic manipulation. However, our purpose is to examine the whole
procedure as a special subset of the theory of ordinary dierential equations. In this
light, the three methods are all contained in the following set of ODE's
d~ = B ; (;; 2 ; 0)B (1; ;2; 1)~ ; ~f
(9.44)
dt
!
and appear from it in the special case when the explicit Euler method is used for its
numerical integration. The point operator that results from the use of the explicit
Euler scheme is
!
!h n ! !h
!
!
n
n
n
n
j = 2 j; + 2 (h ; )j; ; (!h ; 1)j + 2 j ; 2 fj(9.45)
1
( +1)
( +1)
1
( )
1
( )
( )
+1
174
Given our assumption that the component of the error associated with each eigenvector is equally likely to be excited, the asymptotic convergence rate is determined
by the eigenvalue m of G ( I + H ; A) having maximum absolute value. Thus
1
(9.50)
In this section, we use the ODE analysis to nd the convergence rates of the three
classical methods represented by Eqs. 9.30, 9.31, and 9.32. It is also instructive to
inspect the eigenvectors and eigenvalues in the H ; A matrix for the three methods.
This amounts to solving the generalized eigenvalue problem
A~xm = m H~xm
(9.51)
1
(9.52)
The generalized eigensystem for simple tridigonals is given in Appendix B.2. The
three special cases considered below are obtained with a = 1, b = ;2, c = 1, d = ; ,
e = 2=!, and f = 0. To illustrate the behavior, we take M = 5 for the matrix order.
This special case makes the general result quite clear.
175
For M = 40, we obtain jmjmax = 0:9971. Thus after 500 iterations the error content
associated with each eigenvector is reduced to no more than 0.23 times its initial level.
Again from Appendix B.1, the eigenvectors of H ; A are given by
~xj = (xj )m = sin j m ; j = 1; 2; : : : ; M
(9.55)
M +1
This is a very \well-behaved" eigensystem with linearly independent eigenvectors and
distinct eigenvalues. The rst 5 eigenvectors are simple sine waves. For M = 5, the
eigenvectors can be written as
1
2 1=2 3
2 3
2 p3=2 3
p
p
66 3=2 77
66 10 77
66 3=2 77
~x = 666 p 1 777 ; ~x = 666 p0 777 ; ~x = 666 ;1 777 ;
64 3=2 75
64 0 75
64 ; 3=2 75
p
1
1=2
; 3=2
3
2 p
3
2
3=2
1=2
p
p
66 ; 3=2 77
66 ; 3=2 77
6
7
~x = 66 p 0 77 ; ~x = 666 p1 777
64 3=2 75
64 ; 3=2 75
p
1=2
; 3=2
1
(9.56)
= ;1 + 23 = ;0:134
= ;1 + 12 = ;0:5
=
;1 = ;1:0
1
(9.57)
= ;1 ; 12 = ;1:5
4
= ;1 ; 23 = ;1:866
From Eq. 9.39, the numerical solution written in full is
p
~n ; ~1 = c [1 ; (1 ; 3 )h]n~x
2
1
+ c [1 ; (1 ; 2 )h]n~x
5
176
1.0
h = 1.0
m=1
m=5
m
m=4
m=2
=5
m=3
0.0
-2.0
0.0
-1.0
)h]n~x
+ c [1 ; (1 + 12 )h]n~x
p
+ c [1 ; (1 + 23 )h]n~x
4
(9.58)
(9.59)
which can be studied using the results in Appendix B.2. One can show that the H ; A
matrix for the Gauss-Seidel method, AGS , is
1
1.0
h < 1.0
De
ng
cr
si
ea
ea
si
cr
ng
De
0.0
-2.0
0.0
-1.0
mh
1.0
h > 1.0
In
cr
ea
si
ng
ng
si
ea
cr
In
M = 5
0.0
-2.0
-1.0
0.0
mh
177
principal vectors. The equation for the nondefective eigenvalues in the ODE matrix
is (for odd M )
M +1
)
;
m
=
1
;
2
;
:
:
:
;
(9.61)
m = ;1 + cos ( Mm
+1
2
and the corresponding eigenvectors are given by
j; m
M +1
~xm = cos m
sin
j
;
m
=
1
;
2
;
:
:
:
;
(9.62)
M +1
M +1
2
The - relation for h = 1, the optimum stationary case, is shown in Fig. 9.4. The
m with the largest amplitude is obtained with m = 1. Hence the convergence rate is
(9.63)
jm jmax = cos M + 1
Since this is the square of that obtained for the Point-Jacobi method, the error associated with the \worst" eigenvector is removed in half as many iterations. For M = 40,
jm jmax = 0:9942. 250 iterations are required to reduce the error component of the
worst eigenvector by a factor of roughly 0.23.
The eigenvectors are quite unlike the Point-Jacobi set. They are no longer symmetrical, producing waves that are higher in amplitude on one side (the updated side)
than they are on the other. Furthermore, they do not represent a common family for
dierent values of M .
The Jordan canonical form for M = 5 is
2
2 h~ i
66 h~ i
66
;
6
X AGS X = JGS = 6
66
4
1
3
77
2~
3 777
66 ~1
77 777
1 55
4
~
3
(9.64)
179
h = 1.0
m
=5
2 defective m
0.0
-2.0
0.0
-1.0
mh
2
3
2 p
3
2 3
2 3
2 3
3
=
2
1
=
2
1
0
66 3=4 77
66 p3=4 77
66 0 77
66 2 77
66 00 77
~x = 666 3=4 777 ; ~x = 666 p0 777 ; ~x = 666 0 777 ; ~x = 666 ;1 777 ; ~x = 666 4 777 (9.65)
64 9=16 75
64 ; 3=16 75
64 0 75
64 0 75
64 ;4 75
p
9=32
0
0
1
; 3=32
1
= ;1=4
= ;3=4
) = ;1
(4)
Defective, linked to
(5)
Jordan block
The numerical solution written in full is thus
~n ; ~1 = c (1 ; h )n~x
4
3
+ c (1 ; 4h )n~x
1
2
3
(9.66)
180
+ c (1 ; h)n~x
5
1!
(9.67)
If = 1 and 2=! = x in Eq. 9.44, the ODE matrix is B ; (;1; x; 0)B (1; ;2; 1).
One can show that this can be written in the form given below for M = 5. The
generalization to any M is fairly clear. The H ; A matrix for the SOR method,
ASOR B ; (;1; x; 0)B (1; ;2; 1), is
1
2
x
0
0
66 ;2;x2x+ x
x
0
1 66 ;2x + x x x; 2;x2x+ x
x
;
2
x
x
x 664 ;2x + x x ; 2x + x x ; 2x + x
x ; 2x
;2 + x 1 ; 2x + x x ; 2x + x x ; 2x + x x
4
0
0
0
x
; 2x
3
77
77
77 (9.68)
5
m = ;1 +
!pm + zm
2
; m = 1; 2; : : : M
(9.69)
where
zm = [4(1 ; !) + ! pm] =
pm = cos[m=(M + 1)]
2 2
1 2
2 2
1
181
One can easily show that the optimum ! for the stationary case is
!opt = 2= 1 + sin M + 1
and for ! = !opt
m = m ; 1
~xm = mj; sin j m
M +1
(9.70)
(9.71)
where
q
!
opt
m = 2 pm + i p ; pm
Using the explicit Euler method to integrate the ODE's, m = 1 ; h + hm , and if
h = 1, the optimum value for the stationary case, the - relation reduces to that
shown in Fig. 9.5. This illustrates the fact that for optimum stationary SOR all the
jm j are identical and equal to !opt ; 1. Hence the convergence rate is
jm jmax = !opt ; 1
(9.72)
!opt = 2= 1 + sin M + 1
2
1
For M = 40, jmjmax = 0:8578. Hence the worst error component is reduced to less
than 0.23 times its initial value in only 10 iterations, much faster than both GaussSeidel and Point-Jacobi. In practical applications, the optimum value of ! may have
to be determined by trial and error, and the benet may not be as great.
For odd M , there are two real eigenvectors and one real principal vector. The
remaining linearly independent eigenvectors are all complex. For M = 5 they can be
written
2
3
2 3
2 p3(1
3
2
3
)=2
1
=
2
;
6
1
p
p
66 1=2 77
66 9 77
66 3(1 i 2)=6 77
66 0 77
6
7
6
7
6
7
~x = 66 1=3 77 ; ~x = 66 16 77 ; ~x ; = 66 p
77 ; ~x = 666 1=3 777 (9.73)
0p
64 1=6 75
64 13 75
64 3(5 i 2)=54 75
64 0 75
p
p
1=18
6
1=9
3(7 4i 2)=162
The corresponding eigenvalues are
= ;2=3
(2)
Defectiveplinked to
= ;(10 ; 2p2i)=9
= ;(10 + 2 2i)=9
= ;4=3
(9.74)
1
34
182
1.0
h = 1.0
2 real defective m
2 complex m
1 real m
=5
0.0
-2.0
0.0
-1.0
mh
~n ; ~1 =
+
+
+
+
(9.75)
183
N
N
~N = c ~x Y (1 + hn ) + + cm~xm Y (1 + mhn )
1
n=1
+ + cM ~xM
N
Y
n=1
n=1
(1 + M hn ) + ~1
(9.76)
where the symbol stands for product. Since hn can now be changed at each step,
the error term can theoretically be completely eliminated in M steps by taking hm =
;1=m , for m = 1; 2; ; M . However, the eigenvalues m are generally unknown and
costly to compute. It is therefore unnecessary and impractical to set hm = ;1=m
for m = 1; 2; : : : ; M . We will see that a few well chosen h's can reduce whole clusters
of eigenvectors associated with nearby 's in the m spectrum. This leads to the
concept of selectively annihilating clusters of eigenvectors from the error terms as
part of a total iteration process. This is the basis for the multigrid methods discussed
in Chapter 10.
Let us consider the very important case when all of the m are real and negative (remember that they arise from a conditioned matrix so this constraint is not
unrealistic for quite practical cases). Consider one of the error terms taken from
M
N
~eN ~N ; ~1 = X cm~xm Y (1 + mhn)
m=1
n=1
(9.77)
N
Y
n=1
(1 + m hn)
(9.78)
(9.79)
b a
(9.80)
184
TN 2 ; ;a ; b
a
b !
(Pe)N () =
TN ;a;;b
a
b
(9.81)
where
(9.82)
q
N 1 q
N
1
TN (y) = 2 y + y ; 1 + 2 y ; y ; 1
(9.83)
are the Chebyshev polynomials for jyj > 1. In relaxation terminology this is generally
referred to as Richardson's method, and it leads to the nonstationary step size choice
given by
2
"
#)
(9.84)
Remember that all are negative real numbers representing the magnitudes of m in
an eigenvalue spectrum.
The error in the relaxation process represented by Eq. 9.76
is expressed in terms
Q
~
of a set of eigenvectors, xm , amplied by the coecients cm (1 + m hn). With each
eigenvector there is a corresponding eigenvalue. Eq. 9.84 gives us the best choice of a
series of hn that will minimize the amplitude of the error carried in the eigenvectors
associated with the eigenvalues between b and a .
As an example for the use of Eq. 9.84, let us consider the following problem:
Minimize the maximum error associated with the eigenvalues in the
interval ;2 ;1 using only 3
iterations.
The three values of h which satisfy this problem are
"
#!
(9.85)
(9.86)
185
(9.87)
n p
p o
T (3) = [3 + 8] + [3 ; 8] =2 99
(9.88)
where
A plot of Eq. 9.87 is given in Fig. 9.6 and we see that the amplitudes of all the
eigenvectors associated with the eigenvalues in the range ;2 ;1 have been
reduced to less than about 1% of their initial values. The values of h used in Fig. 9.6
are
h = 4=(6 ; 3)
h = 4=(6 ; p
0)
h = 4=(6 + 3)
1
2
3
Return now to Eq. 9.76. This was derived from Eq. 9.37 on the condition that the
explicit Euler method, Eq. 9.41, was used to integrate the basic ODE's. If instead
the implicit trapezoidal rule
n = n + 21 h(0n + 0n)
(9.89)
0 1
1
M
N 1 + hn m C
~N = X cm~xm Y B
CA + ~1
B@ 2
1
m
n
1 ; 2 hnm
(9.90)
+1
+1
=1
=1
would result. This calls for a study of the rational \trapezoidal" polynomial, Pt:
0 1 1
N
Y B 1 + 2 hn CC
(Pt )N () = B
(9.91)
@ 1 A
n
1 ; 2 hn
under the same constraints as before, namely that
=1
b a
(9.92)
186
1
0.9
0.8
0.7
(Pe )3 ()
0.6
0.5
0.4
0.3
0.2
0.1
0
2
1.8
1.6
1.4
1.2
0.8
0.6
0.4
0.2
0.8
0.6
0.4
0.2
0.02
0.015
0.01
e 3
(P ) ()
0.005
0.005
0.01
0.015
0.02
2
1.8
1.6
1.4
1.2
9.6. PROBLEMS
187
The optimum values of h can also be found for this problem, but we settle here for
the approximation suggested by Wachspress
2 = ; a n; = N ; ; n = 1; 2; ; N
(9.93)
b
hn
b
This process is also applied to problem 9.85. The results for (Pt) () are shown in
Fig. 9.7. The error amplitude is about 1/5 of that found for (Pe) () in the same
interval of . The values of h used in Fig. 9.7 are
h = 1p
h = 2
h = 2
(
1) (
1)
1
2
9.6 Problems
1. Given a relaxation method in the form
H ~n = A~n ; f~
show that
where G = I + H ; A.
2. For a linear system of the form (A + A )x = b, consider the iterative method
1
(I + A )~x = (I ; A )xn + b
(I + A )xn = (I ; A )~x + b
where is a parameter. Show that this iterative method can be written in the
form
H (xk ; xk ) = (A + A )xk ; b
1
+1
+1
188
1
0.9
0.8
0.7
t 3
(P ) ()
0.6
0.5
0.4
0.3
0.2
0.1
0
2
1.8
1.6
1.4
1.2
0.8
0.6
0.4
0.2
0.8
0.6
0.4
0.2
x 10
1.5
(Pt )3 ()
0.5
0.5
1.5
2
2
1.8
1.6
1.4
1.2
9.6. PROBLEMS
189
@ u ; 6x = 0
@x
For the initial condition, use u(x) = 0. Use second-order centered dierences
on a grid with 40 cells (M = 39). Iterate to steady state using
(a) the point-Jacobi method,
(b) the Gauss-Seidel method,
(c) the SOR method with the optimum value of !, and
(d) the 3-step Richardson method derived in Section 9.5.
Plot the solution after the residual is reduced by 2, 3, and 4 orders of magnitude. Plot the logarithm of the L -norm of the residual vs. the number of
iterations. Determine the asymptotic convergence rate. Compare with the theoretical asymptotic convergence rate.
2
190
Chapter 10
MULTIGRID
The idea of systematically using sets of coarser grids to accelerate the convergence of
iterative schemes that arise from the numerical solution to partial dierential equations was made popular by the work of Brandt. There are many variations of the
process and many viewpoints of the underlying theory. The viewpoint presented here
is a natural extension of the concepts discussed in Chapter 9.
10.1 Motivation
10.1.1 Eigenvector and Eigenvalue Identication with Space
Frequencies
Consider the eigensystem of the model matrix B (1; ;2; 1). The eigenvalues and
eigenvectors are given in Sections 4.3.2 and 4.3.3, respectively. Notice that as the
magnitudes of the eigenvalues increase, the space-frequency (or wavenumber) of the
corresponding eigenvectors also increase. That is, if the eigenvalues are ordered such
that
j j j j jM j
1
(10.1)
then the corresponding eigenvectors are ordered from low to high space frequencies.
This has a rational explanation from the origin of the banded matrix. Note that
@ sin(mx) = ;m sin(mx)
(10.2)
@x
and recall that
(10.3)
xx~ = 1x B (1; ;2; 1)~ = X 1x D(~) X ; ~
191
2
192
where D(~) is a diagonal matrix containing the eigenvalues. We have seen that
X ; ~ represents a sine transform, and X ~, a sine synthesis. Therefore, the operation 1x D(~) represents the numerical approximation of the multiplication of the
appropriate sine wave by the negative square of its wavenumber, ;m . One nds
that
1 = M + 1 ;2 + 2 cos m ;m ; m << M
(10.4)
M +1
x m
Hence, the correlation of large magnitudes of m with high space-frequencies is to be
expected for these particular matrix operators. This is consistent with the physics of
diusion as well. However, this correlation is not necessary in general. In fact, the
complete counterexample of the above association is contained in the eigensystem
for B ( 21 ; 1; 12 ). For this matrix one nds, from Appendix B, exactly the opposite
behavior.
1
193
basic properties. This form can be arrived at \naturally" by simply replacing the
derivatives in the PDE with dierence schemes, as in the example given by Eq. 3.27,
or it can be \contrived" by further conditioning, as in the examples given by Eq. 9.11.
The basic assumptions required for our description of the multigrid process are:
1. The problem is linear.
2. The eigenvalues, m , of the matrix are all real and negative.
3. The m are fairly evenly distributed between their maximum and minimum
values.
4. The eigenvectors associated with the eigenvalues having largest magnitudes can
be correlated with high frequencies on the dierencing mesh.
5. The iterative procedure used greatly reduces the amplitudes of the eigenvectors
associated with eigenvalues in the range between 21 jjmax and jjmax.
These conditions are sucient to ensure the validity of the process described next.
Having preconditioned (if necessary) the basic nite dierencing scheme by a procedure equivalent to the multiplication by a matrix C , we are led to the starting
formulation
C [Ab~1 ; ~f b ] = 0
(10.5)
where the matrix formed by the product CAb has the properties given above. In Eq.
10.5, the vector ~f b represents the boundary conditions and the forcing function, if
any, and ~1 is a vector representing the desired exact solution. We start with some
initial guess for ~1 and proceed through n iterations making use of some iterative
process that satises property 5 above. We do not attempt to develop an optimum
procedure here, but for clarity we suppose that the three-step Richardson method
illustrated in Fig. 9.6 is used. At the end of the three steps we nd ~r, the residual,
where
~r = C [Ab~ ; ~f b]
(10.6)
Recall that the ~ used to compute ~r is composed of the exact solution ~1 and the
error ~e in such a way that
A~e ; ~r = 0
(10.7)
where
A CAb
(10.8)
194
If one could solve Eq. 10.7 for ~e then
~1 = ~ ; ~e
(10.9)
Thus our goal now is to solve for ~e. We can write the exact solution for ~e in terms of
the eigenvectors of A, and the eigenvalues of the Richardson process in the form:
M=
M
~e = X cm~xm Y [(m hn)] + X cm~xm Y [(mhn)]
2
m=1
n=1
n=1
m=M=2+1
{z
(10.10)
Combining our basic assumptions, we can be sure that the high frequency content of
~e has been greatly reduced (about 1% or less of its original value in the initial guess).
In addition, assumption 4 ensures that the error has been smoothed.
Next we construct a permutation matrix which separates a vector into two parts,
one containing the odd entries, and the other the even entries of the original vector
(or any other appropriate sorting which is consistent with the interpolation approximation to be discussed below). For a 7-point example
2
66
66
66
66
66
64
e
e
e
e
e
e
e
2
4
6
1
3
5
3 2
77 66
77 66
77 66
77 = 66
77 66
75 64
0
0
0
1
0
0
0
1
0
0
0
0
0
0
0
0
0
0
1
0
0
0
1
0
0
0
0
0
0
0
0
0
0
1
0
32
0
0
1
0
0
0
0
0 76
0 77 66
0 77 66
0 777 666
0 77 66
0 75 64
1
e
e
e
e
e
e
e
1
2
3
4
5
6
3
77
77 " #
77
~
77 ; ~ee = P ~e
eo
77
75
(10.11)
Multiply Eq. 10.7 from the left by P and, since a permutation matrix has an inverse
which is its transpose, we can write
PA[P ; P ]~e = P ~r
(10.12)
1
2
3
A1 A2 " ~e # " ~r #
64
75 e = e
~
~ro
A 3 A4 e o
(10.13)
(10.14)
Notice that
1
195
is an exact expression.
At this point we make our one crucial assumption. It is that there is some connection between ~ee and ~eo brought about by the smoothing property of the Richardson
relaxation procedure. Since the top half of the frequency spectrum has been removed,
it is reasonable to suppose that the odd points are the average of the even points.
For example
e 21 (ea + e )
e 12 (e + e )
or ~eo = A0 ~ee
(10.15)
e 12 (e + e )
e 12 (e + eb )
1
It is important to notice that ea and eb represent errors on the boundaries where the
error is zero if the boundary conditions are given. It is also important to notice that we
are dealing with the relation between ~e and ~r so the original boundary conditions and
forcing function (which are contained in ~f in the basic formulation) no longer appear
in the problem. Hence, no aliasing of these functions can occur in subsequent steps.
Finally, notice that, in this formulation, the averaging of ~e is our only approximation,
no operations on ~r are required or justied.
If the boundary conditions are Dirichlet, ea and eb are zero, and one can write for
the example case
2
1 0 0
6
1
A02 = 2 664 10 11 01
0 0 1
3
77
75
(10.16)
(10.17)
or
Ac~ee ; ~re = 0
(10.18)
where
Ac = [A + A A0 ]
1
(10.19)
196
The form of Ac, the matrix on the coarse mesh, is completely determined by the
choice of the permutation matrix and the interpolation approximation. If the original
A had been B (7 : 1; ;2; 1), our 7-point example would produce
2
;2
66
66
66
;
1
PAP = 666 1
66
66 1
4
;2
1
1
;2
;2
1
1
1
1
;2
1
1
;2
3
77
1 777 2 A A 3
77 6 1 2 7
77 = 4
5
77
A3 A4
77
5
(10.20)
;2
2
z
z2
}|
{3 2z
}|
{3 2 1 }|
;2
1 1
16 1 1
64
7
6
;2
5 + 4 1 1 75 664 1 1
;2
1 1 2
1
A2
A1
Ac
3{ 2z
}|
;
1
1
=2
77 6
75 = 4 1=2 ;1 1=2
1=2 ;1
3{
75 (10.21)
197
2
z
}|
{3 z2
}|
{3 2 1 }|
z2
;2
1 1
16 1 1
64
7
6
;2
5 + 4 1 1 75 664 1 1
;2
1 1 2
A1
A2
Ac
3{ 2z
}|
;
1
1
=
2
77 6
75 = 4 1=2 ;1
3{
1=2 75 (10.24)
1=2 ;1=2
198
Based on our assumptions, the most dicult error mode to eliminate is that with
m = 1, corresponding to
= ;2 1 ; cos M + 1 ; ~x = sin j M + 1 ; j = 1; 2; ; M (10.27)
For example, with M = 51, = ;0:003649. If we restrict our attention to odd M ,
then Mc = (M ; 1)=2 is the size of Ac. The eigenvalue and eigenvector corresponding
to m = 1 for the matrix Ac = 12 B (Mc; 1; ;2; 1) are
~xc) = sin j 2
(c) = ; 1 ; cos M2+
;
(
1
M + 1 ; j = 1; 2; ; Mc (10.28)
For M = 51 (Mc = 25), we obtain (c) = ;0:007291 = 1:998 . As M increases,
(c) approaches 2 . In addition, one can easily see that (~xc) coincides with ~x at
every second point of the latter vector, that is, it contains the even elements of ~x .
Now let us consider the case in which all of the error consists of the eigenvector
component ~x , i.e., ~e = ~x . Then the residual is
~r = A~x = ~x
(10.29)
1
(10.30)
since (~xc) contains the even elements of ~x . The exact solution on the coarse grid
satises
~ee = A;c ~re = Xc;c Xc; (~xc)
(10.31)
2 3
1
66 0 77
= Xc;c 66 .. 77
4 . 5
0
(10.32)
2
3
1=(c)
66 0 77
= Xc 66 .. 77
4 . 5
0
(10.33)
1
199
=
(~x )
(c) c
1
12 (~xc)
(10.34)
(10.35)
1 A ~e = ~r
2 ce e
or
(10.36)
1 B (M : 1; ;2; 1)~e = ~r
(10.37)
c
e
e
4
In our case, the matrix A = B (M : 1; ;2; 1) comes from a discretization of the
diusion equation, which gives
Ab = x B (M : 1; ;2; 1)
(10.38)
and the preconditioning matrix C is simply
2
C = x I
2
(10.39)
Applying the discretization on the coarse grid with the same preconditioning matrix
as used on the ne grid gives, since xc = 2x,
x B (M : 1; ;2; 1) = 1 B (M : 1; ;2; 1)
C x B (Mc : 1; ;2; 1) =
c
c
x
4
2
(10.40)
which is precisely the matrix appearing in Eq. 10.37. Thus we see that the process is
recursive. The problem to be solved on the coarse grid is the same as that solved on
the ne grid.
The remaining steps required to complete an entire multigrid process are relatively
straightforward, but they vary depending on the problem and the user. The reduction
can be, and usually is, carried to even coarser grids before returning to the nest level.
However, in each case the appropriate permutation matrix and the interpolation
approximation dene both the down- and up-going paths. The details of nding
optimum techniques are, obviously, quite important but they are not discussed here.
200
We now describe a two-grid process for the linear problem A~ = f~, which can be easily
generalized to a process with an arbitrary number of grids due to the recursive nature
of multigrid. Extension to nonlinear problems requires that both the solution and the
residual be transferred to the coarse grid in a process known as full approximation
storage multigrid.
1. Perform n iterations of the selected relaxation method on the ne grid, starting
with ~ = ~n. Call the result ~ . This gives
~ = Gn1 ~n + (I ; Gn1 ) A; f~
(10.41)
where
G = I + H; A
(10.42)
and H is dened as in Chapter 9 (e.g., Eq. 9.21). Next compute the residual based
on ~ :
~r = A~ ; f~ = AGn1 ~n + A (I ; Gn1 ) A; f~ ; f~
= AGn1 ~n ; AGn1 A; f~
(10.43)
1
(1)
(1)
1
(1)
(1)
(1)
(2)
2 (1)
1
2
1
(2)
(2)
(2)
1
2
1 (2)
(10.46)
201
Here A can be formed by applying the discretization on the coarse grid. In the
preceding example (eq. 10.40), A = 41 B (Mc : 1; ;2; 1). It is at this stage that the
generalization to a multigrid procedure with more than two grids occurs. If this is the
coarsest grid in the sequence, solve exactly. Otherwise, apply the two-grid process
recursively.
2
4. Transfer (or prolong) the error back to the ne grid and update the solution:
~n = ~ ; I ~e
(1)
+1
1=2
1
1=2
0
0
0
0
(10.47)
1 (2)
2
0
0
1=2
1
1=2
0
0
0
0
0
0
1=2
1
1=2
3
77
77
77
77
77
75
(10.48)
+1
2
1
1
2
2
1
(10.49)
2
1
(10.50)
The eigenvalues of this matrix determine the convergence rate of the two-grid process.
The basic iteration matrix for a three-grid process is found from Eq. 10.50 by
replacing A; with (I ; G )A; , where
2
2
3
G = [I ; I A; R A ]Gn2
2
3
2
3
3
2
(10.51)
In this expression n is the number of relaxation steps on grid 2, I and R are the
transfer operators between grids 2 and 3, and A is obtained by discretizing on grid
3. Extension to four or more grids proceeds in similar fashion.
2
3
3
2
202
10.4 Problems
Chapter 11
NUMERICAL DISSIPATION
Up to this point, we have emphasized the second-order centered-dierence approximations to the spatial derivatives in our model equations. We have seen that a centered
approximation to a rst derivative is nondissipative, i.e., the eigenvalues of the associated circulant matrix (with periodic boundary conditions) are pure imaginary.
In processes governed by nonlinear equations, such as the Euler and Navier-Stokes
equations, there can be a continual production of high-frequency components of the
solution, leading, for example, to the production of shock waves. In a real physical problem, the production of high frequencies is eventually limited by viscosity.
However, when we solve the Euler equations numerically, we have neglected viscous
eects. Thus the numerical approximation must contain some inherent dissipation to
limit the production of high-frequency modes. Although numerical approximations
to the Navier-Stokes equations contain dissipation through the viscous terms, this
can be insucient, especially at high Reynolds numbers, due to the limited grid resolution which is practical. Therefore, unless the relevant length scales are resolved,
some form of added numerical dissipation is required in the numerical solution of
the Navier-Stokes equations as well. Since the addition of numerical dissipation is
tantamount to intentionally introducing nonphysical behavior, it must be carefully
controlled such that the error introduced is not excessive. In this Chapter, we discuss
some dierent ways of adding numerical dissipation to the spatial derivatives in the
linear convection equation and hyperbolic systems of PDE's.
203
204
@u = ;a @u
@t
@x
(11.1)
with periodic boundary conditions. Consider the following point operator for the
spatial derivative term
;a [;(1 + )u + 2u + (1 ; )u ]
;a(x u)j = 2
j ;1
j
j +1
x
= ;a [(;uj;1 + uj+1) + (;uj;1 + 2uj ; uj+1)]
2x
(11.2)
The second form shown divides the operator into an antisymmetric component (;uj;1+
uj+1)=2x and a symmetric component (;uj;1 + 2uj ; uj+1)=2x. The antisymmetric component is the second-order centered dierence operator. With 6= 0, the
operator is only rst-order accurate. A backward dierence operator is given by = 1
and a forward dierence operator is given by = ;1.
For periodic boundary conditions the corresponding matrix operator is
;a B (;1 ; ; 2; 1 ; )
;ax = 2
x p
The eigenvalues of this matrix are
2m
2m
;
a
m = x 1 ; cos M + i sin M
for m = 0; 1; : : : ; M ; 1
If a is positive, the forward dierence operator ( = ;1) produces Re(m ) > 0,
the centered dierence operator ( = 0) produces Re(m ) = 0, and the backward
dierence operator produces Re(m) < 0. Hence the forward dierence operator is
inherently unstable while the centered and backward operators are inherently stable.
If a is negative, the roles are reversed. When Re(m) = 0, the solution will either
grow or decay with time. In either case, our choice of dierencing scheme produces
nonphysical behavior. We proceed next to show why this occurs.
205
First carry out a Taylor series expansion of the terms in Eq. 11.2. We are lead to the
expression
2
3 3
4 4
2 @ u + x @ u ; x @ u + : : :5
(xu)j = 21 x 42x @u
;
x
@x j
@x2 j 3 @x3 j 12 @x4 j
We see that the antisymmetric portion of the operator introduces odd derivative
terms in the truncation error while the symmetric portion introduces even derivatives.
Substituting this into Eq. 11.1 gives
@u = ;a @u + a x @ 2 u ; ax2 @ 3 u + a x3 @ 4 u + : : :
(11.3)
@t
@x
2 @x2
6 @x3
24 @x4
This is the partial dierential equation we are really solving when we apply the
approximation given by Eq. 11.2 to Eq. 11.1. Notice that Eq. 11.3 is consistent with
Eq. 11.1, since the two equations are identical when x ! 0. However, when we use
a computer to nd a numerical solution of the problem, x can be small but it is
not zero. This means that each term in the expansion given by Eq. 11.3 is excited to
some degree. We refer to Eq. 11.3 as the modied partial dierential equation. We
proceed next to investigate the implications of this concept.
Consider the simple linear partial dierential equation
@u = ;a @u + @ 2 u +
@ 3 u + @ 4 u
(11.4)
@t
@x @x2 @x3 @x4
Choose periodic boundary conditions and impose an initial condition u = eix. Under
these conditions there is a wave-like solution to Eq. 11.4 of the form
u(x; t) = eixe(r+is)t
provided r and s satisfy the condition
r + is = ;ia ; 2 ; i
3 + 4
or
r = ;2 ( ; 2 ); s = ;(a +
2 )
The solution is composed of both amplitude and phase terms. Thus
u = e| ;2 ({z;2}) e| i[x;({za+
2 )t}]
(11.5)
amplitude phase
206
It is important to notice that the amplitude of the solution depends only upon and
, the coecients of the even derivatives in Eq. 11.4, and the phase depends only on
a and
, the coecients of the odd derivatives.
If the wave speed a is positive, the choice of a backward dierence scheme ( = 1)
produces a modied PDE with ; 2 > 0 and hence the amplitude of the solution
decays. This is tantamount to deliberately adding dissipation to the PDE. Under the
same condition, the choice of a forward dierence scheme ( = ;1) is equivalent to
deliberately adding a destabilizing term to the PDE.
By examining the term governing the phase of the solution in Eq. 11.5, we see
that the speed of propagation is a +
2 . Referring to the modied PDE, Eq. 11.3
we have
= ;ax2 =6. Therefore, the phase speed of the numerical solution is less
than the actual phase speed. Furthermore, the numerical phase speed is dependent
upon the wavenumber . This we refer to as dispersion.
Our purpose here is to investigate the properties of one-sided spatial dierencing
operators relative to centered dierence operators. We have seen that the threepoint centered dierence approximation of the spatial derivative produces a modied
PDE that has no dissipation (or amplication). One can easily show, by using the
antisymmetry of the matrix dierence operators, that the same is true for any centered dierence approximation of a rst derivative. As a corollary, any departure
from antisymmetry in the matrix dierence operator must introduce dissipation (or
amplication) into the modied PDE.
Note that the use of one-sided dierencing schemes is not the only way to introduce dissipation. Any symmetric component in the spatial operator introduces
dissipation (or amplication). Therefore, one could choose = 1=2 in Eq. 11.2. The
resulting spatial operator is not one-sided but it is dissipative. Biased schemes use
more information on one side of the node than the other. For example, a third-order
backward-biased scheme is given by
(xu)j = 61 x (uj;2 ; 6uj;1 + 3uj + 2uj+1)
= 1 [(uj;2 ; 8uj;1 + 8uj+1 ; uj+2)
12x
+ (uj;2 ; 4uj;1 + 6uj ; 4uj+1 + uj+2)]
(11.6)
207
(11.7)
First replace the time derivatives with space derivatives according to the PDE (in
@u
this case, the linear convection equation @u
@t + a @x = 0). Thus
@ 2 u = a2 @ 2 u
@u = ;a @u ;
(11.8)
@t
@x
@t2
@x2
Now replace the space derivatives with three-point centered dierence operators, giving
!2
1
ah
1
ah
(
n
)
(
n
)
(
n
+1)
(
n
)
uj = uj ; 2 x (uj+1 ; uj;1) + 2 x (u(jn+1) ; 2u(jn) + u(jn;)1) (11.9)
This is the Lax-Wendro method applied to the linear convection equation. It is a
fully-discrete nite-dierence scheme. There is no intermediate semi-discrete stage.
For periodic boundary conditions, the corresponding fully-discrete matrix operator
is
0 2
!23
!2 2
!2 31
1
ah
ah
ah
1
ah
ah
~un+1 = Bp @ 2 4 x + x 5 ; 1 ; x ; 2 4; x + x 5A ~un
The eigenvalues of this matrix are
!2
2m ah 2m
ah
m = 1 ; x 1 ; cos M ; i x sin M for m = 0; 1; : : : ; M ; 1
For j ahx j 1 all of the eigenvalues have modulus less than or equal to unity and hence
the method is stable independent of the sign of a. The quantity j ahx j is known as the
Courant (or CFL) number. It is equal to the ratio of the distance travelled by a wave
in one time step to the mesh spacing.
208
The nature of the dissipative properties of the Lax-Wendro scheme can be seen
by examining the modied partial dierential equation, which is given by
@u + a @u = ; a (x2 ; a2h2 ) @ 3 u ; a2 h (x2 ; a2 h2) @ 4 u + : : :
@t @x
6
@x3 8
@x4
This is derived by substituting Taylor series expansions for all terms in Eq. 11.9 and
converting the time derivatives to space derivatives using Eq. 11.8. The two leading
error terms appear on the right side of the equation. Recall that the odd derivatives on
the right side lead to unwanted dispersion and the even derivatives lead to dissipation
(or amplication, depending on the sign). Therefore, the leading error term in the
Lax-Wendro method is dispersive and proportional to
3u
2
3u
a
@
a
x
@
2
2
2
2
; 6 (x ; a h ) @x3 = ; 6 (1 ; Cn) @x3
The dissipative term is proportional to
2
4
2
2
@4u
; a8h (x2 ; a2h2 ) @@xu4 = ; a h8x (1 ; Cn2 ) @x
4
This term has the appropriate sign and hence the scheme is truly dissipative as long
as Cn 1.
A closely related method is that of MacCormack. Recall MacCormack's timemarching method, presented in Chapter 6:
u~n+1 = un + hu0n
(11.10)
un+1 = 21 [un + u~n+1 + hu~0n+1]
If we use rst-order backward dierencing in the rst stage and rst-order forward
dierencing in the second stage,1 a dissipative second-order method is obtained. For
the linear convection equation, this approach leads to
u~(jn+1) = u(jn) ; ahx (u(jn) ; u(jn;)1)
u(jn+1) = 12 [u(jn) + u~(jn+1) ; ahx (~u(jn+1+1) ; u~(jn+1))]
(11.11)
which can be shown to be identical to the Lax-Wendro method. Hence MacCormack's method has the same dissipative and dispersive properties as the Lax-Wendro
method. The two methods dier when applied to nonlinear hyperbolic systems, however.
1 Or vice-versa; for nonlinear problems, these should be applied alternately.
209
In Section 11.1, we saw that numerical dissipation can be introduced in the spatial
dierence operator using one-sided dierence schemes or, more generally, by adding
a symmetric component to the spatial operator. With this approach, the direction
of the one-sided operator (i.e., whether it is a forward or a backward dierence)
or the sign of the symmetric component depends on the sign of the wave speed.
When a hyperbolic system of equations is being solved, the wave speeds can be both
positive and negative. For example, the eigenvalues of the
ux Jacobian for the onedimensional Euler equations are u; u + a; u ; a. When the
ow is subsonic, these are
of mixed sign. In order to apply one-sided dierencing schemes to such systems, some
form of splitting is required. This is avoided in the Lax-Wendro scheme. However,
as a result of their superior
exibility, schemes in which the numerical dissipation
is introduced in the spatial operator are generally preferred over the Lax-Wendro
approach.
Consider again the linear convection equation:
@u + a @u = 0
(11.12)
@t @x
where we do not make any assumptions as to the sign of a. We can rewrite Eq. 11.12
as
@u + (a+ + a; ) @u = 0 ; a = a jaj
@t
@x
2
+
;
If a 0, then a = a 0 and a = 0. Alternatively, if a 0, then a+ = 0 and
a; = a 0. Now for the a+ ( 0) term we can safely backward dierence and for the
a; ( 0) term forward dierence. This is the basic concept behind upwind methods,
that is, some decomposition or splitting of the
uxes into terms which have positive
and negative characteristic speeds so that appropriate dierencing schemes can be
chosen. In the next two sections, we present two splitting techniques commonly used
with upwind methods. These are by no means unique.
The above approach to obtaining a stable discretization independent of the sign
of a can be written in a dierent, but entirely equivalent, manner. From Eq. 11.2, we
see that a stable discretization is obtained with = 1 if a 0 and with = ;1 if
a 0. This is achieved by the following point operator:
;1 [a(;u + u ) + jaj(;u + 2u ; u )]
;a(xu)j = 2
(11.13)
j ;1
j +1
j ;1
j
j +1
x
This approach is extended to systems of equations in Section 11.5.
In this section, we present the basic ideas of
ux-vector and
ux-dierence splitting.
For more subtle aspects of implementation and application of such techniques to
210
nonlinear hyperbolic systems such as the Euler equations, the reader is referred to
the literature on this subject.
@u + @f = @u + A @u = 0
(11.14)
@t @x @t
@x
can be decoupled into characteristic equations of the form
@wi + @wi = 0
(11.15)
i
@t
@x
where the wave speeds, i, are the eigenvalues of the Jacobian matrix, A, and the
wi's are the characteristic variables. In order to apply a one-sided (or biased) spatial
dierencing scheme, we need to apply a backward dierence if the wave speed, i, is
positive, and a forward dierence if the wave speed is negative. To accomplish this,
let us split the matrix of eigenvalues, , into two components such that
= + + ;
where
+ = +2 jj ;
; = ;2 jj
(11.16)
(11.17)
With these denitions, + contains the positive eigenvalues and ; contains the negative eigenvalues. We can now rewrite the system in terms of characteristic variables
as
@w + @w = @w + + @w + ; @w = 0
(11.18)
@t
@x @t
@x
@x
The spatial terms have been split into two components according to the sign of the
wave speeds. We can use backward dierencing for the + @w
@x term and forward
dierencing for the ; @w
term.
Premultiplying
by
X
and
inserting
the product
@x
;
1
X X in the spatial terms gives
(11.19)
211
A+ = X +X ;1 ;
A; = X ;X ;1
(11.20)
@u + @A+u + @A; u = 0
@t
@x
@x
Finally the split
ux vectors are dened as
f + = A+u;
(11.21)
f ; = A; u
(11.22)
@u + @f + + @f ; = 0
(11.23)
@t @x @x
In the linear case, the denition of the split
uxes follows directly from the denition of the
ux, f = Au. For the Euler equations, f is also equal to Au as a result of
their homogeneous property, as discussed in Appendix C. Note that
f = f+ + f;
(11.24)
Thus by applying backward dierences to the f + term and forward dierences to the
f ; term, we are in eect solving the characteristic equations in the desired manner.
This approach is known as
ux-vector splitting.
When an implicit time-marching method is used, the Jacobians of the split
ux
vectors are required. In the nonlinear case,
@f + 6= A+ ;
@f ; 6= A;
@u
@u
Therefore, one must nd and use the new Jacobians given by
+
A++ = @f
@u ;
A;; = @f
@u
(11.25)
(11.26)
For the Euler equations, A++ has eigenvalues which are all positive, and A;; has all
negative eigenvalues.
2 With these denitions A+ has all positive eigenvalues, and A; has all negative eigenvalues.
212
jAj = X jjX ;1
(11.34)
213
and we have also used the relations f = Xg, u = Xw, and A = X X ;1.
In the linear, constant-coecient case, this leads to an upwind operator which is
identical to that obtained using
ux-vector splitting. However, in the nonlinear case,
there is some ambiguity regarding the denition of jAj at the cell interface j + 1=2.
In order to resolve this, consider a situation in which the eigenvalues of A are all of
the same sign. In this case, we would like our denition of f^j+1=2 to satisfy
i0s > 0
f^j+1=2 = ffL ifif all
(11.35)
0
R all i s < 0
giving pure upwinding. If the eigenvalues of A are all positive, jAj = A; if they are
all negative, jAj = ;A. Hence satisfaction of Eq. 11.35 is obtained by the denition
f^j+1=2 = 21 (fL + fR ) + 12 jAj+1=2j (uL ; uR)
(11.36)
if Aj+1=2 satises
fL ; fR = Aj+1=2 (uL ; uR)
(11.37)
For the Euler equations for a perfect gas, Eq. 11.37 is satised by the
ux Jacobian
evaluated at the Roe-average state given by
pLuL + pR uR
(11.38)
uj+1=2 = p + p
L
R
p H + p H
L L
Hj+1=2 =
(11.39)
pL + pRR R
where u and H = (e + p)= are the velocity and the total enthalpy per unit mass,
respectively.3
of this chapter.
214
(11.40)
(xa u)j = uj+1 ; uj;1 ; (xs u)j = ;uj+1 + 2uj ; uj;1
2x
2x
Applying x = xa + xs to the spatial derivative in Eq. 11.15 is stable if i 0 and
unstable if i < 0. Similarly, applying x = xa ; xs is stable if i 0 and unstable if
i > 0. The appropriate implementation is thus
ix = ixa + jijxs
(11.41)
Extension to a hyperbolic system by applying the above approach to the characteristic
variables, as in the previous two sections, gives
x (Au) = xa (Au) + xs (jAju)
(11.42)
or
xf = xa f + xs (jAju)
(11.43)
where jAj is dened in Eq. 11.34. The second spatial term is known as articial
dissipation. It is also sometimes referred to as articial diusion or articial viscosity.
With appropriate choices of xa and xs , this approach can be related to the upwind
approach. This is particularly evident from a comparison of Eqs. 11.36 and 11.43.
It is common to use the following operator for xs
(xs u)j = (uj;2 ; 4uj;1 + 6uj ; 4uj+1 + uj+2)
(11.44)
x
where is a problem-dependent coecient. This symmetric operator approximates
x3 uxxxx and thus introduces a third-order dissipative term. With an appropriate
value of , this often provides sucient damping of high frequency modes without
greatly aecting the low frequency modes. For details of how this can be implemented
for nonlinear hyperbolic systems, the reader should consult the literature. A more
complicated treatment of the numerical dissipation is also required near shock waves
and other discontinuities, but is beyond the scope of this book.
11.6 Problems
1. A second-order backward dierence approximation to a 1st derivative is given
as a point operator by
(xu)j = 1 (uj;2 ; 4uj;1 + 3uj )
2x
11.6. PROBLEMS
215
(a) Express this operator in banded matrix form (for periodic boundary conditions), then derive the symmetric and skew-symmetric matrices that have
the matrix operator as their sum. (See Appendix A.3 to see how to construct the symmetric and skew-symmetric components of a matrix.)
(b) Using a Taylor table, nd the derivative which is approximated by the
corresponding symmetric and skew-symmetric operators and the leading
error term for each.
2. Find the modied wavenumber for the rst-order backward dierence operator.
Plot the real and imaginary parts of x vs. x for 0 x . Using
Fourier analysis as in Section 6.6.2, nd jj for the combination of this spatial
operator with 4th-order Runge-Kutta time marching at a Courant number of
unity and plot vs. x for 0 x .
3. Find the modied wavenumber for the operator given in Eq. 11.6. Plot the real
and imaginary parts of x vs. x for 0 x . Using Fourier analysis
as in Section 6.6.2, nd jj for the combination of this spatial operator with
4th-order Runge-Kutta time marching at a Courant number of unity and plot
vs. x for 0 x .
4. Consider the spatial operator obtained by combining second-order centered differences with the symmetric operator given in Eq. 11.44. Find the modied
wavenumber for this operator with = 0; 1=12; 1=24, and 1=48. Plot the real
and imaginary parts of x vs. x for 0 x . Using Fourier analysis
as in Section 6.6.2, nd jj for the combination of this spatial operator with
4th-order Runge-Kutta time marching at a Courant number of unity and plot
vs. x for 0 x .
5. Consider the hyperbolic system derived in problem 8 of Chapter 2. Find the
matrix jAj. Form the plus-minus split
ux vectors as in Section 11.4.1.
6. Show that the
ux Jacobian for the 1-D Euler equations can be written in terms
of u and H . Show that the use of the Roe average state given in Eqs. 11.38 and
11.39 leads to satisfaction of Eq. 11.37.
216
Chapter 12
SPLIT AND FACTORED FORMS
In the next two chapters, we present and analyze split and factored algorithms. This
gives the reader a feel for some of the modications which can be made to the basic
algorithms in order to obtain ecient solvers for practical multidimensional applications, and a means for analyzing such modied forms.
d~u = A~u ; ~f
dt
217
(12.1)
218
d~u = [A + A ]~u ; ~f
dt
1
(12.2)
where A = [A + A ] but A and A are not unique. For the time march let us choose
the simple, rst-order, explicit Euler method. Then, from observation 2 (new data
~un in terms of old ~un):
1
+1
(12.3)
or its equivalent
(12.4)
Notice that Eqs. 12.3 and 12.4 have the same formal order of accuracy and, in
this sense, neither one is to be preferred over the other. However, their numerical
stability can be quite dierent, and techniques to carry out their numerical evaluation
can have arithmetic operation counts that vary by orders of magnitude. Both of these
considerations are investigated later. Here we seek only to apply to some simple cases
the concept of factoring.
+1
d~u = A ~u + A ~u + (bc~ )
c
d
dt
(12.5)
where Ac and Ad are matrices representing the convection and dissipation terms,
respectively; and their sum forms the A matrix we have considered in the previous
sections. Choose again the explicit Euler time march so that
~ ) + O (h )
~un = [ I + hAd + hAc]~un + h(bc
+1
(12.6)
~un
+1
~)
= [ I + hAd ] [ I + hAc]~un + h(bc
~ ) +O(h ) (12.7)
~ ) + h Ad Ac~un + (bc
= [| I + hAd + h{zAc]~un + h(bc
} |
{z
}
Original Unfactored Terms Higher Order Terms
2
and we see that Eq. 12.7 and the original unfactored form Eq. 12.6 have identical
orders of accuracy in the time approximation. Therefore, on this basis, their selection
is arbitrary. In practical applications equations such as 12.7 are often applied in a
predictor-corrector sequence. In this case one could write
2
u~n
~un
+1
+1
~)
= [ I + hAc]~un + h(bc
= [ I + hAd]~un
(12.8)
+1
Factoring can also be useful to form split combinations of implicit and explicit
techniques. For example, another way to approximate Eq. 12.6 with the same order
of accuracy is given by the expression
~)
= [ I ; hAd]; [ I + hAc]~un + h(bc
~ ) +O(h )
= [| I + hAd + h{zAc]~un + h(bc
}
Original Unfactored Terms
where in this approximation we have used the fact that
~un
+1
(12.9)
[ I ; hAd ]; = I + hAd + h Ad +
1
if h jjAdjj < 1, where jjAd jj is some norm of [Ad ]. This time a predictor-corrector
interpretation leads to the sequence
u~n
[ I ; hAd]~un
+1
+1
~)
= [ I + hAc]~un + h(bc
= u~n
+1
(12.10)
The convection operator is applied explicitly, as before, but the diusion operator is
now implicit, requiring a tridiagonal solver if the diusion term is central dierenced.
Since numerical stiness is generally much more severe for the diusion process, this
factored form would appear to be superior to that provided by Eq. 12.8. However,
the important aspect of stability has yet to be discussed.
2 We do not suggest that this particular method is suitable for use. We have yet to determine its
220
We should mention here that Eq. 12.9 can be derived for a dierent point of view
by writing Eq. 12.6 in the form
un ; un = A u + A u + (bc
~ ) + O(h )
c n
d n
h
+1
Then
+1
~)
[ I ; hAd ]un = [ I + hAc]un + h(bc
which is identical to Eq. 12.10.
+1
Factoring is widely used in codes designed for the numerical solution of equations
governing unsteady two- and three-dimensional
ows. Let us study the basic concept
of factoring by inspecting its use on the linear 2-D scalar PDE that models diusion:
@u = @ u + @ u
@t @x @y
2
(12.11)
We begin by reducing this PDE to a coupled set of ODE's by dierencing the space
derivatives and inspecting the resulting matrix operator.
A clear description of a matrix nite-dierence operator in 2- and 3-D requires some
reference to a mesh. We choose the 3 4 point mesh shown in the Sketch 12.12.
In this example Mx , the number of (interior) x points, is 4 and My , the number of
(interior) y points is 3. The numbers 11 ; 12 ; ; 43 represent the location in the
mesh of the dependent variable bearing that index. Thus u represents the value of
u at j = 3 and k = 2.
3
32
My 13 23 33 43
k 12 22 32 42
1
11 21 31 41
1 j Mx
(12.12)
in the sketch)
were included, but in these notes we describe the size of a mesh by the number of interior points.
221
The dimensioned array in a computer code that allots the storage locations of the
dependent variable(s) is referred to as a data-base. There are many ways to lay out
a data-base. Of these, we consider only two: (1), consecutively along rows that are
themselves consecutive from k = 1 to My , and (2), consecutively along columns that
are consecutive from j = 1 to Mx. We refer to each row or column group as a
space vector (they represent data along lines that are continuous in space) and label
their sum with the symbol U . In particular, (1) and (2) above are referred to as xvectors and y-vectors, respectively. The symbol U by itself is not enough to identify
the structure of the data-base and is used only when the structure is immaterial or
understood.
To be specic about the structure, we label a data{base composed of x-vectors with
U x , and one composed of y-vectors with U y . Examples of the order of indexing
for these space vectors are given in Eq. 12.16 part a and b.
( )
( )
The two vectors (arrays) are related by a permutation matrix P such that
U x = Pxy U y
( )
( )
U y = PyxU x
and
( )
where
(12.13)
( )
dU = A U + (bc
~)
x y
dt
(12.14)
( )
+
( )
4 Notice that
( )
+
( )
(12.15)
Ax+y and U , which are notations used in the special case of space vectors, are
subsets of A and ~u, used in the previous sections.
222
2
6
x
6
6
6
6
6
6
6
6
6
6
o
6
6
A(xx+)y U (x) = 666
6
6
6
6
6
6
6
6
6
6
6
4
j o
x
j
o
x x j
o
x j
o
j
j
j
j
j x
o
j x x
o
j
x x
o j
x
j o
j
o
j
o
j
j o
j
o
j
o
j
o
3
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
o 777
7
7
7
7
7
7
x 75
j x
j x x
j
x
j
x
11
21
31
41
;;
;;
2
6
o
6
6
6
6
6
6
6
x
6
6
6
6
6
6
(y )
(y )
Ax+y U = 666
6
6
6
6
6
6
6
6
6
6
6
6
4
13
23
33
43
( )
j x
j
o j
x
j
o j
x j
o
j
j
j
j o
j x
j
x
j o o j
x
j
x j
o j
x j
j x
j o
j x
j
x
j o o j
x
j
x j
o j
j
j
j
3
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
x 777
7
7
7
7
7
o5
j x
j o
j
x
j o
j
x j
o
12
22
32
42
( )
11
12
13
;;
21
22
23
;;
31
32
33
;;
41
42
43
(12.16)
223
( )
(12.17)
( )
( )
( )
(12.18)
( )
and
( )
( )
The splittings in Eqs. 12.17 and 12.18 can be combined with factoring in the
manner described in Section 12.2. As an example (rst-order in time), applying the
implicit Euler method to Eq. 12.14 gives
h
i
Unx = Unx + h Axx + Ayx Unx + h(bc~ )
( )
+1
( )
( )
( )
( )
+1
or
h
i
I ; hAxx ; hAyx Unx = Unx + h(bc~ ) + O(h )
( )
( )
+1
( )
( )
(12.19)
As in Section 12.2, we retain the same rst order accuracy with the alternative
h
ih
i
~ ) + O(h )
I ; hAxx I ; hAyx Unx = Unx + h(bc
( )
( )
+1
( )
( )
(12.20)
Write this in predictor-corrector form and permute the data base of the second row.
There results
h
~)
I ; hAxx U~ x = Unx + h(bc
h
i y
I ; hAyy Un = U~ y
( )
( )
( )
( )
( )
+1
( )
(12.21)
224
2
x
6
x
6
6
6
6
6
6
6
6
6
6
6
6
(x)
(x)
Ax U = 666
6
6
6
6
6
6
6
6
6
6
6
4
x
x x
x x x
x x
j
j
j
j
j
j
j
j
j x x
j x x x
j
x x x
j
x x
j
j
j
j
j
j
j
j
2
o
j o
6
o
j
o
6
6
6
o
j
o
6
6
o
j
o
6
6
6
6
6
o
6
6
A(yx) U (x) = 666
6
6
6
6
6
6
6
6
6
6
6
4
j o
o
j
o
o
j
o
o j
o
j o
j
o
j
o
j
o
The splitting of Axx y .
( )
+
3
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
U (x)
7
7
7
7
7
7
7
7
7
7
7
x 75
j x x
j x x x
j
x x
j
x x
3
j
7
j
7
7
7
j
7
7
j
7
7
(12.22)
7
7
j o
7
7
j
o
7
x
j
o 777 U
j
o 777
( )
7
7
j o
7
7
j
o
7
j
o 75
j
o
2
x
6
6
6
6
6
6
6
6
x
6
6
6
6
6
6
A(xy) U (y) = 666
6
6
6
6
6
6
6
6
6
6
6
6
4
j x
j
x
j
x
j
x j
x j
j x
j x
j
x
j
x
j
x
j
x j
x j
x j
j x
j x
j x
j
x
j
x
j
x
j
x j
x j
j
j
j
2
o o
j
6
o o o j
6
6
o o j
6
6
6
6
6
6
6
6
6
6
6
(y )
(y )
Ay U = 666
6
6
6
6
6
6
6
6
6
6
6
6
4
j
j
j
225
3
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
7
U (y)
7
7
7
7
7
x 777
7
7
7
7
7
5
j x
j x
j
x
j
x
j
x j
x
3
j
j
7
j
j
7
7
j
j
7
7
j o o
j
j o o o j
j
o o j
j
j
j
j
j
j
j o o
j
j o o o j
j
o o j
j
j
j
j
j
j
7
7
7
7
7
7
7
7
7
7
7
U (y)
7
7
7
7
7
7
7
7
7
7
7
7
7
o5
j o o
j o o
j
o o
(12.23)
226
Second-order accuracy in time can be maintained in a certain factored implicit methods. For example, apply the trapezoidal method to Eq. 12.14 where the derivative
operators have been split as in Eq. 12.17 or 12.18. Let the data base be immaterial
~ ) be time invariant. There results
and the (bc
1
1
1
1
~ ) + O(h ) (12.24)
I ; 2 hAx ; 2 hAy Un = I + 2 hAx + 2 hAy Un + h(bc
Factor both sides giving
1
1
1
I ; 2 hAx I ; 2 hAy ; 4 h AxAy Un
1
1
1
~ ) + O(h ) (12.25)
= I + hAx I + hAy ; h AxAy Un + h(bc
2
2
4
Then notice that the combination 14 h [AxAy ](Un ; Un) is proportional to h since
the leading term in the expansion of (Un ; Un) is proportional to h. Therefore, we
can write
1
1
1
1
I ; 2 hAx I ; 2 hAy Un = I + 2 hAx I + 2 hAy Un + h(bc~ ) + O(h )(12.26)
and both the factored and unfactored form of the trapezoidal method are second-order
accurate in the time march.
An alternative form of this kind of factorization is the classical ADI (alternating
direction implicit) method usually written
1
1
~
I ; 2 hAx U = I + 2 hAy Un + 12 hFn
1
1
(12.27)
I ; 2 hAy Un = I + 2 hAx U~ + 12 hFn + O(h )
3
+1
+1
+1
+1
+1
+1
+1
For idealized commuting systems the methods given by Eqs. 12.26 and 12.27 dier
only in their evaluation of a time-dependent forcing term.
+1
+1
Ne My Mz Mx
2
words and, for well resolved
ow elds, this probably exceeds memory availability for
some time to come.
On the other hand, consider computing a solution using the factored implicit equation 12.25. Again computing the right hand side poses no problem. Accumulate the
result of such a computation in the array (RHS ). One can then write the remaining
terms in the two-step predictor-corrector form
I ; 21 hAxx U~ x = (RHS ) x
I ; 12 hAyy Uny = U~ y
(12.28)
( )
( )
( )
( )
+1
( )
( )
6 For matrices as small as those shown there are many gaps in this \ll", but for meshes of
228
which has the same appearance as Eq. 12.21 but is second-order time accurate. The
rst step would be solved using My uncoupled block tridiagonal solvers . Inspecting
the top of Eq. 12.22, we see that this is equivalent to solving My one-dimensional
problems, each with Mx blocks of order Ne . The temporary solution U~ x would then
be permuted to U~ y and an inspection of the bottom of Eq. 12.23 shows that the nal
step consists of solving Mx one-dimensional implicit problems each with dimension
My .
9
( )
( )
+1
+1
9 A block tridiagonal solver is similar to a scalar solver except that small block matrix operations
12.7. PROBLEMS
229
The point at which the factoring is made may not aect the order of time-accuracy,
but it can have a profound eect on the stability and convergence properties of a
method. For example, the unfactored form of a rst-order method derived from the
implicit Euler time march is given by Eq. 12.19, and if it is immediately factored,
the factored form is presented in Eq. 12.20. On the other hand, the delta form of the
unfactored Eq. 12.19 is
h
~)
[I ; hAx ; hAy ]Un = h Ax y Un + (bc
+
10
~)
[I ; hAx][I ; hAy ]Un = h Ax y Un + (bc
(12.31)
In spite of the similarities in derivation, we will see in the next chapter that the
convergence properties of Eq. 12.20 and Eq. 12.31 are vastly dierent.
12.7 Problems
1. Consider the 1-D heat equation:
@u = @ u
@t @x
2
0x9
Let u(0; t) = 0 and u(9; t) = 0, so that we can simplify the boundary conditions.
Assume that second order central dierencing is used, i.e.,
(xxu)j = 1 (uj; ; 2uj + uj )
x
The uniform grid has x = 1 and 8 interior points.
2
+1
(2)
12
21
10 Notice that the only dierence between the O(h2 ) method given by Eq. 12.30 and the O(h)
method given by Eq. 12.31 is the appearance of the factor 1 on the left side of the O(h2 ) method.
230
iv. The generic ODE representing the discrete form of the heat equation
is
du = A u + f
dt
Write down the matrix A . (Note f = 0, due to the boundary conditions) Next nd the matrix A such that
du = A u
dt
Note that A can be written as
2
T3
U
D
7
A = 64
5
U
D
Dene D and U .
(1)
(1)
(2)
(2)
v. Applying implicit Euler time marching, write the delta form of the
implicit algorithm. Comment on the form of the resulting implicit
matrix operator.
(b) System denition
In problem 1a, we dened u ; u ; A ; A ; P , and P which partition
the odd points from the even points. We can put such a partitioning to
use. First dene extraction operators
21 0 0 0
0 0 0 03
6
0 0 0 0 77
0 1 0 0
6
6
3
0 0 0 0 777 2 I
0 0 1 0
6
6
0
7
6
0 0 0 0 7 = 64
7
I o = 66 00 00 00 01
5
7
0
0
0
0
7
6
0
6
6
0 0 0 0 777 0
60 0 0 0
40 0 0 0
0 0 0 05
0 0 0 0
0 0 0 0
20 0 0 0
0 0 0 03
6
0 0 0 0
0 0 0 0 77
6
6
3
0 0 0 0
0 0 0 0 777 2 0
6
6
0
7
6
0 0 0 0 7 = 64
7
I e = 66 00 00 00 00
5
7
1
0
0
0
7
6
0
I
7
6
6
0 1 0 0 77
60 0 0 0
40 0 0 0
0 0 1 05
0 0 0 0
0 0 0 1
(1)
( )
( )
(2)
12
21
12.7. PROBLEMS
231
( )
( )
( )
(2)
(2)
( )
(2)
232
Chapter 13
LINEAR ANALYSIS OF SPLIT
AND FACTORED FORMS
In Section 4.4 we introduced the concept of the representative equation, and used
it in Chapter 7 to study the stability, accuracy, and convergence properties of timemarching schemes. The question is: Can we nd a similar equation that will allow
us to evaluate the stability and convergence properties of split and factored schemes?
The answer is yes | for certain forms of linear model equations.
The analysis in this chapter is useful for estimating the stability and steady-state
properties of a wide variety of time-marching schemes that are variously referred
to as time-split, fractional-step, hybrid, and (approximately) factored. When these
methods are applied to practical problems, the results found from this analysis are
neither necessary nor sucient to guarantee stability. However, if the results indicate
that a method has an instability, the method is probably not suitable for practical
use.
233
(13.2)
(13.4)
This is to be contrasted to the developments found later in the analysis of 2-D equations.
235
1.2
C = 2/ R
n
C = R /2
n
0.8
C
0.4
C = 2/ R
n
0.8
n
0.4
4
R
Explicit-Implicit
4
R
Explicit-Explicit
237
Next let us analyze a more practical method that has been used in serious computational analysis of turbulent
ows. This method applies to a
ow in which there is
a combination of diusion and periodic convection. The convection term is treated
explicitly using the second-order Adams-Bashforth method. The diusion term is
integrated implicitly using the trapezoidal method. Our model equation is again the
linear convection-diusion equation 13.4 which we split in the fashion of Eq. 13.5. In
order to evaluate the accuracy, as well as the stability, we include the forcing function in the representative equation and study the eect of our hybrid, time-marching
method on the equation
u0 = cu + du + aet
First let us nd expressions for the two polynomials, P (E ) and Q(E ). The characteristic polynomial follows from the application of the method to the homogeneous
equation, thus
un+1 = un + 21 hc(3un ; un;1) + 21 hd (un+1 + un)
This produces
P (E ) = (1 ; 12 hd)E 2 ; (1 + 23 hc + 12 hd)E + 12 hc
The form of the particular polynomial depends upon whether the forcing function is
carried by the AB2 method or by the trapezoidal method. In the former case it is
Q(E ) = 21 h(3E ; 1)
(13.8)
and in the latter
(13.9)
Q(E ) = 12 h(E 2 + E )
Accuracy
From the characteristic polynomial we see that there are two {roots and they are
given by the equation
s
2
1 + 32 hc + 21 hd ; 2hc 1 ; 21 hd
(13.10)
2 1 ; 12 hd
The principal -root follows from the plus sign and one can show
1 = 1 + (c + d )h + 12 (c + d )2h2 + 41 3d + c2d ; 2c d ; 3c h3
From this equation it is clear that 61 3 = 61 (c + d)3 does not match the coecient
of h3 in 1 , so
er = O(h3)
Using P (eh) and Q(eh ) to evaluate er in Section 6.6.3, one can show
er = O(h3)
using either Eq. 13.8 or Eq. 13.9. These results show that, for the model equation,
the hybrid method retains the second-order accuracy of its individual components.
1 + 23 hc + 12 hd
=
Stability
The stability of the method can be found from Eq. 13.10 by a parametric study of cn
and R dened in Eq. 13.7. This was carried out in a manner similar to that used
to nd the stability boundary of the rst-order explicit-implicit method in Section
13.2.1. The results are plotted in Fig. 13.2. For values of R 2 this second-order
method has a much greater region of stability than the rst-order explicit-implicit
method given by Eq. 12.10 and shown in Fig. 13.1.
(13.11)
0.8
Cn
Stable
0.4
_
Figure 13.2: Stability
regions for the second-order time-split method.
and
@u + a @u + a @u = 0
(13.12)
@t x @x y @y
Reduce either of these, by means of spatial dierencing approximations, to the coupled
set of ODE's:
dU = [A + A ]U + (bc
~)
(13.13)
x
y
dt
for the space vector U . The form of the Ax and Ay matrices for three-point central
dierencing schemes are shown in Eqs. 12.22 and 12.23 for the 3 4 mesh shown
in Sketch 12.12. Let us inspect the structure of these matrices closely to see how we
can diagonalize [Ax + Ay ] in terms of the individual eigenvalues of the two matrices
considered separately.
First we write these matrices in the form
2
3
2 ~
3
~b1 I
B
b
I
0
A(xx) = 64 B 75 A(yx) = 64 ~b;1 I ~b0 I ~b1 I 75
~b;1 I ~b0 I
B
where B is a banded matrix of the form B (b;1 ; b0; b1 ). Now nd the block eigenvector
(13.16)
where B and B~ are any two matrices that have linearly independent eigenvectors (this
puts some constraints on the choice of dierencing schemes).
Although Ax and Ay do commute, this fact, by itself, does not ensure the property of \all possible combinations". To obtain the latter property the structure of
the matrices is important. The block matrices B and B~ can be either circulant or
noncirculant; in both cases we are led to the nal result:
The 2{D representative equation for model linear systems is
du = [ + ]u + aet
x
y
dt
where x and y are any combination of eigenvalues from Ax and Ay , a and are
(possibly complex) constants, and where Ax and Ay satisfy the conditions in 13.16.
Often we are interested in nding the value of, and the convergence rate to, the
steady-state solution of the representative equation. In that case we set = 0 and
use the simpler form
du = [ + ]u + a
(13.17)
x
y
dt
which has the exact solution
u(t) = ce(x+y )t ; +a
(13.18)
x
y
We have used 3-point central dierencing in our example, but this choice was for convenience
only, and its use is not necessary to arrive at Eq. 13.15.
4
In the following we analyze four dierent methods for nding a xed, steady-state
solution to the 2-D representative equation 13.16. In each case we examine
1. The stability.
2. The accuracy of the xed, steady-state solution.
3. The convergence rate to reach the steady-state.
P (E ) = (1 ; h x ; h y )E ; 1
Q(E ) = h
giving the solution
"
(13.19)
n
1
un = c 1 ; h ; h ; +a
x
y
x
y
Like its counterpart in the 1-D case, this method:
1. Is unconditionally stable.
2. Produces the exact (see Eq. 13.18) steady-state solution (of the ODE) for any
h.
3. Converges very rapidly to the steady-state when h is large.
Unfortunately, however, use of this method for 2-D problems is generally impractical
for reasons discussed in Section 12.5.
243
Now apply the factored Euler method given by Eq. 12.20 to the 2-D representative
equation. There results
(1 ; h x)(1 ; h y )un+1 = un + ha
from which
P (E ) = (1 ; h x)(1 ; h y )E ; 1
Q(E ) = h
(13.20)
giving the solution
"
#n
1
un = c (1 ; h )(1 ; h ) ; + a; h
x
y
x
y
x y
We see that this method:
1. Is unconditionally stable.
2. Produces a steady state solution that depends on the choice of h.
3. Converges rapidly to a steady-state for large h, but the converged solution is
completely wrong.
The method requires far less storage then the unfactored form. However, it is not
very useful since its transient solution is only rst-order accurate and, if one tries to
take advantage of its rapid convergence rate, the converged value is meaningless.
Next apply Eq. 12.31 to the 2-D representative equation. One nds
(1 ; h x)(1 ; h y )(un+1 ; un) = h(xun + y un + a)
which reduces to
(1 ; h x)(1 ; h y )un+1 = 1 + h2xy un + ha
and this has the solution
"
#n
2 xy
1
+
h
un = c (1 ; h )(1 ; h ) ; +a
x
y
x
y
This method:
Finally consider the delta form of a second-order time-accurate method. Apply Eq.
12.30 to the representative equation and one nds
1
1
1 ; 2 hx 1 ; 2 hy (un+1 ; un) = h(xun + y un + a)
which reduces to
1
1
1
1
1 ; hx 1 ; hy un+1 = 1 + hx 1 + hy un + ha
2
2
2
2
and this has the solution
2
1 h 1 + 1 h 3n
1
+
x
y 7
6
un = c64 21 21 75 ; +a
x
y
1 ; 2 hx 1 ; 2 hy
This method:
1. Is unconditionally stable.
2. Produces the exact steady{state solution for any choice of h.
3. Converges very slowly to the steady{state solution for large values of h, since
jj ! 1 as h ! 1.
All of these properties are identical to those found for the factored delta form of the
implicit Euler method. Since it is second order in time, it can be used when time
accuracy is desired, and the factored delta form of the implicit Euler method can be
used when a converged steady-state is all that is required.5 A brief inspection of eqs.
12.26 and 12.27 should be enough to convince the reader that the 's produced by
those methods are identical to the produced by this method.
In practical codes, the value of h on the left side of the implicit equation is literally switched
from h to 12 h.
5
245
The arguments in Section 13.3 generalize to three dimensions and, under the conditions given in 13.16 with an A(zz) included, the model 3-D cases6 have the following
representative equation (with = 0):
du = [ + + ]u + a
(13.21)
x
y
z
dt
Let us analyze a 2nd-order accurate, factored, delta form using this equation. First
apply the trapezoidal method:
un+1 = un + 12 h[(x + y + z )un+1 + (x + y + z )un + 2a]
Rearrange terms:
1 ; 21 h(x + y + z ) un+1 = 1 + 21 h(x + y + z ) un + ha
Put this in delta form:
1 ; 1 h(x + y + z ) un = h[(x + y + z )un + a]
2
Now factor the left side:
1
1
1
h
1
;
h
1
;
h
1; 2 x
2 y
2 z un = h[(x + y + z )un + a] (13.22)
This preserves second order accuracy since the error terms
1 h2( + + )u and 1 h3
4 x y x z y z n
8 x y z
are both O(h3). One can derive the characteristic polynomial for Eq. 13.22, nd the
root, and write the solution either in the form
2
3n
1
1
1
2
3
6 1 + h(x + y + z ) + 4 h (x y + x z + y z ) ; 8 h x y z 7
7
un = c64 21
5
1
1
2
3
1 ; 2 h(x + y + z ) + 4 h (xy + xz + y z ) ; 8 h xy z
; + a +
x
y
z
6
(13.23)
3n
2
1
1
1
1
3
6 1 + 2 hx 1 + 2 hy 1 + 2 hz ; 4 h x y z 7
a (13.24)
7 ;
un = c64
5
1
1
1
x + y + z
1 ; hx 1 ; hy 1 ; hz
2
2
2
It is interesting to notice that a Taylor series expansion of Eq. 13.24 results in
= 1 + h(x + y + z ) + 21 h2(x + y + z )2
(13.25)
h
i
+ 14 h3 3z + (2y + 2x) + 22y + 3xy + 22y + 3y + 2x2y + 22xy + 3x +
which veries the second order accuracy of the factored form. Furthermore, clearly,
if the method converges, it converges to the proper steady-state.7
With regards to stability, it follows from Eq. 13.23 that, if all the 's are real and
negative, the method is stable for all h. This makes the method unconditionally stable
for the 3-D diusion model when it is centrally dierenced in space.
Now consider what happens when we apply this method to the biconvection model,
the 3-D form of Eq. 13.12 with periodic boundary conditions. In this case, central
dierencing causes all of the 's to be imaginary with spectrums that include both
positive and negative values. Remember that in our analysis we must consider every
possible combination of these eigenvalues. First write the root in Eq. 13.23 in the
form
+ i ; + i
= 11 ;
i ; + i
where , and
are real numbers that can have any sign. Now we can always nd
one combination of the 's for which , and
are both positive. In that case since
the absolute value of the product is the product of the absolute values
2 + ( +
)2
(1
;
)
2
jj = (1 ; )2 + ( ;
)2
>1
and the method is unconditionally unstable for the model convection problem.
From the above analysis one would come to the conclusion that the method represented by Eq. 13.22 should not be used for the 3-D Euler equations. In practical
cases, however, some form of dissipation is almost always added to methods that are
used to solve the Euler equations and our experience to date is that, in the presence
of this dissipation, the instability disclosed above is too weak to cause trouble.
7
13.6. PROBLEMS
13.6 Problems
247
Appendix A
USEFUL RELATIONS AND
DEFINITIONS FROM LINEAR
ALGEBRA
A basic understanding of the fundamentals of linear algebra is crucial to our development of numerical methods and it is assumed that the reader is at least familar with
this subject area. Given below is some notation and some of the important relations
between matrices and vectors.
A.1 Notation
1. In the present context a vector is a vertical column or string. Thus
2 v1 3
6 7
~v = 66 v..2 77
4 . 5
vm
T
and its transpose ~v is the horizontal row
~vT = [v1 ; v2; v3; : : : ; vm] ; ~v = [v1 ; v2; v3 ; : : : ; vm ]T
2. A general m m matrix A can be written
2 a11 a12
6a a
A = (aij ) = 664 21 22
am1 am2
249
a1m 3
a2m 777
...
amm
4. The inverse of a matrix (if it exists) is written A;1 and has the property that
A;1A = AA;1 = I , where I is the identity matrix.
A.2 Denitions
1. A is symmetric if AT = A.
2. A is skew-symmetric or antisymmetric if AT = ;A.
3. A is diagonally dominant if aii Pj6=i jaij j ; i = 1; 2; : : : ; m and aii > Pj6=i jaij j
for at least one i.
4. A is orthogonal if aij are real and AT A = AAT = I
5. A is the complex conjugate of A.
6. P is a permutation matrix if P ~v is a simple reordering of ~v.
7. The trace of a matrix is Pi aii.
8. A is normal if AT A = AAT .
9. det[A] is the determinant of A.
10. AH is the conjugate transpose of A, (Hermitian).
11. If
a b
A= c d
then
det[A] = ad ; bc
and
A;1 = det[1 A] ;dc ;ab
A.3. ALGEBRA
251
A.3 Algebra
We consider only square matrices of the same dimension.
1. A and B are equal if aij = bij for all i; j = 1; 2; : : : ; m.
2. A + (B + C ) = (C + A) + B , etc.
3. sA = (saij ) where s is a scalar.
4. In general AB 6= BA.
5. Transpose equalities:
(A + B )T = AT + B T
(AT )T = A
(AB )T = B T AT
6. Inverse equalities (if the inverse exists):
(A;1);1 = A
(AB );1 = B ;1 A;1
(AT );1 = (A;1 )T
A.4 Eigensystems
1. The eigenvalue problem for a matrix A is dened as
A~x = ~x or [A ; I ]~x = 0
and the generalized eigenvalue problem, including the matrix B , as
A~x = B~x or [A ; B ]~x = 0
2. If a square matrix with real elements is symmetric, its eigenvalues are all real.
If it is asymmetric, they are all imaginary.
X ;1AX =
where X is a matrix whose columns are the eigenvectors,
h
i
X = ~x1 ; ~x2; : : : ; ~xm
and is the diagonal matrix
2 0
66 01 . . .
= 66 .. . .2 . .
4. . .
03
... 77
7
0 75
0 0 m
If A can be diagonalized, its eigenvectors completely span the space, and A is
said to have a complete eigensystem.
A.4. EIGENSYSTEMS
253
10. Defective matrices cannot be diagonalized but they can still be put into a compact form by a similarity transform, S , such that
2J 0 0 3
66 01 J . . . ... 77
7
J = S ;1AS = 66 .. . .2 . .
4 . . . 0 75
0 0 Jk
2 1 0
66 0i 1
i
66
Ji = 66 0 0 i
64 ...
...
0 0
0 3
...
...
...
0
... 77
7
0 777
1 75
i
12. Use of the transform S is known as putting A into its Jordan Canonical form.
A repeated root in a Jordan block is referred to as a defective eigenvalue. For
each Jordan submatrix with an eigenvalue i of multiplicity r, there exists one
eigenvector. The other r ; 1 vectors associated with this eigenvalue are referred
to as principal vectors. The complete set of principal vectors and eigenvectors
are all linearly independent.
13. Note that if P is the permutation matrix
2
3
0 0 1
P = 64 0 1 0 75
1 0 0
then
P T = P ;1 = P
2
3
2
3
1 0
0 0
P ;1 64 0 1 75 P = 64 1 0 75
0 0
0 1
14. Some of the Jordan subblocks may have the same eigenvalue. For example, the
3
2 2 1 1
66 64 1 1 75
66
1
66
1
66
1
1
66
1
66
2 1
64
2
3
3
77
77
77
77
77
77
75
9 eigenvalues
3 distinct eigenvalues
3 Jordan blocks
5 linearly independent eigenvectors
3 principal vectors with 1
1 principal vector with 2
0M
11=p
X
jjvjjp = @ jvj jpA
j =1
jjAvjjp
jjAjjp = max
x6=0 jjv jj
p
255
4. Let A and B be square matrices of the same order. All matrix norms must have
the properties
jjAjj
jjc Ajj
jjA + B jj
jjA B jj
0; jjAjj = 0 implies A = 0
= jcj jjAjj
jjAjj + jjB jj
jjAjj jjB jj
q T
jjAjj2 =
(A A )
jjAjj1 = maxi=1;2;;M PMj=1 jaij j maximum row sum
where jjAjjp is referred to as the Lp norm of A.
6. In general (A) does not satisfy the conditions in 4, so in general (A) is not a
true norm.
7. When A is normal, (A) is a true norm, in fact, in this case it is the L2 norm.
8. The spectral radius of A, (A), is the lower bound of all the norms of A.
Appendix B
SOME PROPERTIES OF
TRIDIAGONAL MATRICES
B.1 Standard Eigensystem for Simple Tridiagonals
In this work tridiagonal banded matrices are prevalent. It is useful to list some of
their properties. Many of these can be derived by solving the simple linear dierence
equations that arise in deriving recursion relations.
Let us consider a simple tridiagonal matrix, i.e., a tridiagonal with constant scalar
elements a,b, and c, see Section 3.4. If we examine the conditions under which the
determinant of this matrix is zero, we nd (by a recursion exercise)
det[B (M : a; b; c)] = 0
if
p
m
b + 2 ac cos M + 1 = 0 ; m = 1; 2; ; M
258
These vectors are the columns of the right-hand eigenvector matrix, the elements of
which are
j ; 1
j = 1; 2; ; M
X = (xjm) = ac 2 sin Mjm
;
(B.4)
m = 1; 2; ; M
+1
Notice that if a = ;1 and c = 1,
j ; 1
a 2 = ei j; 2
(B.5)
c
(
1)
1)
(B.6)
259
DM det[B (M : a; b; c)]
Dening D to be 1, it is simple to derive the rst few determinants, thus
D = 1
D = b
D = b ; ac
D = b ; 2abc
(B.9)
One can also nd the recursion relation
DM = bDM ; ; acDM ;
(B.10)
Eq. B.10 is a linear OE the solution of which was discussed in Section 4.2. Its
characteristic polynomial P (E ) is P (E ; bE + ac) and the two roots to P () = 0
result in the solution
8"
p
p
"
#M 9
< b + b ; 4ac #M
=
1
b
;
b
;
4
ac
DM = p
;
;
2
2
b ; 4ac :
M = 0; 1; 2;
(B.11)
where we have made use of the initial conditions D = 1 and D = b. In the limiting
case when b ; 4ac = 0, one can show that
0
0
1
+1
DM = (M + 1) 2b
!M
; b = 4ac
2
+1
260
Then for M = 4
B; =
1
and for M = 5
B ;1 =
2
1 666
D4 4
D
;cD
cD
;c D
;aD D D ;cD D c D
a D ;aD D D D
;cD
;a D a D
;aD
D
3
2
D4
6
3
1 666 ;a2aD
D5 64 ;a3DD21
aD
The general element dmn is
4
;cD
3
7
7
7
5
3
7
17
7
2 7
7
5
3
cD
;c D c D
D D ;cD D c D D ;c D
;aD D D D ;cD D c D
a D D ;aD D D D
;cD
;a D
aD
;aD
D
2
1
3
Upper triangle:
m = 1; 2; ; M ; 1 ; n = m + 1; m + 2; ; M
dmn = Dm; DM ;n(;c)n;m =DM
1
Diagonal:
n = m = 1; 2; ; M
dmm = DM ; DM ;m =DM
1
Lower triangle:
m = n + 1; n + 2; ; M ; n = 1; 2; ; M ; 1
dmn = DM ;mDn; (;a)m;n=DM
1
Bp(M : a; b; c; )
(B.12)
261
m ; i(a ; c) sin 2m ; m = 0; 1; 2; ; M ; 1
m = b + (a + c) cos 2M
M
(B.13)
The right-hand eigenvector that satises Bp(a; b; c)~xm = m~xm is
~xm = (xj )m = ei j m=M ; j = 0; 1; ; M ; 1
(B.14)
p
where i ;1, and the right-hand eigenvector matrix has the form
ij 2m
0; 1; ; M ; 1
X = (xjm) = e M
; mj =
= 0; 1; ; M ; 1
The left-hand eigenvector matrix with elements x0 is
2
j
;im
M ; m = 0; 1; ; M ; 1
X ; = (x0mj ) = M1 e
j = 0; 1; ; M ; 1
Note that both X and X ; are symmetric and that X ; = M1 X , where X is the
conjugate transpose of X .
(2
Notice the remarkable fact that the elements of the eigenvector matrices X and X ;
for the tridiagonal circulant matrix given by eq. B.12 do not depend on the elements
a; b; c in the matrix. In fact, all circulant matrices of order M have the same set of
linearly independent eigenvectors, even if they are completely dense. An example of
a dense circulant matrix of order M = 4 is
2
b b b b 3
6
b b b b 777
6
6
(B.15)
4 b b b b 5
b b b b
The eigenvectors are always given by eq. B.14, and further examination shows that
the elements in these eigenvectors correspond to the elements in a complex harmonic
analysis or complex discrete Fourier series.
Although the eigenvectors of a circulant matrix are independent of its elements,
the eigenvalues are not. For the element indexing shown in eq. B.15 they have the
general form
MX
;
m = bj ei jm=M
1
j =0
(2
262
Consider a mesh with an even number of interior points such as that shown in Fig.
B.1. One can seek from the tridiagonal matrix B (2M : a; b; a; ) the eigenvector subset
that has even symmetry when spanning the interval 0 x . For example, we seek
the set of eigenvectors ~xm for which
2
b
6
a
6
6
6
6
6
6
6
4
a
b a
a ...
32x 3
1
6
7
7
x
6
2 7
7
6
7
... 77
6
7
6
7
7
6
7
.
7
.
6
7
7
.
7
76
6
a 5 4 x2 75
... a
a b
a b
2 3
x1
6
x2 777
6
6
... 7
6
6
= m 66 .. 777
.7
6
6 7
4 x2 5
b a
7
7
a b a
7
7
.
.
7
.
a
~
~
~xm = m~xm
7
B (M : a; b; a)xm =
7
... a
7
7
a b a 75
a b+a
(B.16)
By folding the known eigenvectors of B (2M : a; b; a) about the center, one can show
from previous results that the eigenvalues of eq. B.16 are
m = b + 2a cos (22mM;+1)1
; m = 1; 2; ; M
(B.17)
263
x=
Line of Symmetry
x =0
j0 = 1 2 3 4 5
M0
j= 1 2 3
M
b. An odd{numbered mesh
Figure B.1 { Symmetrical folds for
special cases
; 1)
m = b + 2a cos (2m2M
and the corresponding eigenvectors are
j0 = 1 2 3 4 5 6
M0
j= 1 2 3
M
a. An even-numbered mesh
Line of Symmetry
x =0
x=
; m = 1; 2; ; M
; j = 1; 2; ; M
264
m = 1; 2; ; M
j = 1; 2; ; M
;2 + 2 cos() = ;4 sin (=2)
2
;2
1
1 ;2 1
1 ;2 1
1 ;2 1
1 ;2
3
7
7
7
7
7
7
5
(B.18)
When one boundary condition is Dirichlet and the other is Neumann (and a diagonal
preconditioner is applied to scale the last equation),
2
6
6
6
6
6
6
4
;2
1
1 ;2 1
1 ;2 1
1 ;2 1
1 ;1
3
7
7
7
7
7
7
5
m
~xm
(2
m
;
1)
= ;2 + 2 cos 2M + 1
(2
m
;
1)
= sin j 2M + 1
(B.19)
Appendix C
THE HOMOGENEOUS
PROPERTY OF THE EULER
EQUATIONS
The Euler equations have a special property that is sometimes useful in constructing
numerical methods. In order to examine this property, let us rst inspect Euler's
theorem on homogeneous functions. Consider rst the scalar case. If F (u; v) satises
the identity
F (u; v) = nF (u; v)
(C.1)
for a xed n, F is called homogeneous of degree n. Dierentiating both sides with
respect to and setting = 1 (since the identity holds for all ), we nd
u @F
+ v @F = nF (u; v)
@u @v
(C.2)
F (Q) = nF (Q)
(C.3)
@F Q = nF (Q)
@q
265
(C.4)
(C.5)
can be written
E = An Q + O(h2)
F = BnQ + O(h2)
(C.6)
since the terms En ; AnQn and Fn ; BnQn are identically zero for homogeneous
vectors of degree 1, see eq. C.4. Notice also that, under this condition, the constant
term drops out of eq. 6.106.
As a nal remark, we notice from the chain rule that for any vectors F and Q
"
@F (Q) = @F @Q = A @Q
@x
@Q @x
@x
We notice also that for a homogeneous F of degree 1, F = AQ and
"
@F = A @Q + @A Q
@x
@x @x
(C.7)
(C.8)
@A Q = 0
@x
in spite of the fact that individually [@A=@x] and Q are not equal to zero.
(C.9)
Note that this depends on the form of the equation of state. The Euler equations are homogeneous if the equation of state can be written in the form p = f (), where is the internal energy
per unit mass.
1
Bibliography
[1] D. Anderson, J. Tannehill, and R. Pletcher. Computational Fluid Mechanics and
Heat Transfer. McGraw-Hill Book Company, New York, 1984.
[2] C. Hirsch. Numerical Computation of Internal and External Flows, volume 1,2.
John Wiley & Sons, New York, 1988.
267