Professional Documents
Culture Documents
Laplace Equation
Fredrik Berntsson , and Lars Elden
1 Introduction
We consider a two dimensional steady state heat conduction problem. The
Laplace equation is valid in a domain
[0; 1] [0; 1], with a hole. The
domain is displayed in Figure 1.1. Find a temperature distribution T 2
Department of Mathematics, Linkoping University, S-581 83 Linkoping, Sweden.
E-mail: laeld@math.liu.se and frber@math.liu.se.
1
1 INTRODUCTION 2
C 2(
) \ C 1(
) that satises,
T = 0;in
;
T = g; on ?1 ; (1.1)
~n T = h; on ?1 ;
r
where ~n denotes outward unit normal, and g; h are the temperature and
heat{
ux data on the outer boundary ?1 . Our aim is to compute an ap-
proximation of T on the inner boundary ?2 . This Cauchy problem for the
Laplace equation arises in applications such as non{destructive testing [1]
and electro-cardiology [13, 14]. A similar problem was studied earlier in [8],
and more recently in [7], see also [21, 23].
y ?1
1
?2
1 x
Figure 1.1: The two dimensional domain
. The hole corresponds to the
set fl1 x; y l2 g.
In this paper we consider, for deniteness, only square domains, but the
numerical techniques can be applied to general, doubly connected, polygonal
domains. The basic idea is to compute numerically a conformal mapping
of the polygonal domain onto a domain where the problem can be solved,
using a separation of variables technique. Thus, it is also possible to solve
Cauchy problems for the Laplace Equation on simply connected polygonal
domains, where Cauchy data are given on a part of the boundary.
Cauchy problems for elliptic equations are ill{posed [19], i.e. the solution
does not depend continuously on the boundary data, and small errors in the
data can destroy the numerical solution. We discuss the nature of the ill{
posedness, by computing approximately the singular values and singular
functions of a certain operator related to the problem.
We investigate numerical aspects of Tikhonov regularization applied to a
discretization of the problem. The nite dierence method leads to a sparse,
1 INTRODUCTION 3
0
10
−2
10
−4
10
−6
10
−8
10
−10
10
−12
10
−14
10
−16
10
−18
10
0 50 100 150 200 250 300
Figure 2.1: The singular values of the matrix Ke . The sequence fk g tend
rapidly to zero, and several singular values are of the same order of magni-
tude as the machine precision.
is not known explicitly. However, in the case where the dierential equa-
tion, = 0, is valid in the annulus
0, cf. Figure 4.1, an explicit formula
for the singular values of the linear operator, mapping the Dirichlet data
jr=r0 onto jr=1, can be derived. Asymptotically, the singular values de-
cay as k e?
k , where
= ?log(r0)=2, and r0 is the inner radius of
0 .
The factor two is present since the singular values appear in pairs. This is
discussed further in the appendix. By letting
0 be the annulus conformally
equivalent to
, we get in some sense equivalent operators. It is reasonable
to expect the rate of decay for the singular values to be nearly the same.
Numerical experiments, using several dierent domains
, do support this.
Typically in inverse problems, the singular vectors (functions) corre-
sponding to large singular values are very smooth. Here, however, we see
that the vector v1 has spikes at the corner locations. This illustrates the
fact that derivatives of the solution of a well-posed boundary value problem
on
can have singularities at the corners of the inner boundary [6, p. 34].
Similar spikes are present in all of the rst four right singular vectors, and
also in a few of the others. Since these are associated with the large singular
values they cause no diculties in the solution of the inverse problem.
There is a high level of symmetry present in the singular vectors fvk ; uk g.
This is a consequence of the corresponding symmetries in the domain
. We
also see the typical smoothing properties of the operator illustrated in v50,
3 TIKHONOV REGULARIZATION 6
0.06 0.4
0.3
0.05
0.2
0.04
0.1
0.03 0
0 100 200 300 400 500 0 100 200 300
U(:,1) V(:,1)
0.1 0.1
0.05 0.05
0 0
−0.05 −0.05
−0.1 −0.1
0 100 200 300 400 500 0 100 200 300
U(:,5) V(:,5)
0.1 0.1
0.05 0.05
0 0
−0.05 −0.05
−0.1 −0.1
0 100 200 300 400 500 0 100 200 300
U(:,50) V(:,50)
3 Tikhonov regularization
In the previous section we dened an operator K by the equation Kf = g ,
where g = T j?1 and T solves (2.1). By discretizing (2.1) using nite dier-
ences we approximate the operator equation by an overdetermined linear
system Ke fe= eg, with matrix Ke 2 Rnm and vectors fe and eg. The compu-
tation of the matrix K~ requires solving as many well-posed boundary value
problems on
as the number of points on the inner boundary, which may
be a prohibitively high cost. This is discussed brie
y in Remark 3.1 Also,
Ke is not a sparse matrix. Since the original problem is ill{posed, Ke is very
ill{conditioned, if the grid is ne enough. Thus regularization is needed.
3 TIKHONOV REGULARIZATION 7
min kK f
e e ? gek2 + 2kLfek2
= minm
Ke fe ? ge
;
(3.1)
fe2Rm fe2R
L 0
0 0
100 100
200 200
300 300
400 400
500 500
600 600
700 700
800 800
900 900
1000 1000
Figure 3.1: The structure of the matrix Ae (left), that correspond to (3.3),
and the matrix R (right), such that Ae = QR, and Q is orthogonal.
4 A spectral method
Let
0 be the annulus fz = rei : r0 < r < 1g, and assume that (z ) is an
analytic function mapping
conformally onto
0, cf. Figure 4.1. For sim-
plicity of notation we will identify R2 with the complex plane C . Two
properties of conformal mappings are of interest here: If (z ) is harmonic
in
0 then (z ) = ((z )) is harmonic in
. Also ~n = 0 on the r
boundary @
0 implies that ~n = 0 on @
. Thus if we nd a function
r
(z ) 2 C 2 (
0) \ C 1 (
0) such that
= 0; 0 < 2; r0 < r < 1;
(ei ) =
(ei ); 0 < 2; (4.1)
@ (ei ) = 0; 0 < 2;
@r
4 A SPECTRAL METHOD 9
c (r e 2
bk eik ; (4.5)
jkjc
Similarly we denote by c the regularized solution with noisy data
.
4.1 Error estimate
In this section we will investigate the dierence between the solution ,
dened by (4.4), and the regularized solution c , dened by (4.5) with noisy
data. We assume that we have an a priori bound, k (r0; )k M , on the
exact solution. In this section k k denotes the norm on L2 ([0; 2 ]).
Lemma 4.1 Let c and c be the regularized solutions, dened by (4.5),
with data
and
. Suppose that k
?
k , then following estimate
holds,
k c(r; ) ? c(r; )k (rc + r?c ) 2 : (4.6)
4 A SPECTRAL METHOD 10
1 1
d
0
r0
1
Figure 4.1: The width d in the square geometry determines, uniquely, the
inner radius r0 of the conformally equivalent annulus.
k c(r; ) ?
rk + r?k 2 2 X
jb
k ? b
kj2:
c (r; )k jmax
2
kjc 2 jkjc
We make the observation that, for k > 0 and r 1,
rk+1 + r?k?1 ? rk ? r?k = (1 ? r)(r?k?1 ? rk ) 0:
Therefore the maximum is attained for jkj = c . Using, once again, the Par-
seval relation, and the bound k
?
k , we get the desired result.
We conclude that, for the regularized solution (4.5), we have stable de-
pendence on the data.
Lemma 4.2 Let be the solution (4.4) and c be the solution (4.5), with
exact data
. Suppose that we have an a priori bound k (r0; )k M . Then
we have the estimate,
k (r; ) ? c(r; )k r0c (rc + r?c )M: (4.7)
4 A SPECTRAL METHOD 11
1 1
0.8
0.5
0.6
0
0.4
−0.5
0.2
−1 0
−1 −0.5 0 0.5 1 0 0.2 0.4 0.6 0.8 1
c (r; )k 2 M + 2M
n o
1 + 2 M ? + 2M 1? ;
we use the Matlab routine spaps, for computing the approximating cubic
spline. By using the Fast Fourier transform (FFT) we compute approxi-
mately the sequence fb
k g. The solution at the inner radius is computed by
solving (4.3) and using the inverse FFT. The frequency components corre-
sponding to jkj > c are explicitly set to zero. The formula (4.5) is well
suited for computations. However, in our implementation we solve (4.3) nu-
merically, using a standard Runge{Kutta method. Both methods are equally
accurate. The dierence in computational cost is not important since the
computation of the cubic spline, used for mapping the boundary data, is
more costly.
Finally, the nodes at the inner radius of the annulus are mapped onto
a set of non{uniform grid points on ?2 , using the conformal mapping. The
solution T j?2 is then obtained by cubic spline interpolation.
For this scheme to work we need a method for computing numerically the
conformal mapping
0 = (
). To nd such a mapping for general regions
is a dicult problem. However, for simply connected polygonal regions
this problem is solved by the Schwarz{Christoel mapping function [24].
A similar mapping function exist for doubly connected domains [17, 18]. A
software package for this case exists, and is freely available from Netlib1 . The
mapping displayed in Figure 4.2 was computed using this code. Numerical
computation of the conformal mapping requires that a non{linear system of
equations, for determining accessory parameters of the mapping, is solved.
The number of unknowns is M + 2, where M is the number of corners in
.
Each point z 2
0 is then mapped onto ?1 (z ) 2
by computing a complex
valued integral. Thus the computational cost for mapping the set of points
feik gNk=1 onto a non{uniform grid on ?1 is O(N ).
The mapping g 7!
= g ?1 is such that smooth boundary data on
?1 are sometimes mapped onto a function that has sharp features. The
derivative of has a singularity at the corners of
. This can be seen
in Figure 4.2, where the spacing between the grid points on ?1 is very
uneven. As a consequence,
= g ?1 , does not in general have a continous
derivative. Therefore
is not nessecarily well approximated by a truncated
Fourier series. This could result in a loss of accuracy.
4.3 Derivative boundary conditions
So far we have assumed that h = 0, i.e. that the normal derivative ~n rT
is zero on ?1 . A general problem can always be reduced to this case, as ex-
1
http://www.netlib.org/toms/785
4 A SPECTRAL METHOD 14
0 , and can be used for subtracting the singularities from the data, thereby
creating a new problem with dierent 'well{behaved' data [2, p. 233].
In a practical implementation we need to solve a problem: = 0 in
0
3
6
2
4
1
2
0
0
−1
−2
−2
−4
−3
−6
−4
−8
−5
−10
0 0.5 1 1.5 2 2.5 3 3.5 4 0 1 2 3 4 5 6
1.5 8
1
4
0.5
0
−2
0
−4
−6
−0.5
−8
−1 −10
0 1 2 3 4 5 6 0 1 2 3 4 5 6
In our implementation we use three grid points on each side of the singu-
larity. The modied boundary data 0 = ~n r 0jr=1 are displayed in Figure
4.3. Clearly 0 has a continuous normal derivative at z = ei . The three
remaining singularities in can be treated in the same way. The function
0 is obtained by solving a Cauchy problem, with the modied, and well{
behaved, data. Finally, (z ) = 0(z ) + c1 1(z ) + c2 2(z ), z = rei 2
0 ,
solves the original problem.
5 Numerical experiments
In this section we give numerical results demonstrating that the proposed
methods work well. For the numerical experiments we selected a domain
6 CONCLUDING REMARKS 16
, where the hole corresponded to the set f0:2 x; y 0:8g. The test
problems were created in the following way: First we selected the function
T , which is harmonic in
, and computed the corresponding temperature
and heat{
ux data, eg and eh, on ?1 . Normally distributed noise was added
giving vectors eg , and eh . By solving numerically the Cauchy problem (1.1)
we obtained approximations of the steady state temperature on ?2 . We
conducted two separate tests, using dierent functions T as exact solutions.
In Figure 5.1 we display the results obtained using Tikhonov regular-
ization on the nite dierence matrix, i.e. by solving (3.3), where L is a
discretization of a second derivative. In this experiment we used a grid with
504 nodes on ?1 and 304 nodes on ?2 . Thus we solved a least squares prob-
lem with a matrix of size 16633 16129, and with 57541 non{zero elements.
In Figure 5.2 the results obtained by solving an equivalent problem on
the annulus are displayed. Since the normal derivatives on ?1 are non{zero,
we used the technique described in Section 4.3. When solving the Cauchy
problem on the annulus we needed to compute the FFT of vectors of size
4096. The system of ordinary dierential equations (4.3) were solved using
the Matlab code ode45.
From these tests we conclude that the proposed methods work well. In
all cases we managed to solve the inverse problem with acceptable accuracy.
6 Concluding remarks
We have considered two methods for solving a Cauchy problem for the
Laplace equation in a doubly connected domain.
By discretizing the dierential equation on the domain we get an overde-
termined system of linear equations. In this paper we have used the nite
dierence method, which works well for the relatively simple domain consid-
ered here. Alternatively, in the case of a more complicated domain, a nite
element method could be used. Both methods should give comparable re-
sults. Since the original problem is ill{posed the discrete problem is severely
ill{conditioned, if a suciently ne grid is used. Thus methods for solv-
ing discrete ill{posed problems need to be applied. Here we use Tikhonov's
method, applied only to the nodes at the inner boundary. The resulting
numerical code works well, and give good accuracy, but it is expensive in
terms of computations and memory.
The solution to the Cauchy problem for the Laplace equation in an an-
nulus can be written explicitly using a Fourier series. Thus, by mapping the
domain
conformally onto an annulus we obtain an equivalent problem,
6 CONCLUDING REMARKS 17
4.5
4 5
3.5
3
4
2.5
2
3
1.5
1
2
0.5
1
0.8 1
1
0.6 0.8
0.4 0.6
0.4
0.2
0.2 0
0 0 0 0.5 1 1.5 2 2.5
6 6
5
5
4
3 4
2
3
1
0 2
−1
1 1
0.8 1
0.6 0.8
0
0.4 0.6
0.4
0.2
0.2 −1
0 0 0 0.5 1 1.5 2 2.5
Figure 5.1: Results obtained using the nite dierence method, and
Tikhonov regularization. We display the numerical solution in
(left), and
at ?2 (right,solid). Also we display the exact solution at ?2 (right,dashed).
The vertical lines mark the locations of the corners. We solved two dierent
problems, in both cases the noise was of variance 10?3 and we used the
regularization parameter = 10?5.
that can easily be solved numerically. The numerical code used for comput-
ing the conformal mapping works for doubly connected polygonal domains.
Thus the techniques described here generalize directly to more complicated
domains. This method require much less computational work than that dis-
cussed above. There is an initial cost to compute the conformal mapping,
although for the simple domain considered here the cost is negligible. A cu-
bic spline is used for interpolating the data between grids. This is the part
of the code that require most computations. Thus the computational time
is, too a large extent, determined by the size of the grid used for represent-
A THE SINGULAR VALUE DECOMPOSITION ON
0 18
5 7
4
5
4
3
2 2
1
1
0
−1
0
Acknowledgments
The work of Fredrik Berntsson is supported by a grant from the National
Graduate School for Scientic Computing. Also we thank the referees for
their constructive criticism.
Let
0 be the annulus fz = rei : r0 < r < 1g. The Cauchy problem for the
Laplace equation in
0 was discussed in Section 4. However, the problem
A THE SINGULAR VALUE DECOMPOSITION ON
0 19
References
[1] G. Alessandrini. Stable determination of a crack from boundary mea-
surements. Proc. Roy. Soc. Edinburgh Sect. A, 123(3):497{516, 1993.
[2] W. F. Ames. Numerical Methods for Partial Dierential Equations.
Academic Press, 1977.
[3] F. Berntsson. A spectral method for solving the sideways heat equation.
Inverse Problems, 15:891{906, 1999.
[4] F. Berntsson and Lars Elden. Numerical solution of an inverse steady
state heat conduction problem. In M. Tanaka and G.S. Dulikravich,
editors, Inverse Problems in Engineering Mechanics II. International
Symposium on Inverse Problems in Engineering Mechanics 2000 (ISIP
2000), Nagano, Japan, pages 91{98. Elsevier, 2000.
[5] M. Sh. Birman and M. Z. Solomjak. Spectral theory of selfadjoint op-
erators in Hilbert space. D. Reidel Publishing Co., Dordrecht, 1987.
[6] Dietrich Braess. Finite Elements. Cambridge University Press, 1997.
[7] J. Cheng, Y.C. Hon, T. Wei, and M. Yamamoto. Numerical solution
of Cauchy problem for an elliptic equation. In M. Tanaka and G.S.
Dulikravich, editors, Inverse Problems in Engineering Mechanics II.
International Symposium on Inverse Problems in Engineering Mechan-
ics 2000 (ISIP 2000), Nagano, Japan, pages 493{499. Elsevier, 2000.
[8] B. H. Dennis and G. S. Dulikravich. A nite element formulation for
the inverse detection of unknown boundary conditions in thermoelastic
problems. In M. Tanaka and G.S. Dulikravich, editors, Inverse Prob-
lems in Engineering Mechanics. International Symposium on Inverse
Problems in Engineering Mechanics 1998 (ISIP 98), Nagano, Japan,
pages 61{72. Elsevier, 1998.
[9] L. Elden. Algorithms for the regularization of ill{conditioned least
squares problems. BIT, 17:134{145, 1977.
[10] L. Elden, F. Berntsson, and T. Reginska. Wavelet and Fourier meth-
ods for solving the sideways heat equation. SIAM J. Sci. Comput.,
21(6):2187{2205, 2000.
[11] H. Engl, M. Hanke, and A. Neubauer. Regularization of Inverse Prob-
lems. Kluwer Academic Publishers, Dordrecht, the Netherlands, 1996.
REFERENCES 22
[12] Dario Fasino and Gabriele Inglese. An inverse Robin problem for
Laplace's equation: theoretical results and numerical methods. Inverse
Problems, 15(1):41{48, 1999.
[13] P. Colli Franzone, L. Guerri, S. Tentoni, C. Viganotti, S. Baru,
S. Spaggiari, and B. Taccardi. A mathematical procedure for solving
the inverse potential problem of electrocardiography. analysis of the
time-space accuracy from in vitro experimental data. Math. Biosci.,
77:353{396, 1985.
[14] P. Colli Franzone and E. Magenes. On the inverse potential problem of
electrocardiology. Calcolo, 16(4):459{538, 1979.
[15] G. H. Golub and C. F. Van Loan. Matrix Computations 3ed. Johns
Hopkins, 1996.
[16] P. C. Hansen. Rank-Decient and Discrete Ill-Posed Problems. Nu-
merical Aspects of Linear Inversion. Society for Industrial and Applied
Mathematics, Philadelphia, 1997.
[17] P. Henrici. Applied and Computational Complex Analysis, volume 3.
Wiley, 1993.
[18] Chenglie Hu. Algorithm 785: A software package for computing
Schwarz-Christoel conformal transformation for doubly connected
polygonal regions. ACM Transactions on Mathematical Software,
24(3):317{333, 1998.
[19] V. Isakov. Inverse Problems for Partial Dierential Equations.
Springer, New York, 1998.
[20] F. Natterer. An initial value approach for inverse Helmholtz problems.
Technical Report 19/96 N, Department of Mathematics, University of
Munster, 1996.
[21] Hans-Jurgen Reinhardt, Houde Han, and Dinh Nho Hao. Stability and
regularization of a discrete approximation to the Cauchy problem for
Laplace's equation. SIAM J. Numer. Anal., 36(3):890{905, 1999.
[22] F. Smithies. Integral Equations. Cambridge University Press, Cam-
bridge, 1965.
[23] U. Tautenhahn. Optimal stable solution of Cauchy problems for elliptic
equations. Zeitschrift fur Analysis und ihre Anwendungen. Journal for
Analysis and its Applications, 15(4):961{984, 1996.
REFERENCES 23