Professional Documents
Culture Documents
Analysis - Hyland PDF
Analysis - Hyland PDF
Dr J.M.E. Hyland1
Michlmas 1996
1
Comments and corrections to soc-archim-notes@lists.cam.ac.uk
Revision: 1.5
Date: 1998-10-27 15:54:56+00
Introduction v
1 Real Numbers 1
1.1 Ordered Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Convergence of Sequences . . . . . . . . . . . . . . . . . . . . . . . 1
1.3 Completeness of R: Bounded monotonic sequences . . . . . . . . . . 4
1.4 Completeness of R: Least Upper Bound Principle . . . . . . . . . . . 5
1.5 Completeness of R: General Principle of Convergence . . . . . . . . 7
2 Euclidean Space 9
2.1 The Euclidean Metric . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.2 Sequences in Euclidean Space . . . . . . . . . . . . . . . . . . . . . 9
2.3 The Topology of Euclidean Space . . . . . . . . . . . . . . . . . . . 11
2.4 Continuity of Functions . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.5 Uniform Continuity . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
3 Differentiation 17
3.1 The Derivative . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
3.2 Partial Derivatives . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
3.3 The Chain Rule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
3.4 Mean Value Theorems . . . . . . . . . . . . . . . . . . . . . . . . . 22
3.5 Double Differentiation . . . . . . . . . . . . . . . . . . . . . . . . . 23
3.6 Mean Value Theorems in Many Variables . . . . . . . . . . . . . . . 24
4 Integration 27
4.1 The Riemann Integral . . . . . . . . . . . . . . . . . . . . . . . . . . 27
4.2 Riemanns Condition: A GPC for integrability . . . . . . . . . . . . . 28
4.3 Closure Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
4.4 The Fundamental Theorem of Calculus . . . . . . . . . . . . . . . . 33
4.5 Differentiating Through the Integral . . . . . . . . . . . . . . . . . . 35
4.6 Miscellaneous Topics . . . . . . . . . . . . . . . . . . . . . . . . . . 36
5 Metric Spaces 39
5.1 Definition and Examples . . . . . . . . . . . . . . . . . . . . . . . . 39
5.2 Continuity and Uniform Continuity . . . . . . . . . . . . . . . . . . . 41
5.3 Limits of sequences . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
5.4 Open and Closed Sets in Metric Spaces . . . . . . . . . . . . . . . . 44
5.5 Compactness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
5.6 Completeness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47
iii
iv CONTENTS
6 Uniform Convergence 49
6.1 Motivation and Definition . . . . . . . . . . . . . . . . . . . . . . . . 49
6.2 The space C(X) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
6.3 The Integral as a Continuous Function . . . . . . . . . . . . . . . . . 52
6.4 Application to Power Series . . . . . . . . . . . . . . . . . . . . . . 54
6.5 Application to Fourier Series . . . . . . . . . . . . . . . . . . . . . . 55
These notes are based on the course Analysis given by Dr. J.M.E. Hyland in Cam-
bridge in the Michlmas Term 1996. These typeset notes are totally unconnected with
Dr. Hyland.
Other sets of notes are available for different courses. At the time of typing these
courses were:
Probability Discrete Mathematics
Analysis Further Analysis
Methods Quantum Mechanics
Fluid Dynamics 1 Quadratic Mathematics
Geometry Dynamics of D.E.s
Foundations of QM Electrodynamics
Methods of Math. Phys Fluid Dynamics 2
Waves (etc.) Statistical Physics
General Relativity Dynamical Systems
Physiological Fluid Dynamics Bifurcations in Nonlinear Convection
Slow Viscous Flows Turbulence and Self-Similarity
Acoustics Non-Newtonian Fluids
Seismic Waves
v
Copyright (c) The Archimedeans, Cambridge University.
All rights reserved.
Redistribution and use of these notes in electronic or printed form, with or without
modification, are permitted provided that the following conditions are met:
1. Redistributions of the electronic files must retain the above copyright notice, this
list of conditions and the following disclaimer.
2. Redistributions in printed form must reproduce the above copyright notice, this
list of conditions and the following disclaimer.
3. All materials derived from these notes must display the following acknowledge-
ment:
4. Neither the name of The Archimedeans nor the names of their contributors may
be used to endorse or promote products derived from these notes.
5. Neither these notes nor any derived products may be sold on a for-profit basis,
although a fee may be required for the physical act of copying.
6. You must cause any edited versions to carry prominent notices stating that you
edited them and the date of any change.
Real Numbers
Definition 1.2. A relation < on a set F is a strict total order when we have a < a,
a < b and b < c a < c, a < b or a = b or b > a for all a, b and c in F. We write
a b for a < b or a = b, and note that in a total order a b b < a.
a a>0
|a| = a a<0
0 a=0
1
2 CHAPTER 1. REAL NUMBERS
|x| x |x|
|y| y |y| .
In general the distance takes values in the field in question; but in the case of Q and
R, the distance is real valued, so we have a metric.
Proof. We set
n = 1 + 1 + ...+ 1 + 1
n times
Example 1.6.
1. an a iff |an a| 0
2. bn 0, bn 0, 0 cn bn , then cn 0
|a a | = |a an + an a |
|a an | + |an a |
+ = 2.
for all n K. Now (1 + |b| + |a|) can be made arbitrarily small and the result is
proved.
1 This is a rigorous form of the thoughtif n we cant have both n, n + 1 within 1/2 of .
4 CHAPTER 1. REAL NUMBERS
From now on, we consider only the complete ordered field R, and occasionally its
(incomplete) ordered subfield Q.
Proposition 1.12 (Archimedean Property).
Proof.
Cheap proof. Let a n be a bounded sequence. Say that m N is a peak number iff
am ak for all k m.
Either there are infinitely many peak numbers, in which case we enumerate them
p(1) < p(2) < p(3) < . . . in order. Then a p(k) ap(k+1) and so ap(k) is a bounded
decreasing subsequence of a n , so converges.
Or there are finitely many peak numbers. Let M be the greatest. Then for every
n > M , n is not a peak number and so we can find g(n) > n: the least r > n with
a r > an .
Define q(k) inductively by q(1) = M + 1, q(k + 1) = g(q(k)).
By definition q(k) < q(k + 1) for all k, and a q(k) < aq(k+1) for all k, so aq(k) is a
bounded, (strictly) increasing subsequence of a n and so converges.
This basis of this proof is that any sequence in a total order has a monotonic subse-
quence.
b is an upper bound for S iff s b for all s S and if S has such, S is bounded
above.
a is a lower bound for S iff a s for all s S, and if S has such, S is bounded
below.
b is an upper bound
If c < b then c < s for some s S (ie c is not an upper bound for S)
a is a lower bound
Theorem 1.17 (Least Upper Bound Principle). A non-empty set S of reals which is
bounded above has a least upper bound.
Proof. Suppose S = and bounded above. Take b an upper bound and a (in S say) so
that [a, b] S = .
Set a0 = a, b0 = b so that a0 b0 and define an bn inductively as follows:
Suppose an , bn given, then a n+1 , bn+1 are defined by stipulating:-
2 Aside: If b, b are both least upper bounds of S, then cant have b < b and cant have b < b and so
b = b .
6 CHAPTER 1. REAL NUMBERS
a
If n +bn
2 , bn S = then an+1 = an +bn
2 , bn+1 = bn .
Take < = = limn an . We can take N such that a n > for all
n N .5
But then [aN , bN ] S = and so there is s S such that s a n > .
Observation 1.18. We can deduce the completeness axiom from the LUB principle.
since
an + bn
, bn S =
2
an + bn
an , S = [an , bn ] S =
2
by induction hypothesis
4 True for n = 0 and inductively, trivial in first case and in the second, clear as
[bn+1 , bn ] S =
5 Let = > 0. We can find N such that |an | < and thus an > .
1.5. COMPLETENESS OF R: GENERAL PRINCIPLE OF CONVERGENCE 7
|an am | < n, m N.
Given > 0, a < a and so there is s S with a < s. Then there are infinitely
many n with an s > a . a + > a, so a + / S and so there are only finitely
many n with an a + . Thus there are infinitely many n with a n (a , a + ).
Take N such that |an am | < for all m, n N . We can find m N with
am (a , a + ) ie |am a| < . Then if n N ,
bn = inf{am : m n}
Euclidean Space
9
10 CHAPTER 2. EUCLIDEAN SPACE
Definition 2.3. A sequence x (n) converges to x in Rp when for any > 0 there exists
N such that 2
(n)
x x < for all n N
In symbols:
(n)
x(n) x > 0 N n N x x <
(n)
Proposition 2.4. x(n) x in Rp iff xi x in R for 1 i p.
(n)
0 < xi xi x(n) x 0
and
p
(n)
0 x(n) x xi xi 0.
i=1
Definition
(n) 2.5. A sequence x (n) Rp is bounded if and only if there exists R such that
x R for all n.
x(n(k(j))) (y, x) as j .
2 xn x in p iff x(n) x 0 in .
2.3. THE TOPOLOGY OF EUCLIDEAN SPACE 11
(n)
Observation 2.8. x (n) is Cauchy in Rp iff each xi = xi (n) is Cauchy in R for
1 i p.
Proof.
(n) is Cauchy. Take 1 i p. Given > 0, we can find N such
Suppose x(n)
that x x(m) < for all n, m N . But then for n, m N ,
|xi (n) xi (m)| x(n) x(m) <
Example 2.11.
= r b a > 0
an a, an A a A
Example 2.13.
c(n) [ ] . . . [ ]
(n) (n)
then each ci ci with ci [ai , bi ] so that ci [ai , bi ]. Therefore
c [ ] . . . [ ].
Proof. Exercise.
in .
2.4. CONTINUITY OF FUNCTIONS 13
In symbols:
Remarks.
{x : 0 < x a < r}
F 1 (V ) = {x E : f (x) V }
is open in E.
Proof. We will only prove the first part for now. The proof of the second part is given
in theorem 5.16 in a more general form.
Assume f is continuous at a and take a convergent sequence a n a in E. Suppose
> 0 given. By continuity of f , there exists > 0 such that
n
n
(x) = (x1 , . . . , xn ) = aij xj , . . . , amj xj
j=1 j=1
and so
(x) |aij | |xj | |aij | x .
ij i,j
K
In symbols:
The difference is that for continuity, the > 0 to be found depends on both x and
> 0; for uniform continuity the > 0 depends only on > 0 and is independent of
x.
Example 2.22. x x1 : (0, 1] [1, ) is continuous but not uniformly continu-
ous.
Consider
1
1 = y x
x y xy
Take x = , y = 2. Then
1
1 = 1
x y 2
while |x y| = .
16 CHAPTER 2. EUCLIDEAN SPACE
f (x) f (y) .
f (xn ) f (yn ) .
Differentiation
f (a + h) f (a) f (a)h
0 as h 0.
h
The idea is that the best linear approximation to f at a E is the affine map
x a + f (a)(x a).
Observation 3.2 (Uniqueness of derivative). If f is differentiable at a then its deriva-
tive is unique.
a are both derivatives of f at a. Then
Proof. Suppose Df a , Df
a (h)
Dfa (h) Df
h
a (h)
f (a + h) f (a) Dfa (h) f (a + h) f (a) Df
+ 0.
h h
Thus
h
LHS = (Dfa Dfa ) 0 as h 0.
h
This shows that Dfa Dfa is zero on all unit vectors, and so Df a Dfa .
Proposition 3.3. If f : E R m is differentiable at a, then f is continuous at a.
Proof. Now
17
18 CHAPTER 3. DIFFERENTIATION
Proof. Exercise.
Proof.
n,m
n,m
(h, k) = bij
1 hi kj , . . . , bij
p hi kj
i=1,j=1 i=1,j=1
K 2 2
(h, k) |bij
k | |hi | |kj | |bij
n | h k (h + k )
2
i,j,k i,j,k
=K
(h,k) K
So (h,k) 2 (h, k) and so 0 as (h, k) 0.
f = (f1 , . . . , fm ),
So (f (a))j is the derivative fj (a) at a. Conversely, if all the f j s are differentiable,
then
R(a, h)
0 as h 0.
h
We also have g(b + k) = g(b) + g (b)(k) + S(b, k), where S(b, k) 0 in the same
manner.
We can now define (b, k) = S(b,k)
k for k = 0, and (b, k) = 0 otherwise, so that
(b, k) is continuous at k = 0.
3.3. THE CHAIN RULE 21
Now
g(f (a + h)) = g(f (a) + f (a)(h) + R(a, h))
= g(f (a)) + g (f (a))(f (a)(h) + R(a, h))
+ (f (a), f (a)(h) + R(a, h)) f (a)(h) + R(a, h)
= g(f (a)) + g (f (a))(f (a)(h)) + g (f (a))(R(a, h)) + Y
as g (f (a)) is linear. So it remains to show that
g (f (a))(R(a, h)) + Y
0 as h 0.
h
1.
g (f (a))(R(a, h)) R(a, h)
= g (f (a))
h h
but as h 0, R(a,h)
h 0, and since g (f (a)) is continuous
g (f (a))(R(a, h))
0 as h 0.
h
2.
f (a)(h) h
K =K
h h
as f (a) is linear (and K is the sum of the norms of the entries in the matrix
f (a)). Also
R(a, h)
0 as h 0
h
R(a,h)
so we can find > 0 such that 0 < h < h < 1. Therefore, if
0 h < then
f (a)(h) + R(a, h)
<K+1
h
Theorem 3.13 (Rolles Theorem). If f (a) = f (b) then there exists c (a, b) with
f (c) = 0.
Proof. Either f is constant and the result is then trivial, or else without loss of gener-
ality, f takes values greater than f (a) = f (b). Then there exists c (a, b) such that
f (c) = sup{f (t) : t [a, b]}. Thus f (c) = 0.2
Theorem 3.14 (Mean Value Theorem). Suppose f : [a, b] R(a < b) is continuous
and differentiable on (a, b). Then there exists c (a, b) with
f (b) f (a)
= f (c).
ba
n
f (a + h) f (a) = Di f (i )hi .
i=1
Hence
n n
|f (a + h) f (a) i=1 Di f (a)hi | | i=1 (Di f (i ) Di f (a))hi |
=
h h
n
|Di f (i ) Di f (a)| .
i=1
Alternatively: Given > 0, take > 0 such that 3 for 0 < |h| < ,
Then if 0 < |h| < , |i a| < and so LHS RHS < n, which can be made
arbitrarily small. This shows that the LHS 0 as h 0.
Vulgarly, we can identify L(R n , Rm ) with Rmn via matrices, and so can ask
whether f is differentiable. If it is differentiable at a E, then its derivative f (a) is a
linear map Rn L(Rn , Rm ). It is better regarded as a bilinear map R n Rn Rm .
Thus (f (a)(h))(k) is regarded as f (a)(h, k). Similarly, if the partial derivatives
Di fj exist in E, we can ask whether the functions
x Di fj (x), E R
exist.
Theorem 3.16. Suppose f : E R m with E Rn open, is such that all the partial
derivatives Dk Di fj (x) (exist and) are continuous in E. Then f is twice differentiable
in E and the double derivative f (a) is a symmetric bilinear map for all a E.
Remarks.
T (h1 , h2 )
lim = D1 D2 f (a1 , a2 )
h1 0,h2 0 h1 h2
Similarly
T (h1 , h2 )
lim = D2 D1 f (a1 , a2 ).
h1 0,h2 0 h1 h2
The result follows by uniqueness of limits.
(x)
= sup
x=0 x
(x) x
for all x.
Theorem 3.19. Suppose f is as above and a, b E are such that the interval [a, b]
(line segment), [a, b] = {c(t) = tb + (1 t)a : 0 t 1}.
Then if f (d) < K for all d (a, b),
f (b) f (a) K b a .
Integration
A dissection D1 is finer than (or a refinement of) a dissection D 2 if and only if all
the points of D2 appear in D1 . Write D1 < D2 . 1
n
SD = (xi xi1 ) sup {f (x)}
i=1 xi1 xxi
n
sD = (xi xi1 ) inf {f (x)}.
xi1 xxi
i=1
These are reasonable upper and lower estimates of the area under f . For general f
we take the area below the axis to be negative.
Combinatorial Facts
Lemma 4.3. For any D, s D SD .
Lemma 4.4. If D1 D2 , then SD1 SD2 and sD1 sD2 .
Lemma 4.5. For any dissections D 1 and D2 , sD1 SD2 .
sD 1 sD 3 S D 3 S D 2
It follows that the sD are bounded by an S D0 , and the SD are bounded by any
sD 0 .
1 The mesh of = [x0 , . . . , xn ] is max1in {|xi xi1 |}. If 1 2 then mesh( 1)
mesh( 2 ).
27
28 CHAPTER 4. INTEGRATION
Definition 4.6. For f : [a, b] R bounded, define the upper Riemann integral
b
S(f ) f (x) dx = inf {SD (f )}
a D
b
Note that s(f ) S(f ). f is said to be Riemann integrable, with a f (x) dx =
iff s(f ) = S(f ).
Example 4.7.
0 x irrational,
f (x) = x [0, 1]
1 x rational.
Then S(f ) = 1, s(f ) = 0 and so f is not Riemann integrable.
0 x irrational,
f (x) = 1 x [0, 1]
q x rational = pq in lowest terms.
is Riemann integrable with
1
f (x) dx = 0
0
Conventions
b b
We defined a f (x) dx for a < b only. For a = b, a f (x) dx = 0 and for b < a,
b a
a f (x) dx = b f (x) dx.
These give a general additivity of the integral with respect to intervals, ie:
If f is Riemann integrable on the largest of the intervals,
This makes sense in the obvious case a c b, but also in all others, eg b a c.
Proof.
() Take > 0, Pick D1 such that
b
SD 1 f (x) dx <
a 2
Pick D2 such that
b
f (x) dx sD2 <
a 2
Then if D is a common refinement,
b b
S D sD SD 1 f (x) dx + f (x) dx sD2 <
a a
if and only if > 0 > 0 D with mesh(D) < and all arbitrary sums
|D (f ) | <
Applications
A function f : [a, b] R is
ba
n
= (f (xi ) f (xi1 ))
n i=1
ba
(f (b) f (a))
=
n
Now, the RHS 0 as n and so given > 0 we can find n with
ba
(f (b) f (a)) <
n
and so we have D with S D sD < . Thus f is Riemann integrable by Riemanns
condition.
Theorem 4.10. If f : [a, b] R is continuous, then f is Riemann integrable.
Note that f is bounded on a closed interval.
Proof. We will use theorem 2.23, which states that if f is continuous on [a, b], f is
uniformly continuous on [a, b]. Therefore, given > 0 we can find > 0 such that for
all x, y [a, b]:
|x y| < |f (x) f (y)| <
ba
Take n such that n < and consider the dissection
! "
(b a) (b a)
D = a, a + ,a+ 2 ,... ,b
n n
= [x0 , x1 , . . . , xn ].
Now if x, y [xi1 , xi ] then |x y| < and so |f (x) f (y)| < . Therefore
We see that
n
S D sD (xi xi1 ) = (b a)
i1
Now assume > 0 given. Take such that (b a) < . As above, we can find
D with SD sD (b a) < , so that f is Riemann integrable by Riemanns
condition.
4.3. CLOSURE PROPERTIES 31
M (f + g; c, d) M (f ; c, d) + M (g; c, d)
m(f + g; c, d) m(f ; c, d) + m(g; c, d)
Hence
sD (f ) + sD (g) sD (f + g) SD (f + g) SD (f ) + SD (g)
sD (f ) + sD (g) sD (f + g)
b
(f + g) dx
a
SD (f + g)
SD (f ) + SD (g)
and so
b b b
f dx + g dx < (f + g) dx
a 2 a 2 a
b b
< f dx + + g dx +
a 2 a 2
and so, given > 0, we can find a dissection D with S D (f ) sD (f ) < and then
Therefore |f | is Riemann-integrable.
As for f 2 , note that
M (f 2 ; c, d) m(f 2 ; c, d)
= [M (|f | ; c, d) + m(|f | ; c, d)] [M (|f | ; c, d) m(|f | ; c, d)]
2K (M (|f | ; c, d) m(|f | ; c, d))
Therefore f 2 is Riemann-integrable.
The integrability of f g follows at once, since
1
fg = (f + g)2 f 2 g 2 .
2
Estimates on Integrals
1. Suppose F : [a, b] R is Riemann-integrable, a < b. If we take D = [a, b] then
we see that
b
(b a)m(f ; a, b) f (x) dx (b a)M (f ; a, b).
a
Also SD |f | SD (f ). and so
b b
|f | f dx
a a
Thus2
b b
f dx |f | dx.
a a
on [a, b].
Observation 4.13.
x
F (x) = f (t) dt
c
x
F (x) = f (t) dt.
c
Proof. Suppose > 0 is given. By the continuity of f at d we can take > 0 such that
(d , d + ) (a, b) and
d
(F (x) g(x)) = F (x) g (x) = f (x) f (x) = 0
dx
and so F (x) g(x) = k is constant. Therefore
b
f (t) dt = F (b) F (a) = g(b) g(a).
a
a a
x
Proof. Set F (x) = c
f (t) dt. Now
g(b)
f (t) dt = F (g(b)) F (g(a))
g(a)
b
= (F g) (s) ds
a
b
= F (g(s))g (s) ds by Chain Rule
a
b
= f (g(s))g (s) ds.
a
Proof. Fix x R and suppose > 0 is given. Now g is continuous and so is uniformly
continuous on the closed bounded set E = [x 1, x + 1] [a, b]. Hence we can take
(0, 1) such that for u, v E,
Now
G(x + h) G(x) b
D1 g(x, t) dt
h a
1 b
= g(x + h, t) g(x, t) hD1 g(x, t) dt .
|h| a
But
Hence
G(x + h) G(x) b
1
D1 g(x, t) dt |b a| |h|
h a |h|
< 2 |b a| .
If
b
fN,M (x) dx limit
a
4.6. MISCELLANEOUS TOPICS 37
2. Case f : (, ) R say.
Then if
+y
f (t) dt limit
x
Metric Spaces
Examples
1. Rn with the Euclidean metric
n
d(x, y) = + (xi yi )2
i=1
1 Define
2 This is the standard metric on C[a, b]. Its the one meant unless we say otherwise.
39
40 CHAPTER 5. METRIC SPACES
Then
h(z, w) = inf {L()}
a path from z to w in S 2
1. There are continuous bijections whose inverse is not continuous. For instance
(a) Let d1 be the discrete metric on R and d 2 the Euclidean metric. Then the
identity map id : (R, d1 ) (R, d2 ) is a continuous bijection; its inverse is
not.
(b) (Geometric Example) Consider the map
with the usual metrics. This map is continuous and bijective but its inverse
is not continuous at z = 1.
2. Recall that a continuous map f : E R m where E is closed and bounded in
Rn is uniformly continuous. Usually there are lots of continuous not uniformly
continuous maps: For example
# $
tan : , R
2 2
is continuous but not uniformly continuous, essentially because
tan (x) as x .
2
Definition 5.5. Let d1 , d2 be two metrics on X. d1 and d2 are equivalent if and only if
id : (X, d1 ) (X, d2 ) is a homeomorphism. In symbols, this becomes
id : (X, d1 ) (X, d2 )
Observation 5.7.
Example 5.8. On Rn , the Euclidean, sup, and grid metrics are uniformly equivalent.
Theorem 5.10. Suppose (X, d X ) and (Y, dY ) are metric spaces. A map
f : (X, dX ) (Y, dY )
Now pick N such that n, m N d X (xn , xm ) < . Then dY (f (xn ), f (xm )) <
for all m, n N . Since > 0 arbitrary, f (x n ) is Cauchy in Y .
Definition 5.13. A metric space (X, d) is complete if and only if every Cauchy se-
quence in X converges in X.
A metric space (X, d) is compact if and only if every sequence in X has a conver-
gent subsequence.
Remarks.
However C[a, b] with the sup metric is complete but not compact.
What is more, given f C[a, b] and r > 0, the set {g : d(g, f ) r} is closed
and bounded but not compact.
3. Compactness is a topological property. If (X, d X ) and (Y, dY ) are homeo-
morphic, then X compact implies Y compact.
However, this isnt true for completeness: (0, 1] is homeomorphic to [1, ) via
x 1/x but (0, 1] is not complete while [1, ) is.
However if (X, dY ) and (Y, dY ) are uniformly homeomorphic, then X complete
implies Y complete.
f : (X, dX ) (Y, dY )
Corollary 5.17. Two metrics d 1 , d2 on X are equivalent if and only if they induce the
same notion of open set. This is because d 1 and d2 are equivalent iff
For all V d2 -open, id1 (V ) = V is d1 -open.
For all U d1 -open, id1 (U ) = U is d2 -open.
4 Recall that in a metric space (X, d): N (x) = {x : d(x, x ) < }.
5 Where f 1 (V ) = {x X : f (x) V }.
5.5. COMPACTNESS 45
Definition 5.18. Suppose (X, d) is a metric space and A X. A is closed if and only
if xn x and xn A for all n implies x A.
n N xn N (x).
5.5 Compactness
If (X, d) is a metric space and a X is fixed then the function x d(x, a) is (uni-
formly) continuous. This is because |d(x, a) d(y, a)| d(x, y), so that if d(x, y) <
then |d(x, a) d(y, a)| < .
Recall. A metric space (X, d) is compact if and only if every sequence in (X, d) has a
convergent subsequence.
If A X with (X, d) a metric space we say that A is compact iff the induced
subspace (A, dA ) is compact.7
Proof.
but clearly
xn(k) as k .
Thus, quite generally, if E is compact in a metric space (X, d), then E is closed
and E is bounded in the sense that there exists a E, r R such that
E {x : d(x, a) < r}
nth position
# $
(n)
e = (0, . . . , 0, 1 , 0, . . . ), or e(n) = nr
r
Then d(e(n) , e(m) ) = 1 for alln = m. So E = {e(n) } is closed and bounded:
E {(xn ) : d(xn , 0) 1} But e(n) has no convergent subsequence.
Theorem 5.22. Suppose f : (X, d X ) (Y, dY ) is continuous and surjective. Then
(X, dX ) compact implies (Y, dY ) compact.
Proof. Take yn a sequence in Y . Since f is surjective, for each n pick x n with f (xn ) =
yn . Then xn is a sequence in X and so has a convergent subsequence x n(k) x as
k . As f is continuous, f (xn(k) ) f (x) as k , or yn(k) y = f (x) as
k .
Therefore y n has a convergent subsequence and so Y is compact.
Application. Suppose f : E R n , E Rn closed and bounded. Then the image
f (E) Rn is closed and bounded. In particular when f : E R we have f (E) R
closed and bounded. But if F R is closed and bounded then inf F, sup F F .
Therefore f is bounded and attains its bounds.
Theorem 5.23. If f : (X, dX ) (Y, dY ) is continuous with (X, dX ) compact then f
is uniformly continuous.
Proof. As in theorem 2.23.
5.6. COMPLETENESS 47
5.6 Completeness
Recall that a metric space (X, d) is complete if and only if every Cauchy sequence in
X converges. If A X then A is complete if and only if the induced metric space
(A, dA ) is complete. That is: A is complete iff every Cauchy sequence in A converges
to a point of A.
Observation 5.26. E R n is complete if and only if E is closed.
Proof.
This is essentially the GPC. If xn is Cauchy in E, then xn x in Rn by the GPC.
But E is closed so that x E and so xn x E.
If E is not closed then there is a sequence x n E with xn x E. But xn is
Cauchy and by the uniqueness of limits x n y E for any y E. So E is not
complete.
Examples.
1. [1, ) is complete but (0, 1] is not complete.
2. Any set X with the discrete metric is complete.
3. {1, 2, .., n} with
1 1
d(n, m) =
n m
is not complete.
Consider the space B(X, R) of bounded real-valued functions f : X R on a set
X = ; with
d(f, g) = sup |f (x) g(x)| ,
xX
Proposition 5.27. The space B(X, R) with the sup metric is complete.
Proof. Take fn a Cauchy sequence in B(X, R). Fix x X. Given > 0 we can take
N such that
n, m N d(fn , fm ) <
Then
This shows that fn (x) is a Cauchy sequence in R and so has a limit, say f (x). As
x X arbitrary, this defines a function x f (x) from X to R.
Claim: fn f . Suppose > 0 given. Take N such that
n, m N d(fm , fn ) < .
Uniform Convergence
n
(1 + x) = x
n=0
n
for |x| < 1. This is quite easy to show via some form of Taylors Theorem. Thus
N
lim xn = (1 + x)
N n
n=0
As it stands this is for each individual x such that |x| < 1. It is pointwise conver-
gence.
For functions f n , f : X R, we say that fn f pointwise iff
x X fn (x) f (x).
0 x0
fn (x) = 1 x n1
1
nx 0 < x < n
which is discontinuous.
49
50 CHAPTER 6. UNIFORM CONVERGENCE
The integral of a pointwise limit need not be the limit of the integrals.
0 x 0 or x 2
n
fn (x) = xn 2
0 n n1
n n (x n ) n1 x n2
2 1
has
2
fn (x) dx = 1
0
We focus on real valued functions but everything goes through for complex valued
or vector valued functions.
We will often tacitly assume that sets X (metric spaces (X, d)) are non-empty.
Definition 6.1. Let fn , f be real valued functions on a set X. Then f n f uniformly
if and only if given > 0 there is N such that for all x X
|fn (x) f (x)| <
all n N . In symbols:
> 0 N x X n N |fn (x) f (x)| < .
This is equivalent to
Definition 6.2. Let fn , f B(X, R). Then fn f uniformly iff fn f in the sup
metric.
The connection is as follows:
If fn , f B(X, R), then these definitions are equivalent. (Theres a bit of <
vs at issue).
Suppose fn f in the sense of the first definition. There will be N such that
x X |fn (x) f (x)| < 1
for all n N . Then (f n f )nN 0 uniformly in the sense of the second
definition.
Theorem 6.3 (The General Principle of Convergence). Suppose f n : X R such
that
Either
> 0 N x X n, m N |fn (x) fm (x)| <
This notation is usually used when X is compact, when all continuous functions
are bounded.
Proof. Fix x X and suppose > 0 given. Take N such that for all y X
|f (y) f (x)| |fN (y) f (y)| + |fN (x) f (x)| + |fN (y) fn (x)|
< 3.
Theorem 6.6. The space C(X) (with the sup metric) is complete.
Proof. We know that B(X, R) is complete, and the proposition says that C(X) is
closed in B(X, R).
fn converges to f uniformly.
Proof. Omitted.
52 CHAPTER 6. UNIFORM CONVERGENCE
b b
fn (x) dx f (x) dx in R.
a a
Proof. Suppose > 0. Take N such that n N d(f n , f ) < . Then if c < d in [a, b]
for all n N .
Taking sups and infs, it follows that
b b b
fn (x) dx (b a) f (x) dx fn (x) dx + (b a)
a a a
for all n N .
Then as (b a) > 0 can be made arbitrarily small,
b b
fn (x) dx f (x) dx.
a a
So
x
: C[a, b] C[a, b].
a
(uniformly in x).
6.3. THE INTEGRAL AS A CONTINUOUS FUNCTION 53
Proof. We see from the previous proof that if N is such that for all y [a, b],
n N |fn (y) f (y)| <
then
x x
fn (t) dt f (t) dt (x a) (b a) < 2(b a).
a a
uniformly in x.
Uniform convergence controls integration, but not differentiation, for example the
functions
1
fn (x) = sin nx
n
converge uniformly to zero as n , but the derivatives cos nx converge only at
exceptional values.
Warning. There are sequences of infinitely differentiable functions (polynomials even)
which converge uniformly to functions which are necessarily continuous but nowhere
differentiable. However, if we have uniform convergence of derivatives, all is well.
Theorem 6.10. Suppose f n : [a, b] R is a sequence of functions such that
1. the derivatives fn exist and are continuous on [a, b]
2. fn g(x) uniformly on [a, b]
3. for some c [a, b], fn (c) converges to a limit, d, say.
Then fn (x) converges uniformly to a function f (x), with f (x) (continuous and)
equal to g(x).1
Proof. By the FTC,
x
fn (x) = fn (c) + fn (t) dt.
c
M n
r
k
|z0 |
N +1
N +1
r 1
<k
|z0 | 1 |zr0 |
which tends to zero as N . This shows that the power series is absolutely
con-
vergent, uniformly in z for |z| r. Whence, not only do power series an z n have a
radius of convergence R [0, ] but also if r < R, then they converge uniformly in
{z : |z| r}.
Also, if an z0n converges, so that |a n z0n | < k say, we have the following for
r < |z0 |. Choose s with r < s < |z0 |. Then for |z| r and M N we have
M
M
n1 nan z n1
nan z
N +1 N +1
n1 n1
M
an z n1 n |z| s
0
s |z0 |
N +1
M # r $n1 s n1
k n where an z0n1 k .
s |z0 |
N +1
r n1
For n N0 , n s 1 and so for N N 0 ,
M n1
M
n1 s
nan z k
|z0 |
N +1 N +1
N
s 1
k 0 as N .
|z0 | 1 |zs0 |
This shows that the series n1 nan z n1 converges uniformly inside the radius
of convergence. So what weve done, in the real case 3 is to deduce that
nan z n1
n1
is the derivative of
an z n
n1
converges. Then
an cos nt
n1
M
|SM (t) SN (t)| = an cos nt
N +1
M
|an cos nt|
N +1
M
|an |
N +1
M
n |an | 0 as N .
N +1
M
Also, |SM (t) SN (t)| = nan sin nt
N +1
M
|nan sin nt|
N +1
M
n |an | 0 as N .
N +1
So both SN (t) and SN (t) are uniformly convergent and we deduce that
d
an cos nt = nan sin nt.
dt
n1 n1
56 CHAPTER 6. UNIFORM CONVERGENCE
The right context for Fourier series is the L 2 norm arising from the inner product
2
1
f, g = f (t)g(t) dt
0
This works for smooth functions; and much more generally in the L 2 -sense; so that
for example, for continuous functions we have Parsevals Identity:
2
2 a20 2
|f (x)| dx = + an + b2n .
0 2
n1
Chapter 7
x, y X d(T x, T y) kd(x, y)
57
58 CHAPTER 7. THE CONTRACTION MAPPING THEOREM
# $
d(T a, a) = d T a, lim xn
n
= lim d(T a, xn )
n
= lim d(T a, T xn1 )
n
lim d(a, xn1 )
n
# $
= d a, lim xn1
n
= d(a, a)
= 0,
So we seek an interval [a, b] with T : [a, b] [a, b] and T a contraction on [a, b].
Now
1 1
|T x T y| = x2 y 2
2 2
1
= |x + y| |x y| .
2
So if |x| , |y| 3
4 then
1 3
|T x T y| (|x| + |y|) |x y| |x y|
2 4
and so T is a contraction on [3/4, 3/4]. Actually
! " ! "
3 3 1
T: , 0,
4 4 2
and so certainly
! " ! "
3 3 3 3
T: , ,
4 4 4 4
is a contraction.
So there is a unique fixed point of T in [3/4, 3/4]. The contraction mapping
principle even gives a way of approximating it as closely as we want.
dy
= F (x, y) (7.1)
dx
subject to y = y0 when x = x0 . We assume
F : [a, b] R R
on [a, b].
F : [a, b] R R
is continuous and satisfies a Lipschitz condition; ie there is K such that for all x [a, b]
Then the differential equation (7.1) subject to the initial condition y(x 0 ) = y0 has
a unique solution in C[a, b].
K n |x x0 |
|T n f1 (x) T n f2 (x)| d(f1 , f2 )
n!
The proof is by induction on n. The case n = 0 is trivial (and n = 1 is already
done). The induction step is as follows:
n+1 x
T f1 (x) T n+1 f2 (x) = F (t, T n f1 (t)) F (t, T n f2 (t)) dt
x
x0
K |T n f1 (t) T n f2 (t)| dt
x
x0
K.K n |t x0 |
n
d(f1 , f2 ) dt
x0 n!
K n+1 |x x0 |n+1
= d(f1 , f2 )
(n + 1)!
But
n+1 n+1
K n+1 |x x0 | K n+1 |b a|
d(f1 , f2 ) d(f1 , f2 ) 0
(n + 1)! (n + 1)!
In fact3 we can do better than this and construct a solution by iterating T starting
from f0 = 0.
f0 (x) = 0,
x
f1 (x) = 1 + 0 dt,
0
x
f2 (x) = 1 + dt = 1 + x,
0
x2
f3 (x) = 1 + x +
2!
..
.
and so on. So (of course we knew this), the series for exp(x) converges uniformly on
bounded closed intervals.
dy
= F (x, y)
dx
with y(x0 ) = y0 has a unique solution in C([a, b], R n ). The proof is the same, but with
s instead of ||s.
This kind of generalization is good for higher order differential equations. For
example if we have
d2 y dy
=F x, y,
dx2 dx
dy
with y = y0 , dy/dx = v0 at x = x0 we can set v = dx and rewrite the equation as
d y v
=
dx v F (x, y, v)
with
y y0
=
v v0
at x = x0 .
With a suitable Lipschitz condition we are home.
3 This is not a general phenomenon!
62 CHAPTER 7. THE CONTRACTION MAPPING THEOREM
F : [a, b] [c, d] R
dy
= F (x, y)
dx
with y(0) = x0 , has a unique solution in [x 0 , x0 + ].
[y0 , y0 + ] [c, d]
so long as f C. So set = L1 .
4 We aim to find a closed and so complete subspace
C C[x0 , x0 + ]
of the form
C = {f : C[x0 , x0 + ] : |f (x) y0 | }
for > 0 with T mapping C to C.
7.4. BOUNDARY VALUE PROBLEMS: GREENS FUNCTIONS 63
|y1 y2 |
|F (x, y1 ) F (x, y2 )| = 1/2 1/2
,
y1 + y2
d2 y
= y
dx2
with y(0) = y() = 0 has solutions A sin x for all A.
Write C 2 [a, b] for the twice continuously differentiable functions on [a, b], so that
Write
and
for the restricted map. Either ker L 0 = {0} then a solution (if it exists) is unique, or
ker L0 = {0}, when we lose uniqueness. Note that because p, q, r have no y or dx dy
h(a) h(b)
f (x) = h(x) gb (x) ga (x)
gb (a) ga (b)
is a solution to the boundary value problem. In fact this solution has an integral form:
b
f (x) = G(x, t)r(t) dt.
a
g (x) gb (x)
W(x) = a
ga (x) gb (x)
W (x) + p(x)W(x) = 0
and so
! x "
W(x) = C exp p(t) dt
a
67