Professional Documents
Culture Documents
Chapter 11: Fourier Series: December 13, 2013
Chapter 11: Fourier Series: December 13, 2013
Fourier Series
Summary
王奕翔
Department of Electrical Engineering
National Taiwan University
ihwang@ntu.edu.tw
1 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
2 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
REVIEW MATERIA
● Section 12.1
A rereading of Exa
Fourier’s Motivation: Solving the Heat Equation
●
INTRODUCTION
and whose ends are h
2
∂ u ∂u satisfies the assumpti
Solve u(x, t) : k 2
= , 0 < x < L, t>0 from the boundary-va
∂x ∂t
Boundary
subject to : u(0, t) = 0, u(L, t) = 0, t>0 condition
u(x, 0) = f(x), 0<x<L Initial
condition
In this section we sha
The above is called the Heat Equation, which can
be derived from heat transfer theory.
u=0 u=0
Prior to Fourier, there is no known solution to the
BVP if f(x) (initial temperature distribution over 0 L x
3 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Boundary
subject to : u(0, t) = 0, u(L, t) = 0, t>0 condition
u(x, 0) = f(x), 0<x<L Initial
condition
Step 1: Assume that the solution takes the form u(x, t) = X(x)T(t) .
(This approach was also taken by other predecessors like D. Bernoulli.)
n2 π 2
Step 4: Once we fix λ = L2 , n = 1, 2, . . ., we obtain
( nπ ) ( )
n2 π 2
X(x) = c2 sin x , T(t) = c3 exp −k 2 t
L L
( nπ ) ( )
n2 π 2
=⇒ un (x, t) = An sin x exp −k 2 t , (An := c2 c3 )
L L
( nπ )
Step 5: Plug in the initial condition =⇒ f(x) = An sin x
L
not true for general f(x)!
6 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
∑
N ( nπ ) ( )
n2 π 2
An sin x exp −k 2 t for any N
n=1
L L
∑
N ( nπ )
The question is, can it satisfy u(x, 0) = An sin x = f(x)?
n=1
L
Not likely
7 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Key Observation: f(x) is arbitrary and hence not necessarily a finite sum
of sine functions.
Fourier’s Idea: How about an infinite series? If we can represent
arbitrary f(x) by the infinite series (for 0 < x < L)
∞
∑ ( nπ )
f(x) = An sin x ,
n=1
L
8 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
1 Orthogonal Functions
2 Fourier Series
3 Summary
9 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Orthogonality of Functions
11 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Examples
12 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Examples
Proof: If λ1 = −λ2 ,
∫ b
λ1 x λ2 x
⟨e ,e ⟩= e(λ1 +λ2 )x dx = b − a ̸= 0.
a
If λ1 ̸= −λ2 ,
∫ b
λ1 x λ2 x e(λ1 +λ2 )b − e(λ1 +λ2 )a
⟨e ,e ⟩= e(λ1 +λ2 )x dx = ̸= 0,
a λ1 + λ2
13 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Examples
Example
{ ( ) }
The set of functions sin nπ L x | n = 1, 2, . . . are orthogonal on [0, L].
( )
Proof: Let ϕn (x) := sin nπ L x . For m ̸= n,
∫ L ( mπ ) ( nπ )
⟨ϕm , ϕn ⟩ = sin x sin x dx
0 L L
∫ L { ( ) ( )}
1 (m − n)π (m + n)π
= cos x − cos x dx
0 2 L L
[ ( )]L
L (m − n)π
= sin x
2(m − n)π L 0
[ ( )]L
L (m + n)π
− sin x
2(m + n)π L 0
= 0 − 0 = 0.
14 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
15 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
16 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Remaining question:
∞
∑ ( nπ )
f(x) = An sin x
n=1
L
17 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Complete Set
For an arbitrary (infinite) set of orthogonal functions {ϕn (x)}, it is not
true that any function f(x) in a space S of functions, can be truthfully
represented by its orthogonal series expansion.
Only when the set of orthogonal functions is complete in S, the
orthogonal series expansion will (essentially) converge to any f(x) in S.
Example
{sin(nx) | n = 1, 2, . . .} is orthogonal on [−π, π] but not complete in the
set of all continuous functions defined on [−π, π].
18 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
1 Orthogonal Functions
2 Fourier Series
3 Summary
19 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Lemma
The following set of functions are orthogonal on [−p, p] (in fact,
[a, a + 2p] for any a ∈ R).
{ ( ) ( ) }
nπ nπ
1, cos x , sin x n = 1, 2, . . . .
p p
20 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Definition
The Fourier series of a function f(x) defined on the interval (−p, p) is
∞ { ( ) ( )}
a0 ∑ nπ nπ
+ an cos x + bn sin x ,
2 n=1
p p
∫ p ∫ p ( ) ∫ p ( )
1 1 nπ 1 nπ
a0 = f(x) dx, an = f(x) cos x dx, bn = f(x) sin x dx.
p −p p −p p p −p p
21 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Theorem
f (x ) Let f and f ′ be piecewise continuous on [−p, p].
f (x+)
On (−p, p), its Fourier series converges to
22 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Periodic Extension
Note that a Fourier series consists of periodic functions:
Hence, if a Fourier series converges for x ∈ [−p, p] (or [a, a + 2p]), it also
converges for any x ∈ R.
Moreover, it is a periodic function with fundamental period 2p (the
largest fundamental period of its components).
What does it converge to? It converges to the 2p-periodic extension of
f(x), except the discontinuities.
23 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
3p p p 3p
f(−p+) + f(p−)
, where f(−p+) := lim f(x), f(p−) := lim f(x)
2 x↓−p x↑p
24 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
3p p p 3p
3p p p 3p
25 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
In other words,
The Fourier series of a piecewise continuous periodic function f(x) with
fundamental period 2p that has piecewise continuous f ′ (x) is
∞ { ( ) ( )}
a0 ∑ nπ nπ
+ an cos x + bn sin x ,
2 n=1
p p
where
∫ p ( ) ∫ p ( )
1 nπ 1 nπ
an = f(x) cos x dx, bn = f(x) sin x dx,
p −p p p −p p
and on R it converges to
f(x) at a point where f(x) is continuous
1
(f(x+) + f(x−)) at a point where f(x) is discontinuous.
2
26 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Examples
Example
{
0, −π < x < 0
Expand f(x) = into a Fourier series. What does
π − x, 0 ≤ x < π
the Fourier series converge to at x = 0 and x = π?
27 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Complex Form
∞ { ( ) ( )}
a0 ∑ nπ nπ
For a Fourier series + an cos x + bn sin x , since
2 n=1
p p
( ) ( )
nπ 1 ( i nπ nπ
) nπ 1 ( i nπ nπ
)
cos x = e p x + e−i p x , sin x = e p x − e−i p x
p 2 p 2i
28 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Complex Form
a0 an −ibn an +ibn
From the fact that c0 = 2 , cn = 2 , c−n = 2 , and
∫ a+2p ( ) ∫ a+2p ( )
1 nπ 1 nπ
an = f(x) cos x dx, bn = f(x) sin x dx,
p a p p a p
one can verify that the Fourier series of a function f(x) can be
represented in the complex form
∞
∑ ∫ a+2p
inπ 1 inπ
cn e p x , where cn = f(x)e− p x dx .
n=−∞
2p a
29 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Complex Form
On the other hand, if we extend the definition of inner product to
complex-valued functions:
Definition (Inner Product of Complex-Valued Functions)
The inner product of f1 (x) and f2 (x) on an interval [a, b] is defined as
∫ b
⟨f1 , f2 ⟩ := f1 (x)f∗2 (x) dx
a
{ inπ }
Then, it is easy to verify that e p x | n ∈ Z is an orthogonal set on
any [a, a + 2p], and the coefficients in the expansion are exactly the same
as above.
30 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Property
Both f1 (x) and f2 (x) are even (odd) =⇒ f1 (x)f2 (x) is even.
f1 (x) is odd but f2 (x) is even =⇒ f1 (x)f2 (x) is odd.
Both f1 (x) and f2 (x) are even (odd) =⇒ f1 (x) ± f2 (x) is even (odd).
∫ a ∫ a
f(x) is even =⇒ f(x) dx = 2 f(x) dx.
−a 0
∫ a
f(x) is odd =⇒ f(x) dx = 0.
−a
31 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
32 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
∞ ( ) ∫ ( )
a0 ∑ nπ 2 p
nπ
+ an cos x , an = f(x) cos x dx
2 n=1
p p 0 p
∞
∑ ( ) ∫ p ( )
nπ 2 nπ
bn sin x , bn = f(x) sin x dx
n=1
p p 0 p
33 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Definition
The Fourier cosine series of a function f(x) defined on (0, p) is
∞ ( ) ∫ ( )
a0 ∑ nπ 2 p
nπ
+ an cos x , an = f(x) cos x dx.
2 n=1
p p 0 p
Definition
The Fourier sine series of a function f(x) defined on (0, p) is
∞
∑ ( ) ∫ p ( )
nπ 2 nπ
bn sin x , bn = f(x) sin x dx.
n=1
p p 0 p
34 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Half-Range Expansions
3 options to expand a function f(x) defined on the interval (0, L):
1 Fourier Cosine Series: Take p := L, and expand it as
∞ ( nπ ) ∫ ( nπ )
a0 ∑ 2 L
+ an cos x , an = f(x) cos x dx.
2 n=1
L L 0 L
35 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
f (x)
36 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
L L
37 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
L L
38 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
L L
39 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Example
Example
Expand the function f(x) = 1 on (0, π)
(a) in a cosine series, (b) in a sine series, and (c) in a Fourier series.
40 / 44 王奕翔 DE Lecture 13
ior of Sremains
but
sums aNFourier series
fairly
from the nearOrthogonal
a values
constant,
functional point
evenat which
when
near f isvalue
a the
point discontinuous
N is takenistoknown
of discontinuity be large.
does ThisGibbs
notassmooth
the behav-
out
butof remains
phenomenon. fairly constant, a even when
Functions
the fvalue N is taken toisbe large.asThis behav-
Gibbs
butiorremains
a Fourier
fairlyseries neareven
constant, point
when
FourieratSeries
which
the value is discontinuous
N is taken to be known
large. This the
behav-
ior of aperiodic
iorphenomenon.
ofThe Fourier
a Fourier series near
extension
series near a point
of at
Summary
which
f inatExample
a point which f isf2is discontinuous
onto the entire
discontinuous is is known
x-axis
known isasaas the Gibbs
meander
the Gibbs
phenomenon.
function The
phenomenon. periodic
(see extension of f in Example 2 onto the entire x-axis is a meander
page 310).
Gibbs Phenomenon The
function
The periodic
(see
periodicpage extension
310). of of
extension f inf in Example
Example 2 onto
2 onto thethe entire
entire is is
x-axis
x-axis a meander
a meander
function (see page
function (see page 310).y 310). y
y y
1 1
1 y y 1 y y
0.5 0.5
10.51 10.51
x x
0.50.5 0.50.5
x x
-0.5 -0.5
-0.5 x x -0.5 x x
-1
--
0.5
-0.51 --
0.50.5
--
-1 - 13 3--
2 -1 1 2 3 -3 -2 -1 1 2 3
2 -1 1 2 3 -3 -2 -1 1 2 3
(a) S1(x) (b) S2(x)
-- 3 -
3 - 2 - 1 1(a) S1(x)
2 - 1 1 2 2 3 3 -- 3 -
3 - 1 1(b) S2(x)
2 -
2 - 1 1 2 2 3 3
(a)(a)
yS1(x)
S1(x) (b)(b)
yS2(x)
S2(x)
y y
1 1 y y 1 1 y y
0.510.5 0.510.5
1 1
0.50.5 xx 0.50.5 xx
--
0.50.5 x x --
0.50.5 x x
-- 1 1
-
0.5
- 0.5 -- 0.5
-
1 1
-0.5
--1--13 3--
2 2--
1 1 1 1 2 2 3 3 -- 1--13 3-- 2 2--1 1 1 1 2 2 3 3
--
3 - 2 - (c)
1 1(c)S 3(x)
S3(x)
1 1 2 2 3 3 -- 3 - 2 - (d)
1 1(d)
S S
15(x)
151(x)1 2 2 3 3
3 - 2 - 3 - 2 -
41 / 44 FIGURE
FIGURE (c)
11.3.6 Partial
11.3.6 Partial (x)
(c)S3sums
S sums
(x)of of sine
sine (7)(7)DE Lecture 13 (d)(d)S15S(x)(x)
series
series
王奕翔
Orthogonal Functions
Fourier Series
Summary
1 Orthogonal Functions
2 Fourier Series
3 Summary
42 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Short Recap
Periodic Extension
43 / 44 王奕翔 DE Lecture 13
Orthogonal Functions
Fourier Series
Summary
Self-Practice Exercises
11-1: 3, 5, 7, 17, 22
44 / 44 王奕翔 DE Lecture 13