You are on page 1of 46

Spring 2015

信號與系統
Signals and Systems

Chapter SS-2
Linear Time-Invariant Systems

Feng-Li Lian
NTU-EE
Feb15 – Jun15

Figures and images used in these lecture notes are adopted from
“Signals & Systems” by Alan V. Oppenheim and Alan S. Willsky, 1997

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Outline NTUEE-SS2-LTI-2

 Discrete-Time Linear Time-Invariant Systems


• The convolution sum
 Continuous-Time Linear Time-Invariant Systems
• The convolution integral
 Properties of Linear Time-Invariant Systems
 Causal Linear Time-Invariant Systems
Described by Differential & Difference Equations
 Singularity Functions

h[n] h(t)
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Chapter 1 and Chapter 2 NTUEE-SS2-LTI-3

h[n] h(t)

Signals Systems






Feng-LiLian
Feng-Li Lian ©© 2015
2015
In Section 1.5, We Introduced Unit Impulse Functions NTUEE-SS2-LTI-4

 Sample by Unit Impulse


 For x[n]  More generally,
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-5

 Representation of
DT Signals by Impulses:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-6

 Representation of DT Signals by Impulses:


 More generally,

• The sifting property of the DT unit impulse


• x[n] = a superposition of scaled versions of
shifted unit impulses δ[n-k]
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-7

 DT Unit Impulse Response & Convolution Sum:


Linear System

Linear System

Linear System

Linear System

Linear System

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-8

 DT Unit Impulse Response & Convolution Sum:


Linear System

Linear System

Linear System

Linear System

Linear System
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-9

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-10

Linear System
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-11

 If the linear system (L) is also time-invariant (TI)

Linear System

Linear System

L & TI

L & TI

 Then,

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-12

 Hence, for an LTI system,

• Known as the convolution of x[n] & h[n]


• Referred as the convolution sum or superposition sum

 Symbolically,
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-13

LTI LTI
 Example 2.1m:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-14

 Example 2.2m: LTI


Feng-Li Lian © 2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-15

 Example 2.2m:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-16

 Example 2.1o: LTI


Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-17

 Example 2.2o: LTI

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-18

 Example 2.2o:
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-19

 Example 2.2o:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-20

 Example 2.3:
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-21

 Example 2.3:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-22

 Example 2.3:
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-23

 Example 2.4:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-24
Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-25

LTI

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Convolution Sum NTUEE-SS2-LTI-26

 Example 2.5: LTI


Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Matrix Representation of Convolution Sum NTUEE-SS2-LTI-27

 For an LTI system,

 The convolution of finite-duration discrete-time signals


may be expressed as the product of a matrix and a vector.

Feng-LiLian
Feng-Li Lian ©© 2015
2015
DT LTI Systems: Matrix Representation of Convolution Sum NTUEE-SS2-LTI-28
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Outline NTUEE-SS2-LTI-29

 Discrete-Time Linear Time-Invariant Systems


• The convolution sum

 Continuous-Time Linear Time-Invariant Systems


• The convolution integral
 Properties of Linear Time-Invariant Systems
 Causal Linear Time-Invariant Systems
Described by Differential & Difference Equations
 Singularity Functions

Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-30

 Representation of CT Signals by Impulses:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-31

 Representation of CT Signals by Impulses:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-32

 Graphical interpretation:
Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-33

 CT Impulse Response & Convolution Integral:


Linear System

Linear System

Linear System

Linear System


Linear System

Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-34

 CT Impulse Response & Convolution Integral:


Linear System

Linear System

Linear System

Linear System

Linear System
Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-35

Linear
System

Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-36

 CT Unit Impulse Response & Convolution Integral:

Linear System

Linear System
Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-37

 If the linear system (L) is also time-invariant (TI)


• Then, LTI

 Hence, for an LTI system,

• Known as the convolution of x(t) & h(t)


• Referred as the convolution integral
or the superposition integral

 Symbolically,

Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-38

 Example 2.6:
Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-39

 Example 2.7:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
CT LTI Systems: Convolution Integral NTUEE-SS2-LTI-40

 Example 2.8:
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Convolution Sum and Integral NTUEE-SS2-LTI-41

 Signal and System:

LTI: h(t)

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Outline NTUEE-SS2-LTI-42

 Discrete-Time Linear Time-Invariant Systems


• The convolution sum
 Continuous-Time Linear Time-Invariant Systems
• The convolution integral

 Properties of Linear Time-Invariant Systems


 Causal Linear Time-Invariant Systems
Described by Differential & Difference Equations
 Singularity Functions
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-43

 Convolution Sum & Integral of LTI Systems:

h[n]

h(t)

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-44

 Properties of LTI Systems

1. Commutative property
2. Distributive property
3. Associative property

4. With or without memory h[n]

5. Invertibility h(t)
6. Causality
7. Stability

8. Unit step response


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-45

 Commutative Property:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-46

 Distributive Property:

h1[n]

h1[n]+h2[n] +
h2[n]
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-47

 Distributive Property:

h[n]

+ h[n] +
h[n]

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-48

 Example 2.10
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-49

 Associative Property:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-50
Feng-LiLian
Feng-Li Lian ©© 2015
2015
In Section 1.6.1: Basic System Properties NTUEE-SS2-LTI-51

 Systems with or without memory


 Memoryless systems
• Output depends only on the input at that same time

(resistor)

 Systems with memory

(accumulator)

(delay)

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-52

 Memoryless:
• A DT LTI system is memoryless if

• The impulse response:

• From the convolution sum:

• Similarly, for CT LTI system:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
In Section 1.6.2: Basic System Properties NTUEE-SS2-LTI-53

 Invertibility & Inverse Systems


 Invertible systems
• Distinct inputs lead to distinct outputs

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-54

 Invertibility:

h1(t) h2(t)

Identity System δ(t)


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-55

 Example 2.11: Pure time shift

h1(t) h2(t)

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-56

 Example 2.12

h1[n] h2[n]
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-57

 Causality:
• The output of a causal system
depends only on
the present and past values of the input to the system

• Specifically, y[n] must not depend on x[k], for k > n

• It implies that the system is initially rest

• A CT LTI system is causal if

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-58

 Convolution Sum & Integral


Feng-LiLian
Feng-Li Lian ©© 2015
2015
In Section 1.6.4: Basic System Properties NTUEE-SS2-LTI-59

 Stability
 Stable systems
• Small inputs lead to responses that do not diverge
• Every bounded input excites a bounded output
– Bounded-input bounded-output stable (BIBO stable)
– For all |x(t)| < a, then |y(t)| < b, for all t

• Balance in a bank account?

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-60

 Stability:
• A system is stable
if every bounded input produces a bounded output

Stable LTI
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-61

 Stability:
• For CT LTI stable system:

Stable LTI

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-62

 Example 2.13: Pure time shift


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-63

 Example 2.13: Accumulator

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Properties of LTI Systems NTUEE-SS2-LTI-64

 Unit Impulse and Step Responses:


• For an LTI system, its unit impulse response is:

DT LTI CT LTI

• Its unit step response is:

DT LTI CT LTI
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Outline NTUEE-SS2-LTI-65

 Discrete-Time Linear Time-Invariant Systems


• The convolution sum
 Continuous-Time Linear Time-Invariant Systems
• The convolution integral
 Properties of Linear Time-Invariant Systems
1. Commutative property
2. Distributive property
3. Associative property
4. With or without memory
5. Invertibility
6. Causality
7. Stability
8. Unit step response
 Causal Linear Time-Invariant Systems
Described by Differential & Difference Equations
 Singularity Functions

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-66

 Singularity Functions
• CT unit impulse function is one of singularity functions
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-67

 Singularity Functions

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-68

 Example 2.16
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-69

 Example 2.16

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-70

 Defining the Unit Impulse through Convolution:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-71

 Defining the Unit Impulse through Convolution:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-72

 Defining the Unit Impulse through Convolution:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-73

 Unit Doublets of Derivative Operation:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-74

 Unit Doublets of Derivative Operation:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-75

 Unit Doublets of Integration Operation:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-76

 Unit Doublets of Integration Operation:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-77

 Unit Doublets of Integration Operation:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Singularity Functions NTUEE-SS2-LTI-78

 In Summary


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Outline NTUEE-SS2-LTI-79

 Discrete-Time Linear Time-Invariant Systems


• The convolution sum
 Continuous-Time Linear Time-Invariant Systems
• The convolution integral
 Properties of Linear Time-Invariant Systems
1. Commutative property
2. Distributive property
3. Associative property
4. With or without memory
5. Invertibility
6. Causality
7. Stability
8. Unit step response
 Causal Linear Time-Invariant Systems
Described by Differential & Difference Equations
 Singularity Functions

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-80

 Linear Constant-Coefficient Differential Equations


• e.x., RC circuit

RC Circuit

• Provide an implicit specification of the system


• You have learned how to solve the equation in Diff Eqn
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-81

 Linear Constant-Coefficient Differential Equations


• For a general CT LTI system, with N-th order,

CT LTI

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-82

 Linear Constant-Coefficient Difference Equations


• For a general DT LTI system, with N-th order,

DT LTI
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-83

 Recursive Equation:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-84

 For example, Example 2.15 LTI


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-85

 Nonrecursive Equation:
• When N = 0,

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-86

 Block Diagram Representations:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-87

 Block Diagram Representations:

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-88

 Block Diagram Representations:


Feng-LiLian
Feng-Li Lian ©© 2015
2015
Causal LTI Systems by Difference & Differential Equations NTUEE-SS2-LTI-89

 Block Diagram Representations:

 Example 9.30 (pp.711)  Example 10.30 (pp.786)

Feng-LiLian
Feng-Li Lian ©© 2015
2015
Chapter 2: Linear Time-Invariant Systems NTUEE-SS2-LTI-90

 Discrete-Time Linear Time-Invariant Systems


• The convolution sum
 Continuous-Time Linear Time-Invariant Systems
• The convolution integral

 Properties of Linear Time-Invariant Systems


1. Commutative property
2. Distributive property
3. Associative property
4. With or without memory
5. Invertibility
6. Causality
7. Stability
8. Unit step response

 Causal Linear Time-Invariant Systems


Described by Differential & Difference Equations
 Singularity Functions
Feng-LiLian
Feng-Li Lian ©© 2015
2015
Flowchart NTUEE-SS2-LTI-91

Signals & Systems (Chap 1) LTI & Convolution (Chap 2)

Bounded/Convergent

Periodic Aperiodic
CT CT (Chap 4)
FS DT FT
(Chap 3) DT (Chap 5)

Unbounded/Non-convergent

LT CT (Chap 9)

zT DT (Chap 10)

Time-Frequency (Chap 6) Communication (Chap 8)

CT-DT (Chap 7) Control (Chap 11)

You might also like