BENT 4733-DIGITAL SIGNAL PROCESSING

Chapter 1: Introduction to Digital Signal

Processing
 Learning Outcomes
By the end of the chapter, you are expected to be able to:
• Explain what is signal, system & digital signal processing
(DSP)
• Recognise the importance and benefits of DSP
• Distinguish between digital and analog signals
 What is signal?
• Variable that carries or contains some kind of information
• The information can be conveyed, displayed or manipulated
• Examples: speech signal, electrical signal (voltage & current),
temperature, pressure, etc.
• y(t), v(t) are dependant variables
• t is independent variable
 What is signal?
• Can vary with time, frequency, space, distance, etc
• Example: Speech signal can be represented by amplitudes, frequencies
and phase (i.e. sum of several sinusoids)
 A (t) sin[2f (t)  
i i i (t)]
i1

• Example: Signal with a function of two spatial coordinates in a plane

s(x, y)  3x  2xy  1 0 y 2

• Black & white image  light intensity wrt two spatial coordinates
• Video signals in TV  sequence of images (frames)
 two spatial coordinates and time
Examples
 Types of Signals
Signals may be classified into four categories depending on the
characteristics of the time-variable and the values they can take:
Signals

Continuous-time Discrete-time

Continuous-value / Discrete-value Continuous-value Discrete-value

Analog Discrete Digital

 Types of Signals
• Continuous time –
Continuous amplitude

• Continuous time –
Discrete amplitude

• Discrete time –
Continuous amplitude

• Discrete time –
Discrete amplitude
Continuous-time (analog) signals
Time: defined for every value of time t R
Descriptions: functions of a continuous variable t → f (t)
Notes: they take on values in the continuous
interval f (t) (a,b) for a, b   .
 Discrete-time signals:
Time: defined only at discrete values of time → t = nT
Descriptions: sequences of real/complex numbers → f (n)
Notes: they take on values in the continuous interval,
f (n) (a,b) for a, b  
Notes: sampling of analog signals,
• sampling interval / period : T
• sampling frequency (Hz): f s 1/T
• sampling rate: number of samples per second,
 Digital signals:
Descriptions: discrete-time and discrete-valued signals
(i.e. taking values from a finite set of possible values)
Note: sampling, quantizing and coding process i.e. process of analog-
to-digital conversion.

10
 What is system?
• Entity that processes a set of signals
• Entity that manipulates one or more signals to accomplish a function,
thereby yielding new signals.
• Examples: software systems, electronic systems, computer systems,
or mechanical systems
 What is system?
• Example (specific for the course): Filter system
• Performs operations on the signal to filter out the
noise/interference
• I.e. to reduce noise/interference corrupting the
desired signal
• OPERATIONS = SIGNAL PROCESSING
 Analog versus Digital
Signal Processing

Analog
Digital
V1(t)V1(t) VV22(t)(t)

i(t)

i(t)

Digital processing on signal is performed by digital hardware

(logic circuit) and digital software program  digital system
 Digital Signal Processing (DSP)
• Digital signal processing (DSP) includes the mathematics, the
algorithms, and the techniques used to manipulate these signals after they
have been converted into a digital form.
• Representation of signals by sequences of numbers or symbols AND the
processing of these sequences.
• Mathematical and algorithmic manipulation of discretized and quantized
or naturally digital signals in order to extract the most relevant and
pertinent information that is carried by the signal.
• Digital representation of signals and the use of digital processors to
analyse, modify, or extract information from signals.
 Digital Signal Processing (DSP)
Refers to processing of signal using digital technology

Signal - A function or physical System - an Processing

quantity of a set of independent abstraction of By processing we mean operating
variables that contains some kind of anything that takes in a fashion on signal to extract
information which can be conveyed/ an input signal, some useful information
displayed/ manipulated. Examples: operates on it, and
Voltage, Image, Movie produces an output
signal
 Why DSP?
Why process signals?
• Signals are corrupted by interference due to noise.
• Signals are distorted due to the transmission medium.
• Recover information present in the signal.
• Perform algorithms such as modulation, compression etc.
Components of a DSP System

Block diagram of a real-time digital signal processing system

Components of a DSP System
 DSP Operation: Examples
• Elementary time-domain operations
• Signal correlation
• Digital filtering
• Modulation and demodulation
• Discrete transformation from time domain to frequency
domain and vice versa
• Multiplexing and demultiplexing
 DSP Operation: Filtering
 By far the most commonly used DSP operation
 Filtering deliberately change the frequency content of the signal,
typically, by removing certain frequencies from the signals.
 For denoising applications, the (frequency) filter removes those
frequencies in the signal that correspond to noise.
 In communications applications, filtering is used to focus to that part of
the spectrum that is of interest, that is, the part that carries the
information.
 DSP Operation: Filtering
 Typically, we have the following types of filters
Lowpass (LPF) – removes high frequencies, and retains (passes) low
frequencies
Highpass (HPF) – removes low frequencies, and retains high frequencies
Bandpass (BPF) – retains an interval of frequencies within a band,
removes others
Bandstop (BSF) – removes an interval of frequencies within a band,
retains others
Notch filter – removes a specific frequency
 A Practical Example –
Low Pass Filtering (LPF)
- Sound:
• Clean:
• Noisy:
- Time Domain:
• Clean:
• Noisy:
- Frequency Domain:
• Clean:
• Noisy:
 Frequency Domain separates signal and noise
23
 Applications of DSP
 Communication – Modulation and demodulation
 Signal security – Encryption and decryption
 Data compression – reduce space/computation required to store/process data
 Signal denoising – Filtering for noise reduction
 Audio processing – Signal enhancement, equalization
 Image processing – Image denoising, enhancement, watermarking,
reconstruction
 Data analysis and feature extraction – Recognize structure on data
 Frequency/Spectral analysis – Alternate approach to time domain
analysis
 Other Applications of DSP
 Image processing
 Pattern recognition, Robotic vision, Image enhancement, Facsimile

 Telecommunications
 Echo cancellation, Adaptive equalization, Video conferencing, Data

communication
 Biomedical
 Patient monitoring, Scanners, ECG analysis (electrocardiography), EEG brain

mappers (electroencephalogram)
 Consumer appliances
 Digital, cellular mobile phones, Digital TV, Digital cameras, CD/VCD/DVD

players/writers, PlayStation
 Advantages of a DSP system
 Guaranteed accuracy: Determined by the no. of bits used.
 Perfect reproducibility: Digital recoding can be copied repeatedly without
degrading the signal quality.
 No drift in performance with temperature or age.
 Greater reliability, smaller size, and lower power consumption due to
advances in semiconductor technology.
 Greater flexibility: Can be programmed and reprogrammed without
modifications to the hardware.
 Superior performance: Can perform functions that are not possible with analog
methods, e.g. adaptive filtering, encryption, channel coding / decoding.
 Information is already in digital form (e.g. digital computer), DSP is the only
option.
 Disadvantages of a DSP system
 Complexity: additional pre- and post- processing
devices (ADCs/DACs, associated filters and complex
digital circuitry)
 Speed and cost: DSP designs and ADCs/DACs can be
expensive for broadband signals. Most DSP are still not
fast enough for wideband applications. Bandwidths in the
100 MHz range are still processed by analog means.
 Design time: Due to the shortage of knowledgeable DSP
engineers and the necessary resources (software
packages), DSP designs can be time consuming.
 SUMMARY
DSP refers to processing of signals using digital
technology. It is a better alternative to analog signal
processing.

Now you should know

 Digital signal processing (DSP) and the basic elements
in the system
 The reason why digital signal processing of analog
signals is preferred.
 The requirement of ADC and DAC as interfaces
between analog and digital domain

31
Thank You
DSP - Basic Mathematics
• Trigonometry
• Complex numbers
• Complex exponentials
• Factorisation
• Long division
• Irrational functions
• Sum/Product
• Functions: Change of variable
32
 Trigonometry
sin
• Trigonometric circle: 1 

 1   
cos
 



cos 0  1 cos / 3  1/ 2   
sin 0  0 sin  / 6  1/ 2 sin  cos  
  2 
cos / 4  2 / 2 ...
cos  1 sin  /4  2 /2
sin   0 
 cos0  1 
 cos  cos 
sin 0  0 cos / 2  0 cos / 6  3 / 2 sin   sin 
sin / 2  1 
sin  / 3  3 / 2 ...

30
 Complex numbers
93 2  1.41421... 1  i  j
42 3  1.73205...  4  (1)(4)  (1) 4  2 j
1 1   3.1415926535897932384626433832...  2  1.41421... j
 irrationalnumbers j 2  1
00

5  3 j : complex number
5 3 j2 4 j  10  20 j  6 j 12 j 2 a  bjc  dj ac  db ad  bcj
 10 14 j 121 a : real part
 10 14 j 12 b :imaginary part
 22 14 j

Imaginary Im
plane:

Re

31
 Complex exponentials
Imaginary Im Im
plane: 1

 1
Re Re

carthesian coordinates : polar coordinates :

a  jb r

Euler formula : e j  cos  j sin e j e  j

cos
2
e  e  j
j
sin
re j  rcos  j sin  r cos  jr sin 2j

e j 2  e j 
2

?
cos2  j sin 2  cos  j sin 
2

cos 2
  sin 2   j 2cos  sin   cos 2   sin 2   2 j cos  sin 
32
 Factorization
   f x a  bx  cx2
f x   x  x  x  x  
     D 2  b 2  4ac  discriminant
/, / : roots ( f x 0) b D
xi   roots
f x      x  x
2
2a
f x ax  x1 x x2 

D  0 : 2 different, real roots

D  0 : 2 equal, real roots
D  0 : 2 different, complex roots

factorization : write f xin function of itsroots

f xof order n  f xhas n roots
 roots real or complex
 roots equal or different

order 1: evident
order 2 : easy
order 3 : difficult
order  3 : numerical, not analytical
33
 Long Division
1254
5142741
41
104
82
222
205
177
164
13
 51427 / 41 = 1254, remainder 13

x2 + 8x + 22
x3 + 5x2 - 2x + 5x - 3
x3 - 3x2
8x2 - 2x
8x2 -24x
22x + 5
22x -66
71
x3 + 5x2 - 2x + 5 71
 ----------------- = (x + 8x + 22) + ------
2

x - 3 x - 3 37
Irrational Functions
3 25
rational numbers :1, 2, , ,...
4 36

irrational numbers : , e, 2, sin ,...
10 
irrational functions :sin,cos,exp,log,...

calculate : tables or power series

x3 x5 
x 2n1
example :sin x  x    ...  1
n

3! 5! n0 2n 1!

other irrational functions :

tan,arctan,cosh,sinh,...
sin x
sincx
x
I0 x: zeroth order modified Bessel function of the first kind
U n x: Jacobian elliptic function of order n
38
 5
1 2  3  4  5   n : depends on 1, 5, NOT n
Sum/Product
n1
7
1 4  9 16  25  36  49   n 2
n1
5
1. 1 .1 1. 1.   1
234 5 n1 n


1 1 1 1 1
 0.5  1      ...  ?
n

n0 2 4 8 16 32

1
a
n0
n

1 a
a 1

N 1
1 a N
N2
a N1 1  a N 2
 a  n

1 a
 a  1 a
n

n0 nN 1
N 1 N 1 N
(N 1)a  Na  a
 na  n

(1 a) 2
n0
N 1 
1 1
 n  2 N (N 1) a n

1 a
a 1
n0 n0
N 1 
1 a
 n  6 N (N 1)(2N 1)
2
 na n

(1 a) 2
a 1
n0 n0
39
 Functions & variables
change variable  change each of its occurences


 
f x  x 2  x 1 sin 

x
4 
 
 
evaluate : say x  2  f 2 2 2 2 1 sin 2   7.1  7
4 
change variable : say x  5y  3

   
 f 5y  3 5y  3  5y  31 sin  5y  3 
2

4 
5 3 
 
 25y 2  35y 13 sin y  
 4 4 

N1
1 a N
 an  1 a
n0
5
1 1 65 1
1  
4
1
n

   
51 n
1
1
 6  6 5 65   
65 1 6 
65 1 7775
  6 

 6 

1 1 6 1
 5
6 6 1

6 4
.5

6480
 1.1998457...
n0 n0
1 1
6 6 6
M N1
1 a N


n0
an  ? n0
an 
1 a
M  N 1  N  M 1
M M 1
1 a
 an  1 a 40
n0