Professional Documents
Culture Documents
7
GLOBAL JOURNAL OF PURE AND APPLIED SCIENCES VOL. 20, 2014: 127-134 127
COPYRIGHT© BACHUDO SCIENCE CO. LTD PRINTED IN NIGERIA ISSN 1118-0579
www.globaljournalseries.com, Email: info@globaljournalseries.com
ABSTRACT
One area of application of the discrete wavelet transform (DWT) has been the detection and classification of
physiological signals such as electroencephalography (EEG) signals. Anomalies in EEGs yield very low frequency
signals which are ideal for analysis using the DWT. Anomalies in mechanical systems yield high frequency signals.
The structure of the DWT makes it an un-ideal tool for the analysis of such signals. Such signals are, however, ideal
for analysis using the wavelet packet transform (WPT) in which Mallat’s pyramid algorithm is applied to the
multiresolution analysis (MRA) of both the approximation and detail subspaces of a signal. As a contribution to the
computer-aided signal processing of non-stationary signals, this paper develops a pyramid algorithm for the discrete
wavelet packet transform (DWPT) from two-scale relations for wavelet packets. The algorithm is used in the
derivation of the fast Haar discrete wavelet packet transform (FHDWPT) and its inverse. It is found out that the
FHDWPT is computationally as efficient as the fast Fourier transform (FFT).
2 Ф2 −
∈
of Vj-1 AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA. (1)
and
2 2 −
∈
of Wj-1 AAAAAAAAAAAAAAAAAAAAAAAAAAA. (2)
which are in line with the axioms ofMRA that {Ф(t-k)}k∈Z is an orthonormal basis of Vo and {φ(t-k)}k∈Zis an
orthonormal basin of W o(Mallat, 1989a).
The DWT decomposition is represented by
Vj = Vj-1 ⊕Wj-1 AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA (3)
Edith T. Luhanga, School of Computational and Communication Sciences and Engineering, Nelson Mandela African
Institute of Science and Technology, P.O. Box 447, Arusha. Tanzania
Matthew L. Luhanga, College of Information and Communication Technology, University of Dar es Salaam,
P.O.Box35131,Dar es Salaam, Tanzania.
128 EDITH T. LUHANGA AND MATTHEW L. LUHANGA
where W j-1 is the orthogonal complement of Vj-1 in Vj and contained in subspace Wj-1 (Mallat, 1989a). The
denotes the sum of mutually orthogonal subspaces approximation is made up of the low frequency
(Bulthiel, 2011). information in the signal and the detail contains the high
frequency information.
The DWT is based on wavelet decomposition (WD). The
WD splits the original signal (S), assumed to be In WD only the subspace containing the low frequency
contained in subspace Vj, into two components – the information is iteratively decomposed into lower time
approximation contained in subspace Vj-1 and details resolution subspaces as shown in Fig.1.
S(Vj))
Level 1
Vj-1 Wj-1
Coifman, Meyer and Wickerhausen introduced wavelet number of nodes that are on its left at the same scale
packets by generalizing WD into the wavelet packet level. Thus N-j≥0 is the level of the node in the tree.
decomposition (WPD) (Coifman, et al., 1992). In the
WPD both the approximation (low frequency part) and Note that at each scale level of Fig.2, the first two boxes
the details (high frequency part) are iteratively from the left correspond to the DWT decomposition
decomposed into lower time resolution subspaces. The (WD).
WPD yields a finer gradation of frequency components
in a full wavelet tree decomposition as shown in Fig. 2. The decomposition of the wavelet subspaces in the high
The decomposition in Fig. 2 is assumed to start at some frequency section of Fig.2 parallels that of the DWT
scale level N. Any node of the decomposition tree is decomposition. In this case, to each node (j,n) of Fig.2
labeled (j,n) where j is the scale level and n is the we associate a space Wj,nwhich is the direct sum of two
orthogonal subspaces, i.e. (Mallat, 1989a);
S (V N)
(N-1,0) (N-1,1)
The purpose of this work is to present a pyramid the Haar scaling and wavelet coefficients and a series of
algorithm for the Haar Discrete Wavelet Packet permutation matrices. As a departure point we
Transform (HDWPT) which uses two types of matrices – reformulate some of the ideas of Wickerhauser
an orthogonal matrix whose elements are made up of (Wickerhauser, 1992).
= 2 $ %# Ф2 −
… … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … …5b
Where {hk}k∈Z and {gk} k∈Z are impulse responses of low-pass and high-pass filters, respectively, known as
quadrature mirror filters (QMF) related through
%# = −1
# ℎ# , ∈Z AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA.. (6)
From eqns (1) and (2) we note that {Ф (t-k)} k∈Z and {φ This splitting algorithm for the V space leading to the
(t-k)} k∈Zform an orthonormal basis for Vo and Wo, DWT can also be applied to the W space representing
respectively. Hence eqn (6) read together with eqn (3) high frequencies. But, in order to make the
shows that the V subspace can be decomposed into a development easier to understand, we first redefine the
direct sum of two orthogonal subspaces defined by their variables in eqns (5a) and (5b).
basis functions which are given by eqns (5a) and (5b).
130 EDITH T. LUHANGA AND MATTHEW L. LUHANGA
Let W o(t) = Ф(t). Then W o(t) satisfies eqn (5a). If we next let W 1(t) =φ(t), then W 1(t) would satisfy eqn (5b).
+,
= 2 $ ℎ# +, 2 −
… … … … … … … … … … … … … … … … … … … … … … … … … … … … … … …8.
+
= 2 $ %# +/ 2 −
… … … … … … … … … … … … … … … … … … … … … … … … … … … … … … ..81
Unlike WD which involved the iterative splitting of the V space, WPD involves the iterative splitting of the W space.
The iterative splitting of the W space is achieved by defining the following sequence of functions from W 0(t) and W 1(t):
+
= 2 $ ℎ# + 2 −
… … … … … … … … … … … … … … … … … … … … … … … … … … … … … … ….9.
#
+3
= 2 $ %# + 2 −
… … … … … … … … … … … … … … … … … … … … … … … … … … … … … … ….91
where now {W 2(t-k)} k∈Z and {W 3(t-k)} k∈Zare orthonormal basis functions for the two subspaces whose direct sum
yields W1,1.
#
+6
= 2 $ %# + −
… … … … … … … … … … … … … … … … … … … … … … … … … … … … … … …101
where {W 4(t-k)} k∈Zand {W 5(t-k)} k∈Zare orthonormal basis functions for the two subspaces whose direct sum isW1,2.
+78
= 2 $ %# +7 2 −
… . . … … … … … … … … … … … … … … … … … … … … … … … … … … … … …111
for n=0,1,2, A
Now {W 2n(t-k)} k∈Zand {W 2n+1 (t-k)} k∈Zare orthonormal basis functions for the two subspaces whose direct sum is
W1,n.
Note that for n=0, eqns (11a) and (11b) yield eqns (5a) and (5b), respectively.
Eqns (1) and (2) are combined to form a basis for Vj. Now the sequence of functions {Wn(t)} n∈Zwith their dilations and
translations can be used to form an orthonormal basis for a function space.
are said to form the (j,n) wavelet packet which is an orthogonal basis for the space Wj,n. Eqns (11a) and (11b) thus
form the two-scale relations for wavelet packets.
The Algorithm
A given signal f(t) can be decomposed using the basis functions given in eqn (12). The decomposition coefficients are
given by
∞
.7
<# = 2 / = >
+7 2 −
? … … … … … … … … … … … … … … … … … … … … … … … … … … … … … ..13
∞
j-1
Dilating eqns (11a) and (11b) by 2 and translating them by m and applying eqn (13) to the resulting equations may
be shown to yield.
,7 ,7
<# = $ ℎA# <A … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … …14.
A
A PYRAMID ALGORITHM FOR THE HAAR DISCRETE WAVELET PACKET TRANSFORM 131
,78 ,7
<# = $ %A# <A … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … …141
The coefficients<#,7 and<#,78 can thus be successively obtained from some highest level coefficients <#C,7 for some
large N.
Assuming that W o(t) = Ф(t) is the Haar scaling function and that W 1(t) = φ(t) is the Haar mother wavelet, eqn 14 may
be shown to reduce to
2 2
,78 1 ,7 1 ,7
<# = <# − <#8 … … … … … … … … … … … … … … … … … … … … … … … … … … … … ….151
2 2
Eqns (15) show that the (j-1)tn level coefficients are obtained from the jtn level coefficients through multiplication by the
following orthogonal matrix
1 1 1
ϴ = E F… … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … … …16
2 1 −1
We assume that the signal f(t) to be decomposed and all orthogonal functions of eqn (12) which are used in signal
decomposition have support over the unit interval [0,1). For the orthogonal functions of eqn(12) this implies that the
translation parameter, k, is bounded by
j
0≤ k< 2 – 1 AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA (17)
The signal f(t) is also assumed to be discretized to yield
>
≅ 2C/ $ <#C,/ +/ 2C −
… … … … … … … … … … … … … … … … … … … … … … … … … … … … ..20
#
2
can be made to be as accurate as possible in L (R) norm by proper choice of N.
For N large and with relation (17) satisfied, we can assume that the scaling functionW o(t) is so narrow that it covers
only the first data point to = 0. Thus by choosing a large N and translating the scaling function we can invoke the
wavelet crime(Strang, et al., 1996) by setting the scaling function coefficients equal to the data point
We next express the relations ineqn (15) in matrix form. To facilitate that we need to define the orthogonal sum of
matrices.
Now using eqns (15) and eqn (21) we can represent the transition from Level 0 (the Level of the data fk) to Level 1 in
Fig. 2 by
O
M<,C,/ , <,C, , <C,/ , <C, , … . . , <C,/ , <C, N = PH Q>, , > , … . , >H RT AAAAAAAAAAAAAAAAAA..
(24)
H H
132 EDITH T. LUHANGA AND MATTHEW L. LUHANGA
WhereT represents the transpose operator for vectors or matrices.
In moving from Level 1 to Level 2 of Fig.2, the mathematical operations just described are repeated but now the
coefficients at Level 2 are in 4 groups corresponding to n=0, n=1, n=2 and n=3. The coefficients at scale parameter
N-2 are thus
Q<,C,/ , <,C, , <C,/ , <C, , … , <C,/ ,<C, , <,C, , </C,3 , <C,/ , <C,3 , … .,
H H
W W
<C, , <C,3 R
T
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA (26)
H H
W W
The matrix HM is now applied to the expression in (25) but now we apply a permutation matrix VX ⊕ VX to sort out the
Y Y
coefficients in (26) into the 4 groups. These operations continue until the coefficients can no longer be divided by 2 to
create another dyadic group of coefficients. This occurs at Level N. The complete transformation, denoted by H, is
given by
C = Hf AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA (27)
where
Eqn (27) represents the Fast Haar Discrete Wavelet an optimization problem in the choice of the best basis
Packet Transform and eqn (30) the Inverse Fast (Mallat, 1989a; Strang, et al., 1996).
HaarDiscrete Wavelet Packet Transform.
The leaves of any admissible tree would form an
With the Haar functions under consideration, the wavelet adequate basis for the decomposition of functions f(t).
packets of eqn (12) may be shown to be Walsh Not all leaves of an admissible tree fall on the same
functions in Paley order. level of a wavelet packet tree similar to the levels in
Fig.2 (Mallat, 1989a; Daly, 2007). This is what makes it
Discrete Haar Series difficult to write a simple algebraic relationship to
represent signal decomposition as is possible for the
The coefficients in eqn (27) may be used to write a Haar DWT. One of the few exceptions where we can write an
series for f(t). The problem with the WPT is the choice of expression to represent signal decomposition is the
the best basis to use in representing f(t) for a given case where all leaves of an admissible tree fall on the
application (Mallat, 1989a; Wickerhauser, 1992). The same level.
leaves of any admissible tree from Fig. 2 form a basis.
An admissible tree( Mallat, 1989a) is any tree where Let us assume that all leaves of an admissible tree fall
each node in the tree has 0 or 2 children nodes. This on level m (equivalent to scale parameter j=N-m). Then
yields a large library of admissible bases which leads to f(t) can be decomposed as
A PYRAMID ALGORITHM FOR THE HAAR DISCRETE WAVELET PACKET TRANSFORM 133
7 7
2/
>
= $ $ <#,7 +7 2 −
… … … … … … … … … … … … … … … … … … … … … … … … … … . . …31
U 7c/ #c/
Where
d = 2e − 1
d = 2 − 1
The factor 1/ U is required to preserve the orthonormality of the wavelet packets.
Note that the normalized frequencies occupied by the wavelet packets of eqn (31) are
f f f g
f
E0, F,E , F,…,E , hF AAAAAAAAAAAAAAAAAAAAAAAAA. (32)
g g g g
Stated differently, normalized frequency bend occupied by the n’th wavelet packet is
7f 78
f
E , F , d = 0, 1 … . 2e − 1 AAAAAAAAAAAAAAAAAAAAAAAAAAAA. (32a)
g g
EXAMPLE
To fix ideas we consider a simple example whose data is shown below
We make two immediate conclusions from Table 2. Second, we can use Table 2 to find an admissible tree
First, if the decomposition is stopped at levels 2 or 1, the whose leaves are not at the same level and use this tree
WPT decomposition compresses the signals energy in signal decomposition. Using the nomenclature of
more than the DWT as the latter has two coefficients Fig.2 we choose an admissible tree whose leaves are at
whose values are 0. nodes (2,0), (1,2) and (1,3).
134 EDITH T. LUHANGA AND MATTHEW L. LUHANGA
The decomposition of f(t) is
>p
= [5 2q2+/ 4
+ 9 2q2+/ 4 − 1
+ 13 2q2+/ 4 − 2
+ 17 2q2+/ 4 − 3
− 2q 2+ 2
−
2q 2+ 2 − 1
\ AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA (33)
Using eqn (9a) we get
W 2(t) = W 1(2t) + W 1(2t-1)
then
and
Using eqns (5), (34) and (35) in eqn (33) reproduces the values of f(t) given in Table 1.
The coefficients corresponding to the DWT are obtained from rows
2,0
1,0
and 0,0 and 0,1