You are on page 1of 4

2009 Second Asia-Pacific Conference on Computational Intelligence and Industrial Applications

Quantum BP Neural Network for Speech


Enhancement

Fei Li Guobiao Xu
Institue of Signal Processing and Transmission Network Maintenance Division ofHuai'an Branch
Nanjing University of Posts and Telecommunications Jiangsu Mobile Communications Corporation
Nanjing, China Huai'an, China
e-mail: lifei@njupt.edu.cn e-mail: xuguobia0397@163.com

Abstract-Quantum Neural Network (QNN), a burgeoning give us some advantages unattainable by classical artificial NN
new field which integrates quantum computation with classical such as exponential memory capacity, higher performance for
neural network, can improve the inadequacies of artificial neural lower number of hidden neurons, faster learning, etc [6]. These
network. A model of quantum neuron and Quantum Back potential advantages of QNN are indeed compelling motivation
Propagation (BP) Neural Network based on quantum neuron are
investigated. A novel approach toward speech enhancement
for their development. Some authors proposed the approach
which adopts Quantum BP Neural Network is proposed. The toward speech signal processing which adopts QNN [7-8].
numerical simulation results show that the proposed speech In this paper, a novel speech enhancement algorithm based
enhancement scheme resulted in better performance than
on Quantum BP Neural Network is proposed and its
traditional spectral subtraction, Wiener filtering method and
RBF neural network.
performance is evaluated. The rest of this paper is organized as:
In Section II we shortly review the basic notations of quantum
Keywords-Quantum Computation; Quantum Neural Network; computing. In Section III we describe the mechanism of
Back Propagation; Speech Enhancement quantum neuron and Quantum BP Neural Network. In Section
IV the proposed speech enhancement based on Quantum BP
I. INTRODUCTION Neural Network is introduced and the numerical simulation
There are many speech enhancement algorithms, such as results are discussed. Finally, we give conclusions in Section V.
wavelet decomposition, spectral subtraction, Wiener filtering
II. FOUNDATION OF QUANTUM COMPUTING
and neural network (NN), etc. Speech enhancement based on
neural network is one of research hotspots within current A. Quantum Bit
speech enhancement domain [1]. The smallest unit of information stored in a two-state
Neural Network has some attractive features such as large- quantum computer is called a quantum bit or qubit. A qubit is a
scale parallel processing, fault tolerance, self-organization, self- unit vector in the two-dimensional Hilbert complex vector
adjustment and association, etc [2]. However, NN also faces space for which a particular basis, denoted by {IO>,/l>}, has
many difficulties including the absence of rules for determining been fixed. The orthonormal basis {IO>,ll>} can be expressed
optimal architectures, limited memory capacity, time- as {(I, O)T, (0, I)T}. For the purposes of quantum computation,
consuming training, catastrophic forgetting due to the pattern the basis states 10> and 11> are taken to represent the classical
interference etc. bit values 0 and 1 respectively. Unlike the classical bit however,
a qubit can be in a superposition of 10> and 11> such as [9]:
In the field of NN, some pioneers introduced quantum
computation into analogous discussion such as quantum neural (1)
computing, quantum-inspired neural network and quantum
associative memory [3-5]. They constructed the foundation for where a and b are complex numbers called probability
further study of quantum computation in NN. From this amplitude. That is, if such a superposition is measured with
scenario, emerge the field of neural network based on quantum respect to the basis {IO>,11>}, the probability that the measured
theoretical concepts and techniques. They are called Quantum value is 10> is lal 2 and the probability that the measured value is
2
Neural Network (QNN). 11> is Ib1 , and
Quantum neural network (QNN) is a burgeoning new field (2)
which integrates classical NN with quantum computing. It can
be justified both by the potential of combining their benefits
and also to eliminate some their inherent shortcomings. QNN

978-1-4244-4607-0/09/$25.00 ©2009 IEEE PACIIA 2009


389
B. Quantum Gates III. Q UANTUM BP N EURAL N ETWORK

Unlike the classical digital logical gates, the quantum gates A. Quantun Neuron
generally act on a superposition of digital states such as (1). Quantum neuron can be composed of quantum gates, as in
Through the single bit rotation gate as shown in Fig. 1, the state Fig.3. The two basal quantum logical gates are included in this
of one qubit is rotated to B angle. The two-bit controlled NOT quantum neuron model and complete the complex operation of
gate performs XOR operation, as in Fig.2. It follows that if the input quantum state. The connection between the neuron
quantum bit ' a' is 10>, quantum bit ' b' is output keeping its states and the quantum states is made as follows: firing neuron
input, while if quantum bit 'a' is 11>, quantum bit 'b ' is state is defined as qubit state II>, non-firing neuron state is
reversed (through NOT operation) its input state and then defined as qubit state 10>, and the arbitrary neuron state is the
output. coherent superposition of the two.

- 0 1---
Figure I. One-bit Rotation Gate

a
1-----'<----1 o

b + l---- a ffi b
Figure 3. Quantum Neuron Model

Essentially, the amplitude and phase of quantum state are


handled respectively. The activation function of quantum
Figure 2. Two-bit Controlled NOT Gate
neuron is expressed as [II]:
It had been proved that quantum gate is constructed by
connecting the single bit rotation gate shown Fig.I to the two-
». = *f(B/,k ).f(I/) (6)
bit controlled NOT gate shown Fig.2. a EB b This means that
these two gates are fundamental to construct a quantum logic
gate [10]. Yk = JT g(Ak)-arg(u k) (7)
2
For the sake of convenient application, a quantum state may
also be expressed by its phase in the planar quantum system .
o, ==f(Yk) (8)
The expression of mathematics is used as the quantum state Herej{x) is the same function as (3) and g(x) is the sigmoid
IlfIo) in (3). function.

feB) = eiO = cosB+isinB (3) g(x) = I (9)


I +exp(-x)
which the probabilistic amplitude of'[O> corresponds to the real
B is phase variable and A is phase controlled factor , they
part and 11>, the imaginary part, where i is imaginary unit
are the two parameters to control the neuron and correspond to
..r:I and B is the phase. phase of the rotation gate and the reversal rate of the control-
Not gate respectively.
In accordance with expression of quantum state the rotation
gate and the control-NOT gate are described. The rotation gate B. 3-Layer Quantum BP Neural Network
is presented as follows, Based on the quantum neuron shown in Fig.3, we can
construct a Quantum Back Propagation (BP) Neural Network.
(4) The structure of Quantum BP Neural Network is shown in
FigA. This structure is three layered feed-forward network on
And the controlled-not gate may also be defined as [11],
the basis offeed-forward artificial neural network model. There
are L input nodes , K hidden layer nodes and M output nodes.
f ( -JT y - B)_{sinB+icosB,
- (Y=I)} (5) All the neurons of Quantum BP Neural Network are quantum
2 cosB-isinB, (y=O)
neurons.
where r is the control variable, r =1 implies the reversal
and r =0 means the non-reversal.

390
spectral subtraction based speech enhancement, the improved
wiener filter based speech enhancement, RBF neural network
based speech enhancement and our Quantum BP Neural
Network based speech enhancement. We evaluate speech by
measuring Mel Cepstral Distance (MCD) Distortion [12]. The
experiment results are given in Table 1.
According to the experiment results, Mel Cepstral
Distance of enhanced speech, which are largely improved
compared with the former ones, are very small. The Mel
Cepstral Distance of enhanced speech by Quantum BP
Neural Network is the smallest, which means the proposed
Quantum BP Neural Network based speech enhancement
outperforms the others.

Figure 4. 3-Layer Feed Forward Network TABLE I. EXPERIMENTALRESULTS


SNR
-9.38 I8 -2.2508 3.7698 10.2142 15.3654
IV. EXPERIMENTS ON SPEECH ENHANCEMENT Before (db)
Denoise
In order to evaluate the performance of Quantum BP Neural MCD 49.6986 43.5414 35.8599 26.5884 19.5445
Network in speech enhancement, several experiments Spectral
45.7490 38.6650 30.5975 23.2445 18.5737
compared with traditional methods were conducted. This Subtraction
section presents the tasks and the results. Improved
10.6173 8.4638 6.7859 5.0816 3.8858
Wiener Filter
A. Experimental Methods RBF Neural
7.104 5.4518 4.2969 3.2707 2.3746
Networ k
The structure of the proposed speech enhancement scheme Quantum BP
based on Quantum BP Neural Network is depicted in Fig.5. 5.2119 3.7565 2.8016 1.9992 1.4610
Neural Network
Make use of three layer feed-forward quantum BP neural
network to denoise. The Quantum BP Neural Network has 256 The time-domain graphs and spectrum maps of the
quantum neurons of input layer, 200 quantum neurons of enhanced speech by spectral subtraction, improved wiener
hidden layer and 256 quantum neurons of output layer (256- filter, RBF neural network and Quantum BP Neural Network
200-256 can be expressed as ). are depicted in Fig.6 and Fig.7 respectively. Obviously, the
enhanced speech signals by the proposed Quantum BP
Neural Network based speech enhancement is nearest to pure
speech signals.
Recen-
Quantum BP Pure Speech Signal Noisy Speec h Signal(SNR=3 .7698dB)
structed
NeurnlNetwor
speech

15
4
X 10
Spectral Subtraction
Figure 5. Speech Enhancement Based On Quantum BP Neural Network
.,
"0
~
Experiments have been conducted on ' 863 Speech C.
E
Database' collected by the Center for Speech Signal Processing '"
of NUPT. The pure speech signal was randomly divided into t X 104 X
4
10
two sets which length are respectively about five minutes. One RBF Network Quantum BP Network

set is used for training the network and another is used for
evaluation.
B. Experiment results
Novel experiments have been designed for in depth studies
of applying the Quantum BP Neural Network to speech Figure 6. Time-domain graphs
enhancement. The speech signals are generated by adding
mixed noises (including: white noise, pink noise, brown noise,
high frequency channel noise, etc.) into pure speech.
For comparison, evaluations were also done for classical
NN and other methods. We report the experiments of the

391
Noisy Speech Signal(SNR=3 .7698dB)
», 1 r----~-~----, R EFERENCES
g
s 0.5 [I] Parveen, Shahla; Green, Phil. "Speech enhancement with missing data
techniques using recurrent neural networks", Proceedings - IEEE
~ a r~~!l!glle~!!~
u, i::l ' """ International Conference on Acoustics, Speech, and Signal Processing,
4 6
4
May 17,2004 - May 21,2004 .
X 10 Time x 104
Spectral Subtraction lmproeed Wiener Filter [2) Ding Shifei; Su Chunyang; Zhang Liwen, etal. "Neural network research
», », progress and applications in forecast", Lecture Notes in Computer
g g Science v 5264 LNCS, n PART 2, pp.783-793, 2008, Advances in
~ 0.5 s.,. .
0.5 , '
Neural Networks - ISNN 2008 - 5th International Symposium on Neural
~ . . . .~. . .IIlii_ _1II ~
u. 0- u, Networks, ISNN 2008, Proceedings .
24 6
Time x 104 4 [3) S.Kak, "On Quantum Neural Computing ", Information Science, Vo1.83.
X 10
RBF Network Quantum BP Network
pp.I43-I60,I995.
[4] T. Menneer and A. Narayanan , "Quantum-inspired Neural Networks ",
Tech. Rep. R329. Univ. of Exeter, 1995.
[5] D. Ventura and T. R. Martinez, "Quantum Associativ e Memory",
4 6 4 6 Information Sciences, Vo1.I24. pp.273-296 , 2000.
Time 4
10
Time 4
10 [6] A. Ezhov and D.Venture, "Quantum Neural Networks", In: Kasabov N.
------
X X
(ed.): Future Directions for Intelligent Systems and Information Sciences .
Figure 7. Spectrum maps 2000, pp. 213-234 .
[7) LI Fei , ZHAO Shengrnei , ZHENG Baoyu. "Quantum Neural
V. CONCLUSION Network in Speech Recognition", IEEE 2002 6th International
Conference on Signal Processing Proceedings (ICSP02), Beijing, China,
In this paper we have proposed a novel speech Aug. 2002, pp.I267-1270.
enhancement scheme based on Quantum BP Neural Network, [8] Laxmidhar Behera and Bharat Sundaram, "Stochastic Filtering and
which combines the advantages of quantum computing and Speech Enhancement using a Recurrent Quantum Neural Network ",
feed-forward neural network. An analysis is given to the ICISIP 2004, pp.I65-I 70
theoretical basis and practical performance of the proposed [9] Nielsen M A. Chuang I L. "Quantum Computation and Quantum
Information", Cambridge University Press, 2000.
speech enhancement scheme. The comparison experiments
[10] DiVincenzo D., "Two-Bit Gates are Universal for Quantum
results show that the new scheme has better denoising effect Computation ", Phys. Rev. A. Vo!.5I , 1995, pp.1015-1022.
and robustness than traditional spectral subtraction, Wiener [II] Nobuyuki Matsui, Nobuyuki Kouda, Haruhiko Nishimura,eta!. "Neural
filtering method and RBF neural network. Network Based on QBP and Its Performance", Neural
Networks,Vo!.7(3), 2000, pp.247-252.
ACKNOWLEDGMENT [12] Kubichek, Robert F. "Mel-Cepstral distance measure for objective
This work was supported in part by the National Research speech quality assessment", IEEE Pac Rim Conf Commun. Comput.
Signal Process, 1993, pp.125-128.
Foundation for the Doctoral Program of the Ministry of
Education of China under Grant No. 2006029300 I.

392

You might also like