Professional Documents
Culture Documents
Noisy Conditions
Abstract— Image restoration of noisy motion blurred images parameters. Lokhande et al. [9] used Hough transform based
is a challenging problem in image processing. The quality of approach for estimation of blur angle. An obvious problem
restoration of such images depends on the perfect estimation of associated with this approach is the selection of threshold
blur parameters. In this paper, an algorithm is proposed to value used in binarization. To overcome this, Radon transform
estimate linear motion blur parameters such as blur length and
motion direction under noisy conditions. In the proposed
based approach has been proposed for blur angle estimation
algorithm, pre-processing of the noisy image requires appropriate [11]. Deshpande et al. [12] proposed algorithm based on
windowing and subsequently dual Fourier transform of the modified cepstrum domain processing and Radon transform
image. Blur angle is estimated accurately using Radon Transform for PSF estimation for noise free blurred images along with
on a specific bit plane image of the dual Fourier transformed ringing reduction. Dash et al. [16] used gabor filter and radial
image. For accurate estimation of blur length in presence of noise, basis function neural network to estimate blur parameters.
the image is processed in bispectrum domain as the bispectrum Chang et al. [10] and Moghanddam [11] exploited the property
suppresses additive Gaussian noise. A robust novel exponential of bispectrum to suppress the additive Gaussian noise for blur
model is proposed based on curve fitting that represents the length identification. They used the estimated blur angle to
behavior of blur length in bispectrum domain. The maximum
error in the estimated blur angle and the blur length is less than
make motion in horizontal direction before bispectum
1.6° and 2 pixels respectively in presence of additive Gaussian estimation of degraded image. So the error in estimating blur
noise of variance up to 150. Experimental results are also angle may lead to the erroneous blur length estimation in these
compared with the previous methods to demonstrate the superior algorithms. Our algorithm estimates angle more accurately and
performance of the proposed algorithm. uses a novel mathematical model to estimate blur length in
bispectrum domain.
Keywords— Motion blur, PSF, Dual Fourier transform, Radon
transform, Bit plane slicing, Bispectrum This paper is organized in six sections. Mathematical
model of image blur is presented in section II. Section III
I. INTRODUCTION describes the algorithm to estimate blur angle accurately.
Motion blur is a result of relative motion between the scene Motion length estimation for noisy images is also proposed in
and the camera during exposure time. It is modelled as this section using an exponential model in bispectrum domain.
convolution of the clear image with a blurring kernel, known Experimental results and comparison with other algorithms are
as Point Spread Function (PSF). The problem of recovering the provided in section IV and section V respectively to indicate
clear image requires deconvolution of the PSF with the blurred that the proposed algorithm is better than the other approaches.
image. So, accurate estimation of blur parameters or PSF is the Finally conclusion is given in section VI.
first and the most significant task for restoration of the motion
blurred images. Once the parameters are estimated, any of the II. MATHEMATICAL MODEL OF IMAGE BLURRING
conventional restoration algorithms such as Lucy-Richardson, Assuming PSF to be spatially invariant, a blurred image
Wiener Filter etc. can be applied for image restoration. g(x,y) can be modelled mathematically in the form of
Various methods for finding motion blur parameters have convolution operation between the clear image f(x,y) to be
been proposed earlier. Cannon [1], Fu et al. [2] proposed restored and the PSF h(x,y) in presence of additive n(x,y) [4].
identification algorithms using power cepstrum [3] of a blurred Mathematically:
image, but performance of these algorithms degrades as the
signal to noise ratio gets lower. A comprehensive overview of ݃ሺݔǡ ݕሻ ൌ ݄ሺݔǡ ݕሻ ݂ כሺݔǡ ݕሻ ݊ሺݔǡ ݕሻ (1)
image deconvolution is given by Kundur [4]. Fabian et al. [5]
uses Cannon’s approach in addition with pre-processing steps where * denotes convolution operation. In frequency domain:
for noise reduction using modified spectral subtraction
technique. Rekleitis [6] proposed the use of steerable filter in ܩሺݑǡ ݒሻ ൌ ܪሺݑǡ ݒሻܨሺݑǡ ݒሻ ܰሺݑǡ ݒሻ (2)
cepstrum domain. H. Ji et al. [7] uses the same cepstrum
domain based approach on image gradients for wider range of where capital letters are Fourier transform of the
motion types. Dobes et al. [8] used filtered power spectrum of corresponding lower case letters.
the image gradient in frequency domain to estimate blur
A linear motion blur is characterized mathematically in the next lead to unwanted hoorizontal and vertical lines in
terms of PSF as [11]: image spectrum that may produuce false estimate of blur angle.
So the original image is window
wed.
݄ሺݔǡ ݕሻ ൌ
ଵ ௫
݂݅ඥ ݔଶ ݕଶ ܽ݊݀ ൌ െߠ݊ܽݐ െ
ቊ ଶ ௬ ቋ (3)
Ͳ݈݁ ݁ݎ݄݁ݓ݁ݏ
In this section, we are proposing an alggorithm to estimate Fig. 1 (a) Noise free motion blurred image with L=20 pixel and Ĭ=45°
motion direction and blur length for a motioon blurred image in (b) Log spectrum
presence of Gaussian noise. Results are shhown for standard
cameraman image.
A. Estimation of motion direction
The previously described algorithms [1],, [2], [12] estimate
blur angle based on spectral analysis of the blurred noise free
images in cepstrum domain. The blurred im mage is transformed
into frequency domain which contains parallel
p dark lines
(zeros) due to SINC nature of the frequenccy response of the
linear PSF. Log spectra of noise free blurredd image are shown (a) (b)
in Fig. 1. Orientation and spacing between these
t parallel lines
contain information regarding blur parameteers. The orientation
gives direction of motion and the spacing (dd) between them is
related with blur length as [11]:
2.6
ା ା
2.4
ܤ ሺ߱ଵ ǡ ݒଵ Ǣ ͲǡͲሻ ൌ ȁܪሺ߱ଵ ǡ ݒଵ ሻȁଶ ܪሺͲǡͲሻܤ ሺ߱ଵ ǡ ݒଵ Ǣ ͲǡͲሻ (7)
12
10
Noise Free TABLE I
10
11 Gaussian noise Var=1 Comparison of goodness of fit parameters for various mathematical models
Gaussian noise Var=25
10 Gaussian noise Var=100
Nature of Mathematical Models R- Adjusted RMSE
10 Curve square R-square
Mixture of f(x) = a1*exp(-((x- 0.9829 0.9825 1.532
Bispectrum (Log scale)
9
10 X: 14 Gaussians b1)/c1)^2) + a2*exp(-
Y: 1.482e+008
8
((x-b2)/c2)^2)
10 Rational f(x) = (p1*x^4 + p2*x^3 0.9854 0.9848 1.429
7
Polynomial + p3*x^2 + p4*x + p5) /
10 (x^5 + q1*x^4 + q2*x^3
6
+ q3*x^2 + q4*x + q5)
10 Mixture f(x) = a*exp(b*x) + 0.9909 0.9907 1.105
5
of c*exp(d*x)
10 Exponential
4
10
-150 -100 -50 0 50 100 150
Spatial Frequency 45
LobeW idth vs. BlurLength
Mixture of Gaussians
Fig. 4 Log bispectra of 256x256 cameraman image blurred with L=20 pixel 40
Rational Polynomial
and Ĭ=60° for different level of Gaussian noise. Estimated width of central 35 Mixture of Exponentials
lobe =28
25
20
To minimize the error introduced due to slightly inaccurate
finding of the lobe width (Wl) under noisy conditions, we try to
15
estimate L in range (5…50), we try to fit different model to 20 40 60 80 100 120 140 160
achieve higher accuracy at lower bound in the range (3...40). Lobe W idth
For that we have used several different random values of L in Fig. 5 Fitting of Gaussian, rational polynomial and exponentials functions
the range (3…40) and found the corresponding values of Wl.
Then we try to fit curves of various natures among the data
using the method of robust least square fitting using bisquare where dfe and dft are the degree of freedom associated with
weights. The idea behind the bisquare is to reweight points SSE and SST respectively. The value of R-Square and Adjusted
based on their residuals using bisquare weighting function R- Square near to 1 and small value of RMSE correspond to
defined as [17]: better fit of a mathematical model to the data.
The curve, which fitted the data most accurately with best
ሺͳ െ ݑଶ ሻଶ ǡ ȁݑ ȁ ൏ ͳ fitting parameters, in 99% confidence level is given as
ܵܤ ൌ ൜ (10)
ݔǡ ȁݑ ȁ ͳ
ܮൌ ͶǤͻʹ ݔ݁ כሺെͲǤͲͶͳܹ ሻ ͳͷǤͶ ݔ݁ כሺെͲǤͲͳͳʹܹ ሻ
where ui is standardized adjusted residuals defined in [17]. (13)
Robust fitting is implemented by minimizing the summed
square of the residuals and reducing the weight of outliers Thus the blur length can be estimated accurately using (13)
using bisquare weighting function. It is found from initial in the blur range (3…40) in presence of the additive Gaussian
experiments that Gaussian function, rational polynomial and noise for linear motion blurred images.
exponential function are the main competitors for fitting the
experimental data accurately. Hence we compared the IV. EXPERIMENTAL RESULTS
goodness of fit parameters like R-Square, Adjusted R-Square We tested our algorithm for 100 instances of standard
and Root Mean Square Error (RMSE), of the best fitted curves 256x256 images like Cameraman, Lena, Barbara etc. having
of these families in TABLE I to select the optimized curve. different amount of motion direction (ߠ) and blur length (L)
Natures of the fitted curves are also shown in Fig. (5). The R- randomly selected in the range Ͳ ߠ ͳͺͲ and ͵ ܮ ͶͲ
Square is defined as: and corrupted with zero mean additive Gaussian noise with
variance up to 150.
ܴܵܵ ܵܵܧ
ܴܵ ݁ݎܽݑݍൌ ൌ ͳെ ሺͳͳሻ TABLE II
ܵܵܶ ܵܵܶ Experimental results for images with Gaussian noise of variance up to 150
where SSR is the sum of square of regression, SST is sum of Error in ࣂ (degree) Error in L (pixel)
square total and SSE is sum of square error described in [10]. Best Estimate 0 0
The Adjusted R-Square can be described as:
Worst Estimate 1.6 2
ܵܵܧȀ݂݀
݁ݎܽݑݍܴܵ݀݁ݐݏݑ݆݀ܣൌ ͳ െ ሺͳʹሻ Standard Deviation 0.62 0.79
ܵܵܶȀ݂݀௧
2014 IEEE International Conference on Computational Intelligence and Computing Research
Motion blurred images from the real world are not used as The direction of motion blur is estimated using 90 degree
they may not be degraded by blur parameters defined in (3). offset correction with higher estimation accuracy. For blur
The error in the best and the worst estimate for ߠ and L with length estimation, we have used bispectrum of the image and
standard deviation of the estimates, are tabulated in TABLE II. proposed an exponential model using curve fitting techniques
The best and the worst estimate for ߠ occur randomly in any to minimize the error introduced due to noise. The goodness of
direction, however the error in L is minimum for the fit parameters of the proposed model are also compared with
rangeͳͲ ܮ ʹͳ. Image restored using wiener filter [15] other competitive models. We have tested our algorithm on
after estimation of the blur parameters is shown in Fig. (6). images degraded by different values of linear motion blur
parameters corrupted with Gaussian noise up to variance of
V. COMPARISON WITH OTHER ALGORITHM 150, and compared the results with other existing algorithms to
We compare our algorithm against some other algorithms demonstrate better performance. The maximum error achieved
proposed by Lokhande et al. [9] and Moghaddam et al. [11]. in the estimated blur angle and the blur length is less than 1.6°
Experiments are conducted on standard 256x256 images of and 2 pixels respectively. However the algorithm does not
Cameraman, Lena etc. in presence of the additive Gaussian provide best PSF estimate for images which are degraded with
noise up to variance 150 for the applicable range of blur some complex PSF instead of linear blur parameters defined in
parameters specified in [9] and [11]. The maximum error (3).
resulted in estimation of blur angle and blur length along with
applicable range of the algorithms are compared in TABLE III.
Our algorithm estimates the blur angle more accurately. The REFERENCES
estimation of blur length is also improved due to subsequent [1] M. Cannon, “Blind deconvolution of spatially invariant image blurs with
usages of the blur angle in blur length estimation by the robust phase”, IEEE Trans. on Acoustic, Speech and Signal Processing, vol. 24,
exponential model proposed in bispecrum domain. no. 1, pp. 58-63, Feb. 1976.
[2] Z. Fu, H. Xian, J. Xu, X. Ge, “Evaluation of motion blur parameters
VI. CONCLUSION based on cepstrum domain of the intentional restored”, International
Conference on Computational Problem-Solving, pp. 271-274, Dec. 2010.
In this paper, we have proposed the robust algorithm to [3] D. G. Childers, D. P. Skinner, R. C. Kemerrait, “The cepstrum: a guide
estimate motion blur parameters under noisy conditions. The to processing”, Proceedings of the IEEE, vol. 65, no. 10, pp. 1428-
pre-processed dual transform of the degraded image is bit 1443,Oct. 1977.
[4] D. Kundur, D. Hatzinakos, “Blind image deconvolution”, IEEE Signal
plane sliced and radon transform is applied to 4th bit plane Processing Magazine, vol. 13,no. 3, pp. 43-64,May 1996.
image having significant information. [5] R. Fabian, D. Malah, “Robust identification and out-of-focus blur
parameters from blurred and noisy”, CVGIP: Graphical Models and
Image Processing, vol. 53, no. 5, pp. 403-412, Sept. 1991.
[6] I. M. Rekleitis, “Steerable filters and cepsturm analysis for optical flow
calculation from a single blurred image”, Vision Interface, Canadian
Information Processing Society, Toronto, pp. 159-166, May1996.
[7] H. Ji., C. Liu, “Motion blur identification from image gradients”, IEEE
Conference on Computer Vision and Pattern Recognition, pp. 1-8, June
2008.
[8] M. Dobes, L. Machala, T. Furst, “Blurred image restoration: a fast
method of finding the motion length and angle”, Digital Signal
Processing, vol. 20, no. 6, pp. 1677-1686, Dec. 2010.
[9] R. Lokhande, K .V. Arya, P. Gupta, “Identification of parameters and
restoration of motion blurred images”, ACM Symposium on Applied
Computing, pp. 301-305, 2006.
[10] M. M. Chang, A. M. Tekalp, A. T. Tanju Erdem, “Blur identification
(a) (b) using bispectrum”, IEEE Trans. on Signal Processing, vol. 39, no. 10, pp.
2323-2325, Oct. 1991.
Fig. 6 (a) Motion blurred image with L=20 pixel and Ĭ=60° added with [11] M. E. Moghaddam, M. Jamzad, “Motion blur identification in noisy
Gaussian noise of variance 150 (b) Restored image using Wiener filter images using mathematical models and statistical measures,”Pattern
with estimated values of L=20.705 pixel and Ĭ=60.7° Recognition,vol. 40, no. 7, pp. 1946-1957, July 2007.
[12] A. M. Deshpande, S. Patnaik, “Single image motion deblurring: An
accurate PSF estimation and ringing reduction”, Optik-Int. Jour. for
TABLE III Light and Electron Optics, vol. 125, no. 14, pp. 3612-3618, July 2014.
Comparison with other algorithms in presence of Gaussian noise [13] P. Toft, “The radon transform: theory and implementation”, Ph.D.
Thesis, Technical University of Denmark, Copenhegen, Denmark, 1996.
Methods Applicable Maximum Maximum [14] C. L. Nikias, M. R. Raghuveer, “Bispectrum estimation: a digital signal
Range of error in error in blur processing framework”, Proceedings of the IEEE, vol. 75, no. 7, pp. 869-
parameters blur angle length 891, July 1987.
(degree) (pixels) [15] R. C. Gonzales, R. E. Woods, S. L. Eddins, “Digital image processing
Lokhande et al. Ͳ ߠ Ͳ 5 7 using Matlab”, Prentice Hall, 2004.
[9] ͳͷ ܮ Ͳ [16] R. Dash, B.Majhi, “Motion blur parameters estimation for image
Moghaddam et al. Ͳ ߠ ͳͺͲ 2 2.1 restoration”, Optik, vol. 125, no. 5, pp. 1634-1640, Mar. 2014.
[11] ͷ ܮ ͷͲ [17] MATLAB curve fitting toolbox user’s guide.
Proposed Ͳ ߠ ͳͺͲ 1.6 2
͵ ܮ ͶͲ