Professional Documents
Culture Documents
The rest of the paper is organized as follows. Section II The ݒ௫ – pixel intensity of salt pixels, and the ݒ –
presents the salt-and-pepper noise removal by TV-L1 denoising pixel intensity of pepper pixels. The sum ݍൌ ݍଵ ݍଶ – the
model and the proposed parameter estimation method. Section level of the salt-and-pepper noise.
III presents experimental results for salt-and-pepper denoising For the image without very high contrast, the pixel intensity
with various noise levels and the comparison. Finally, Section
is usually greater than 0 and less than 255 for 8-bits grayscale
IV concludes.
image. So, if the pixel intensity gets the maximum value or
II. THE SALT-AND-PEPPER NOISE REMOVAL BY minimum value, it may be a pixel of corrupted parts. Especially,
TOTAL VARIATION AND PARAMETER ESTIMATION if the noise level is very high, this statement becomes more
exact. In this case, we propose method to evaluate the
A. Generalized Image Denoising Problem by Total Variation regularization parameter ߣ as follows:
Let ݑ ሺݔሻǡ ݒሺݔሻǡ ݑሺݔሻ אԹ – be (grayscale) original image ߣ ൌ ൛ߤ௩ Ȁࣦఎ ǡ ͳൟǡሺ͵ሻ
(without noise), noisy image and restored image, respectively,
where ݔൌ ሺݔଵ ǡ ǥ ǡ ݔ ሻ אԹ – pixels. The general image where ߤ௩ – the mean of corrupted pixels values with the
restoration by total variation [7, 8] has the following form: noisy image ݒis normalized in interval ሾͲǡͳሿ, ࣦఎ – the salt-and-
pepper noise level.
ߣ
ݑൌ ቆන ȁݑȁ݀ ݔ න ȁ ݑܭെ ݒȁ ݀ݔቇǡሺͳሻ Let ܫǡ ܫ ǡ ܫ௫ ǡ ܫ be set of pixels domain, set of corrupted
௨ ஐ ஐ pixels, set of pixels with maximum intensity, set of pixels with
ଶ minimum intensity, respectively. In the case of the salt-and-
where ȁݑȁ ൌ ටσ൫ܦ௫ ݑ൯ ǡ ȁǤ ȁ – the ܮ -norm, p=1 or 2,
pepper noise, we consider that ܫ ൌ ܫ௫ ܫ . For images
ܦ௫ – ݑthe derivative of ݑby ݔ , – ܭa filtering operator, in the without very high contrast and with high noise level, the mean
case of denoising, – ܭthe identity operator and ߣ – value and noise level can be considered as:
regularization parameter. σூ ݒூ ܿܽ݀ݎሺܫ ሻ
Rudin et al. studied model (1) with L2-norm and this model ߤ௩ ൌ ǡ ࣦఎ ൌ ǡ
ܿܽ݀ݎሺܫ ሻ ܿܽ݀ݎሺܫሻ
is well-known as ROF model [9, 10] (Rudin-Osher-Fatemi): where ݒூ – intensities values of pixels of noisy image
ߣ corresponding to ܫ , the notation ܿܽ݀ݎሺǤ ሻ – set cardinality
ݑൌ ቆන ȁݑȁ݀ ݔ න ȁ ݑെ ݒȁଶଶ ݀ݔቇǡ
௨ ஐ ʹ ஐ (number of elements of the set).
However, this model is only effective for Gaussian noise In the experiments, we will show that the proposed
[11, 12] and does not preserve image contrast and geometry [3]. estimation method (3) gets more effective if the salt-and-pepper
There are a lot of adaptive models based on ROF have been noise level is greater than 50%. We expect that in the case of
developed to remove these disadvantages. Unfortunately, those very high noise level from 70% and above, the denoising result
models still did not work well on the salt-and-pepper noise. of the proposed method will be good enough to compare to
Chan and Esedoglu [3] studied the total variation denoising other state-of-the-art methods.
model with L1-norm and this denoising model is the most
effective to treat the salt-and-pepper noise.
III. EXPERIMENTAL RESULTS AND DISCUSSIONS
B. TV-L1 Regularization for the Salt-and-Pepper Denoising
We handle the experiments of the proposed parameter
The TV-L1 denoising model that is proposed by Chan and estimation method for the salt-and-pepper denoising on
Esedoglu is presented below [3]: MATLAB. The configuration of the computing system is
Windows 10 Pro with Intel Core i5, 1.6GHz, 4GB 2295MHz
ݑൌ ቆන ȁݑȁ݀ ݔ ߣ න ȁ ݑെ ݒȁ ݀ݔቇǤሺʹሻ DDR3 RAM memory.
௨ ஐ ஐ
With the normalized image (pixel intensity value from 0 to A. Parameter Values and Error Metrics
1), the regularization parameter need to be Ͳ ൏ ߣ ͳ. There is no parameter that affects the final restoration
The TV-L1 denoising model preserves image contrast and quality in the adaptive denoising method, because the unique
geometry well and this feature is very important for removing parameter ߣ was estimated. To handle the test, we set the
the salt-and-pepper noise. As can be seen, the model (2) is non- tolerance ߳ ൌ ͳͲିହ between two successive images in L2-
convex. In this work, we use the primal-dual gradient method to norm, ฮݑሾାଵሿ െ ݑሾሿ ฮ ൏ ߳ , where ݅ – index of iteration step.
solve this problem [6]. Otherwise, we also limit the maximum number of iterations –
C. Regularization Parameter Estimation 500. This setting is helpful if the convergence is slow. However,
in all our tests, the loop has not reach this condition. That means
To perform the model (2) as the automatic denoising method, the convergence speed is fast enough. These settings are like for
it is necessary to estimate the parameter ߣ. This parameter is implementing TV-L1 method of Chan and Esedoglu [3]. The
chosen based on the characteristics of the salt-and-pepper noise. BPDF is non-iterative manner, so these settings are
The salt-and-pepper noise on image has following form [1]: unnecessary.
ݒ ݍଵ
ߟሺݔሻ ൌ ൜ ௫ .
ݒ ݍଶ
401
2018 5th NAFOSTED Conference on Information and Computer Science (NICS)
To quantitatively test the restoration performance, we utilize after denoising. The original images are taken from the open
the following error metrics that are widely used in the image dataset of the UC Berkeley https://www2.eecs.berkeley.edu
processing literature [8, 11, 12, 13, 14, 15]: /Research/Projects/CS/vision/bsds/BSDS300/html/dataset/ima
ଶ
ݑ௫ ges.html. We will generate the salt-and-pepper noise by using
ܴܲܵܰ ൌ ͳͲ ଵ ቆ ቇ ݀ܤ the built-in function imnoise of MATLAB for the tests.
ܧܵܯ
(b) The second case: the proposed method will be compared
where ܧܵܯൌ ሺ ݑെ ݑ ሻȀሺ݉݊ሻ is the means square error with to other salt-and-pepper denoising methods. The dataset is like
ݑ is the original (latent) image, ݑ௫ denotes the maximum above. In this case, we only use the salt-and-pepper noise level
value, for e.g for 8-bit images ݑ௫ ൌ ʹͷͷ . Note that a 80% for all the tests.
difference of 0.5dB is visible and higher PSNR (measured in Figure 1 shows the selected images of the UC Berkeley
decibels – dB) indicate better quality image. Structural dataset that we use for the tests. We choose 20 images. All
similarity (SSIM) is a proven to be a better error metric for images are stored in JPEG, grayscale and size 481x321 pixels.
comparing the image quality and it is in the range [0, 1] with For the first case, we will perform the proposed method on
value closer to one indicating better structure preservation. The two images with ID 3096 and 42049. Firstly, we add salt-and-
SSIM is computed between two windows and of common size pepper noise to image with 20%, 50%, 60% and 70% to the
ܰ ൈ ܰ, original images. Secondly, we implement the proposed method
ሺʹߤఠభ ߤఠమ ܿଵ ሻሺʹߪఠభఠమ ܿଶ ሻ to remove noise on these noisy input images. The figure 2 shows
ܵܵ ܯܫൌ ଶ ଶ ܿ ሻሺߪ ଶ ߪ ଶ ܿ ሻ
ǡ
ሺߤఠభ ߤఠ మ ଵ ఠభ ఠమ ଶ
the denoising result on the plane image with ID 3096. The figure
3 – the result after denoising on the eagle image with ID 42049.
where ߤఠ – the average of ߱ , ߪఠଶ – the variance of ߱ , ߪఠభఠమ
– the covariance, and ܿଵ ǡ ܿଶ stabilization parameters. The mean
value of SSIM (MSSIM) is taken as the single value of quality
indicating the structural similarity of the two images compared.
For image denoising, in the synthetic noise added case, the
original noise-free and restored image is compared to find out
how much structures are preserved by the restored method while
removing noise.
B. Synthetic Images and Test Cases
Noisy level 20% Denoised for noisy level 20%
We test the denoising performance of the proposed method
with following cases:
(a) The first case: we implement the proposed method on As we can see on figure 2, the detail of plane is preserved
two images of open dataset with various noise levels. In this well after denoising with various noise level from 20% to 70%.
case, we will evaluate the image quality metrics PSNR/SSIM For the eagle image, with the noise level up to 50%, the
402
2018 5th NAFOSTED Conference on Information and Computer Science (NICS)
denoising result is very good. With high noise level (60%, 70%), 3096 and 42049. The deterioration image level is proportional
some tiny details of the branches and of eagle face are lost. This to the raise of noisy level. For the corrupted images, the PSNR
happens not only for our proposed method, but also for many metric in every noise level is very low (under 13), that means
other denoising methods. The reason is that the tiny details on the corrupted images has very low quality. For the SSIM is same,
the images with very high noise levels are almost impossible to but there is an exception for image with ID 42049 and noise
see. So, the denoising process cannot restore the tiny details level 20%, the SSIM is not too bad (SSIM=0.8095). However,
fully. In this case, machine learning based methods are could be after denoising by the proposed method, the reconstructed
helpful to predict the tiny detail. However, in this work, we only images have very good quality with high PSNR (greater than 20)
focus on non-learning-based methods. and SSIM (greater than 0.8) metrics.
Noisy level 20% Denoised for noisy level 20% Noisy 80% (ID 157055) By TV-L1 of Chan (ID 157055)
Noisy level 50% Denoised for noisy level 50% By BPDF (ID 157055) Proposed (ID 157055)
Noisy level 60% Denoised for noisy level 60% Noisy 80% (ID 119082) By TV-L1 of Chan (ID 119082)
Noisy level 70% Denoised for noisy level 70% By BPDF (ID 119082) Proposed (ID 119082)
Fig. 3. Denoising result of the proposed method for various noise levels on Fig. 4. Result of denoising methods for the salt-and-pepper noise level 80%.
image with ID 3096.
403
2018 5th NAFOSTED Conference on Information and Computer Science (NICS)
and SSIM metrics. The average PSNR of denoised images by From denoising result of test cases, we can see that the
our proposed method is greater than 20. With very high noise proposed method can remove the salt-and-pepper noise with
level (80%), the acquired result is really impressive. With very various noise level well. Specifically, on the very high noise
high noise level, it is impossible to restore the tiny details (e.g. level, our proposed method gives impressive result to compare
the face details) were corrupted by noise in the input images to other salt-and-pepper denoising methods.
with non-learning-based methods.
IV. CONCLUSIONS
TABLE 2. THE COMPARISON OF IMAGE QUALITY METRICS In this paper, we proposed a parameter estimation method for
366566,0 OF DENOISING METHODS WITH NOISE LEVEL . the TV-L1 denoising model to remove the salt-and-pepper noise.
Our method is simple and easy to perform. This proposed
0HWKRG
79/&KDQHWDO
3URSRVHG
%3')
and-pepper noise).
,'
404
2018 5th NAFOSTED Conference on Information and Computer Science (NICS)
on Image Processing, vol. 24, no. 12, pp. 5220-5235, Multiscale," in IEEE 7th International Conference on
2015. Communications and Electronics, pp. 278-282, Hue,
[8] D. N. H. Thanh and S. Dvoenko, "A method of total 2018.
variation to remove the mixed Poisson-Gaussian noise," [13] V. B. S. Prasath, D. N. H. Thanh, N. H. Hai and N. X.
Pattern Recognition and Image Analysis, vol. 26, no. 2, Cuong, "Image Restoration With Total Variation and
pp. 285-293, 2016. Iterative Regularization Parameter Estimation," in The
[9] L. I. Rudin, S. Osher and E. Fatemi, "Nonlinear total Eighth International Symposium on Information and
variation based noise removal algorithms," Physica D, Communication Technology SoICT, pp. 378-384,
vol. 60, p. 259–268, 1990. NhaTrang, 2017.
[10] D. N. H. Thanh and S. Dvoenko, "Image noise removal [14] D. N. H. Thanh, S. Dvoenko and D. V. Sang, "Colour
based on Total Variation," Computer Optics, vol. 39, no. image denoising based on a combined model," in Seventh
4, pp. 564-571, 2015. Symposium on Information and Communication
Technology, pp. 308-315, Ho Chi Minh city, 2016.
[11] V. B. S. Prasath, D. N. H. Thanh and N. H. Hai, "On
Selecting the Appropriate Scale in Image Selective [15] D. N. H. Thanh and S. Dvoenko, "A denoising of
Smoothing by Nonlinear Diffusion," in IEEE 7th biomedical images," The International Archives of
International Conference of Communications and Photogrammetry, Remote Sensing and Spatial
Electronics, pp. 267-272, Hue, 2018. Information Sciences, vol. XL, no. 5, pp. 73-78, 2015.
[12] V. B. S. Prasath, D. N. H. Thanh and N. H. Hai,
"Regularization Parameter Selection in Image
Restoration with Inverse Gradient: Single Scale or
405