Final Year Project Presentation

Under the Guidance of Dr. Tapan Pradhan

Topic: Image Restoration using Adaptive Filters

Team Members:
M Niranjan Kumar - 1913121
A R Kaushik - 1913149
S Karthik Raju - 1913156
Contents
1. Motivation
2. Objective of this Project
3. What is Image Restoration?
4. Literature Review
5. Image Degradation/Restoration Model
6. Objectives of Image Restoration
7. Applications of Image Restoration
8. What is Noise?
9. Spatial Properties of Noise
10. Types of Noise occurring usually
11. Reduction of Noise in Spatial Domain
12. Reduction of Noise in Frequency Domain
13. Work plan
14. Conclusion
15. References
Motivation

• Image restoration is the problem of recovering images which

have been degraded by blurring and noise.
• We often find ourselves in the need for a platform that
restores degraded images, be it old images or incomplete
images due to damaged sensors etc.,
• Since imaging devices are never perfect, there are many
applications for image restoration: astronomy, medical
imaging, remote sensing, microscopy, underwater imaging,
near infrared imaging etc.,
Objective of this Project

Restoration of Images using adaptive filters:

• To develop an optimized approach to restore images that consists of
different types of noise and blur components.
• To compare this approach with existing traditional image restoration
methods and improve the performance in different conditions.
What is Image Restoration?
Image restoration attempts to restore images that have been degraded.
• Identifies the degradation process and attempts to reverse it
• Similar to image enhancement, but more objective.
Before After

Fig.1:-Comparison of original image and image after restoration

Literature Review
Title of the Research
S.No. Paper/Reference Book Publication Details
1 Digital Image Processing, By Rafael C. Gonzalez, University of Tennessee.
Third Edition. Richard E. Woods,
MedData Interactive
2 Performance Comparison M. Yadav and N. Tiwari, "Performance
of Image Restoration Comparison of Image Restoration techniques
techniques using CNN and using CNN and their applications," 2021 5th
their applications International Conference on Computing
Methodologies and Communication (ICCMC),
2021, pp. 1146-1151, doi:
10.1109/ICCMC51019.2021.9418340.
3 A Survey of Restoration W. Zhang, L. Dong, X. Pan, P. Zou, L. Qin and W.
and Enhancement for Xu, "A Survey of Restoration and Enhancement
Underwater Images for Underwater Images," in IEEE Access, vol. 7,
pp. 182259-182279, 2019, doi:
10.1109/ACCESS.2019.2959560.
Learnings
Fundamentals in Digital Image
Processing, and basics of noise filtering.
Focused on CNN based state of art
denoiser methods and perform a
comparative study on various methods
This paper introduced overview of
underwater image restoration and
enhancement techniques which are
broadly classified as Image
restoration(Physical based model) and
Image enhancement(Non physical
based model)
 Title of the Research
S.No.
Paper/Reference Book
4 Underwater Image Restoration
and Enhancement Based on a
Fusion Algorithm With Color
Balance, Contrast Optimization,
and Histogram Stretching
5 Application of fuzzy image
restoration in criminal
investigation
6 Fast video enhancement
algorithm using real-time image
Publication Details
W. Luo, S. Duan and J. Zheng,
"Underwater Image Restoration and
Enhancement Based on a Fusion
Algorithm With Color Balance,
Contrast Optimization, and Histogram
Stretching," in IEEE Access, vol. 9, pp.
31792-31804, 2021, doi:
10.1109/ACCESS.2021.3060947.
Shuo Sun,
Application of fuzzy image
restoration in criminal investigation,
Journal of Visual Communication and
Image Representation,
Volume 71,
2020,
102704,
ISSN 1047-3203,
https://doi.org/10.1016/
j.jvcir.2019.102704.
Sungjin Kim and Joonki Paik, "Fast
video enhancement algorithm using
Learnings
As some details of the processed image might
disappear in histogram equalization, there
might be excessive enhancement at the peak
of histogram. For wavelet transform, it is
usually successful to deal with images
captured in shallow waters, while fails in deep
waters where the red light attenuation is
severe.
Image restoration based on conventional filter
algorithms cannot achieve satisfactory
performance. Thus, they first introduced the
image restoration algorithms based on
different degradation model. Then, they
proposed some applications of fuzzy image
restoration in criminal investigation.
A fast video enhancement algorithm is
proposed. The algorithm enhances the quality
Image Degradation/Restoration Model
• Image Restoration is the process of recovering an image that has been degraded
by some knowledge of degradation function H and the additive noise term
..(x, y). Thus in restoration, degradation is modelled and its inverse process is
applied to recover the original image.

Fig.2:-Image Degradation Model

Image Degradation

• The degradation is modelled as a degradation function, that together

with an additive noise term, operates on an input image f(x, y) to
produce a degraded image g(x, y)
• If h(x, y) is the degradation function then the degraded image in
spatial domain is given by
…………….(1)
Where,
• is the additive noise function and
• “*” indicates spatial convolution
Objectives of Image Restoration

• The major objective of Image restoration is to obtain an estimate

of the original image.

• The more the resemblance of our restored image ( ) with the original
image ( ), the greater the efficiency of the restoration process.

• Image restoration can be done in

(a) Spatial Domain
(b) Frequency Domain
Some applications of Image Restoration

• Medical Imaging
• Astronomical Imaging
• Remote Sensing
• Microscopy Imaging
• Underwater Image restoration
• Near Infrared Image restoration
• Burglary detection
What is Noise?

• Image noise is random variation of brightness or color information in

images, and is usually an aspect of electronic noise.
• It can be produced by the image sensor and circuitry of a scanner or
digital camera.
• The principle source of noise in digital images arise during image
acquisition (digitization) and transmission.
• The performance of imaging sensors is affected by a variety of factors.
• Images are corrupted during transmission due to interference in
channel.
Spatial Properties of Noise

• With the exception of spatially periodic noise, noise is independent of

spatial co-ordinates and it is uncorrelated with respect to the image
itself.
• We can describe that spatial noise is concerned with the statistical
behavior of the gray-level values
Types of Noise occurring usually:

• The below mentioned noises are commonly found

1. Gaussian Noise
2. Rayleigh Noise
3. Erlang (Gamma) Noise
4. Exponential Noise
5. Uniform Noise
6. Impulse (Salt & Pepper) Noise
Gaussian Noise
• Gaussian Noise is a statistical noise having a probability density function equal
to normal distribution, also known as Gaussian Distribution.
• It is also called as electronic noise because it arises in amplifiers or detectors.

Fig.3:-Probability Density Function of Gaussian Noise

Rayleigh Noise
• The Rayleigh distribution is a continuous probability distribution for positive
valued random variables. It is often observed when the magnitude of a vector is
related to its directional components
• The probability density function for Rayleigh noise is:
for

,Otherwise

Fig.4:-Probability Density Function for Rayleigh Noise

Erlang (Gamma) Noise
• The Erlang probability distribution is a two parameter distributions with support ∈ (0, ∞). The two
parameters are:
1. A positive integer representing 'shape' k.
2. A positive real representing 'rate’ ; sometimes the , is use to represent the inverse of the rate.

Fig.5:-Probability function for Gamma Noise

Exponential Noise

• Exponential noise is a special case of gamma or Erlang noise where b parameters
equals to 1.

Fig.6:-Probability Density Function for Exponential Noise

Uniform Noise

• The noise cause by quantizing the pixels of image to a number of distinct levels is known as
quantization noise.
• It has distribution approximated to uniform distribution. In the uniform noise the noise are
uniformly distributed across a specified range

Fig.7:-Probability Density function for Uniform Noise

Impulse (Salt & Pepper) Noise

• This is caused due to sharp & sudden disturbances in the image gray values.
• Its appearance is randomly scattered white or Black pixel over the image.
• The PDF of bipolar impulse noise model is given by:

• If b>a , grey-level b appears as a light dot in the image like salt.

• Conversely, will appear as dark dot looks like pepper. If either , is zero, the
PDF is called unipolar.
Reduction of Noise in Spatial Domain using
Mean Filters

• Types of Mean Filters are:-

1. Arithmetic Mean Filter
2. Geometric Mean Filter
3. Harmonic Mean Filter
4. ContraHarmonic Mean Filter
• Let represent the set of co-ordinates in the rectangular subimage
window of size mxn, centred at point (x,y)
Arithmetic Mean Filters
• Computes the average value of the corrupted/degraded image g(x,y)
in the area defined by
• The value of restored image at any point (x,y) is

………………(2)
Geometric Mean Filter
• In the geometric mean method, the color value of each pixel is
replaced with the geometric mean of color values of the pixels
in a surrounding region. A larger region (filter size) yields a
stronger filter effect with the drawback of some blurring.

• The Geometric Mean Filter operation is given by the expression

…………….(3)
Harmonic Mean Filter
• The Harmonic Mean Filter operation is given by the expression
Contraharmonic Mean Filter
• The ContraHarmonic Mean Filter operation is given by the expression

• Where ‘Q’ is called the order of the filter.This filter is well suited for
reducing or virtually eliminating the effects of the salt and pepper
noise
Reduction of Noise in spatial domain using
Order-Statistics Filters
• Order-Statistics Filters are spatial filters whose response is based on
ordering(ranking) the pixels contained in the image area
encompassed by the filter

• Types of Order-Statistics Filters are:-

1. Median Filters
2. Max and Min Filters
3. Midpoint Filters
4. Alpha-trimmed Mean Filters
Median Filter
• The operating principle of Median Filter is that it replaces the value of
pixels by the median of the gray levels in the region of that pixel:
Max and Min Filter
• Using the 100th percentile results in the Max Filter
• This filter is used for finding the brightest points in the image. Since, pepper
noise has very low values it is reduced by this filter as a result of max selection
processing the subimage area

• Using the 0th percentile results in the Min Filter

• This filter is useful for finding the darkest points in the image
• So, it reduces the salt noise as a result of min operation
Midpoint Filter
• The mid point filter simply computes the mid point between
maximum and minimum values in the area encompassed by the filter

• NOTE:-This filter works best for randomly distributed noise like

Gaussian noise or Uniform noise
Alpha-Trimmed Mean Filter
• Suppose that we delete the d/2 lowest and d/2 highest gray-level values of g(s,t) in
the area
• Let represent the remaining mn-d pixels.And averaging these remaining pixels
is denotes as:

• Where the value of d can range from 0 to mn-1.When d=0,it is Arithmetic Mean
Filter and when d=mn-1,it is a Median Filter.
• It is useful for multiple types of noise such as combination of salt and pepper noise
and Gaussian noise
Reduction of Noise in Frequency Domain

Band Pass Filters

• The applications of band reject filtering is for noise removal in applications where the general location of
the noise component(s) in the frequency domain is approximately known.

Band Reject Filters

• A bandpass filter performs the opposite operation of a bandreject filter. The transfer function of a
bandpass filter is obtained from a corresponding bandreject filter with transfer function H BR(u,v) by using
the equation

Notch Filters
• A notch filter rejects (or passes) frequencies in predefined neighbourhoods about a centre frequency. Due
to the symmetry of the Fourier transform, notch filters must appear in symmetric pairs about the origin in
order to obtain meaningful results.
Inverse Filtering
• The simplest approach to restoration is direct inverse filtering, where we compute
an estimate, of the transform of the original image simply by dividing the
transform of the degraded image, , by the degradation function

• It tells us that even if we know the degradation function we cannot recover the
undegraded image [the inverse Fourier transform of ] exactly because is not
known.
Weiner Filter
• This image restoration technique may be a commonplace approach that has been planned by N. Weiner,
which contains each the degradation perform and applied math representative of noise into the restoration
perform
• It’s thought of united of the simplest deblurring direct ways by that image will be reconstructed from
degraded one, by mistreatment renowned foreign terrorist organization
• It mechanisms with each great and low pass filter to execute deconvolution tom take away noise with density
operation. f = g × (f + n)
• The yield image is gotten by higher than equation wherever additive noise and frequency physiognomies area
unit renowned.
Adaptive Filters

• Adaptive filters behaviour changes based on the statistical

characteristics of the image in the filter region defines by the mxn
rectangular window
Work Plan
S.No TIME LINE WORK DONE

1 AUGUST-SEPTEMBER Analysis of Research Papers and Reference Book

2 SEPTEMBER-OCTOBER Learned about basic types of most occurring noises in general and removal of
noises in spatial and frequency domains

3 OCTOBER-NOVEMER Implementation of filtering techniques in Image Restoration(Coding Part)

4 NOVEMBER-DECEMBER Optimizing the basic algorithm such that it works adaptively for images
consisting of different kinds of noises
Conclusion
• In this presentation definition and objectives of image restoration are
addressed. In addition to that, noise models and different filtering
techniques are elaborated.
• It is concluded from the above explanations that usage of the techniques
is governed by the understanding, requirement and the standard of the
output needed.
• Restoration Techniques are used to restore corrupted images to their
original form
• Spatial domain techniques are particularly useful for removing random
noise
• Frequency domain techniques are particularly useful for removing
periodic noise
Reference
[1] B. Li and Z. Zhan, "Research on Motion Blurred Image Restoration," 2012 5th International Congress on Image
and Signal Processing, 2012, pp. 1307-1311, doi: 10.1109/CISP.2012.6469900.
[2] M. Yadav and N. Tiwari, "Performance Comparison of Image Restoration techniques using CNN and their
applications," 2021 5th International Conference on Computing Methodologies and Communication (ICCMC), 2021,
pp. 1146-1151, doi: 10.1109/ICCMC51019.2021.9418340.
[3] W. Zhang, L. Dong, X. Pan, P. Zou, L. Qin and W. Xu, "A Survey of Restoration and Enhancement for Underwater
Images," in IEEE Access, vol. 7, pp. 182259-182279, 2019, doi: 10.1109/ACCESS.2019.2959560.
[4] W. Luo, S. Duan and J. Zheng, "Underwater Image Restoration and Enhancement Based on a Fusion Algorithm
With Color Balance, Contrast Optimization, and Histogram Stretching," in IEEE Access, vol. 9, pp. 31792-31804,
2021, doi: 10.1109/ACCESS.2021.3060947.
[5] Shuo Sun, Application of fuzzy image restoration in criminal investigation, Journal of Visual Communication and
Image Representation, Volume 71, 2020, 102704, ISSN 1047-3203
[6] Sungjin Kim and Joonki Paik, "Fast video enhancement algorithm using real-time image restoration framework,"
Proceedings of 2002 IEEE 10th Digital Signal Processing Workshop, 2002 and the 2nd Signal Processing Education
Workshop., 2002, pp. 108-113, doi: 10.1109/DSPWS.2002.1231086.