Computer Vision and Image processing
Chapter Five
Image Restoration and Reconstruction
1
Outlines
Introduction
Models of images and noise
Estimation of noise parameters
Restoration in the presence of noise
2
What is Image Restoration?
Image restoration attempts to restore images that have been degraded.
Identify the degradation process and attempt to reverse it
Similar to image enhancement, but more objective
Exemplified by removal of blur by deblurring operation
Operations may be done in spatial (localized) or frequency (global) domain
.
3
An image gets corrupted by different types of degradation
Images are degraded by noise, blurs or distortion or artefacts during:
Image Acquisition
Image processing
Image Storage
Transmission
.
4
What is purpose of Restoration?
The purpose of image restoration is to retrieve an original image from
degraded/distorted image.
Objective is to obtain an image as close as the original image
It is possible by removing or minimizing degradations
5
Types of Image Degradation
Degradations re three types
1. Noise: it is a disturbance that causes fluctuations in pixel values therefore pixel
values show random variations
2. Blur: it makes an image less clear so makes the process of image analysis
difficult
3. Artefacts: these are extreme intensity or color fluctuations which makes an
image meaningless
6
7
8
9
10
Cont’d…
Image noise is random variation of brightness or color information in
images, and is usually an aspect of electronic noise.
Itcanbe produced by the image sensor and
circuitry of a scanner or digital camera.
Image noise is an undesirable by-product of image capture that
obscures the desired information.
11
Cont’d…
The sources of noise in digital images arise during image
acquisition (digitization) and transmission.
Imaging sensors can be affected by ambient conditions. Interference
can be added to an image during transmission.
We can consider a noisy image to be modelled as follows:
Where f(x, y)is the original image pixel ,η(x, y) is the noise term and g(x, y)is
the resulting noisy pixel.
12
Noise Models
Noise tells unwanted information in digital images.
Noise produces undesirable effects such as artifacts, unrealistic edges,
unseen lines, corners, blurred objects and disturbs background
scenes.
To reduce these undesirable effects, prior learning of noise models is
essential for further processing.
Here we will discuss few noise models, their types and categories in
digital images
13
14
15
1. Gaussian Noise Models
It is also called as electronic noise because it arises in amplifiers or
detectors.
Gaussian noise caused by natural sources such as thermal vibration
of atoms and discrete nature of radiation of warm objects, high or too
low temperature
Affect both dark and white areas of the image
Gaussian noise generally disturbs the gray values in digital images.
z is grey level, z is the average of z, and σ is its standard deviation
Image sensors : environmental condition and quality of the sensor
16
17
2. Impulse Valued Noise (Salt and
Pepper Noise)
This is also called data drop noise because statistically its drop the
original data values.
This noise is also referred as salt and pepper noise.
However the image is not fully corrupted by salt an
d pepper noise instead of some pixel values are changed in the image.
Although in noisy image, there is a possibilities of some neighbors does
not changed.
This noise is seen in data transmission. Image pixel values are replaced by
corrupted pixel values either maximum ‘or’ minimum pixel value i.e., 255
‘or’ 0 respectively.
18
Let us consider 3x3 image matrices which are shown in the Figure Suppose
the central value of matrices is corrupted by Pepper noise.
Therefore, this central value i.e., 212 is given in Figure is replaced by value
zero. In this connection, we can say that, this noise is inserted dead pixels
either dark or bright.
So in a salt and pepper noise, progressively dark pixel values are present in
bright region and vice versa.
19
20
21
Noise Modelling
Types of Noise based on nature
1. Additive Noise 2. Multiplicative noise
Additive noise in an image refers to unwanted noise that scales with the intensity of the original image
random variations in pixel intensities that are signal.
added to the original image signal. It is also known as speckle noise in contexts like radar, sonar,
It is called "additive" because the noise is or medical imaging.
mathematically combined (added) to the original Unlike additive noise, multiplicative noise is introduced by
signal. multiplying the noise factor with the original image signal.
The observed noisy image Y(x,y) can be expressed as:
𝑌(𝑥,𝑦)=𝑋(𝑥,𝑦)+𝑁(𝑥,𝑦) where:
Noise is added pixel-wise to the image signal as
Y(x,y)=X(x,y)⋅N(x,y)Y(x, y)
𝑌(𝑥,𝑦)Y(x,y) is the observed noisy image.
Where:
𝑋(𝑥,𝑦)X(x,y) is the original image.
Y(x,y) is the observed noisy image.
𝑁(𝑥,𝑦)N(x,y) is the noise component.
X(x,y) is the original image signal.
N(x,y) is the multiplicative noise component.
22
Quantization noise appearance is
inherent in amplitude quantization
process.
It is generally presents due to
analog data converted into digital
data.
23
24
25
Example of Image Deblurring
Restoration in the presence of noise
When the only degradation present in an image is noise, i.e.
g(x,y)=f(x,y)+η(x,y) or G(u,v)= F(u,v)+ N(u,v)
The noise terms are unknown so subtracting them from g(x,y)
or G(u,v) is not a realistic approach
N(u,v) can be subtracted from G(u,v) to obtain an estimate of original
image.
27
Cont’d…
Image restoration is different from Image Enhancement
Restoration is more Objective and Enhancement is Subjective.
Image Enhancement could not precisely represent by
mathematical function, whereas in Image restoration is related to
feature extraction from the imperfect image
Enhancement is manipulated the degraded image, increases the contrast
of the image and visual appearance can be improved.
28
There are various restoration techniques as well as spatial domain filter for
noise removal
In spatial domain methods,the technique operates directly on the
pixels of an image.
The spatial domain methods are used for removing additive noise only.
Image restoration techniques are used to make the corrupted image as
similar as that of the original image.
29
Restoration in the presence of Noise only- Spatial
filtering:
Spatial filtering is the method of filtering out noise from images
using a specific choice of spatial filters.
When the only degradation present in an image is noise.
Spatial filtering can be done when only additive noise is present.
The following techniques can be used to reduce the noise effect:
A. Mean Filters B. Order statistics Filters
Arithmetic mean filter Median filter
Geometric mean filter Max and Min filter
Harmonic mean filter Mid point filter
Contra-harmonic mean filter Alpha trimmed filter
30
31
32
33
Order statistics filtering
34
35
Example1:
Based on the above 5X5 image perform the followings:
a. Arithmetic mean filter
b. Geometric mean filter
c. Harmonic mean filter
d. Contra-harmonic mean filter
36
Example2:
Find the value of pixel given in red above using 3x3 kernel after applying
the followings:
a. Median filter
b. Max and Min filter
c. Mid point filter
d. Alpha trimmed filter
37
End of the chapter
38
