Image Fusion Using Quaternion

Wavelet Transform and Multiple

Features
 Domain Introduction:
 Image processing is a method to perform some operations on an image, in order to get an
enhanced image or to extract some useful information from it.

 It is a type of signal processing in which input is an image and output may be image or
characteristics/features associated with that image.

 Nowadays, image processing is among rapidly growing technologies. It forms core research area
within engineering and computer science disciplines too.
 Image processing basically includes the following three steps:

 Importing the image via image acquisition tools;

 Analyzing and manipulating the image;

 Output in which result can be altered image or report that is based on image analysis.
 Abstract:
• For local smooth regions in multi-focus images, it is difficult to judge whether they are in focus or
not, whether using human eyes or special focus measures. We propose to classify the images into
smooth and non-smooth regions based on structural similarity index.

• Quaternion wavelet transform (QWT), as a novel tool of image analysis, has some superior
properties compared to discrete wavelet transform, such as nearly shift-invariant wavelet
coefficients and phase-based texture representation.

• We use the local variance of the QWT phases to detect the focus position for the pixels belonging
to the non-smooth image regions. Thus, binary images of the left-focus, right-focus, and smooth
region, e.g., there are two different focuses, are obtained.
 Abstract:
• Then, the connected components labeling algorithm is exploited to label the two binary images
containing the focus position information, and the regions with focus measure errors are
transferred between the two binary images.

• The fusion result is finally acquired through three weighted binary images combined with the
original multi-focus images.

• Furthermore, we conduct several experiments to verify the feasibility of the proposed fusion
method. The performance of SSIM is demonstrated to be superior to current methods.
 Objective :
• The objective of multisensory image fusion is to combine complementary information from
multisensory images of the same scene into a single image to obtain data that is more useful than
the data from any of the individual source.

• To reducing imprecision and uncertainty in the spatial properties and maintaining completeness of
the spectral information.
 Introduction:
• With the recent, rapid developments in the sensing technologies, multisensory imaging systems are

field of being used in a growing number of fields, such as in remote sensing and military

applications.

• Multisensory image fusion, which is de fined as the process of combining relevant information

from two or more images into a single image, has been receiving increasing attention in the remote

sensing research community due to the increasing availability of space borne imaging sensors.
 Existing System:
• In this process we put forward an image fusion algorithm based on Wavelet Transform, Second
Generation Curve let Transform and Non-subsampled Contour let Transform.

• Here we analyze the characteristics of NSCT along with Wavelet and Curve let Transform for
simulation experiments on multi-focus images.

• Here it includes multi resolution analysis ability in wavelet transform, also has better direction
ability for edge feature of awaiting describing image in the second Generation Curvelet Transform
and the NSCT is flexible, multi-scale, multi-direction, and shift invariant image decomposition
that can be efficiently implemented in image fusion. The core of the proposed scheme is in NSCT.
 Disadvantages:
• This process is only based on the contrast method.

• The multi focusing method is more complex and time taken when compared with the other
techniques.
 Proposed system:
• In this image fusion process, a novel multimodal image fusion method using QWT and multiple
features.

• This will be segregated as the three stages, First, we perform QWT on each source image to obtain
low frequency coefficients and high-frequency coefficients.

• Then Second, a weighted average fusion rule based on the phase and magnitude of low-frequency sub
band and spatial variance is proposed to fuse the low-frequency sub bands.

• Next, a choose-max fusion rule based on the contrast and energy of coefficient is proposed to
integrate the high-frequency sub bands. Finally, the final fused image is constructed by inverse QWT.
 Advantages:
• The complexity of the process low when compared with the other existing process, hence the time
consumption is low.

• The wavelet coefficient have better fusion stability.

Block Diagram:

Input Image

Image resize

Wavelet coefficient

QWT Fusion

Performance
Estimation
 Architecture Diagram:

Performan
Input Preprocess Apply Image Overall
ce
Image ing Wavelets Fusion process
estimation
 Flow Diagram

Real Time Dataset

Input Image

Image
Row – Col Preprocessing
Image Resize
256 X 256
High Band Band 1
Quaternion wavelet Band 2
Apply Wavelets
transform (QWT) Band 3
Low Band
Band 4
Image Fusion
Fuse pixel
coefficient of low  SSIM
band Performance  MI
Estimation  Correlation
 Time
 System Requirements
SOFTWARE REQUIREMENTS:

OS : Windows

Software : Mat lab

HARDWARE REQUIREMENTS:

Processor : Intel Pentium.

RAM : 2GB
 Modules:
• Input Image

• Preprocessing

• Wavelet coefficient

• Image Fusion

• Performance Analysis
Module Description:
 Input Image
• Read an image into the workspace, using the imread command. The example reads one of the sample
images included with the toolbox, an image, and stores it in an array named I . imread infers from the
file that the graphics file format is Tagged Image File Format (TIFF).

• Display the image, using the imshow function. You can also view an image in the Image Viewer app.
The imtool function opens the Image Viewer app which presents an integrated environment for
displaying images and performing some common image processing tasks.

• The Image Viewer app provides all the image display capabilities of imshow but also provides access
to several other tools for navigating and exploring images, such as scroll bars, the Pixel Region tool,
Image Information tool, and the Contrast Adjustment tool.
Input Image - Screenshots
Input Image - Screenshots
Input Image - Screenshots
Input Image - Screenshots
 Preprocessing
Image Resize:
• In computer graphics and digital imaging, image scaling refers to the resizing of a digital image.
In video technology, the magnification of digital material is known as upscaling or resolution
enhancement.
• When scaling a vector graphic image, the graphic primitives that make up the image can be scaled
using geometric transformations, with no loss of image quality. When scaling a raster graphics
image, a new image with a higher or lower number of pixels must be generated.
• In the case of decreasing the pixel number (scaling down) this usually results in a visible quality
loss.
• From the standpoint of digital signal processing, the scaling of raster graphics is a two-
dimensional example of sample rate conversion, the conversion of a discrete signal from a
sampling rate (in this case the local sampling rate) to another.
Preprocessing - Screenshots
 Wavelet coefficient
• In this process, a method based on wavelet coefficients in low-pass bands is proposed for the
image classification with adaptive processing of data structures to organize a large image database.

• After an image is decomposed by wavelet, its features can be characterized by the distribution of
histograms of wavelet coefficients.

• The coefficients are respectively projected onto x and y directions. For different images, the
distribution of histograms of wavelet coefficients in low-pass bands is substantially different.

• However, the one in high-pass bands is not as different, which makes the performance of
classification not reliable.
Wavelet coefficient - Screenshots
Wavelet coefficient - Screenshots
Wavelet coefficient - Screenshots
Wavelet coefficient - Screenshots
 Image Fusion
• Image fusion is a process involved with the integration of multiple images where the result is a
composite image with higher visual characteristics than images used to integrate it. Therefore, how
can we measure the quality of the fused image, Several metrics were defined to measure the
experimental results. One such metric is the mean square error

• MSE, which is widely used to make these comparisons or metrics based on the measure of the
image differences. However, a non-reference quality metric was recently introduced to measure
the fusion of two images.

• In this process, we propose to extend the fusion metric to be used when several images are fused
instead of just two images.
Image Fusion - Screenshots
 Performance Analysis
• SSIM

• The Structural Similarity (SSIM) index is a method for measuring the similarity between two
images.
• The SSIM index can be viewed as a quality measure of one of the images being compared,
provided the other image is regarded as of perfect quality.
• It is an improved version of the universal image quality index proposed before.
 Performance Analysis
• MI

• In probability theory and information theory, the mutual information (MI) of two random
variables is a measure of the mutual dependence between the two variables.
• More specifically, it quantifies the "amount of information" (in units such as shannons, more
commonly called bits) obtained about one random variable, through the other random variable.
• The concept of mutual information is intricately linked to that of entropy of a random variable,
a fundamental notion in information theory, that defines the "amount of information" held in a
random variable.
 Performance Analysis
• Entropy

• Image entropy is a quantity which is used to describe the `business' of an image, i.e. the amount
of information which must be coded for by a compression algorithm.
• Low entropy images, such as those containing a lot of black sky, have very little contrast and
large runs of pixels with the same or similar DN values. An image that is perfectly flat will have
an entropy of zero.
• Consequently, they can be compressed to a relatively small size. On the other hand, high entropy
images such as an image of heavily cratered areas on the moon have a great deal of contrast
from one pixel to the next and consequently cannot be compressed as much as low entropy
images.
 Performance Analysis
• Entropy
• Image entropy as used in my compression tests is calculated with the same formula used by the Galileo Imaging
Team:
 Performance Analysis
• Correlation:

• Digital Image Correlation (DIC) is a full-field image analysis method, based on grey value digital
images, that can determine the contour and the displacements of an object under load in three
dimensions.
• Due to rapid new developments in high resolution digital cameras for static as well as dynamic
applications, and computer technology, the applications for this measurement method has broadened
and DIC techniques have proven to be a flexible and useful tool for deformation analysis.
• The dynamic range is wide, with the capability to measure large strains (>100%). The resolution
depends on the field of view and is therefore scalable.
Performance Analysis - Screenshots
Performance Analysis - Screenshots
Performance Analysis - Screenshots
Performance Analysis - Screenshots
Literature Survey
 Title Year Author Methodology Advantages Disadvantages

A Review on 2014 Mahendra PS There are many modified Reducing the The precision of the
Modified Image Kuber1 and technique related to brightness complexity of the process is decreased
Enhancement Manish Dixit2 preserving dynamic Histogram process. due the noise occurred
Applications Equalization that uses statistics in the image.
of digital images for their
representation and processing
are discussed here.
 Title Year Author Methodology Advantages Disadvantages

A Survey of Image 2014 Sandeep Singh, The main objective of this paper The reliability of Some of the data in
Enhancement Sandeep is to discover the limitations of the process is the image get
Techniques Sharma the existing image enhancement more when damaged due to the
strategies. Image enhancement processing all the pixel replacement.
is mainly increasing the images.
observation of information in
images for individual viewers
and providing improved input
for other image processing
methods.
 Title Year Author Methodology Advantages Disadvantages

An Image 2014 Er. Manu Researchers of many computer The results show some degradation
Enhancement by Gupta, vision or machine vision has that Fuzzy Logic occurs at the output.
Fuzzy Logic and Er.Amanpreet mainly focused on the field of and Artificial Hence, the output
Artificial Neural Kaur image enhancement because of Neural network is image has to undergo
Network using the additional knowledge and best technique a process called image
Hybrid Approach. hidden information provided by that help to enhancement.
the results of this procedure improve the
which will further be used for image visibility
many different useful purposes. and preserving the
significance
features of images
 Title Year Author Methodology Advantages Disadvantages

Adaptive Contrast 2014 Diwakar Image enhancement is one of The experimental When the high
Image Shrivastava, the most key issues in high results show that resolution images
Enhancement Dr. Vineet quality pictures such as digital the proposed were run, the process
Based on Fuzzy Richhariya cameras and image research algorithm is very will be degrade the
Set Theory area. Since image clarity is very effective in quality of the image.
easily affected due to lighting contrast
during image acquiring, enhancement as
weather, or other equipment well as required
that has been used to capture minimum
the image. processing time
than the other
methods.
 Title Year Author Methodology Advantages Disadvantages

Image Resolution 2014 Neha Tripathi This paper presents a resolution The targets of The computational
Enhancement by method for enhancing digital medical image time of the process is
Wavelet Transform gray images. The proposed enhancement are more.
Based enhancement technique is mainly to solve
Interpolation and based on the interpolation of problems of low
Image Fusion the high frequency sub-bands contrast and the
obtained by DWT and SWT. high level noise
of a medical
image.
 Conclusion:
• In this process, a novel image fusion method Using QWT and multiple features is proposed. Compared
to traditional MSD tools, the QWT can provide abundant magnitude and phase
information, which meet approximate translation invariance and limited redundancy.

• Different from the traditional fusion methods using a single feature as the activity level measure,
we combine the magnitude, phase and spatial variance of low frequency coefficient into a
comprehensive feature as the activity level measure of low frequency coefficient and combine the
contrast and energy of high frequency coefficient into the other comprehensive feature as the activity
level measure of high frequency coefficient.

• These two multi-features are reliable and robust, which are available for image fusion. Finally, the
experimental results demonstrate the proposed method is effective in all kinds of image fusion.
 Future Enhancement:
• This future process the Formulation, Flow Diagrams and algorithms of PCA (principal Component
Analysis), DCT (Discrete Cosine Transform) and DWT (Discrete Wavelet Transform) based image
fusion techniques.

• The results are also presented in table & picture format for comparative analysis of above techniques.

• The DWT based techniques are more favorable as they provides better results for image fusion. In
future process, two algorithms based on DWT are proposed, these are, pixel averaging & maximum
pixel replacement approach.
 References:
• [1] H. Li, L. Li, and J. Zhang, ‘‘Multi-focus image fusion based on sparse feature matrix
decomposition and morphological filtering,’’ Opt. Commun., vol. 342, pp. 1–11, May 2015.

• [2] Q. Zhang and B.-L. Guo, ‘‘Multifocus image fusion using the nonsubsampled contourlet
transform,’’ Signal Process., vol. 89, no. 7, pp. 1334–1346, 2009.

• [3] J. Tian and L. Chen, ‘‘Adaptive multi-focus image fusion using a waveletbased statistical
sharpness measure,’’ Signal Process., vol. 92, no. 9, pp. 2137–2146, 2012.

• [4] L. Yang, B. Guo, and W. Ni, ‘‘Multimodality medical image fusion based on multiscale geometric
analysis of contourlet transform,’’ Neurocomputing, vol. 72, pp. 203–211, Dec. 2008.
 References (Cont.,):
• [5] S. Singh, A. Gyaourova, G. Bebis, and I. Pavlidis, ‘‘Infrared and visible image fusion for face
recognition,’’ Proc. SPIE, vol. 5404, pp. 585–596, Aug. 2004.

• [6] F. Nencini, A. Garzelli, S. Baronti, and L. Alparone, ‘‘Remote sensing image fusion using the
curvelet transform,’’ Inf. Fusion, vol. 8, no. 2 pp. 143–156, 2007.

• [7] H. Li, B. S. Manjunath, and S. K. Mitra, ‘‘Multisensor image fusion using the wavelet transform,’’
Graph. Models Image Process., vol. 57, no. 3, pp. 235–245, 1995.
[8] T. Pu and G. Ni, ‘‘Contrast-based image fusion using the discrete wavelet transform,’’ Opt. Eng.,
vol. 39, no. 8, pp. 2075–2082, 2000.
Thank You…