COMPRESSIVE SENSING BASED

IMAGE RECONSTRUCTION
Internal Guide External Guide
Prof. Jigna Patel Prof. Ketki Pathak
E.C .Department E. C. Department,
Dr. S. & S. S. Ghandhy GEC, Surat SCET, Surat.

Submitted By:-
SHERIN C ABRAHAM (150230727015)
M.E. (ELECTRONICS AND COMMUNICATION)
Wireless Communication Systems and Networks
Semester-4, Year 2017,
Dr. S. & S. S. Ghandhy Govt. Engineering College, Surat.
CONTENTS
• Introduction
• Applications
• Literature survey Summary
• CS based CSPM system
• Proposed Block Diagram
• Results
• Inferences
• Future works
• Conclusion
• References

Compressive sensing based image reconstruction

2
150230727015
INTRODUCTION – COMPRESSIVE SENSING
• By Nyquist criteria, signal sampled at 2* fmax rate and then compress by
discarding small coefficients
• If the signal is “sparse” or compressible, then the acquired significant
information is sufficient to reconstruct.
• The Compressive Sensing (CS) theory asserts that one can recover certain
signals and images from far fewer samples or measurements.
• CS directly measure the part that will not end up being thrown away
• Compressive Sensing relies on three principle – Sparsity, Incoherence, Non-
Linear Reconstruction.
M N
X Compressed sensing Reconstruction 𝑋෠
Compressive Sensing based Image Reconstruction
3
150230727015
APPLICATIONS
• Medical Imaging
• Compressive Radio Detecting and Ranging.
• Analog to Information Converters
• Seismic Imaging
• CS in Camera

Fig. 3: Applications of CS. [21]

Compressive sensing based image reconstruction
4
150230727015
WHY CS IN MRI?

• Magnetic Resonance Imaging (MRI) is an essential medical imaging tool with

an inherently slow data acquisition process.
• Applying CS to MRI offers
– significant scan time reductions
– benefits for patients and health care economics.
• Medical imagery is naturally compressible by sparse coding in an appropriate
transform domain (e.g., by wavelet transform).
• MRI scanners naturally acquire encoded samples, rather than direct pixel
samples (e.g., in spatial-frequency encoding).

Compressive sensing based image reconstruction

5
150230727015
CS- BASIC BLOCK DIAGRAM

f
x Orthonormal
basis Ψ
Measurement
matrix φ

y
ሚf
Reconstruction
𝑥෤ Ψ* Inverse of Ψ
algorithm

Compressive sensing based image reconstruction

6
150230727015
EXAMPLE OF CS USING SPARSE SIGNAL

0
0.18
0.03
0.2336 0.52 0.67 0.65 0.53 −2.30 −0.89 0.85 −0.11
0
−0.1767 = 0.21 −0.84 −1.62 −2.06 −1.16 −0.02 0.21 0.93
0
−0.1572 −1.34 −1.38 −0.37 0.22 2.09 −0.62 0.93 −1.40
0
0.11
0

A signal -- K-sparse in one basis (sparsity basis) -- recovered from M

(cK) non adaptive linear projections onto a second basis (measurement
basis) that is incoherent with the first (where c is a small over-measuring
constant).

Compressive sensing based image reconstruction

7
150230727015
RESTRICTED ISOMETRY PROPERTY (RIP)

Compressive sensing based image reconstruction

8
150230727015
MEASUREMENT MATRIX

Hadamard Matrix
• Square Matrix whose entries are either +1 or −1 and whose rows are
mutually orthogonal which satisfies below condition.
• HHT = n In,
– where In is identity matrix of size n when H is of size n x n.
– HT is the transpose of H.
Gaussian Matrix
• The random projection or a matrix of i.i.d. random variables from a sub-Gaussian
distribution is Gaussian Matrix. An M-by-N matrix containing pseudorandom
values drawn from the standard normal distribution and the values are normalized.

Compressive sensing based image reconstruction

9
150230727015
MEASUREMENT MATRIX CONT..
Bernoulli matrix
• The Bernoulli distribution is the probability distribution of a random
variable which takes the value 1 with probability p and the value 0 with
probability q = 1-p.
• If X is a random variable with this distribution, we have:
Pr (X=0) = 1 – Pr (X=1) = 1-p =q
Toeplitz matrix
• A matrix in which each descending diagonal from left to
right is constant. If the i, j element of A is denoted A i, j.
• A i , j = A i+1, j+1 Fig. 11: Toeplitz matrix
• Diagonal-constant matrix
Compressive sensing based image reconstruction
10
150230727015
RECONSTRUCTION ALGORITHMS:-
L1 MINIMIZATION TECHNIQUE
• Also known as least absolute error.
• Convex Optimization Problem
ሚ 1 s.t ||φψ𝑇 𝑓෩ − y|| l2 ≤ ε
min ||ψT𝑓||l
• ε is the noise term,
• y is the received CS measurements
• 𝑓ሚ is the recovered non-sparse signal.
• ψT denotes the transpose of ψ.
• Φ is the measurement matrix.

Compressive sensing based image reconstruction

11
150230727015
OMP – ORTHOGONAL MATCHING PURSUIT
1. Input = column vector [ 4 5 7 2]
2. Measurement Matrix = Hadamard Matrix of 4 x 4
3. Tx Sig = Measurement Matrix * Input = [18 4 0 -6]
4. Residual = Tx Sig
5. RecSig = (Measurement MatrixT ) * Residual = [16 20 28 8]
6. Estimate position of large coefficient in RecSig value i.e, Pos. Add up
position values to this Pos vector.
7. Estimate = (Pseudo-inverse of Measurement Matrix for only in Pos)* Tx Sig
[0 0 7 0]
8. Residual = Tx Sig - (Estimate * Measurement Matrix ). [11 -3 7 1]
9. Repeat from step 5 for desired iterations.
Compressive sensing based image reconstruction
12
150230727015
CS BASED CSPM SYSTEM

Fig. 12: Overall block diagram. [1]

Compressive sensing based image reconstruction
13
150230727015
CSPM ENCODER / DECODER

Fig. 13: CSPM Encoding and Decoding . [1]

Compressive sensing based image reconstruction
14
150230727015
PROPOSED BLOCK DIAGRAM
Original Image Reconstructed Image

2-D DWT Inverse DWT

Low frequency High frequency

CS Recovery CS Recovery
components components

Received Received
Measurements using Measurements using Measurements of Measurements of
Measurement matrix Measurement matrix low band high bands

Prediction error calculation Prediction

Encoder Decoder

Channel

Fig. 14: Proposed algorithm block diagram

Compressive sensing based image reconstruction
15
150230727015
PROPOSED BLOCK DIAGRAM – CONT.
Original Image Reconstructed Image

2-D DWT Inverse DWT

Low frequency High frequency CS Recovery using CS Recovery using

components components L1 minimization OMP

Measurements using Measurements using Received Received

Hadamard matrix Gaussian matrix Measurements of Measurements of
low band high bands

Prediction error calculation using DARC Prediction using DARC

Huffman Encoder Huffman Decoder

Channel

Fig. 15: Proposed algorithm block diagram

Compressive sensing based image reconstruction
16
150230727015
PROPOSED IN MSR

• Compare with different levels of wavelet transform and different wavelets.

• Compare with more measurement matrices.

Compressive sensing based image reconstruction

17
150230727015
MATLAB ALGORITHM
• Perform the wavelet transform of the N*N image, and get the four wavelet sub-
band coefficients {LH1, HL1, HH1, LL1}.
• Use the measurement matrix to measure the three high-frequency sub-band
coefficients LH1, HL1, HH1, to get the matrices of the measured high band
coefficients while use another measurement matrix for the low-frequency sub-band
coefficients LL1.
• Find out prediction error for all components.
• Undergoes entropy coding and transmit encoded values.

Compressive sensing based image reconstruction

18
150230727015
MATLAB ALGORITHM CONT..
• At receiver side, do decoding of received signal values.
• Do prediction on decoded values.
• Use the reconstruction algorithm to reconstruct the three high-frequency
coefficients matrices 𝐿𝐻 1, 𝐻𝐿1, 𝐻𝐻 1.Then LL1 band coefficient matrices are
reconstructed by using another reconstruction algorithm.
• All coefficient recovered will undergo inverse wavelet transform to reconstruct
the image.
• The image reconstructed will be verified by its PSNR value and MSE value.

Compressive sensing based image reconstruction

19
150230727015
 RESULTS

Compressive sensing based image reconstruction

20
150230727015
WAVELET TRANSFORM

Fig. 15: Wavelet Transform Output of 512 x 512 image.

Compressive sensing based image reconstruction
21
150230727015
IMAGE SPARSITY BY WAVELET TRANSFORM

Fig. 16: Sparsity due to wavelet transform

Compressive sensing based image reconstruction
22
150230727015
MEASUREMENTS BY APPLYING CS

Fig. 17: Less samples after applying CS

Compressive sensing based image reconstruction
23
150230727015
IMAGE SPARSITY BY DCT TRANSFORM

Fig. 18: Sparsity using DCT

Compressive sensing based image reconstruction
24
150230727015
MEDICAL IMAGES

Fig.19: Different medical images [24,25,26]

Compressive sensing based image reconstruction
25
150230727015
COMPARISON BETWEEN DIFFERENT
MEASUREMENT MATRIX USING DCT IMAGE

Fig. 20 Comparison between different measurement matrix used for DCT transformed
image
Compressive sensing based image reconstruction
26
150230727015
COMPARISON WITH DIFFERENT SIZE OF
DWT IMAGES USING GAUSSIAN MATRIX

Fig. 21 Comparison with different size of images

Compressive sensing based image reconstruction
27
150230727015
 COMPARISON OF DWT AND DCT

Fig. 23: Visual quality comparison for different medical images for DCT and DWT method is compared
of 128x128 images Compressive sensing based image reconstruction
28
150230727015
COMPARISON BETWEEN HADAMARD WITH
GAUSSIAN MATRIX USED FOR MEASURING
LL BAND

Fig 24: Comparison between Hadamard matrix used for measuring LL band and Gaussian
used for all frequency bands
Compressive sensing based image reconstruction
29
150230727015
 COMPARISON OF DWT WITH ALL BAND GAUSSIAN
MATRIX AND LL BAND USING HADAMARD MATRIX

Fig. 25: Visual quality comparison for different medical images for DWT with all Gaussian and DWT
method with LL band measured with Hadamard is compared of 128 x 128 image
Compressive sensing based image reconstruction
30
150230727015
OUTPUT FROM
DIFFERENT
TECHNIQUES

Compressive sensing based image reconstruction

Fig. 27: Output of 512 x 512 image using various techniques
150230727015 31
with LL band Hadamard and high bands with Gaussian matrix
COMPARISON BETWEEN DCT AND DWT

Fig. 28: DCT and DWT

Compressive sensing based image reconstruction
32
150230727015
COMPARISON WITHOUT AND WITH LINEAR
PREDICTION

Fig. 29: Visual quality comparison for different medical images for DWT method with LL band
measured with Hadamard and DWT with linear prediction is compared
Compressive sensing based image reconstruction
33
150230727015
COMPARISON WITH LINEAR PREDICTION AND
WITH DARC PREDICTION

Fig. 31: Visual quality comparison for different medical images for DWT method with
linear prediction and DWT with DARC prediction is compared
Compressive sensing based image reconstruction
34
150230727015
GRAPH REPRESENTING DWT WITH DIFFERENT
PREDICTION METHODS AND WITHOUT PREDICTION

Fig. 33: Comparison for different medical images for DWT with different prediction
methods
Compressive sensing based image reconstruction
35
150230727015
COMPARISON FOR DWT WITH DIFFERENT
LEVELS OF DECOMPOSITION

Fig. 34: Comparison for different medical images for DWT with different levels of
decomposition
Compressive sensing based image reconstruction
36
150230727015
COMPARISON FOR DIFFERENT MEDICAL
IMAGES FOR DWT WITH DIFFERENT
DAUBECHIES WAVELET

Fig 35: Comparison for different medical images for DWT with different
Daubechies wavelet
Compressive sensing based image reconstruction
37
150230727015
COMPARISON FOR DIFFERENT MEDICAL IMAGES
FOR DWT WITH DIFFERENT MEASUREMENT
MATRIX

Fig 36: Comparison for different medical images for DWT with different
measurement matrix
Compressive sensing based image reconstruction
38
150230727015
COMPARISON FOR DIFFERENT MEDICAL
IMAGES FOR DWT WITHOUT ENCODER
AND WITH ENCODER

Fig 37: Comparison for different medical images for DWT without encoder and with
encoder Compressive sensing based image reconstruction
39
150230727015
COMPRESSION RATIO COMPARISON
BETWEEN WITH HUFFMAN ENCODER
AND WITHOUT ENCODING

Fig 38: Compression ratio comparison between with Huffman encoder and without
encoding
Compressive sensing based image reconstruction
40
150230727015
INFERENCES
• When size of image increases, the PSNR value decreases for OMP
reconstruction algorithm.
• MSE value will increases when size of image increases.
• PSNR will increase when number of iterations are increased.
• Hadamard matrix for low frequency band will give better results than Gaussian
matrix for LL band.
• With applying pseudo- inverse method, the PSNR is getting better when
Hadamard matrix used for LL band measurement.
• DARC is better prediction than Linear Prediction.

Compressive sensing based image reconstruction

41
150230727015
PSNR VS ITERATIONS

Fig. 40: PSNR for different iterations in OMP reconstruction algorithm.

Compressive sensing based image reconstruction
42
150230727015
FUTURE WORKS

• Add ROI extraction

Compressive sensing based image reconstruction

43
150230727015
PUBLICATIONS

• AD publication
– ISSN : 2454-1338(O), ISSN : 2454-1125(P)
– Impact Factor : 3.885 (Calculated by I2OR)
• WJERT
– Impact factor : 4.326
– Index Copernicus Value (ICV) - 44.56
• ICMTES
– UGC Approved
• ICFITT
– Springer
– Conference at SVNIT

Compressive sensing based image reconstruction

44
150230727015
 REFERENCES
1. V. Angayarkanni, S. Radha ”Design of Bandwidth Efficient Compressed Sensing Based
Prediction Measurement Encoder for Video Transmission in Wireless Sensor Networks”,
Springer Wireless Personnel Communication Journal, 13 January 2016
2. Chenwei Deng, Weisi Lin, Bu-sung Lee, and Chiew Tong Lau, "Robust Image Coding Based
Upon Compressive Sensing”, IEEE Transactions on Multimedia, vol. 14, no.2, April 2014.
3. Yun Song, Wei Cao, Yanfei Shen and Gaobo Yang, “Compressed sensing image reconstruction
using intra prediction”, Science direct, Neurocomputing, 2015
4. Xiumeni Li and Guoan Bi, “Image reconstruction based on the improved compressive sensing
algorithm”, IEEE International Conference on Digital Signal Processing (DSP), 2015
5. Weisheng Dong, Xiaolin Wu, and Guangming Shi, "Sparsity Fine Tuning in Wavelet Domain
With Application to Compressive Image Reconstruction”, IEEE Transactions on Image
Processing , vol. 23, no.12, December 2014.
6. Muhammad Ali Qureshi and M. Deriche, “A new wavelet based efficient image compression
algorithm using compressive sensing”, Springer Science Multimedia tools and applications,
March 2015 Compressive sensing based image reconstruction
45
150230727015
 REFERENCES CONT..
7. Michael Lustig and et.al, “ Compressed sensing MRI”, IEEE signal processing magazine,
March, 2008
8. Sabbisetti Ravindranath and et. al, “Compressive Sensing based Image acquisition and
Reconstruction analysis” Green Computing Communication and Electrical Engineering
(ICGCCEE), 2014 International Conference
9. Chen Chen and Junzhou Huang, “Exploiting the wavelet structure in compressed sensing
MRI”, Science Direct Magnetic Resonance Imaging, July 2014.
10. Saad Qaisar ande et.al, “Compressive sensing: From theory to applications, a survey”, IEEE
Journal of communications and networks, vol.15, no.5, October 2013
11. Reza Moradi Rad, Abdolrahman Attar and AsadollahShahbahrami, “A predictive algorithm for
multimedia data compression”, Springer Multimedia Systems, 24 July 2012
12. Emmanuel J. Candès and Michael B. Wakin, “An introduction to compressive sensing”, IEEE
Signal Processing Magazine, March 2008

Compressive sensing based image reconstruction

46
150230727015
 REFERENCES CONT..
13. S. Spurthi and Parnasree Chakraborty, “Block based compressed sensing algorithm for medical
image compression”, International Journal of Engineering and Computer Science, 2016
14. SumitBudhiraja and DiptiBhatnagar, “Wavelet based compressive sensing techniques for image
compression”, International journal of Engineering Research and Applications, 2011.
15. Dr. G Vijay Kumar, “Fast compressed sensing based high resolution image reconstruction”,
International Journal of New Technology and Research, vol. 2, Issue 3, March 2016
16. JieXu and et.al, “Improved total variation minimization method for compressive sensing by intra-
prediction”, Science direct, Signal processing, 2012
17. Wonseok Kang and et.al, “Compressive sensing-based image de-noising using adaptive multiple
sampling and optimal error tolerance”, IEEE International Conference on Acoustics, Speech and
Signal Processing, 2013
18. Quisong Wu and et.al, “Multi-task Bayesian compressive sensing exploiting intra-task
dependency”, IEEE signal processing letters, 2013
Compressive sensing based image reconstruction
47
150230727015
 REFERENCES CONT..
Websites:
19. http://dsp.rice.edu/cs
20. http://dsp.rice.edu/sites/dsp.rice.edu/files/cs/baraniukCSlecture07.pdf
21. https://en.wikipedia.org/wiki/Compressed_sensing
22. https://pdfs.semanticscholar.org/228a/594fcc53c6166c18e6ff4a03d3471a45537f.pdf
23. http://www.slideshare.net/thomasstefani169/compressive-sensing-basics-medical-imaging-mri
Image Database:
24. Civil Hospital, Surat
25. https://www.ncm-c.org/services/diagnostic-imaging/magnetic-resonance-imaging-mri/
26. http://www.healthhype.com/diagnostic-imaging-of-the-abdomen-x-ray-ultrasound-ct-mri.html

Compressive sensing based image reconstruction

48
150230727015
THE END

Compressive sensing based image reconstruction

49
150230727015