Professional Documents
Culture Documents
net/publication/332029758
CITATIONS READS
0 61
4 authors, including:
Dante Mújica-Vargas
Centro Nacional de Investigación y Desarrollo Tecnológico
23 PUBLICATIONS 95 CITATIONS
SEE PROFILE
All content following this page was uploaded by Dante Mújica-Vargas on 27 March 2019.
Abstract—This paper presents the heterogeneous implementa- the process of estimating the intermediate values of a function
tion and evaluation of five algorithms to improve the resolution in or signal sampled in continuous positions or the attempt to
magnetic resonance images, these are Nearest-Neighbor, Bilinear, reconstruct the original continuous function from a set of
Bicubic, Catmull-Rom and Lanczos. The experiments were carried
out using the database BraTS 2017 considering T 1, T 2, T 1ce and discrete samples [10]. In the context of 2D signals (images),
F lair acquisition modes. To measure the efficiency and quality interpolation refers to the technique of recovering a continuous
of the results, the metrics PSNR, MAE, SSIM, as well as the signal by estimating the image data of a set of discrete samples
Runtime were used. The results show that for all modalities of image data. This task is fundamental in the processing of
the Bicubic algorithm has a P SN R > 35, M AE < 1.089, images, for which it is widely studied and applied, e.g. in [11],
SSIM > 0.958 and RT < 5.205 seconds per whole database.
By other hand, Catmull-Rom achieves favorable results compared it was proposed a video resolution improvement technique for
with Bicubic algorithm, maintaining the balance between quality low resolution video sequences based on a new directional
and a less processing time than mentioned method. interpolation of edge and complex wavelet transforms. In [12],
Index Terms—Brain MRI images, Interpolation techniques, the interpolation was used to reconstruct the satellite video
Heterogeneous system images. In [13], [14], were proposed new super-resolution
methods based on interpolation, the first work was based on
I. I NTRODUCTION an interpolation that considers the intensity distances and the
Computed tomography (CT), magnetic resonance imaging geometry of the pixel data, it was able to produce good texture
(MRI), and positron emission tomography (PET) are sophis- details; by other hand, the second one was based on fractional
ticated modalities typically used in the second-line diagnosis order gradient interpolation and let preserve the edges of the
following routine clinical practice [1]. Both in the diagnosis image.
processes and treatment planning, as well as in the control and In the context of medical images, the following researches
prediction of diseases [2]–[4] such as: cancer, cardiovascular can be mentioned: in [15], it was proposed a geometrical
diseases, trauma, neurological conditions as studied in [5], [6]. approach of the linear interpolation Nearest-Neighbor in order
In this regard, medical imaging has improved the accuracy, to accelerate the reconstruction of the HARDI signal from
timeliness and effectiveness of diagnoses. The majority of a few images of diffusion MRI (Diffusion Weighted MRI),
investigations in medical images refer to MR images due to the results were outstanding in terms of the quality of the
their flexible and non-invasive characteristics. These features data and a significant reduction in scan time. In [16], it was
make MRI an important diagnostic imaging technique, being proposed an approach based on restricted inverse diffusion
a valuable tool in the early detection of abnormal changes for the interpolation of 3D brain MR images, the proposal
in tissues and organs. However, this type of images regularly was compared with the linear interpolation methods, based
present a limited spatial resolution [7], [8]. on registration and CubicB-Spline, obtaining better results in
The spatial resolution of the image is an index to measure volumes of coarse slices. The approach proposed by [17] was
the clarity of the details of the image; improving the spatial based on an interpolation framework that considers 2 features
resolution of the image implies reducing the spectral alias (eigenvalues and orientation) in MRI images with diffusion
of the image by increasing the sampling frequency without tensor (Diffusion tensor MRI) of the human heart, the results
damaging the signal-to-noise ratio [9]. One way to perform this of this paper offered flexible options for interpolation while
procedure is using interpolation techniques. Interpolation is preserving the properties of diffusion tensors. Almost all image
window function ψ(x), therefore an interpolation kernel takes flexibility in the implementation, and in addition reducing the
the following form: arithmetic complexity and bandwidth usage of the computation
for each data point. How it was stated in Section II, the
w(x) = ψ(x) · Sinc(x), (10)
interpolation algorithms can be implemented via separable
w(y) = ψ(y) · Sinc(y), (11) convolution filters; therefore, this processing mode is ideal to
be implemented in a heterogeneous system.
The particular window functions for the interpolation of
Lanczos are defined as:
IV. H ETEROGENEOUS IMPLEMENTATION
1
for|x| = 0
ψLn (x) = sin(πx/n)
πx/n 0 < |x| < n , (12) Graphics Processing Units (GPUs) are devices with high
performance that have been widely used to accelerate image
0 for|x| ≥ n
processing tasks, or complex algorithms [21]. Introduced by
NVIDIA, the Compute Unified Device Architecture (CUDA)
1
for|y| = 0
ψLn (y) = sin(πy/n)
0 < |y| < n , (13) enables GPUs to be devices for parallel computation. Nev-
πy/n
ertheless, the graphics accelerators can be considered as co-
0 for|y| ≥ n
processors that receive instructions as well as tasks from the
where n ∈ N denotes the order of the filter. In the literature, CPUs, in this regard, together both devices form a hetero-
values of n = 2, 3 are suggested for digital image processing geneous system. In a conventional way, the CPU invokes a
tasks. From these separable 1D kernels in both x as well as kernel function, which encapsulates a set of instructions (in
y, it is possible to make the extension to 2D signals in the this research paper it can be the 2D interpolation kernels)
following way: executed simultaneously by multiple threads in the GPU;
then information processed is returned to CPU. In order to
WLn (x, y) = wLn (x) · wLn (y), (14) develop the interpolation task, a brain MRI image I(x, y)
In Fig.1(e) is depicted the 2D kernel of this interpolation with size M × N is transfered from the system memory
method. to the device memory, by using the cudaM emcpy function
with the macro cudaM emcpyHostT oDevice, then the pa-
III. I NTERPOLATION VIA SEPARABLE CONVOLUTION rameters threadsP erBlock = (32, 32, 1), numBlocks =
FILTERS (M/dimBlock.x, N/dimBlock.y, 1) and the texture are set
In conventional way, a 2D convolutional filter with a kernel up; after that, the kernel function is invoked by the CPU.
with width n and height m demands n × m multiplications Inside of kernel function, the selected interpolation technique
for each output pixel. Separable filters are a special type of is developed using the concept of separable convolution by
filter that can be expressed as the composition of two 1D the computation into horizontal (row) and vertical (column)
filters, one on the rows on the image, and one on the columns. passes; in other words, row and column filters are applied
A separable filter can be divided into two consecutive 1D onto the input image. The resulting image I(x, ˜ y) is copied
convolution operations on the data, and therefore requires only back to the CPU via cudaM emcpy function with the macro
n+m multiplications for each output pixel [26]. Convolutions cudaM emcpyDeviceT oHost; finally, the restored image is
based on separable filters have the benefit of offering more saved at hard disk. As it is stated in the CUDA C Programming
(g) T 2 (h) Nearest Neighbor (i) Bilinear (j) Bicubic (k) Catmull-Rom (l) Lanczos
(m) T 1ce (n) Nearest Neighbor (o) Bilinear (p) Bicubic (q) Catmull-Rom (r) Lanczos
(s) F lair (t) Nearest Neighbor (u) Bilinear (v) Bicubic (w) Catmull-Rom (x) Lanczos
[9] Qifang, X., Guoqing, Y., & Pin, L. (2017). Super-resolution Reconstruc- application to human cardiac DT-MRI. Medical image analysis, 16(2),
tion of Satellite Video Images Based on Interpolation Method. Procedia 459-481.
Computer Science, 107, 454-459. [18] Burger, W., & Burge, M. J. (2016). Digital image processing: an
[10] Lehmann, T. M., Gonner, C., & Spitzer, K. (1999). Survey: Interpolation algorithmic introduction using Java. Springer.
methods in medical image processing. IEEE transactions on medical [19] Li, X., & Orchard, M. T. (2001). New edge-directed interpolation. IEEE
imaging, 18(11), 1049-1075. transactions on image processing, 10(10), 1521-1527.
[11] Izadpanahi, S., & Demirel, H. (2013). Motion based video super reso- [20] Wu, T., Bai, B., & Wang, P. (2013). Parallel catmull-rom spline
lution using edge directed interpolation and complex wavelet transform. interpolation algorithm for image zooming based on CUDA. Applied
Signal Processing, 93(7), 2076-2086. Mathematics & Information Sciences, 7(2), 533.
[12] Qifang, X., Guoqing, Y., & Pin, L. (2017). Super-resolution Reconstruc- [21] Snchez, M. G., Vidal, V., Bataller, J., & Arnal, J. (2013). A parallel
tion of Satellite Video Images Based on Interpolation Method. Procedia method for impulsive image noise removal on hybrid CPU/GPU systems.
Computer Science, 107, 454-459. Procedia Computer Science, 18, 2504-2507.
[13] Yang, Q., Zhang, Y., Zhao, T., & Chen, Y. (2017). Single image [22] Nvidia, C. U. D. A. (2018). Programming guide.
super-resolution using self-optimizing mask via fractional-order gradient [23] Menze, B. H., Jakab, A., Bauer, S., Kalpathy-Cramer, J., Farahani,
interpolation and reconstruction. ISA transactions. K., Kirby, J., ... & Lanczi, L. (2015). The multimodal brain tumor
[14] Zhang, Q., & Wu, J. (2015). Image super-resolution using windowed image segmentation benchmark (BRATS). IEEE transactions on medical
ordinary Kriging interpolation. Optics Communications, 336, 140-145. imaging, 34(10), 1993-2024.
[15] Alaya, I. B., Jribi, M., Ghorbel, F., Sappey-Marinier, D., & Kraiem, T. [24] Mújica-Vargas, D., de Jesús Rubio, J., Kinani, J. M. V., & Gallegos-
(2017). Fast and Accurate Estimation of the HARDI Signal in Diffusion Funes, F. J. (2018). An efficient nonlinear approach for removing fixed-
MRI Using a Nearest-Neighbor Interpolation Approach. IRBM, 38(3), value impulse noise from grayscale images. Journal of Real-Time Image
156-166. Processing, 14(3), 617-633.
[16] Neubert, A., Salvado, O., Acosta, O., Bourgeat, P., & Fripp, J. (2012). [25] Wang, Z., Simoncelli, E. P., & Bovik, A. C. (2003, November). Mul-
Constrained reverse diffusion for thick slice interpolation of 3D volumet- tiscale structural similarity for image quality assessment. In Signals,
ric MRI images. Computerized Medical Imaging and Graphics, 36(2), Systems and Computers, 2004. Conference Record of the Thirty-Seventh
130-138. Asilomar Conference on (Vol. 2, pp. 1398-1402). Ieee.
[17] Yang, F., Zhu, Y. M., Magnin, I. E., Luo, J. H., Croisille, P., & Kingsley, [26] Podlozhnyuk, V. (2007). Image convolution with CUDA. NVIDIA
P. B. (2012). Feature-based interpolation of diffusion tensor fields and Corporation white paper, June, 2097(3).