You are on page 1of 6

Research Journal of Applied Sciences, Engineering and Technology 9(5): 353-358, 2015

DOI:10.19026/rjaset.9.1413
ISSN: 2040-7459; e-ISSN: 2040-7467
© 2015 Maxwell Scientific Publication Corp.
Submitted: September 13, 2014 Accepted: October 11, 2014 Published: February 15, 2015

Research Article
A Combination of Restoration, Enhancement and Skull Stripping for Brain MRI
1
S. Madhukumar and 2N. Santhiyakumari
1
Department of Electronics and Communication Engineering, St. Joseph’s College of Engineering and
Technology, Palai, Kottayam,
2
Department of Electronics and Communication Engineering, Knowledge Institute of Technology,
Salem, India

Abstract: The preprocessing steps have substantial influence on the accuracy of segmentation and classification of
lesions. The background on the image grid, behind the brain structures in the MRI images may not be always
homogeneous. The edges or sharp pixel intensity transitions present in the back ground may get preserved during
edge sensitive noise restoration and highlighted during contrast enhancement. If conventional noise restoration
methods as Gaussian Kernels are adopted, the weak edges of lesions and structures get smoothened. Similarly,
common contrast enhancement schemes like Global/Local histogram equalization either over saturate the image or
degrade the textural, intensity and geometrical features of the image above tolerable limit. This study proposes a
novel combination of preprocessing methods which is exclusively suitable for MR images carrying weak edges. The
proposed combination of preprocessing comprises back ground elimination, restoration with bilateral filter,
enhancement with Contrast Limited Adaptive Histogram Equalization (CLAHE) and skull stripping. Back ground
elimination and skull stripping are performed by multiplying the original image and contrast enhanced image
respectively with a multiplication mask. Multiplication mask for background elimination is generated by gradient
based thresholding and a series of morphological operations and the multiplication mask for skull stripping is
generated via adaptive Otzu’s thresholding. MR images of tumor edema complex are used for testing the proposed
strategy. The method is experimented in Matlab®. Qualitative inspection of the skull stripped images reveals that the
weak edges of tumor-focus and perifocal edema are well preserved, inhomogeneity in the uniform regions is
suppressed, CLAHE do not alter the textural intensity and geometrical image features and the brain region is
accurately extracted.

Keywords: Bilateral filter, contrast limited adaptive histogram equalization, glioblastoma multiforme, otzu’s
threshold, preprocessing

INTRODUCTION equalization. Contrast stretching is not applicable if the


raw image itself is spread over the possible full
The term ‘preprocessing’ when used in connection intensity range. Devising a mapping function which
with medical images refers to restoration and contrast equally suits multiple images is difficult in contrast
enhancement. Contrast enhancement in medical transformation. Generally, histogram equalization
imaging is nothing but improving the pixel intensity saturates the image beyond tolerable limits. Though
difference between different morphological structures edge sensitive restoration methods like non-local means
so that visual distinction between these structures or filter (Lu et al., 2012), anisotropic diffusion filter
their automated segmentation is easy. Sharp pixel (Sameh Arif et al., 2011) and bilateral filters are
intensity transitions in the homogenous tissue structures available, operational parameters has to be selected
which causes unpleasant visual impact is ‘noise’. carefully. Otherwise the outcome may become even
Traditional mean filters, median filters and Gaussian worse than the raw image. Even for the most widely
kernels degrade the contrast between the morphological accepted contrast enhancement scheme CLAHE, the
structures and smoothen edges between the operational parameters like tile size, clip-limit,
morphologies (Wang et al., 2006). Similarly, for distribution etc. can be fixed empirically, from
enhancing contrast, there are traditional methods like qualitative evaluation of the equalized images.
contrast stretching, (Jagatheeswari et al., 2009; Formulating the right combination of the restoration
Umamaheswari and Radhamani, 2012) contrast and enhancement schemes and the selection of their
transformation (Hossain et al., 2010) and histogram operational parameters are quite critical, in specific

Corresponding Author: S. Madhukumar, Department of Electronics and Communication Engineering, St. Joseph’s College of
Engineering and Technology, Palai, Kottayam, India
This work is licensed under a Creative Commons Attribution 4.0 International License (URL: http://creativecommons.org/licenses/by/4.0/).
353
Res. J. App. Sci. Eng. Technol., 9(5): 353-358, 2015

(a) (b) (c) (d) (e)

Fig. 1: The images after each step of pre-processing


processing; (a): Original image; (b): Background eliminated image;
image (c): Restored image
after bilateral filtering; (d): Contrast enhanced image after CLAHE and (e) (e): skull stripped image

medical applications as the intensity and texture of the experimented inMatlab®. Figure 2 illustrates the
image has certain diagnostic meaning. hierarchy of steps involved in preprocessing.
Intensity transients and intensity in homogeneity Background elimination was accomplished by
are usually
sually present in the background of MR images as multiplying the original MR image with a binary
evident in Fig. 1a. These intensity transitions in the multiplication mask. Towards the construction of this
background and the noise present in the morphological multiplication mask, binary edge map of the raw MR
structures may interfere with the performance of the image is generated through gradient based threshold
edge based segmentation schemes. Moreover, th the (Yazid and Arof, 2013).. The multiplication
mul mask is
contrast of the image would not be enough to allow an constructed from this edge map through a series of
accurate segmentation of the Region of Interest (ROI). morphological operations. The series of morphological
The structures and tissue classes other than the brain operations include, dilation, hole filling, border clearing
region, like skull and scalp, increases the number of and erosion. In gradient based threshold, the gradient is
tissue classes in the whole image. S Segmentation computed with Sobel mask (Jähne et al., al 1999).
methods like, K-Means (Chen et al al., 2008) and The magnitude gradient is computed from gradient
Expectation Maximization (EM) (Carson et al., 2002), along horizontal and vertical directions (Gonzalez
( and
yield better outcomes when the number of tissue classes Woods, 1992; Acharya and Ray, 2005).
2005)
in the image of interest is less. The gradient along x-direction:
This study proposes a combination of background
elimination, noise restoration, enhancement and skull ∂fx,y
gx = (1)
stripping for MR images. The optimum operational ∂x

parameters of CLAHE and bilateral filter are used


The gradient along y-direction:
which are fixed through qualitative inspection of the
processed MR R images. In fact operational parameters of ∂fx,y
enhancement methods like CLAHE and restoration gy = (2)
∂y
methods like bilateral, anisotropic and nonnon-local means
filters can be fixed only empirically. But the choice The gradient magnitude:
operational parameters may be distinct for different
Gx,y= g2x +g2y
classes of images.
The forthcoming discussions comprise (3)
mathematics of background removal, restoration,
enhancement and skull stripping followed by qualitative Edge image generated from gradient based threshold:
evaluation of the preprocessed MR images
images.

f x,y=  
if Gx,y≥GT

MATERIALS AND METHODS (4)
else

Axial Plane T1 contrast enhanced (Series: AX T1 where, GT is the adaptive gradient threshold. For
SE FS+C, Spin Echo Sequence (SE)) MR images dilation of the traced edges, horizontal and vertical
(courtesy: Hind Labs, Govt. Medical College structuring elements or strel objects with three
Kottayam, Kerala) are selected for the experimental neighbours or length 3 are used. Erosion is performed
evaluation of the proposed method. The specification of with a diamond strel object having five neighbours or
MR equipment is; Manufacturer: GE Medical Systems, with a length one neighbours or length 3 are used.
Model Name: SignaHDxt, Acquisition Type: 2D and Erosion is performed with a diamond strel object
1.5T field strength. The proposed preprocessing is having five neighbours or with a length one.
354
Res. J. App. Sci. Eng. Technol., 9(5): 353-358, 2015

Fig. 2: Steps involved in pre-processing

Conventional spatial filter kernels may sm


smooth the contrast between the brain structures
ctures and edema is also
weak edges present between morphological structures. poor as evident in Fig. 1. Even though schemes like
Bilateral filtering is a technique to smooth Histogram Equalization (HE) can be employed to
homogeneous regions of images while preserving the enhance the contrast, HE either over enhances the noise
edges. In bilateral filtering, each pixel intensity is or saturates the image. In HE, the degree of contrast
replaced by a weighted average of its neighneighbouring enhancement is determined ned by the slope of the mapping
intensities. The mathematical concept of bilateral filter function, which transforms the original intensity into
(Tomasi and Manduchi, 1998) is the he corrupted signal Y contrast enhanced intensity. Hence, the enhancement of
noise can be managed by manipulating the slope of the
is the sum of noise V and the uncorrupted signal X:
mapping function. In HE, the contrast enhanced
Y=X+V
intensity ‘Sk’ is directly proportional to the cumulative
(5) probability density. The slope of the mapping function
at any point is proportional to the height of the
The bilateral filter approximates a weighted histogram at the corresponding intensity as apparent in
average of pixels in the given image Y: (10). So that limiting the slope of the mapping function
fu
is equivalent to clipping the height of the histogram:
X k =
N
W k,n Yk-n
n=-N
L-1
Sk =
N -N
N≤n≤N (6)
W k,n k
j=0 nj k=0,1, 2,…. ..,L
L-1 (10)
n=-N
MN

In (6) restored intensity is the normalized weighted


where,
average of a neighbourhood of [2N+1] samples around L = The maximum possible intensity, say 255 in a
the kth sample. The weights W [k, n] are computed uint8 image
based on the content of the neighbourhood. For the M*N = The total number of pixels
center sample X[k], the weight W[k, n] is computed nj = The probability of occurrence of the jth intensity
from the following two factors:
CLAHE is an extension of the adaptive histogram
d2  k ,k-n
Ws k, n =exp -  =exp - 
n2 equalization which improves contrast between
(7)
2σ2s 2σ2s morphologies and suppresses pixel intensity transitions
in the homogeneous regions. In CLAHE (Karel,
( 1994),
d2 Y k ,Yk-n Y k -Yk-n
2

Wg k,n =exp -  = exp - 


the image is divided into non-overlapping
overlapping contextual
(8) region or tiles and the local histogram of the tile is
2σ2R 2σ2R
computed. Prior to the estimation of the cumulative
probability density and contrast enhanced intensity,
where, σ2s and σ2R are the variance of the Gaussian histogram of each tile is clipped with respect to a user
functions which form, the kernel of spatial and radio defined clip-limit. The clip-limit
limit is a multiple of the
metric weight factors, respectively. average height of the histogram of the contextual
The final weight is the product of spatial and radio region. Average height of the histogram is the ratio of
metric weight factors: total number of pixels present in the contextual region
and the number of grey levels. In this respect, clip-limit
clip
W k,n =Ws k,n WR k,n  (9) is the product of the user-defined
defined contrast factor, ‘α’
and average number of pixels falling in each histogram
bin. For a contextual region of size ‘M’ rows and ‘N’
For the bilateral filter, optimum window size of
columns and L being the number of histogram bins, the
11*11, variance of the spatial weight factor Gaussian
clip-limit is given by:
kernel = 10 and variance of the radiometric weight
factor Gaussian kernel = 1.3 are opted through trial and αMN
error. Usually, the contrast between the brai
brain structures nT = 0< α ≤1 (11)
L
and ROI may be poor so that contouring the ROI is
difficult. For example, in the MR images used to test The original height of the histogram of the
the proposed preprocessing, the GBM GBM-focus and the contextual region is clipped with respect to the clip-
clip
perifocaledema
edema exhibit fairly close intensities. The limit nT such that:
355
Res. J. App. Sci. Eng. Technol., 9(5): 353-358, 2015

hk =  T
n if nk ≥nT Let L is the maximum possible grey level in the
k=1,2,……L-1 (12)
nk else histogram equalized MR image and the image contains
grey levels, {0, 1, 2….L}. The normalized grey level
 is the histogram of contextual region and: histogram:

Pi = iN Pi ≥ 0,
L-1 n L
k =0 nk = MN (13) i=1 pi =1 (18)

Total number of clipped pixels: where, N is the total number of pixels in the MR image,
ni is the number of occurrence of grey level ‘i’ and pi is
L-1 its probability density function, given, i = { 0, 1,
nc = MN - k=0 hk (14)
2,…..L} and N = {n1+n2+....+nL}. If the grey levels are
assumed to be of two classes C0 and C1, separated by a
To renormalize the histogram or to bring its area
threshold ‘k’, so that C0 = 0, 1,…k} and C1= {k+1…},
under the curve back to the original, the clipped pixels
the probabilities of class occurrence:
are redistributed back to the histogram bins. This
ω0 = PrC0 =
redistribution can be uniform or distributing them into k
the bins with contents less than the clip-limit, in i=1 Pi = ωk (19)

ω1 = PrC1  =
proportion to the number of pixels in the bin. Here, the
L
clipped pixels are equally redistributed to all the i=k+1 Pi =1-ωk (20)
histogram bins such that the bin content is less than the
clip-limit. The number of clipped pixels to be The mean grey level of classes:
redistributed to each histogram bin:
k iPi
µ0 = i=1 i Pr  C  ωk (21)
k i µk
= ω0 =
nµ = 
L-1 i=1
MN- 0
nc k=0 hk
= (15)
L L
µ1 = i=k+1 i Pri/C1 = i=k+1 ipi !ω1 
L L µT -µk
= (22)
The clipped pixels are uniformly redistributed to all 1-ωk
the histogram bins, provided the new histogram:
ωk = k
i=1 pi  (23)
hk =  
nT if nk + nµ ≥nT
"k  =  i=1 ipi
(16) k
nT +nk else (24)

The number of undistributed pixels are again where, ω(k) and µ(k) are the zeroth and first order
computed from (14-15) and the transformation (16) is cumulative moments of the histogram up to the kthlevel,
repeated till all the clipped pixels get distributed respectively:
uniformly to the histogram bins and the histogram
µT =µL = ip i 
grows back to the original area. The cumulative L
i=1 (25)
histogram of the contextual region is given by:

j=0 hj 
1 k µT is the global mean of histogram equalized image:
Ck = (17)
ω0 µ0 +ω µ1 =µT , ω + ω1 = 1, ∀ k
MN
(26)
Contrast of each tile is enhanced so that the 1 0

histogram of the tile approximately matches with the


The class variances are given by:
histogram specified by the distribution parameter as

i=1i-µ0  Pri!C0  = i=1i-µ0  Pi !ω0 


uniform (flat), Rayleigh (bell-shaped) or exponential 2 2
k k
(curve shaped). The neighbouring tiles are combined σ20 = (27)
using bilinear interpolation to eliminate artificially
i=k+1i-µ1  Pri!C1  = i=k+1i-µ1  Pi !ω1 
induced boundaries. The clip-limit and tile size opted L 2 k 2
σ21 = (28)
here is 0.1 and 8*8, respectively and the distribution
specified is uniform. This also was decided empirically,
as the bilateral filter parameters. MR image after To evaluate the performance of the threshold ‘k’,
restoration and contrast enhancement is intensity the following discriminant criterion is used:

λ= σ2B !σ2w K= σ2T σ2w η=σ2B !σ2w


threshold and connected components in the resulting
binary image are labelled. As the intensity features of (29)
each MR image is different, an image adaptive
threshold is computed using Otsu’s method (Otsu, where λ, K and η are within class variance, between
1979). The mathematical way of estimating Otsu’s class variance and the variance of total grey levels,
threshold is as follows: respectively:
356
Res. J. App. Sci. Eng. Technol., 9(5): 353-358, 2015

σ2w = ω0 σ20 +ω1 σ21 (30) And the optimal threshold k is:

σ2B k* = max1≤k˂<L σ2B k


σ2B =ω0 µ0 -µT  +ω1 µ1 -µT  = ω0 ω1 µ1 -µ0  
2 2 2 (36)
(31)
The MR image is converted to binary image by
The global variance of grey levels: thresholding it with respect to the optimum threshold
‘k’ as in (37):
σ2T = i=1i-µT  Pi 
L 2
(32)
Bx,y= 
1, if Bx,y ≥ k
(37)
0, else
At optimum threshold k, the object function (29)
maximizes.
elimination, restoration and enhancement, the &' (, * is
where, B(x, y) is the MR image after back ground
The discriminant criteria maximizing λ, K or η for
k, are however, equivalent to one another; e.g., K= λ+1 the binary image generated via intensity threshold. The
and η= λ/(λ+1) in terms of λ because the following connected components in the binary image are labelled.
basic relation always holds: Region properties, area and solidity of each labelled
regions are estimated. Labelled region, presenting area
σ2w +σ2B =σ2T  (33) above half of the maximum area are identified as high
solidity regions. This high solidity labelled region,
exhibiting highest area, corresponds to the brain region.
σw2, and σB2 are functions of threshold level k, but σT2 is A multiplication mask, similar to the mask used in
independent of k, σw2 is based on the second order background elimination was generated by hole-filling
statistics, while σB2 is based on the first order statistics.
Therefore, %is the simplest measure with respect to
this ‘high solidity-high area’ region. The skull stripped
image is:
k. Thus at the optimum threshold ‘k’, the object
function % maximises. Ux,y=Sx,y×Fx,y (38)
The optimal threshold ‘k’ which maximizes % or x=+1,2,3,……M, and y=+1,2,3,……N,
equivalently maximizes σB2, is selected through a
sequential search using (23) and (24), or explicitly where, ‘F’ is the binary multiplication mask and ‘S’ is
the MR image after background elimination, bilateral
using (19)-(22): filtering and CLAHE.

ηk= σ2B k!σ2T  (34) RESULTS AND DISCUSSION

µT ωk- µk 


2

σ2B k= ω 1-ω 


The combination of pre-processing, background
 (35) elimination, bilateral filtering, enhancement with
k k CLAHE and skull stripping is experimentally proved to

(a) (b)

(c) (d)

(e) (f)

Fig. 3: Original image specimens and its pre-processed versions


357
Res. J. App. Sci. Eng. Technol., 9(5): 353-358, 2015

be viable on Axial Plane T1 contrast enhanced MR Carson, C., S. Belongie, H. Greenspan and J. Malik,
images of Glioblstoma Multiforme-edema complex. 2002. Blobworld: Image segmentation using
Figure 1 demonstrates the images after each step of expectation-maximization and its application to
preprocessing. It is apparent from the Fig. 1a and b that image querying. IEEE T. Pattern Anal., 24(8):
the structures other than the morphologies are removed 1026-1038.
from the raw MR image after background elimination. Chen, T.W., Y.L. Chen and S.Y. Chien, 2008. Fast
Bilateral filtering well preserves the weak edges among image segmentation based on K-Means clustering
the morphological structures while smoothening the with histograms in HSV color space. Proceeding of
noise inherent in homogeneous regions. It is obvious the IEEE 10th Workshop on Multimedia Signal
from the qualitative inspection of the contrast enhanced Processing, pp: 322-325.
image that CLAHE has good noise suppression Gonzalez, R.C. and R.E. Woods, 1992. Digital Image
capabilities and the degree of contrast enhancement is Processing. 2nd Edn., Addison-Wesley Longman
sufficient to support characterization of tissue classes Publishing Co., Inc., Boston, USA.
such that even primitive segmentation methods can Hossain, M.F., M.R. Alsharif and K. Yamashita, 2010.
yield accurate outcomes. As skull stripping accurately Medical image enhancement based on nonlinear
extracts the brain region, effectively eliminating skull technique and logarithmic transform coefficient
and scalp, the number of tissue classes in the resultant histogram matching. Proceeding of the
image comes down and this would enhance the IEEE/ICME International Conference on Complex
accuracy of segmentation, especially when K-means or Medical Engineering (CME, 2010), pp: 58-62.
EM are employed. Jagatheeswari, P., S.S. Kumar and M. Rajaram, 2009.
Six sets of raw MR images and the corresponding Contrast stretching recursively separated histogram
preprocessed images are illustarted in Fig. 3. equalization for brightness preservation and
contrast enhancement. Proceeding of the
CONCLUSION International Conference on Advances in
Computing, Control and Telecommunication
A combination of background elimination, Technologies (ACT'09), pp: 111-115.
restoration, enhancement and skull stripping schemes Jähne, B., H. Scharr and S. Körkel, 1999. Principles of
were successfully demonstrated on axial plane T1 Filter Design. Handbook of Computer Vision and
weighted MR images. The background elimination Applications. Academic Press, San Diego.
could remove structures other than morphology from Karel, Z., 1994. Contrast Limited Adaptive Histograph
the image grid. Edge sensitive bilateral filter could Equalization. Graphic Gems IV. Academic Press
preserve the weak edges between the tumor-focus and Professional, San Diego, pp: 474-485.
the perifocaledema during smoothening. CLAHE Lu, K., N. He and L. Li, 2012. Nonlocal means-based
exhibits good noise suppression capabilities and it is denoising for medical images. Comput. Math.
immune to saturation. The skull stripping methodology, Method. M., 2012: 7, Article Id 438617.
adopted could extract the brain region perfectly. As the Otsu, N., 1979. A threshold selection method from
pre-processing steps proposed here are robust and gray-level histograms. IEEE T. Syst. Man Cyb.,
adaptive, segmentation algorithms would yield better SMC-9(1): 62-66.
outcomes. Sameh Arif, A., S. Mansor and R. Logeswaran, 2011.
Combined bilateral and anisotropic-diffusion filters
ACKNOWLEDGMENT for medical image de-noising. Proceeding of the
IEEE Student Conference on Research and
The authors would like to thank Dr. Jose Tom, Development (SCOReD), pp: 420-424.
Professor & Head, Department of Radiotherapy, Tomasi, C. and R. Manduchi, 1998. Bilateral filtering
Government Medical College, Kottayam, Kerala, Dr. for gray and color images. Proceeding of the IEEE
Unni.S.Pillai, Department of Oncology, The Jawaharlal International Conference on Computer Vision.
Institute of Postgraduate Medical Education and Bombay, India.
Research (JIPMER), Puducherry and Dr. Umamaheswari, J. and G. Radhamani, 2012. An
GowriShanker, Hindlab, Govt. Medical College, enhanced approach for medical brain image
Kottayam, for their incessant involvement in this enhancement. J. Comput. Sci., 8(8): 1329-1337.
endeavor. Wang, H., Y. Chen, T. Fang, J. Tyan and N. Ahuja,
2006. Gradient adaptive image restoration and
REFERENCES enhancement. Proceeding of the IEEE International
Conference on Image Processing, pp: 2893-2896.
Acharya, T. and A.K. Ray, 2005. Image Processing: Yazid, H. and H. Arof, 2013. Gradient based adaptive
Principles and Applications. 1st Edn., Wiley- thresholding. J. Vis. Commun. Image R., 24:
Interscience, ISBN: 978-0-471-71998-4. 926-936.
358

You might also like