You are on page 1of 12

Computerized Medical Imaging and Graphics 33 (2009) 520–531

Contents lists available at ScienceDirect

Computerized Medical Imaging and Graphics


journal homepage: www.elsevier.com/locate/compmedimag

Active contours driven by local and global intensity fitting energy with
application to brain MR image segmentation
Li Wang a , Chunming Li b,∗ , Quansen Sun a , Deshen Xia a , Chiu-Yen Kao c,d
a
School of Computer Science & Technology, Nanjing University of Science and Technology, Nanjing 210094, China
b
Vanderbilt University Institute of Imaging Science, 3rd Floor, VUIIS Building, Medical Center North, 1161 21st Ave, South, Nashville, TN 37232-2310, USA
c
Department of Mathematics, The Ohio State University, 410 Math Tower, 231 West 18th Ave, Columbus, OH 43210-1174, USA
d
Mathematical Biosciences Institute, The Ohio State University, Columbus, OH 43210-1174, USA

a r t i c l e i n f o a b s t r a c t

Article history: In this paper, we propose an improved region-based active contour model in a variational level set for-
Received 5 August 2008 mulation. We define an energy functional with a local intensity fitting term, which induces a local force
Received in revised form 15 March 2009 to attract the contour and stops it at object boundaries, and an auxiliary global intensity fitting term,
Accepted 9 April 2009
which drives the motion of the contour far away from object boundaries. Therefore, the combination of
these two forces allows for flexible initialization of the contours. This energy is then incorporated into
Keywords:
a level set formulation with a level set regularization term that is necessary for accurate computation
Image segmentation
in the corresponding level set method. The proposed model is first presented as a two-phase level set
Intensity inhomogeneity
Active contour model
formulation and then extended to a multi-phase formulation. Experimental results show the advantages
Level set method of our method in terms of accuracy and robustness. In particular, our method has been applied to brain
Variational method MR image segmentation with desirable results.
© 2009 Elsevier Ltd. All rights reserved.

1. Introduction wise constant (PC) models [12,10,14] are based on the assumption
that image intensities are statistically homogeneous in each region,
Since the introduction by Kass et al. [1], active contour mod- and therefore they fail to segment MR images with intensity
els have been widely used in image segmentation with promising inhomogeneity. In [10,11], two similar region-based active con-
results. The models are able to provide smooth and closed contours tour models were proposed for the segmentation of more general
to recover object boundaries with subpixel accuracy, which is typ- images. These models are based on a piecewise smooth description
ically not possible in classical methods, such as edge detection and of the images, and thus have been known as piecewise smooth (PS)
thresholding. The existing active contour models can be catego- models. Therefore, the PS models have exhibited certain capabil-
rized into two classes: edge-based models [1–7] and region-based ity of handling intensity inhomogeneity. The computational cost of
models [8–17]. the PS models is, however, rather expensive due to the complicated
In general, edge-based models typically use image gradient as procedures involved [18,17]. This limitation, along with their some-
an image-based force to attract the contour toward object bound- what complex parameter settings, has made the PS models barely
aries. These models have been successfully used for general images useful for MR brain image segmentation.
with strong object boundaries, but they may suffer from bound- In fact, intensity inhomogeneity occurs in many real-world
ary leakage problem for brain MR images, which typically contain images from different modalities [19,20]. In particular, it is often
weak boundaries between gray matter and white matter due to low seen in medical images, such as X-ray radiography/tomography and
contrast and partial volume effect. Region-based models have bet- magnetic resonance (MR) images. For example, the intensity inho-
ter performance than edge-based models in the presence of weak mogeneity in MR images often appears as an intensity variation
boundaries. However, region-based models [8–10,12–14] tend to across the image, which arises from radio-frequency (RF) coils or
rely on intensity homogeneity. For example, the well-known piece- acquisition sequences. Thus the resultant intensities of the same
tissue vary with the locations in the image. Similar artifacts also
occur in CT images due to the beam hardening effect, as well as
in ultrasound images caused by non-uniform beam attenuation
∗ Corresponding author. Tel.: +1 615 343 7083; fax: +1 615 322 0734.
within the body.
E-mail addresses: li.wang8401@gmail.com (L. Wang), lchunming@gmail.com
(C. Li), sunquansen@mail.njust.edu.cn (Q. Sun), deshen x@263.net (D. Xia), Recently, Li et al. proposed a local binary fitting (LBF) model
kao@math.ohio-state.edu (C.-Y. Kao). [21,17,22] to overcome the difficulty in segmentation caused by

0895-6111/$ – see front matter © 2009 Elsevier Ltd. All rights reserved.
doi:10.1016/j.compmedimag.2009.04.010
L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531 521

Fig. 1. Experiments for a synthetic image with intensity inhomogeneity. (a) Original image and initial contour. (b) Result of the CV model. (c) Result of the LBF model, with
intensities at four points (shown in blue) and values {f1 , f2 } at two points (shown in green) indicated. (For interpretation of the references to colour in this figure legend, the
reader is referred to the web version of the article.)

intensity inhomogeneity. The LBF model draws upon spatially vary- 2. Background
ing local region information and thus is able to deal with intensity
inhomogeneity. By using local region information, specifically local 2.1. Piecewise constant models
intensity mean, the LBF model is able to provide desirable seg-
mentation results even in the presence of intensity inhomogeneity. Chan and Vese [12] proposed an active contour approach to the
Some related methods were recently proposed in [18,23], which Mumford–Shah problem [25] for a special case where the original
have similar capability of handling intensity inhomogeneity as the image is a piecewise constant function. Let ˝ ⊂ 2 be the image
LBF model. These methods [21–23,17,18] are, however, to some domain, I : ˝ →  be a given gray level image. The variable x in
extent sensitive to initialization, which limits their practical appli- I(x) is a point in ˝. They proposed the following energy:
cations.
In this paper, we propose an improved region-based active con- 
tour model in a variational level set formulation. We define an ECV (c1 , c2 , C) = 1 |I(x) − c1 |2 dx
energy functional1 with a local intensity fitting term, which is dom- outside(C)
inant near object boundaries and responsible for attracting the  (1)
2
contour toward object boundaries, and an auxiliary global inten- +2 |I(x) − c2 | dx + |C|
sity fitting term, which incorporates global image information to inside(C)

improve the robustness of the proposed method. In addition, this


energy is then incorporated into a level set formulation with a level where outside(C) and inside(C) represent the regions outside and
set regularization term that is necessary for accurate computation inside the contour C, respectively, and c1 , c2 are two constants
in the corresponding level set method. In the associated curve evo- that approximate the image intensity in outside(C) and inside(C).
lution, the motion of the contour is driven by a local intensity fitting |C| is the length of the contour C. The parameters 1 , 2 and 
force and a global intensity fitting force, induced by the local and are nonnegative constants. We call the first two terms in (1) the
global terms in the proposed energy functional, respectively. The global data fitting energy. One of the most attractive properties of
influence of these two forces on the curve evolution is comple- the Chan–Vese (CV) model is that it is much less sensitive to the
mentary. When the contour is close to object boundaries, the local initialization.
intensity fitting force becomes dominant, which attracts the con- Such optimal constants c1 and c2 can be far different from
tour toward and finally stops the contour at object boundaries. This the original data, if the intensities within outside(C) and inside(C)
force plays a key role in accurately locating object boundaries, espe- are inhomogeneous. Without taking local image information into
cially for images with intensity inhomogeneity. The global intensity account, the CV model generally fails to segment images with
fitting force is dominant when the contour is far away from object inhomogeneity. For example, Fig. 1 (a) shows a synthetic image
boundaries, and it allows more flexible initialization of contours by with intensity inhomogeneity. The contour is initialized as a circle.
using global image information. The proposed model is first pre- The CV model fails to segment this image, as shown in Fig. 1(b).
sented as a two-phase level set formulation and then extended to It is clearly seen that some part of the background/foreground
a multi-phase formulation for brain MR image segmentation. is incorrectly identified as the foreground/background. Likewise,
Note that part of results in this paper were reported in our recent more general piecewise constant models in a multi-phase level set
conference paper [24]. The remainder of this paper is organized framework [10,13,14] are not applicable for such images either.
as follows. In Section 2, we review some well-known region-based
models and their limitations. The proposed method is introduced in
Section 3. The implementation and results are given in Section 4, fol-
2.2. The LBF model
lowed by some discussions in Section 5. This paper is summarized
in Section 6.
The LBF model [21,17] was recently proposed to segment images
with intensity inhomogeneity, utilizing the local intensity infor-
mation efficiently, and has achieved promising results. Two fitting
functions f1 (x) and f2 (x) that locally approximate the intensities
outside and inside the contour are introduced in the LBF model.
1
In calculus of variations, an energy functional refers to an energy whose variables In contrast to the two constants c1 and c2 in the CV model, the
are functions (e.g. f1 , f2 ,  in our model). functions f1 (x) and f2 (x) are spatially varying fitting functions. They
522 L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531

Fig. 2. Result of the LBF model. (a) Original image and initial contour. (b) Final contour and values of {f1 , f2 } for three points p1 , p2 , and p3 .

proposed to minimize the following energy 3. Our method


  
ELBF (C, f1 , f2 ) = 1 K (x − y)|I(y) − f1 (x)|2 dy dx Our method combines the advantages of the CV model and the
outside(C) LBF model by taking the local and global intensity information into
   account. In this section, we will detail our active contour model
+2 K (x − y)|I(y) − f2 (x)|2 dy dx based on local and global intensity fitting (LGIF) for image segmen-
inside(C) tation.
+|C|
(2) 3.1. Two-phase level set formulation

where K is a Gaussian kernel with standard deviation . The first


The local intensity fitting (LIF) energy [17] is defined as follows,
two terms are the local intensity fitting energy, denoted by FLBF .
which is the same as the first two terms in Eq. (2):
This energy can be represented by a level set formulation, and then
  
the energy minimization problem can be converted to solving a
LIF 2
level set evolution equation [17]. E (, f1 , f2 ) = 1 K (x − y)|I(y) − f1 (x)| H((y))dy dx

Due to the localization property of the kernel function, the con-    (3)
tribution of the intensity I(y) to the LBF energy decreases to zero as 2
+2 K (x − y)|I(y) − f2 (x)| (1 − H((y)))dy dx
the point y moves away from the center point x. Therefore, the LBF
energy is dominated by the intensity I(y) of points y in a neighbor-
hood of x. This localization property plays a key role in segmenting where  is the level set function, H(·) is the Heaviside function [12].
the images with intensity inhomogeneity. For example, we apply We use the CV model’s global intensity fitting (GIF) energy
the LBF model to segment the image shown in Fig. 1(a), which 
has shown that the CV model fails to segment the object correctly. E GIF
(, c1 , c2 ) = 1 |I(x) − c1 |2 H((x))dx
Fig. 1(c) shows the correct result of the LBF model. It is clearly seen
that spatially varying fitting functions f1 and f2 approximate the  (4)
2
local intensities on the two sides of the contour very well. For exam- +2 |I(x) − c2 | (1 − H((x)))dx
ple, the values of f1 and f2 at the green point in the upper left part
of the image are 67.9 and 101.1 respectively, which are consistent Now, we define the following energy functional:
with the local intensities.
LGIF
However, such localization property may introduce many local E (, f1 , f2 , c1 , c2 ) = (1 − ω)ELIF (, f1 , f2 ) + ωEGIF (, c1 , c2 ) (5)
minimums of the energy functional. Consequently, the result is
where ω is a positive constant (0 ≤ ω ≤ 1). When the images are cor-
more dependent on the initialization of contour. This can be seen
rupted by intensity inhomogeneity, the parameter value ω should
from a simple experiment for a binary image with a special initial
be chosen small enough. The selection of the parameter ω is dis-
contour as shown in Fig. 2 (a). The intensities of the background
cussed in Section 5.
and foreground are 100 and 150 respectively. Fig. 2(b) shows the
For more accurate computation involving the level set function
final segmentation result of the LBF model. It can be seen that the
and its evolution, we need to regularize the level set function by
contour is stuck in the middle of both background and foreground
penalizing its deviation from a signed distance function [6], which
regions. This can be explained by investigating the values of f1 and
can be characterized by the following energy functional
f2 at some points. For example, the values of f1 and f2 at three points
p1 , p2 , and p3 are shown in Fig. 2(b). For points p1 and p2 , the val-

1 2
ues are equal to the intensities of the background and foreground P() = (|∇ (x)| − 1) dx (6)
˝
2
respectively. As a result, the fitting energy FLBF at the points p1 ,
p2 is minimized to zero, which results in the contour being stuck As in typical level set methods [12,10], we need to regularize the
in the middle of both background and foreground regions. For the zero level set by penalizing its length to derive a smooth contour
point p3 , the values of f1 and f2 approximate the local intensities during evolution:
on both sides of the contour very well. As a result, the local fitting 
energy FLBF is minimized, and therefore the contour is stopped at L() = |∇ H((x))|dx (7)
the object boundaries. ˝
L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531 523

Now, we define the entire energy functional

F(, f1 , f2 , c1 , c2 ) = ELGIF (, c1 , c2 , f1 , f2 ) + L() + P() (8)

where  > 0,  > 0 are constants as the weights of the length term
L() and the level set regularization term P(), respectively.
In practice, Heaviside function H is approximated by a smooth
function H defined by

1
 2
 x 
H (x) = 1 + arctan (9)
2 

where  is a positive constant. The derivative of H is the smoothed


Dirac delta function

1 
ı (x) = H (x) = (10)
2 + x2

The parameter  in H and ı is set to 1.0 as in [12,10,17]. This


parameter can be fixed as this value in practice.
Thus, the energy functional F(, f1 , f2 , c1 , c2 ) in Eq. (8) is approx- Fig. 3. Influence of LIF and GIF forces.

imated by
where
F (, f1 , f2 , c1 , c2 ) = ELGIF
 (, f1 , f2 , c1 , c2 ) + L () + P() (11)  
F1 = (1 − ω) −1 K (y − x)|I(x) − f1 (y)|2 dy
We use the standard gradient descent (or steepest descent)
method to minimize the energy functional (11). For a fixed level set   (21)
function , we minimize the energy functional F (, f1 , f2 , c1 , c2 ) +2 K (y − x)|I(x) − f2 (y)|2 dy
in Eq. (11) with respect to the functions f1 (x), f2 (x) and constants c1 ,
c2 . By calculus of variations, it can be shown that the functions f1 (x),
and
f2 (x) and constants c1 , c2 that minimize F (, f1 , f2 , c1 , c2 ) satisfy
the following Euler–Lagrange equations: F2 = ω[−1 |I(x) − c1 |2 + 2 |I(x) − c2 |2 ] (22)

We call F1 and F2 the local intensity fitting (LIF) force and global
K (x − y)(I(y) − f1 (x))H ((y))dy = 0 (12)
intensity fitting (GIF) force, respectively.
The influence of the LIF force and GIF force on the curve evolu-

tion is complementary. When the contour is near object boundaries,
K (x − y)(I(y) − f2 (x))(1 − H ((y)))dy = 0 (13) the LIF force is dominant, which attracts the contour toward object
boundaries and finally stops the contour there. Therefore, the loca-
 tion of the final contour is determined by the LIF force. When the
(I(x) − c1 )H ((x))dx = 0 (14) contour is far away from object boundaries, the GIF force is dom-
inant, while the LIF force is close to zero. This can be illustrated
 by an example shown in Fig. 3. The initial contour and the contour
(I(x) − c2 )(1 − H ((x)))dx = 0 (15) after 10 iterations are plotted in yellow and green respectively. The
blue and red arrows represent the LIF and GIF forces,2 respectively.
It can be seen that the LIF force is dominant near the object bound-
From Eqs. (12)–(15), we obtain
aries, while the GIF force is dominant at locations far away from the
K (x) ∗ [H ((x))I(x)] object boundaries.
f1 (x) = (16)
K (x) ∗ H ((x))
3.2. Extension to multi-phase level set formulation
K (x) ∗ [(1 − H ((x)))I(x)]
f2 (x) = (17)
K (x) ∗ [1 − H ((x))] The model proposed above is a two-phase level set formulation,
which is not able to segment multiple regions that are adjacent
I(x)H ((x))dx to each other (a situation often referred to as multiple junctions).
c1 = (18) For example, in brain MR images, the regions of white matter
H ((x))dx
(WM), gray matter (GM), and cerebrospinal fluid (CSF) may be adja-
cent to each other. In this section, we extend the LGIF model to a
I(x)(1 − H ((x)))dx
c2 = (19) multi-phase level set formulation to segment multiple junctions. An
(1 − H ((x)))dx important application of this multi-phase formulation is for the seg-
mentation of WM, GM and CSF. In multi-phase level set formulation,
Minimization of the energy functional F (, f1 , f2 , c1 , c2 ) in Eq. n level set functions can represent 2n regions [10]. The multi-layer
(11) with respect to  can be achieved by solving the gradient level set formulation can also represent multiple regions [26]. In
descent flow equation this paper, we focus on four-phase formulation, which is sufficiently

∂
 ∇    ∇   to segment brain MR images. Two level set functions 1 , 2 are
=ı ()(F1 + F2 ) + ı ()div +  ∇ 2  − div
∂t |∇ | |∇ |

(20) 2
The LIF and GIF forces are interpreted as vectors (see Appendix A for more detail).
524 L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531

Fig. 4. Experiment for a synthetic image with intensity inhomogeneity. (a) Initial contour. (b) Result of the LBF model. (c) Result of our method.

used to define the partition of image domain into four disjoined mulation of LGIF model. Therefore, we omit i for simplicity of
regions [10]: {1 > 0, 2 > 0}, {1 > 0, 2 < 0}, {1 < 0, 2 > 0}, notation.
{1 < 0, 2 < 0}. We define the following energy functional, Minimizing Eq. (23), we obtain f1 , . . . , f4 , c1 , . . . , c4 as follows:

F(1 , 2 , f1 , f2 , f3 , f4 , c1 , c2 , c3 , c4 ) K (x) ∗ [Mi I(x)] I(x)Mi dx
fi (x) = , ci = , i = 1, . . . , 4

4   K (x) ∗ Mi Mi dx
= (1 − ω) i K (x − y)|I(y) − fi (x)|2 Mi (y)dydx (24)
i=1
(23)

4  Minimizing the energy functional F in Eq. (23) with respect to


2 1 , we derive the gradient descent flow:
+ω i |I(x) − ci | Mi (x)dx
∂1
 ∇ 
i=1 1
= ı (1 )(F13 + F24 ) + ı (1 )div
∂t   ∇   |∇ 1 | (25)
+(L (1 ) + L (2 )) + (P(1 ) + P(2 ))
1
+ ∇ 1 − div
2
where M1 = H (1 )H (2 ), M2 = H (1 )(1 − H (2 )), M3 = |∇ 1 |
(1 − H ( 1 ))H (2 ), M4 = (1 − H (1 ))(1 − H (2 )), and where
2
L (i ) = |∇ H (i (x))|dx, and P(i ) = 12 (|∇ i (x)| − 1) dx.
We fix i = 1 in our implementation for the multi-phase for- F13 = H (2 )(e3 − e1 ) (26)

Fig. 5. Application to medical images. The curve evolution process from the initial contour (in the first column) to the final contour (in the fourth column) is shown in every
row.
L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531 525

Fig. 6. Comparison of our method with the PC model and LBF model. The initial contours and the final contours are plotted as the dashed green contours and solid red
contours, respectively. Column 1: results of the PC model; column 2: results of the LBF model; column 3: results of our method. (For interpretation of the references to colour
in this figure legend, the reader is referred to the web version of the article.)

F24 = (1 − H (2 ))(e4 − e2 ) (27) of the parameters in our method:  = 3.0, 1 = 2 = 1.0, time step
t = 0.1,  = 1.0, ω = 0.01, and  = 0.001 × 255 × 255.
and ei is a function
We first apply our method to segment a synthetic image shown

in Fig. 4. Note that this image is the same as Fig. 1 but with the
ei (x) = (1 − ω) K (y − x)|I(x) − fi (y)|2 dy + ω|I(x) − ci |2 (28) initialization as shown in Fig. 4(a), which has shown that the LBF
model fails to segment the object correctly with such initialization.
Likewise, minimizing the energy functional F with respect to 2 , The results of the CV model, LBF model and our method are shown
we derive the gradient descent flow: in Figs. 1(b), 4(b) and (c), respectively. It is clearly seen that the
∂2
 ∇  CV model cannot handle intensity inhomogeneity as explained in
2
= ı (2 (F12 + F34 )) + ı (2 )div Section 2.1, and the LBF model got trapped into a local minimum
∂t   ∇   |∇ 2 | (29)
2
without taking global image information into account. By contrast,
+ ∇ 2 2 − div our model, driven by the LIF and GIF forces, successfully extracts
|∇ 2 |
the object boundaries.
where Intensity inhomogeneity often occurs in medical images, such
F12 = H (1 )(e2 − e1 ) (30) as the images shown in Fig. 5. All of them are typical images with
intensity inhomogeneity. The first row shows the result for a vessel
F34 = (1 − H (1 ))(e4 − e3 ) (31) image. In this image, part of the vessel boundaries are quite weak,
which renders it a nontrivial task to segment the vessel from the
4. Implementation and results background. The second row shows the result for a brain MR image.
As can be seen in this image, some intensities of the WM in the
4.1. Two-phase segmentation upper part are even lower than those of the GM in the lower part.
For this image, we used the parameters 1 = 1.0, 2 = 2.0, and  =
The level set function  can be simply initialized as a binary 0.003 × 255 × 255. The bottom row shows the result for a CT image
step function [6] which takes a negative constant value −c0 inside a of heart. The contour is placed across the interventricular septum
region R0 and a positive constant value c0 outside. We choose c0 = 2 of the heart. In next subsection, we show an example that the LBF
in the experiments shown in this paper. The proposed method has model fails to extract ventricles with this initialization (see Fig. 6).
been tested with synthetic and real images from different modali- Nevertheless, satisfactory segmentation results have been obtained
ties. Unless otherwise specified, we use the following default setting for these images, as shown in the last column of Fig. 5.
526 L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531

Fig. 7. Application to brain MR image segmentation. The red curve and blue curve are zero level sets of 1 and 2 . Upper row: (a) initial contours and (b–e) intermediate
results. Lower row: (f) initial contours and (g–j) intermediate results. (For interpretation of the references to colour in this figure legend, the reader is referred to the web
version of the article.)

Since the PS model is computationally expensive due to its com- region of GM and WM, denoted by R. Then, we perform the dilation
plex procedure [18], we focus on the comparison of our model and erosion operations to expand and shrink the region R, respec-
with the PC model [12] and the LBF model on the images shown tively. As a result, we obtain a expanded version of R, denoted by
in Fig. 5. Fig. 6 shows the results of the PC model (the first col- Rexpanded , and a shrunk version of R, denoted by Rshrunk . Following
umn), the LBF model (the second column) and our method (the the initialization scheme in [28], the level set functions 1,0 and
third column). It can be observed that the PC model cannot seg- 2,0 are initialized as
ment images with intensity inhomogeneity. The LBF model and our

method have achieved similar final results for the vessel image. c0 , if x /∈ R;
For the brain image, the LBF model incorrectly identifies the back- 1,0 (x) = (32)
−c0 , else;
ground as the WM. For the heart image, the contour of the LBF model
is somewhat noisy and finally fails to extract the object boundaries.
c0 , if x /∈ Rexpanded or x ∈ Rshrunk ;
With the same initializations, our method can achieve satisfactory 2,0 (x) = (33)
−c0 , else;
results, which demonstrates the advantage of our model in term of
robustness to the initialization.
where c0 is a constant. As a result, the contours are initialized near
the boundaries of WM, GM and CSF. Thus, less iterations are needed
4.2. Multi-phase segmentation of brain MR images to obtain the final segmentation result. For example, the lower
row of Fig. 7 shows the results with the new initialization scheme.
The segmentation of the brain MR images into WM, GM, and The initial contours are shown in Fig. 7(f). The curve evolution is
CSF has been an important task in medical image analysis. A major depicted in the lower row. With such initialization, only 45 itera-
difficulty in segmentation of MR images is the intensity inhomo- tions are needed to obtain the final desirable segmentation result
geneity due to the radio-frequency coils or acquisition sequences. in Fig. 7(j).
Our method is able to address the difficulty. In this subsection, we Note that new contours can emerge during the curve evolution
will show an application of our multi-phase model to the segmen- shown in Fig. 7. The emergence of new contours speeds up the curve
tation of brain MR images. evolution toward final results. The emergence of new contours can
We first apply our multi-phase model to segment a 2D MR image be explained as follows. Note that the terms ı (1 )(F13 + F24 ) in Eq.
from McGill Brain Web [27] with noise level 3%, and intensity non- (25) and ı (2 )(F12 + F34 ) in Eq. (29) have influence on the change of
uniformity (INU) 40% as shown in Fig. 7 (a). We have increased INU 1 and 2 in the entire image domain, since the factor ı is non-zero
to test the validity of our method to handle intensity inhomogene- by the definition of ı in Eq. (10). For points x far away from the zero
ity. In fact, the intensity of WM in the lower part is even lower than level contour but near an object boundary, the values of (F13 + F24 )
that of the GM in the upper part. The contours are initialized as and (F12 + F34 ) may still be large. Although the factor ı takes small
two circles shown in Fig. 7(a). The curve evolution is depicted in values far away from the zero level set, the terms ı (1 )(F13 + F24 )
the upper row of Fig. 7. Total number of iterations is 182. It can be and ı (2 )(F12 + F34 ) are not zero and cannot be ignored, which
observed that WM, GM, and CSF are well segmented by our method. can eventually change the values of 1 and 2 . When the level set
In practice, to reduce the number of iterations, we can initialize functions 1 and 2 are initialized to be small values, such as the
the contour close to the true boundaries by a preliminarily seg- binary step function used in our implementation, new contours can
mentation. In our implementation, we use a simple thresholding emerge easily and quickly, even at locations far away from current
to obtain two regions: one as the preliminarily segmented region zero level set. This is because the factor ı takes relatively larger
of background and CSF, the other as the preliminarily segmented values for small values of 1 and 2 (in our experiments, the initial
L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531 527

Fig. 8. Results for 3D brain MR images. Row 1: GM and WM surfaces obtained by the PC model. Row 2: GM and WM surfaces obtained by our model.

level set functions as binary step functions take values of c0 and −c0 faces obtained by our method are more accurate. To demonstrate
with c0 = 2). the advantage of our method clearly, we show four sagittal slices
Fig. 8 shows the surfaces of the GM and WM segmentation of and the corresponding contours obtained by the PC model and our
real 3D brain MR images with obvious intensity inhomogeneity. method in Fig. 9. It can be clearly seen that the PC model does not
The upper and lower row show the results obtained by the PC correctly segment images: part of the WM is incorrectly identified
model [10] and our model, respectively. It can be seen that GM as the GM, while part of the GM is labeled as the WM. By con-
obtained by the PC model is a little bit thinner at the top of the trast, our method recovers the boundaries of WM, GM, and CSF
brain and WM is seriously misclassified as GM. By contrast, the sur- accurately.

Fig. 9. Results of sagittal slices from 3D segmentation of Fig. 8. The red curve and blue curve are zero level sets of 1 and 2 . Row 1: original image slices. Row 2: results of
PC model. Row 3: results of our method.
528 L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531

Fig. 10. Comparison of our method with the methods of Wells et al., Leemput et al. on brain MR images. Column 1: original images (the first image is the same as the image
shown in Fig. 7. The other four images are real images); column 2: ground truth; column 3: Wells et al.; column 4: Leemput et al.; column 5: our method.

4.3. Validation and method comparison columns 3, 4 and 5, respectively. The segmentation results are visu-

4
Fig. 10 shows the comparison of the proposed method with alized by displaying ci Mi . It can be observed that the results of
the methods of Wells et al. [29] and Leemput et al. [30] i=1
on five brain MR images. These two methods are based on our model and the methods of Wells et al. and Leemput et al. look
expectation–maximization (EM) algorithm for interleaved bias similar by visual comparison. However, we can show by quantita-
field correction and segmentation. The first column shows the orig- tive comparison that our model produces more accurate results. The
inal images. The ground truth segmentation of the first image (the metric adopted in this paper for comparison is the Dice Similarity
top-left) was obtained from Brain Web [27]. The other four images Coefficient (DSC) [31], which is defined as
are real images and the corresponding ground truth of these images
were obtained from expert manual segmentation, as shown in the
second column. The segmentation results obtained by the methods 2N(S1 S2 )
DSC = (34)
of Wells et al., Leemput et al. and the proposed method are shown in N(S1 ) + N(S2 )
L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531 529

Fig. 11. DSC values for WM (left) and GM (right). The x-axis represents five images in Fig. 10 in the same order.

Fig. 12. Effect of level set regularization. (a) and (d) Segmentation result and final level set function  with level set regularization. (b) and (e) Segmentation result and final
level set function  without level set regularization, and without re-initialization. (c) and (f) Segmentation result and final level set function  without level set regularization,
but with re-initialization.

where S1 and S2 represent the obtained segmentation and ground and finally stop it on the object boundary. In the experiment, we
truth, respectively, and N(·) indicates the number of voxels in the need to choose appropriate value for ω according to the degree of
enclosed set. The closer the DSC value to 1, the better the seg- inhomogeneity.
mentation. Fig. 11 shows the DSC values for WM and GM of these
methods. It can be seen that our method achieves more accurate 5.2. Effect of level set regularization term
results.
The level set regularization term P defined in (6) is necessary in
5. Discussion the proposed variational level set formulation.3 Without the level
set regularization term (i.e.,  = 0), the level set function  typi-
5.1. The parameter ω cally grows to very large positive or negative values on both sides of
the zero level set, resulting in arbitrarily large gradients there. This
In this paper, the parameter ω is a constant, which controls the irregularity of  causes errors in the computation for the numer-
influence of the LIF force and GIF force. When the intensity inho- ical solution to the evolution equation and affects the accuracy
mogeneity is severe, the accuracy of segmentation relies on the of final segmentation results. Therefore, an extra numerical rem-
LIF force. In such case, we should choose small ω as the weight edy, known as re-initialization, is usually required to periodically
of the GIF force; otherwise the GIF force may prevent the LIF force stop the evolution and reshape the degraded level set function as
stopping at object boundaries. For images with minor inhomogene-
ity, the GIF force alone is able to attract the contour to a location
near the object boundary. In this case, we can use relatively larger
ω as the weight of GIF. Thus, the motion of the contour is domi- 3
The level set regularization term can be defined as P = p(|∇ (x)|)dx, where p is
2

nated by the GIF force until it is close to the object boundary. Then, a function. For example, we can choose P = (|∇ (x)| − 1) dx or P = |∇ (x)|2 dx.
the LIF force becomes dominant and it starts to attract the contour More general level set regularization term is proposed by Li et al. in [28].
530 L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531

Fig. 13. Effect of level set regularization. (a) Result with level set regularization. (b) Result without level set regularization, and without re-initialization. (c) Result without
level set regularization, but with re-initialization.

a signed distance function for further evolution and accurate com- Acknowledgements
putation. By contrast, the regularity of the level set function in our
method is inherently maintained by the level set evolution itself The authors would like to thank X. Hong and C. He for providing
due to the regularization mechanism of the level set regularization their hand segmentation results, and the anonymous reviewers for
term. their supportive comments. L. Wang, Q. Sun, and D. Xia acknowl-
Fig. 12 shows three experimental results for the MR image in edge the support from National Natural Science Funds. C. Li would
Fig. 5 for the following three cases: (a) with level regularization; like to thank the support from Vanderbilt University Institute of
(b) without level set regularization, and re-initialization is not per- Imaging Science. C-Y. Kao acknowledges the support and hosting
formed; (c) without level set regularization but re-initialization from Mathematical Biosciences Institute at The Ohio State Univer-
is performed. For comparison, we show the segmentation results sity.
and the final level set functions for this figure. For the case (a),
it can be clearly seen from the result in Fig. 12(d) that the reg- Appendix A. Curve evolution and its level set formulation
ularity of  is well preserved, and the segmentation result is
desirable. For the case (b) (the second column), the irregularity The level set method is a numerical technique for tracking inter-
of  affects the accuracy in the segmentation and creates some faces and shapes [32]. The motion of the interfaces can be described
unwanted noisy features as shown in Fig. 12(e). For the case (c) by an curve evolution equation of a parameterized curve C in the
(the third column), the regularity of  is preserved, however, the form
segmentation result is inaccurate, which can be clearly seen in
∂C
Fig. 12(c). = FN (35)
We also test our multi-phase model for the cases (a), (b), and ∂t
(c) as shown in Fig. 13. It is evidently that the segmentation result where F is the speed function, and N is the inward normal vector
of our method with level set regularization is desirable as shown to the curve C. The basic idea of the level set method is to embed
in Fig. 13(a). The result is quite consistent with the brain anatomy. the dynamic curve C(p, t) as the zero level set of a time dependent
In contrast, for the cases (b) and (c), the results (Fig. 13(b) and (c)) function (x, y, t), and then convert the curve evolution in Eq. (35)
are not consistent with the anatomy of brain in some areas, such to the evolution of the embedding level set function  [32]. If the
as those pointed by the dashed green arrows. For example, WM is embedding level set function  takes negative values inside the zero
mislabeled as GM in those areas. level contour and positive values outside, then the inward normal
vector can be expressed as N = −(∇ /|∇ |). The curve evolution
Eq. (35) can then be converted to the following level set evolution
6. Conclusion equation
∂
In this paper, we propose a new region-based active contour = F|∇ | (36)
model in a variational level set formulation. We define an energy ∂t
functional with a local intensity fitting term, which is dominant which is a Hamilton–Jacobi equation. Conversely, a level set evolu-
near object boundaries and responsible for attracting the contour tion equation in the form of (36) describes the curve evolution in
toward object boundaries, and an auxiliary global intensity fitting (35), and the scalar function F in (36) corresponds the vector FN,
term, which incorporates global image information to improve the which can be interpreted as a force on the contour.
robustness of the proposed method. Our model can handle intensity
inhomogeneity, and allows for flexible initialization. In addition, Conflict of interest statement
the regularity of the level set function is intrinsically preserved by
the level set regularization term to ensure accurate computation None declared.
and thus avoid expensive re-initialization procedures. We further
extend our two-phase LGIF model into a multi-phase level set for-
References
mulation. Experimental results demonstrate desirable performance
of our extension method for brain MR images with intensity inho- [1] Kass M, Witkin A, Terzopoulos D. Snakes: active contour models. Int J Comput
mogeneity. Vis 1987;1(4):321–31.
L. Wang et al. / Computerized Medical Imaging and Graphics 33 (2009) 520–531 531

[2] Caselles V, Catte F, Coll T, Dibos F. A geometric model for active contours in [26] Chung G, Dinov I, Toga A, Luminita A, Vese, MRI, Tissue segmentation using
image processing. Numer Math 1993;66(1):1–31. a variational multilayer approach, Department of Mathematics, UCLA, CAM
[3] Kimmel R, Amir A, Bruckstein A. Finding shortest paths on surfaces using level Report, 08-54, 2008, July.
set propagation. IEEE Trans Pattern Anal Mach Intell 1995;17(6):635–40. [27] http://www.bic.mni.mcgill.ca/brainweb/.
[4] Malladi R, Sethian JA, Vemuri BC. Shape modeling with front propaga- [28] Li C, Xu C, Gui C, Fox MD. Distance regularized level set evolution and applica-
tion: a level set approach. IEEE Trans Pattern Anal Mach Intell 1995;17(2): tions to image segmentation. IEEE Trans Image Process; in press.
158–75. [29] Wells W, Grimson E, Kikinis R, Jolesz F. Adaptive segmentation of MRI data. IEEE
[5] Xu C, Prince J. Snakes, shapes, and gradient vector flow. IEEE Trans Image Process Trans Med Imaging 1996;15(4):429–42.
1998;7(3):359–69. [30] Leemput V, Maes K, Vandermeulen D, Suetens P. Automated model-based
[6] Li C, Xu C, Gui C, Fox MD. Level set evolution without re-initialization: a new bias field correction of MR images of the brain. IEEE Trans Med Imaging
variational formulation. In: Proceedings of IEEE conference on computer vision 1999;18(10):885–96.
and pattern recognition (CVPR), vol. 1. 2005. p. 430–6. [31] Shattuck DW, Sandor-Leahy SR, Schaper KA, Rottenberg DA, Leahy RM. Magnetic
[7] Li C, Liu J, Fox MD. Segmentation of edge preserving gradient vector flow: an resonance image tissue classification using a partial volume model. Neuroimage
approach toward automatically initializing and splitting of snakes. In: Proceed- 2001;13:856–76.
ings of IEEE conference on computer vision and pattern recognition (CVPR), vol. [32] Osher S, Sethian J. Fronts propagating with curvature-dependent speed: algo-
1. 2005. p. 162–7. rithms based on Hamilton–Jacobi formulations. J Comp Phys 1988;79(1):12–49.
[8] Ronfard R. Region-based strategies for active contour models. Int J Comput Vis
1994;13(2):229–51. Li Wang is a Ph.D. student in School of Computer Science and Technology, Nanjing
[9] Samson C, Blanc-Feraud L, Aubert G, Zerubia J. A variational model for University of Science and Technology. His research interests include image process-
image classification and restoration. IEEE Trans Pattern Anal Mach Intell ing, computer vision, medical imaging, and applied mathematics.
2000;22(5):460–72.
[10] Vese L, Chan T. A multiphase level set framework for image segmentation using Chunming Li received the Ph.D. degree in Electrical Engineering from University of
the Mumford and Shah model. Int J Comput Vis 2002;50(3):271–93. Connecticut, Storrs, CT, in 2005. Between 2001 and 2003, he was a consultant for
[11] Tsai A, Yezzi A, Willsky AS. Curve evolution implementation of the Robotics Technology Group, ABB Corporate Research, where he worked on image
Mumford–Shah functional for image segmentation, denoising, interpolation, processing and camera calibration algorithms. From 2003 to 2005, he did his Ph.D.
and magnification. IEEE Trans Image Process 2001;10(8):1169–86. research on medical image processing and analysis, which was supported by Pfizer
[12] Chan T, Vese L. Active contours without edges. IEEE Trans Image Process Global Research and Development for his excellent summer research on the mea-
2001;10(2):266–77. surement of a biomarker for atherosclerosis in 2004. He is currently a research
[13] Paragios N, Deriche R. Geodesic active regions and level set methods for super- fellow at Vanderbilt University Institute of Imaging Science. His research interests
vised texture segmentation. Int J Comput Vis 2002;46(3):223–47.
include the development and application of algorithms in image processing, medical
[14] Rousson M, Deriche R. A variational framework for active and adaptative seg-
imaging, and computer vision.
mentation of vector valued images. In: Proceedings of the workshop on motion
and video computing. 2002. p. 56–61. Quan-Sen Sun received the Ph.D. degree in pattern recognition and intelligence sys-
[15] Rousson M, Cremers D. Implicit active shape models for 3d segmentation in MR tem from Nanjing University of Science and Technology (NUST), China, in 2006. He is
imaging. In: MICCAI (1). 2004. p. 209–16.
a professor in the Department of Computer Science at NUST. He visited the Depart-
[16] Cremers D, Rousson M, Deriche R. A review of statistical approaches to level set
ment of Computer Science and Engineering, The Chinese University of Hong Kong
segmentation: integrating color, texture, motion and shape. Int J Comput Vis
2007;72(2):195–215. in 2004 and 2005, respectively. His current interests include pattern recognition,
[17] Li C, Kao C, Gore J, Ding Z. Implicit active contours driven by local binary fit- image processing, computer vision and data fusion.
ting energy. In: Proceedings of IEEE conference on computer vision and pattern
De-Shen Xia received the B.Sc. degree in radiology from Nanjing Institute of Tech-
recognition (CVPR). 2007. p. 1–7.
nology, Nanjing, China, in 1963, and the Ph.D. degree from Rouen University, Rouen,
[18] Piovano J, Rousson M, Papadopoulo T. Efficient segmentation of piecewise
smooth images. In: SSVM07, Ischia, Italy; 2007. pp. 709–720. France, in 1988. Currently, he is a Professor at the Nanjing University of Science and
[19] Awate S, Tasdizen T, Foster N, Whitaker R. Adaptive Markov modeling for Technology, Nanjing, China, an Honorary Professor with ESIC/ELEC, Rouen, France,
mutual-information-based, unsupervised MRI brain-tissue classification. Med and a Research Member with the Computer Graphics Laboratory of the Centre
Image Anal 2007;10(5):726–39. National de la Recherche Scientifique (CNRS), France. He is also the Director of Image
[20] Wong W, Chung A. Bayesian image segmentation using local iso-intensity struc- Recognition Laboratory at Nanjing University of Science and Technology. He is the
tural orientation. IEEE Trans Image Process 2005;14(10):1512–23. Direction Member of the National Remote Sensing Federation, China, and the Direc-
[21] Li C. Active contours with local binary fitting energy. In: IMA workshop on new tion Member of the Micro-Computer Application Association of Province Jiangsu,
mathematics and algorithms for 3-D image analysis. 2006. China. His research interests include image processing, analysis, and recognition,
[22] Li C, Kao C, Gore JC, Ding Z. Minimization of region-scalable fitting energy for remote sensing, medical imaging and mathematics in imaging.
image segmentation. IEEE Trans Image Process 2008;17(10):1940–9.
[23] Brox T, Cremers D. On the statistical interpretation of the piecewise smooth Chiu-Yen Kao received the Ph.D. degree in Mathematics from University of Cal-
Mumford–Shah functional. In: SSVM07, Ischia, Italy; 2007. pp. 203–213.
ifornia, Los Angeles, in 2004. She is currently an assistant professor at The Ohio
[24] Wang L, Li C, Sun Q, Xia D, Kao C. Brain MR image segmentation using local
State University and a long term visitor at Mathematical Biosciences Institute. Her
and global intensity fitting active contours/surfaces. In: Proceedings of medical
research expertise lies in level set methods, Hamilton–Jacobi equations, computa-
image computing and computer aided intervention (MICCAI), vol. LNCS 5241,
Part I. 2008. p. 384–92. tional anatomy, and inverse problems. For biological applications, she is currently
[25] Mumford D, Shah J. Optimal approximations by piecewise smooth func- working on the structural study of human brains, automatic numerical extraction of
tions and associated variational problems. Commun Pure Appl Math ciliary muscle, and general image processing techniques based on partial differential
1989;42(5):577–685. equations.

You might also like