You are on page 1of 5

Segmentation of tumors from endoscopic images

using topological derivatives based on discrete


approach
Ravindra S. Hegadi*
*
Department of Computer Science, Karnatak University
Dharwad – 580003, India.
1
ravindrahegadi@rediffmail.com

Abstract— The growth and development of interdisciplinary morphological filtering and others [4], [5]) have been applied
research areas in the recent years has motivated the researchers to try to solve this problem with variable outcomes [6], [7].
in the area of image processing to apply the techniques from the Such techniques tend to be unreliable when segmenting a
Physics and Mathematics extensively in developing efficient structure which is surrounded by others with similar image
image processing algorithms. One such application is use of
topological derivatives for image segmentation. In this paper the
intensity (e.g., low-contrast structures). More sophisticated
cancer tumors from endoscopic images are segmented using the techniques, like Level Sets, use powerful numerical
topological derivatives based on discrete approach. The computations for tracking the evolution of moving surface
topological derivatives quantify the sensitivity of a problem when fronts. These techniques are based on computing
the image domain is perturbed by the introduction of linear/nonlinear hyperbolic equation solutions for the
heterogeneity such as hole, inclusion, source term, etc. The appropriate equations of motion. An initial approximation of
topological derivatives are used here as a descent direction to the solution (seed) evolves until it gets the limits of the region
minimize the associated cost function. The segmentation results of interest.
based on the proposed methodology are very encouraging.. A Segmentation method based on active contour without
edges is proposed by Dhandra and Ravindra Hegadi [2] in
Keywords— Topological derivatives, segmentation, endoscopy, which an endoscopic image is classified as normal or
tumor abnormal based on number of regions generated in the image
after segmentation. Since Active Contours is the most
I. INTRODUCTION successful variational model, it has been used extensively in
The endoscope has revolutionized the field of Medical Image Analysis [8]. Many of its extensions have also
gastroenterology. Through the endoscopy physician can contributed to the analysis of medical images. But, the only
directly examine almost any part of the intestinal tract. drawback of this model is the existence of local minima in the
Biopsies can be obtained, polyps removed and clear images active contour energy, which makes the initial guess critical to
obtained. This gallery of endoscopy images provides views of get satisfactory results.
the GI tract from top to bottom. The gallery is separated into In this paper the input endoscopic images are segmented
the various organs within the abdomen-esophagus, stomach, using the discrete image segmentation algorithm based on
colon, etc. Gastrointestinal endoscopy has been significantly topological derivatives proposed by I. Larrabide [9]. Section 2
improved during the last decade. Tumors of less than 5 mm in presents the formulation of the segmentation problem and the
diameter can now be detected by using high-resolution video cost functional associated to a specific segmentation of the
endoscopes. Additional in vivo staining allows better image data. The topological derivative of this cost functional
delineation and more precise identification of the lateral using the Topological-Shape Sensitivity Method [10], [11] is
spreading of lesions. Today the missing of cancers in early calculated and the proposed segmentation algorithm and
stage is mainly due to lack of screening programs rather than numerical approximation used to find an approximated
technical limitations. Endoscopic mucosal resection of solution of the associated variational problem will be
superficial lesions is primarily a diagnostic procedure to presented in this Section. In Section 3 segmentation results
determine the need for surgery [1]. using the proposed method for endoscopic images are
Many contributions have been made to this area of medical presented.
image segmentation since the introduction of the Mumford
and Shah functional [3]. Moreover, the inherent complexity of II. IMAGE SEGMENTATION BASED ON TOPOLOGICAL
this issue has motivated interdisciplinary research and the use DERIVATIVES
of techniques actually born in other areas into image The introduction of the Topological Derivative originally
processing and medical imaging. Classical image conceived for the study of topology optimization problems. It
segmentation techniques are based on two basic pixel has shown interesting results when applied to image
characteristics: discontinuities and similarities. Many of these processing [12], [13]. The topological derivative is computed
classical techniques (e.g., multiple thresholds, region growing, for an appropriate functional associated to the image

c
978-1-4244-8594-9/10/$26.00 2010 IEEE 54
indicating the cost endowed to a specific image segmentation. where Nc is the number of predefined classes in which the
Further, an image segmentation algorithm based on this original image v will be segmented and ci represents the
derivative is proposed. intensity that characterizes the ith í class.
Therefore, the image segmentation problem can be stated as
following: Given the image data v  V find the segmented
image u *  U such that minimizes a functional :ܷհԹ
endowed to the cost of a specific segmented image and being
U defined as:
U = {u V : u(x) C, x‫ א‬ȍ } (4)
Motivated by the Mumford and Shah functional and on our
works on image processing [14], [15], [13], [16], [17] the
following cost functional associated to a segmented image
Fig,1 Topologicalderivativeconcept
u U will be adopted:
ଵ ଵ ଶ
Roughly speaking, let (ȍ) = (ij(ȍ)) be the cost (ȍ) =  ‫׬‬ȍ ॶ‫ ߮׏‬ȉ ‫݀߮׏‬ȍ ൅ ‫׬‬ȍ ൫߮ െ ሺ‫ ݒ‬െ ‫ݑ‬ሻ൯ ݀ȍ,
ଶ ଶ
function to be minimized and ij(ȍ) the solution of an
associated variational problem (VP) defined in the domain ȍ. (5)
For a small parameter ‫ • ׫‬0, let ȍ‫ ׫‬be the perturbed domain
where field ij is solution of the variational problem. Find ij‫א‬
obtained by the insertion of heterogeneity on the parameters
H1(ȍ), such that:
governing the associated VP. This heterogeneity is defined in
a small sphere of radius ‫ ׫‬cantered at any point X̂ of the a (ij, Ș) = l (Ș) ‫ א ߟ׊‬H1(ȍ) (6)
domain ȍ. Furthermore, let ij‫ ׫‬be the solution of the VP with bilinear form a (·,·) : H1(ȍ) × H1(ȍ) ĺ and the linear
defined in the perturbed domain ȍ‫( ׫‬see Figure 1). Then, for form l (·) : L2(ȍ) ĺ respectively defined as:
small values of parameter ‫ ׫‬the topological sensitivity
provides an asymptotic expansion of (ȍ‫)׫‬: a (ij, Ș) :=‫׬‬ȍ ॶ‫ ߮׏‬ȉ ‫݀ߟ׏‬ȍ + ‫׬‬ȍ ߮ߟ݀ȍand
(ȍ‫= )׫‬ (ȍ) + f(‫  )׫‬DT ( Xˆ )  o( f (‫))׫‬ (1) l (Ș) := ȕ‫׬‬ȍ ሺ‫ ݒ‬െ ‫ݑ‬ሻߟ݀ȍ (7)
where f (‫ )׫‬is a known positive function going Associated to ij, defined the function ij‫ ׫‬which is solution of
monotonically to zero with ‫ ׫‬and DT ( Xˆ ) is the topological a perturbed variational formulation. The perturbation is
derivative. Therefore, this derivative can be seen as a first characterized by changing the segmented image u with a new
order correction on (ȍ) to estimate (ȍ‫)׫‬. Since f (‫ )׫‬is one uT which is identical to u at every point of the domain ȍ
positive, the heterogeneity must be introduced at any point X̂ except in the small region B‫ ׫‬centered at point ‫ܠ‬ො ‫ א‬ȍ . In B‫׫‬,
where DT is negative in order to reduce the value of the cost uT assumes one of the values ci C. Formally,

function . As will be shown later, the topological derivative തതതఢ and


uT(x) = u(x) x‫ א‬ȍ̳‫ܤ‬
can be easily obtained and the segmentation method based on uT(x) = ci, ci C x‫ܤ א‬ఢ
this information appears robust even in the presence of very
large noise in the image data. Therefore, the perturbed cost functional becomes:

A. Problem Formulation (ȍ‫׬  = )׫‬ȍ ॶ‫߮׏‬ఢ ȉ ‫߮׏‬ఢ ݀ȍ ൅

The image data could be characterized by a two- ଶ

dimensional matrix of pixels, which are the image elements ଶ ȍ
‫ ׬‬൫߮ఢ െ ሺ‫ ݒ‬െ ‫ ் ݑ‬ሻ൯ ݀ȍ, (8)
with certain intensity. Then, the original image data can be
described by a real valued functions v which is constant at where field ij‫ ׫‬is solution of the perturbed variational problem.
image element level, then: Find ij‫ ׫‬H1 (ȍ) such that:
a(ij‫׫‬, Ș) = l‫(׫‬Ș) Ș H1(ȍ) (9)
­°w  L2 (:) : w constant ½°
v V ® ¾ (2) 2
with l‫) (׫‬: L (ȍ) ՜ Թ defined as:
°̄at image element level °¿

where ȍ is an open bounded domain in Թ௡ , n = 2, 3. In l‫( ׫‬Ș) = E ³ v  u T K d: (10)


:
addition let us define the set of classes C:
B. Numerical solution of topological derivatives
C = {ci ‫ א‬Թ : i = 1, · · · ,Nc}, (3)
The topological derivative allows us to quantify the
sensitivity of the problem when the domain under
consideration ȍ is perturbed by introducing a hole, an

2010 International Conference on Signal and Image Processing 55


inclusion or a source term in a small region B‫ ׫‬which is ball of (15)
radius ‫׫‬. According to [17] the numerical solution of ௗ
topological derivatives is: where the second term ࣜ ሺ‫ݑ‬ሻ is associated to the measure of
the interfaces between different regions. In particular, this

DT ሺ‫ܠ‬ොሻ ൌ ሺܿ௜ െ ‫ݑ‬ሻൣ൫߮ሺ‫ܠ‬ොሻ െ ሺ‫ ݒ‬െ ‫ݑ‬ሻ൯ ൅ ൫߮ሺ‫ܠ‬ොሻ െ ሺ‫ ݒ‬െ ܿ௜ ሻ൯ ൅ functional is taken as:

ʹሺͳ െ ߚሻ߮ሺ‫ܠ‬ොሻ൧‫ܠ׊‬ො ‫ א‬ષ ଵ
(11) ࣜௗ ሺ‫ݑ‬ሻ = σ௦ σ௣ ‫ݔ‬ሺ‫ ݑ‬௦ ǡ ‫ݑ‬௣ ሻ (16)
ସ௡
From the above result the topological derivative at any Here, n = 2 and 3 for two-dimensional and three-dimensional
point ‫ܠ‬ො ‫ א‬ષ only depends on the value at that point of the images respectively and (us, up) is a characteristic function of
function ij solution of the variational problem given by Eq. (6) the boundary that the image element s shares with the
defined in the non perturbed domain ȍ on the image data v, on neighbor image element p and is defined taking the value 1
the actual segmented image u and on the perturbation given by (one) when us  up and 0 (zero) otherwise. The parameter ߠ
one of the intensity values characterizing the Nc classes ௗ
ci  C in which the image data v will be segmented. controls the contribution of each term ( ሺ‫ݑ‬ሻ andࣜௗ ሺ‫ݑ‬ሻ) to
ௗ ሺ‫ݑ‬ሻ.
Moreover, from Eq. (1) and since f (‫ )׫‬is positive, by the cost function ࣠
introducing a perturbation at any point ‫ܠ‬ො where DT( ‫ܠ‬ො ) is Then, from de definition of the functional ࣠ ௗ ሺ‫ݑ‬ሻ given by
negative we will obtain a cutback on the cost function value. Eq.(15) the cost associated to a segmented image u ‫ א‬U is
Then, DT can be taken as an indicator function defining the easily calculated. Moreover, if we perturb the value of u at a
best places where the perturbations could be introduced. This given image element s by changing its corresponding class
information is used to for the algorithm for image from us to some ci ‫ א‬C we obtain a new perturbed segmented
segmentation as shown in the next section. image uT . Therefore, ࣠ ௗ ሺ‫ݑ‬ሻ ் is given by:

C. Discrete image segmentation algorithm ࣠ ௗ ሺ‫ ் ݑ‬ሻ ൌ ߠ ሺ‫ ் ݑ‬ሻ ൅ ሺͳ െ ߠሻࣜௗ ሺ‫ ் ݑ‬ሻ, (16)
In this algorithm it is not necessary to compute the field ߮ where ࣠ ௗ ሺ‫ ் ݑ‬ሻ and ࣜௗ ሺ‫ ் ݑ‬ሻ can be written as:
to obtain topological derivative. In fact, taking ȕ = 0 in Eq.(6)
ௗ ௗ
we obtain the trivial solution ߮ ‫ Ͳ ؠ‬for any segmented image ሺ‫ ் ݑ‬ሻ = ሺ‫ݑ‬ሻ െ ሺ‫ ݒ‬௦ െ ‫ ݑ‬௦ ሻଶ ൅ ሺ‫ ݒ‬௦ െ ܿ௜ ሻଶ
u U. In this case also the cost functional (ȍ) reduces to a ଵ
functional defined in U and given by: ࣜௗ ሺ‫ ் ݑ‬ሻ ൌ ࣜௗ ሺ‫ݑ‬ሻ െ σ௣ሾ‫ݔ‬ሺ‫ ݑ‬௦ ǡ ‫ݑ‬௣ ሻ െ ‫ݔ‬ሺܿ௜ ǡ ‫ݑ‬௣ ሻሿ
ସ௡

(ȍ) = ‫׬‬π ሺ‫ ݒ‬െ ‫ݑ‬ሻଶ ݀π (12) since uT is equal to u everywhere except at image element
level s where assumes the value ci ‫ א‬C.
Moreover, since v and u are constant at image element level From the above expressions, the total variation of the
the above functional can be rewritten as: functional ࣠ ௗ due to a perturbation at image element s will be
ଶ denoted by DT (s) and is given by:
d
(ȍ) =σ௦ሺ‫ ݒ‬௦ െ ‫ ݑ‬௦ ሻ , (13)
DT (s) = ࣠ ௗ ሺ‫ ் ݑ‬ሻ െ  ࣠ ௗ ሺ‫ݑ‬ሻ, (17)
where v and u mean the value of v and u at image element ws
s s

ഥ ൌ ‫ڂ‬௦ തതതത
respectively and π ‫ݓ‬௦. where
According to this approach, the image segmentation problem
DT (s) = ߠሾሺ‫ ݒ‬௦ െ ‫் ݑ‬௦ ሻଶ െ ሺ‫ ݒ‬௦ െ ‫ ݑ‬௦ ሻଶ ሿ
could be reduced to: Given the original image ‫ ܸ א ݒ‬find ଵ
‫ ܷ א ݑ‬such that: ൅ሺͳ െ ߠሻ σ௣ሾ‫ݔ‬ሺ‫் ݑ‬௦ ǡ ‫ݑ‬௣ ሻ െ ‫ݔ‬ሺ‫ ݑ‬௦ ǡ ‫ݑ‬௣ ሻሿ (18)
ସ௡
ௗ for ‫் ݑ‬௦ = ci, ci ‫ א‬C, i = 1, · · · , Nc.
u* = arg ‹௨‫א‬௎ ሺπሻ (14)
It is interesting to rewrite the total variation given by
The above minimization problem is easy to be solved. In Eq.(17) in the following way:
fact, it is only necessary to find for each image element s the
࣠ ௗ ሺ‫ ் ݑ‬ሻ ൌ ࣠ ௗ ሺ‫ݑ‬ሻ ൅ DT (s), (19)
index ଓҧ := arg min{|vs í ci|; i = 1, · · · , Nc; ci ‫ א‬C }. Therefore,
the segmented image u* is characterized by‫כݑ‬௦ ൌ ܿపҧ. In other Then, comparing with Eq. (1) the above expression can be
words and at each image element level s, the segmented image interpreted as a”topological asymptotic expansion” for this
is obtained taking the value of the class ܿపҧ ‫ ܥ א‬which is closer fully discrete approach. Moreover, at each image element s
to the value vs of the input image v. the perturbation ‫் ݑ‬௦ could be selected such that produces the
In the above formulation there is no control on the measure minimum value for the total variation. The minimum value of
of the boundary corresponding to the sub-domain ȍi = {x ‫ א‬ȍ; the total variation and the corresponding class ci will be
u(x) = ci} associated to the class ci ‫ א‬C, i = 1, · · ·, Nc. Then, denoted by ‫ܦ‬ ෢் ሺ‫ݏ‬ሻ and ܿෝప respectively. Then, for this fully
in order to obtain a segmented image with more smooth discrete approach the total variation plays the same role than
boundaries and from the ideas behind of the Mumford - Shah the topological derivative has in the former section. In fact,
functional [3], the following cost functional is proposed: the total variation DT could be taken as an indicator function
ௗ that allow us to select the image element at which the
࣠ ௗ ሺ‫ݑ‬ሻ ൌ ߠ ሺ‫ݑ‬ሻ ൅ ሺͳ െ ߠሻࣜௗ ሺ‫ݑ‬ሻ, with ߠ ‫[ א‬0, 1]‫ ؿ‬Թ

56 2010 International Conference on Signal and Image Processing


perturbation must be introduced in order to reduce the value of
the cost functional.
Using the above considerations a very fast fully discrete
algorithm is proposed. As mentioned before, according to
the”topological asymptotic expansion” (Eq. (19)), for an
image v ‫ א‬V we must find the segmented image u* ‫ א‬U that
minimizes the cost functional ࣠ ௗ by successively choosing
the class that produces the most negative values of the
topological derivative (total variation). With this in mind we
propose the following image segmentation algorithm
(Algorithm 1) named from now on S DT -Discrete.

Algorithm 1 S DT - Discrete an image segmentation


algorithm based on a fully discrete approach
Input: An input image v ‫ א‬V, the set C, an initial guess ‫ܷ א ݑ‬
and the parameters ߠ and ߙ ‫( א‬0, 1).
Output: The segmented image u* ‫ א‬U
normalize the image v and classes values to [0; 1]
while DTMIN < 0 do
෢் ሺ‫ݏ‬ሻ at each image element s
compute ܿෝప and ‫ܦ‬
evaluate DTMIN = mins{‫ܦ‬ ෢் ሺ‫ݏ‬ሻ; ‫ܦ‬
෢் ሺ‫ݏ‬ሻ < 0}
at each image element s make us = ܿෝప if ‫ܦ‬ ෢் ሺ‫ݏ‬ሻ ൑
ߙ‫்ܦ‬ெூே
end while
u* = u
At this point is interesting to remark that in the two
segmentation algorithms the adopted stop criteria was DTMIN •
0, however others could also be adopted. For example, a
criteria associated to the behavior of the cost functional could
be used, i.e., if in two consecutive iterations the cost function
decreased less than a given tolerance the algorithm stops. Also,
in the two algorithms we use the condition ‫ܦ‬ തതതത் ሺ‫ݏ‬ሻ ” ĮDTMIN to
determine the image elements whose class is to be modified.
Another approach could be adopted, e.g., let L DT be a list of
all image element s with negative topological derivative
ordered by this value, that is:
L DT (N) = {s1, s2, · · · , sN}, (20)

where DT (s1) ” DT (s2) ” · · · ” DT (sN) < 0 and N is the


number of image elements in this list. Then, the new strategy
is to modify the value of the segmented image elements us for
s ‫ א‬L DT (N) belonging to the N first elements of the list L DT
(N).

III. EXPERIMENTAL RESULTS Fig. 2 Proposed segmentation results (a) Endoscopic colour images,
The endoscopic images of size 128×128 sq. Pixels, (b) tumor segmentation using topological derivatives
containing cancerous tumors belonging to the region of
esophagus are obtained for experimentation. The proposed
segmentation algorithm will segment the input image into Figure 2 shows the results of proposed segmentation
three segments of different class of intensities. The term ȡ method for five endoscopic images containing tumors and
which is used to weight both terms in the cost function is set cancer growths. The proposed algorithm could clearly
to 0.85. The percentage of pixels to be reclassified in each segment the tumors and abnormal regions in the images
iteration is 0.5. containing tumors with distinct color and shape where as it
could segment vaguely for those images in which there is no
distinct boundary between the tumor and background region.

2010 International Conference on Signal and Image Processing 57


IV. CONCLUSIONS [5] C. R. Gonzalez and R. E.Woods, Digital Image Processing -Second
Edition, Prentice Hall, 2001.
In this paper the topological derivative are used as tool for [6] J. Suri, S. Singh, and K. Setarehdan, Eds., Advanced algorithmic
endoscopic image segmentation to segment possible tumors approaches to medical image segmentation: state-of-the-art
and cancerous growths. The topological derivative, originally applications in cardiology, neurology, mammography and pathology,
Springer-Verlag, 2001.
conceived for topology optimization problems, has proved to [7] K. H. Hohne, H. Fuchs, and S. M. Pizer, 3D imaging in medicine:
be useful when applied to image processing. algorithms, systems, applications, NewYork: Springer-Verlag, 1990.
In particular, image segmentation algorithms based on the [8] J.M. Fitzpatrick and M. Sonka ed., Medical Imaging - Volume III:
topological derivative associated to an appropriated functional Medical Image Analysis, May 2000.
[9] I. Larrabide, et.al., “Topological derivative as a tool for image
(indicating the cost endowed to a specific segmentation) were processing: Image segmentation,” LNCC - Laboratorio Nacional de
presented. In this algorithm the segmentation process is driven Computacao Cientifica, Tech. Rep., 2006.
by the information obtained with the topological derivative. [10] A. A. Novotny, “An´alise de sensibilidade topol´ogica,” PhD Thesis,
In the S DT í Continuous method the solution of a state and Laboratorio Nacional de Computac¸ ˜ao Cient´ıfica, Petr´opolis - RJ -
Brazil, 2003.
adjoint equation are necessary to be obtained in order to [11] A. Novotny, R. Feij´oo, E. Taroco, and C. Padra, “Topological
evaluate the topological derivative. As a counterpart of its sensitivity analysis,” Computer Methods in Applied Mechanics and
Engineering, vol. 192, pp. 803–829, 2003.
computational cost, the S DT í Continuous appears to be [12] L. J. Belaid, M. Jaoua, M. Masmoudi, and L. Siala, “Image restoration
robust giving good quality segmentations even for high levels and edge detections by topological asymptotic expansion,” 2005,
masmoudi personal communication.
of noise. [13] D. Auroux, M. Masmoudi, and L. Belaid, “Image restoration and
classification by topological asymptotic expansion,” Variational
ACKNOWLEDGMENT Formulations in Mechanics: Theory and Applications - CIMNE,
This work is carried out with the support from the Research Barcelona, Spain, 2006.
[14] I. Larrabide, A. A. Novotny, R. A. Feijo, and E. Taroco, “A medical
project F. No. 34-104\2008 (SR), University Grant image enhancement algorithm based on topological derivative and
Commission, Government of India, anisotropic diffusion,” in Proceedings of CILAMCE 2005, Brazil, 2005.
[15] I. Larrabide, R. A. Feij´oo, A. A. Novotny, E. Taroco, and M.
REFERENCES Masmoudi, “An image segmentation method based on a discrete
version of the topological derivative,” in World Congress Structural
[1] Seitz U and Soehendra N., Endoscopy: current state and future trends
and Multidisciplinary Optimization 6, Rio de Janeiro. International
in tumor diagnosis, Anticancer Res. 2003 Mar-Apr; 23(2A):827-9.
Society for Structural and Multidisciplinary Optimization, 2005.
[2] B.V. Dhandra and Ravindra S. Hegadi, Endoscopic Image
[16] L. J. Belaid, M. Jaoua, M. Masmoudi, and L. Siala, “Image restoration
classification based on active contour without edges”, in proceedings
and edge detection by topological asymptotic expansion,” C. R. Acad.
of ICDIM-2006, IEEE Engineering Management Society, p. 167-172.
Sci. S´er. I, vol. 342, no. 5, 2006.
[3] D. Mumford and J. Shah, “Optimal approximations by piecewise
[17] I. Larrabide, A. A. Novotny, R. A. Feij´oo, and E. Taroco,
smooth functions and associated variational problems,”
“Topological derivative as a tool for image processing: Image
Communications on Pure and Applied Mathematics, vol. 42, pp. 577–
segmentation,” LNCC - Laborat´orio Nacional de Computac¸ ˜ao
684, 1989.
Cient´ıfica, Tech. Rep., 2006.
[4] A. K. Jain, Fundamentals of Digital Image Processing, Prentice Hall,
1989.

58 2010 International Conference on Signal and Image Processing

You might also like