Professional Documents
Culture Documents
net/publication/319077636
CITATIONS READS
3 179
1 author:
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Automatic Construction of Immobilisation Masks for use in Radiotherapy Treatment of Head-and-Neck Cancer View project
Automatic Detection and Classification of the Ghor-area Plant Diseases View project
All content following this page was uploaded by Mohammad Hashem Ryalat on 04 November 2019.
1 Introduction
Image segmentation is the process of dividing an image into multiple parts.
Every pixel in an image is allocated to one of a number of these parts. The
aim of segmentation process is to simplify the representation of an image into
something that is more meaningful and easier to analyze [1].
Image segmentation is one of the most important steps that should take
place in the treatment process in order to benefit from the medical images pro-
duced by the modern imaging modalities such as computed tomography (CT)
and magnetic resonance imaging (MRI). Segmentation of medical images can
be performed manually, automatically (computerized) or using a combination
2 Mohammad Hashem Ryalat et al.
modified bacterial foraging algorithm was used in [8], artificial bee colony in [9],
Cuckoo search algorithm and wind driven optimization in [10], particle swarm
optimisation based in [11], differential evolution in [12] and genetic algorithms
in [13]).
Particle swarm optimization (PSO) is a population based stochastic opti-
mization algorithm developed in 1995 [14] inspired by social behavior of bird
flocking or fish schooling in search of food. It is basically initialized with a pop-
ulation of random solutions and searches for optima by updating generations.
The basic drawback of the PSO algorithm is that their is a possibility, as other
optimisation algorithms, to be trapped in a local optima. Darwinian particle
swarm optimization (DPSO) introduced in 2005 [15] as an extension to the PSO
algorithm by adding the natural selection mechanism (i.e. survival of the fittest)
to improve the ability of the PSO algorithm to escape from local optima. In
DPSO, many parallel PSO algorithms, each one forms a swarm, operate on the
same search space. The fractional-order Darwinian PSO (FODPSO) [16] was de-
veloped in 2011 and published in 2012 as an extension to the DPSO algorithm.
In the FODPSO, fractional calculus concepts are used in order to control the
convergence rate of the DPSO.
Few studies have applied the PSO, DPSO and FODPSO algorithms on image
segmentation (e.g. the authors of [17] applied those algorithms over hyperspec-
tral remote sensing images which contain numerous number of data channels).
In the context of medical images, there are a number of studies that applied
the traditional form of the PSO algorithm to segment medical images (e.g [18],
[19], [20], [21], [22]). This paper compares and validates the PSO, DPSO and
FODPSO algorithms, when using with medical images, in terms of speed, accu-
racy and stability of results. It also develops, using the FODPSO algorithm, a
new procedure to remove automatically the masks that are normally appeared
in CT images for those patients who are undergoing radiotherapy treatment for
tumours affecting the head and neck. In addition to that, this paper employs the
three PSO-based algorithms in: MRI image segmentation and CT volume recon-
struction. The experiments prove the gained speed and accuracy of PSO-based
algorithms when they are used in those mentioned applications.
The remaining sections of this paper is organised as follows. Section 2 gives
an overview on the PSO, DPSO and FODPSO algorithms. Section 3 presents
the datasets, experiments, applications and results of the work. Finally, Section
4 concludes this study.
vid and position Xid are updated at each iteration k. Each particle has a kind of
memory which stores the position where it had the lowest cost (Xpbestid ), and
the position of the best particle in the population (Xgbestd ).
Vid (k) = wvid (k −1)+c1 r1id (k)(Xpbestid −Xid )+c2 r2id (k)(Xgbestd −Xid ) (1)
to a local optimum, the search in that area is basically ignored and another area is
searched instead. More than one swarm is exist in DPSO. Each swarm separately
behaves like a normal PSO algorithm with some rules controlling the group of
swarms that are intended to simulate natural selection.
Algorithm 2 displays the internal processes that are performed by the DPSO
algorithm. The algorithm starts by setting initial values in a collection of pa-
rameters. Those parameters include number of swarms, maximum and minimum
possible number of swarms, maximum and minimum possible population size in
addition to the basic parameters of the traditional PSO. It is worthy to notice
that the swarm in the DPSO algorithm spawns (reproduce) a new particle if
it finds a new global best, and a particle is removed if the swarm has been
unsuccessful to find a more fit status in a fixed number of steps.
The basic idea that stands behind the FODPSO algorithm is that this algorithm
utilises the fractional calculus concepts in order to control the convergence rate
of the DPSO algorithm. Those systems that comprise the using of fractional
processes reveal residual memory and their fractional order is understood as a
measure of the memory strength [24] [25].
Equation 3 presents the Grunwald-Letnikov description based on the concept
of fractional differential of a general signal x(t):
+∞
1 X (−1)k Γ (α + 1)x(t − kh)
α
D [x(t)] = lim (3)
h→0 hα Γ (k + 1)Γ (α − k + 1)
k=0
where Γ is the gamma function and α is the fractional coefficient such that α ∈
C. It is worthy to notice that while an integer-order derivative is evaluated as
an finite series, the fractional-order derivative is evaluated as an infinite number
of terms. Consequently, integer-order derivative behaves like a local operator,
while fractional-order derivative behaves like a structure that has a memory of
all past events [16].
3 Experimental Works
in this study to classify each point in the MRI image under specific class and
validate that process. Instead, we explore the feasibility of applying the PSO,
DPSO and FODPSO algorithms, in the field of medical images segmentation, in
terms of:
In order to evaluate the accuracy of the results generated by each one of the
three optimisation algorithms (i.e. PSO, DPSO and FODPSO), we measured the
fitness (i.e. inter-class variance) for each algorithm and compared the outcomes
with the brute-force (exhaustive search) method. Since brute-force method ex-
plores all the different combinations of threshold values, then it will certainly
find the optimal threshold(s) and the optimal fitness value. Table 2 presents the
average fitness values generated by the PSO, DPSO and FODPSO algotithms
against the fitness value generated by the brute-force method. We run PSO,
DPSO and FODPSO algorithms 50 times since those optimisation algorithms
are stochastic and random. We calculate the average fitness values for 1, 2, 3
and 4 thresholds.
It is obvious from Table 2 that the three optimisation algorithms achieved
fitness values which are either the same or very closed to the fitness value gen-
erated by the brute-force method. In general, the accuracy (fitness value) of
FODPSO and DPSO were better than the accuracy of the PSO algorithm. The
FODPSO algorithm has either the same value or a slightly better fitness value
when compared to the DPSO algorithm. Although the fitness values of the three
algorithms were closed to the one of the brute-force method, we can notice that
as the number of thresholds increase, the differences between fitness values of the
three optimisation algorithms and the one of the brute-force method increases
but marginally. Fortunately, The trend of the results is the same for the three
test images which supports the robustness of the procedure. The average optimal
threshold(s) that were generated by PSO, DPSO and FODPSO against the ones
generated by the brute-force method are presented in Table 3. The readings of
this table supports the fact that PSO algorithm is prone to give a local maxima.
In order to evaluate the speed of each algorithm, we measured the average
CPU processing time that PSO, DPSO, FODPSO and brute-force methods need
Evaluation of Particle Swarm Optimisation for Medical Image Segmentation 9
Table 2: Average fitness values of Brute-Force, PSO, DPSO and FODPSO algo-
rithms for different number of thresholds over three MRI images.
Image No. Thresholds Brute-Force PSO DPSO FODPSO
Image1 1 1985.55 1984.78 1985.55 1985.55
2 2218.33 2216.98 2218.33 2218.33
3 2273.58 2272.91 2273.38 2273.49
4 2300.49 2297.44 2299.21 2299.27
Table 3: Average thresholds of PSO, DPSO and FODPSO over three MRI images
against the thresholds coming from Brute-Force.
No. Thresholds Brute-Force PSO DPSO FODPSO
Img1 1 {582} {575} {582} {582}
2 {418, 1077} {407, 1066} {418, 1077} {418, 1077}
3 {341, 835, 1242} {330, 824, 1231} {343, 837, 1244} {342, 837, 1244}
4 {275,681,1022,1374} {256, 655, 996, 1346} {270, 672, 1015, 1363} {270, 672, 1012, 1358}
to produce results. Table 4 presents the average execution time in seconds for
each method. It is obvious from the readings in that table that the FODPSO al-
gorithm is always faster than the DPSO algorithm with a slight difference where
the DPSO algorithm is faster than PSO algorithm with significant difference.
Table 4: Average execution time (in sec) of the Brute-Force, PSO, DPSO and
FODPSO over three MRI images.
No. Thresholds Brute-Force PSO DPSO FODPSO
Img1 1 0.1168 0.2792 0.1225 0.1118
2 1.466 0.4376 0.3732 0.3501
3 158.8388 0.5575 0.4575 0.4373
4 14623 0.6840 0.5490 0.5170
Since PSO, DPSO and FODPSO algorithms are stochastic and random, then
there is a possibility to have different results in each run. In order to evaluate the
stability of the three optimisation algorithms, we used the standard deviation
as an evaluation metric of stability by finding the deviation of the fitness value
generated in each run. Table 5 presents the calculated standard deviation for
each algorithm in different cases.
Table 5: Standard deviation of the PSO, DPSO and FODPSO after running each
algorithm 50 times over three MRI images.
No. Thresholds PSO DPSO FODPSO
Img1 1 0.8134 0.0259 0.0213
2 0.9821 0.0329 0.0255
3 1.1711 0.6257 0.0341
4 1.2513 0.4251 0.1002
Img3 1 0.0251 0 0
2 0.0011 0 0
3 0.0966 0.0622 0.0112
4 0.3227 0.1925 0.0409
It is obvious that the measured values of standard deviation are low for the
PSO, DPSO and FODPSO algorithms which means that we can consider our
implementation of them over medical images is stable. FODPSO is the most
stable one when compared to the PSO and DPSO. It can be concluded from
Table 5 that the standard deviation values increase as the number of thresholds
increase in most cases. We present in Figure 2 the results of segmentation when
applying the FODPSO algorithm over the three MRI images using different
number of thresholds.
Fig. 2: Results of segmentation when applying FODPSO over the three MRI
images using different number of thresholds
Evaluation of Particle Swarm Optimisation for Medical Image Segmentation 13
applied the other three algorithms to be compared with the FODPSO algorithm
in terms of speed. We used Marching cubes algorithm [30] to construct the
volume from the stack of segmented images.
The three objects that were used in this part of the study is shown in Fig.
3. The first object is a 3D-printed scaled head of a Cantonese chess piece that
were delicately carved from ivory throughout the 19th Century. This object was
produced using 3D-printing techniques by Laycock et al. [31]. A CT data set (512
x 512 x 180, helical, pitch = 0.562:1, collimation 16x0.625 mm (10mm)) of this
head was acquired at Ipswich Hospital. The second dataset is a plastic object in a
shape of nested cubes where the third dataset is a plastic hemisphere. The second
and third datasets were initially designed digitally with known dimensions and
then printed in the 3D printing lab in computing sciences school at University
of East Anglia. CT data sets of those two objects were acquired (helical, pitch =
0.562:1, collimation 16x0.625 mm (10mm), 512 x 512 x 60 for the nested cubes,
512 x 512 x 129 for the hemisphere). Figure 4 displays one example CT slice for
each object.
Fig. 3: The three objects that were used in this part of study (section 3.2) to
investigate the speed of volume reconstruction using different algorithms.
between the brute-force, PSO, DPSO and FODPSO algorithms when they are
used in segmentation to construct 3D models. The table gives the required time
for constructing the mesh, in seconds, for the three objects (i.e. the Cantonese
head, nested cubes and the hemisphere).
Fig. 5: The (a)Cantonese head (b) Nested cubes and (c) The hemisphere depicted
in 3D Max after we applied the FODPSO algorithm and Marching cubes.
Table 6 shows clearly that the FODPSO algorithm is the fastest algorithm
to construct a volume when applying it over any one of the three objects where
the PSO was the slowest one. It is also obvious from that table that the speed
of DPSO algorithm is very closed to the speed of the brute-force method. It is
worthy to notice that in order to construct a volume from the CT images, we
chose the number of thresholds to be equal to one (i.e. number of thresholds = 1)
for the 2D segmentation process. Consequently the difference in CPU execution
time between the brute-force method and the FODPSO algorithm will not be
significant to a high level. We recommend using FODPSO algorithm as a mean
of segmentation to construct volumes as the total number of slices is large since
this will make a direct reflect on the total required time for the construction
process.
Evaluation of Particle Swarm Optimisation for Medical Image Segmentation 15
(a) (b)
Fig. 6: (a) The input CT image with a mask. (b) The same image after using
FODPSO algorithm to segment it.
Fig 8.
(a) (b)
Fig. 8: A snap shot that displays pixel values after segmentation using Image
Viewer App in MATLAB where red squares represent the pixels that form the
mask.
6. Get the copyImage and set all the pixels on this image that lies on the
same locations as indices to Vbackground . This modified image represents the
output image which does not include the mask as Fig 9 displays.
We find that setting the number of thresholds to be equal to five when apply-
ing the FODPSO algorithm will lead to better results when compared to other
number of thresholds. Setting the number of thresholds to five means that the
algorithm will segment the image into five different classes in addition to the
background class. This number of thresholds will classify all or most of the pix-
Evaluation of Particle Swarm Optimisation for Medical Image Segmentation 17
els that belong to mask under the same class. We applied our procedure over
a group of images for the same subject. Our experiments produced correct re-
sults over 90% of the tested images. However, the proposed procedure needs
more investigation over more than one dataset in order to generalise its use and
applicability.
4 Conclusion
This paper investigated the advantages gained when applying the PSO, DPSO
and FODPSO algorithms in the field of medical images segmentation. The results
showed that the FODPSO is a superior algorithm in terms of speed, accuracy
and stability of results when using over dicom images.
In order to benefit from the PSO-based algorithms, some arguments (such as
search space, candidate solutions and global optima) are needed to be correctly
defined, perceived and grasped according to field of the study. We customised
those arguments and showed the exact meaning of it in the field of medical image
segmentation.
To present the success and superiority of the FODPSO algorithm , we com-
pared it with PSO, DPSO and brute-force methods. The reason for selecting
those algorithms for comparison is due to that there are other studies reported
the superiority of the PSO over bacterial foraging algorithm [7] in terms of speed,
PSO over ant colony optimization, genetic algorithms, tabu search and simulated
annealing [32] in terms of accuracy and speed, PSO over genetic algorithms in
terms of speed and stability [33], and since the experimental works in this study
revealed that the FODPSO algorithm exceeds significantly the PSO algorithms
in terms of speed, accuracy and stability. That two facts implies the superiority
of the FODPSO over those algorithms.
The paper utilized the FODPSO algorithm by applying it in three medical
applications: MRI image segmentation, volume reconstruction from CT images,
and development of a new procedure to be used to remove automatically the
masks that are normally appeared in CT images for those patients who have
head-and-neck cancer and undergoing radiotherapy treatment.
The objective function that was used in this study is Otsu criterion (i.e. inter-
class variance). The future direction of this research will be investigating the
18 Mohammad Hashem Ryalat et al.
References
1. Lauren Barghout and Lawrence Lee. Perceptual information processing system,
July 11 2003. US Patent App. 10/618,543.
2. Zhen Ma, João Manuel RS Tavares, Renato Natal Jorge, and T Mascarenhas.
A review of algorithms for medical image segmentation and their applications
to the female pelvic cavity. Computer Methods in Biomechanics and Biomedical
Engineering, 13(2):235–246, 2010.
3. Nobuyuki Otsu. A threshold selection method from gray-level histograms. Auto-
matica, 11(285-296):23–27, 1975.
4. Mehmet Sezgin et al. Survey over image thresholding techniques and quantitative
performance evaluation. Journal of Electronic imaging, 13(1):146–168, 2004.
5. Ping-Sung Liao, Tse-Sheng Chen, Pau-Choo Chung, et al. A fast algorithm for
multilevel thresholding. J. Inf. Sci. Eng., 17(5):713–727, 2001.
6. SMR Soroushmehr, A Bafna, S Schlosser, K Ward, H Derksen, and K Najarian. Ct
image segmentation in traumatic brain injury. In 2015 37th Annual International
Conference of the IEEE Engineering in Medicine and Biology Society (EMBC),
pages 2973–2976. IEEE, 2015.
7. Raghavendra V Kulkarni and Ganesh Kumar Venayagamoorthy. Bio-inspired algo-
rithms for autonomous deployment and localization of sensor nodes. IEEE Trans-
actions on Systems, Man, and Cybernetics, Part C (Applications and Reviews),
40(6):663–675, 2010.
8. PD Sathya and R Kayalvizhi. Modified bacterial foraging algorithm based multi-
level thresholding for image segmentation. Engineering Applications of Artificial
Intelligence, 24(4):595–615, 2011.
9. Ming-Huwi Horng. Multilevel thresholding selection based on the artificial bee
colony algorithm for image segmentation. Expert Systems with Applications,
38(11):13785–13791, 2011.
10. Ashish Kumar Bhandari, Vineet Kumar Singh, Anil Kumar, and Girish Kumar
Singh. Cuckoo search algorithm and wind driven optimization based study of
satellite image segmentation for multilevel thresholding using kapur’s entropy. Ex-
pert Systems with Applications, 41(7):3538–3560, 2014.
11. Pedram Ghamisi, Micael S Couceiro, JóN Atli Benediktsson, and Nuno MF Fer-
reira. An efficient method for segmentation of images based on fractional calculus
and natural selection. Expert Systems with Applications, 39(16):12407–12417, 2012.
12. Erik Cuevas, Daniel Zaldivar, and Marco Pérez-Cisneros. A novel multi-threshold
segmentation approach based on differential evolution optimization. Expert Sys-
tems with Applications, 37(7):5265–5271, 2010.
13. Chih-Chin Lai and Din-Chang Tseng. A hybrid approach using gaussian smoothing
and genetic algorithm for multilevel thresholding. International Journal of Hybrid
Intelligent Systems, 1(3, 4):143–152, 2004.
14. Russ C Eberhart, James Kennedy, et al. A new optimizer using particle swarm
theory. In Proceedings of the sixth international symposium on micro machine and
human science, volume 1, pages 39–43. New York, NY, 1995.
15. Jason Tillett, T Rao, Ferat Sahin, and Raghuveer Rao. Darwinian particle swarm
optimization. 2005.
Evaluation of Particle Swarm Optimisation for Medical Image Segmentation 19
16. Micael S Couceiro, Rui P Rocha, NM Fonseca Ferreira, and JA Tenreiro Machado.
Introducing the fractional-order darwinian pso. Signal, Image and Video Process-
ing, 6(3):343–350, 2012.
17. Pedram Ghamisi, Micael S Couceiro, Fernando ML Martins, and Jon Atli Benedik-
tsson. Multilevel image segmentation based on fractional-order darwinian parti-
cle swarm optimization. IEEE Transactions on Geoscience and Remote sensing,
52(5):2382–2394, 2014.
18. Samy Ait-Aoudia, El-Hachemi Guerrout, and Ramdane Mahiou. Medical image
segmentation using particle swarm optimization. In 2014 18th International Con-
ference on Information Visualisation, pages 287–291. IEEE, 2014.
19. Kaiping Wei, Bin He, Tao Zhang, and Xianjun Shen. A novel method for segmen-
tation of ct head images. In 2007 1st International Conference on Bioinformatics
and Biomedical Engineering, pages 717–720. IEEE, 2007.
20. Ahmed Afifi, Toshiya Nakaguchi, Norimichi Tsumura, and Yoichi Miyake. Particle
swarm optimization based medical image segmentation technique. Medical Imaging
Technology, 28(1):53–62, 2010.
21. Devraj Mandal, Amitava Chatterjee, and Madhubanti Maitra. Robust medical
image segmentation using particle swarm optimization aided level set based global
fitting energy active contour approach. Engineering Applications of Artificial In-
telligence, 35:199–214, 2014.
22. Ehsan Shahamatnia and Mohamad Mehdi Ebadzadeh. Application of particle
swarm optimization and snake model hybrid on medical imaging. In 2011 IEEE
Third International Workshop on Computational Intelligence In Medical Imaging,
pages 1–8. IEEE, 2011.
23. Ivo Petráš. Fractional derivatives, fractional integrals, and fractional differential
equations in matlab. Engineering Education and Research Using MATLAB, In-
Tech, kap, 10:239–264, 2011.
24. Toma Marinov, Nelson Ramirez, and Fidel Santamaria. Fractional integration
toolbox. Fractional Calculus and Applied Analysis, 16(3):670–681, 2013.
25. KB Oldham and J Spanier. (1974). the fractional calculus: Theory and ap-
plications of differentiation and integration to arbitrary order. new york: Aca-
demic.(republished by mineola. 2006.
26. N Hema Rajini and R Bhavani. Classification of mri brain images using k-nearest
neighbor and artificial neural network. In Recent Trends in Information Technology
(ICRTIT), 2011 International Conference on, pages 563–568. IEEE, 2011.
27. Lynn M Fletcher-Heath, Lawrence O Hall, Dmitry B Goldgof, and F Reed
Murtagh. Automatic segmentation of non-enhancing brain tumors in magnetic
resonance images. Artificial intelligence in medicine, 21(1):43–63, 2001.
28. Florin Gorunescu. Data mining techniques in computer-aided diagnosis: Non-
invasive cancer detection. PWASET, 25:427–430, 2007.
29. Chen Wei and Fang Kangling. Multilevel thresholding algorithm based on par-
ticle swarm optimization for image segmentation. In 2008 27th Chinese Control
Conference, pages 348–351. IEEE, 2008.
30. William E Lorensen and Harvey E Cline. Marching cubes: A high resolution 3d
surface construction algorithm. In ACM siggraph computer graphics, volume 21,
pages 163–169. ACM, 1987.
31. Stephen D Laycock, Graham D Bell, David B Mortimore, Mark K Greco, Nick
Corps, and Irving Finkle. Combining x-ray micro-ct technology and 3d printing
for the digital preservation and study of a 19th century cantonese chess piece
with intricate internal structure. Journal on Computing and Cultural Heritage
(JOCCH), 5(4):13, 2012.
20 Mohammad Hashem Ryalat et al.
32. Kamal Hammouche, Moussa Diaf, and Patrick Siarry. A comparative study of
various meta-heuristic techniques applied to the multilevel thresholding problem.
Engineering Applications of Artificial Intelligence, 23(5):676–688, 2010.
33. PD Sathya and R Kayalvizhi. Pso-based tsallis thresholding selection procedure for
image segmentation. International Journal of Computer Applications, 5(4):39–46,
2010.