Professional Documents
Culture Documents
net/publication/266525278
CITATIONS READS
45 246
4 authors, including:
Anitha Jude
Karunya University
105 PUBLICATIONS 999 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
Application of Pseudo 2-D Hidden Markov Model for Hand Gesture Recognition View project
All content following this page was uploaded by Jude Hemanth D on 24 June 2015.
**
Christian Engineering College, Oddanchatram, India
Abstract: Brain tumor image classification and segmentation are an important but inherently difficult problem
in magnetic resonance (MR) medical images. Artificial neural networks employed for image classification
problems do not guarantee high accuracy besides being computationally heavy. The necessity for a large
training set to achieve high accuracy is another drawback of ANN. On the other hand, fuzzy logic technique
which promises better accuracy depends heavily on expert knowledge, which may not always available. Even
though it requires less convergence time, it rely on trial and error method in selecting either the fuzzy
membership functions or the fuzzy rules. These problems are overcome by the hybrid model namely, neuro-
fuzzy model. This system removes the stringent requirements since it enjoys the benefits of both ANN and the
fuzzy logic systems. In this paper, the application of Adaptive neuro-fuzzy inference systems (ANFIS) for MR
brain tumor classification has been demonstrated. Abnormal brain tumor images from four classes namely
metastase, meningioma, glioma and astrocytoma are used in this work. A comprehensive feature set and fuzzy
rules are selected to classify an abnormal image to the corresponding tumor type. Experimental results
illustrate promising results in terms of classification accuracy and convergence rate. A comparative analysis is
performed with the representatives of ANN and fuzzy systems to show the superior nature of ANFIS systems.
Keywords : ANFIS, Brain tumor, Classification accuracy, MR images, Neurofuzzy.
95
International Journal of Biomedical Soft Computing and Human Sciences, Vol.16,No.1 (2010)
On the other hand, several researches based on fuzzy from radiologist), pre-processing, feature extraction and
logic techniques are also reported in the literature. classification.
Marcin Denkowski [13] used rule based fuzzy logic
inference for MR brain image classification. MR image database
Experiments based on fuzzy C-means algorithm are also
proposed in the literature [14].Yang and Zheng [15]
Pre-processing
implemented a modified fuzzy C-means algorithm for
image classification. The fuzzy set theoretic models try
to mimic human reasoning and the capability of GLCM based feature
handling uncertainty, whereas the neural network extraction
models attempt to emulate the architecture and
information representation schemes of the human brain.
Integration of the merits of the fuzzy set theory and BPN based ANFIS based Fuzzy based
neural network theory promises to provide, to a great classification classification classification
extent, more intelligent systems to handle real life
problems. There have been several attempts by
researchers over the world in making a fusion of the Classified Classified Classified
merits of these theories under the heading neuro-fuzzy images images images
computing for improving the performance in decision
making systems. A neuro-fuzzy approach as a
combination of neural networks and fuzzy logic has
been introduced to overcome the individual weaknesses Performance evaluation
and to offer more appealing features. The ultimate goal & comparison
of applying such a system is to get rid of imprecise
information present in an image such as pixel greyness Figure 1. Proposed Methodology
ambiguity, geometrical segmentation of the image and
the uncertain interpretation of a scene. This exploits, The database consists of abnormal brain tumor images
respectively, the learning capabilities and the from four tumor types namely metastase, meningioma,
descriptive power of systems, thus providing results astrocytoma and glioma. The slices are acquired from
characterized by a high interpretability and good degree Devaki MRI and CT scans Madurai, INDIA. The
of accuracy [16]. The level of research in the area of images are 256*256 gray level images with intensity
neuro-fuzzy model for image classification is relatively value ranges from (0 to 255). Some samples of the MRI
low. Segmentation of images using neuro fuzzy model database have been displayed in Figure 2.
has been studied by Rami J. Oweis and Muna J. Sunna
[17] .Image segmentation using neuro fuzzy tools are
also implemented by Mausumi Acharyya [18]. ANFIS
is one of the widely used neuro-fuzzy systems.
In this work, the neuro-fuzzy based approach namely
adaptive neuro fuzzy inference system (ANFIS) is used
for MR brain tumor classification. The classes of (a) (b) (c) (d)
interest are the four tumor types namely metastase, Figure 2. Sample data set: (a)Metastase (b)Glioma
meningioma, glioma and astrocytoma. Several textural (c) Astrocytoma (d) Meningioma
features based on gray level co-occurence matrix are
extracted from these images and used along with a As a pre-processing step, the extra cranial skull
comprehensive set of fuzzy rules for classification. The tissues surrounding the soft brain tissues are removed
figure of merit used in this work is classification using the morphological operations. The skull extraction
accuracy and convergence rate. The performance algorithm used in this work is extracted from [19].
measures of ANFIS are compared with the results of the Feature extraction is the technique of data reduction
representatives of neural networks and fuzzy logic to find a subset of informative variables based on the
theory namely back propagation neural network and image. In this work, six textural features based on the
fuzzy nearest center classifier respectively. gray level co-occurence matrix (GLCM) are extracted
Experimental results prove the superior nature of from each image.
ANFIS over the neural networks and fuzzy theorotic The purpose of image classification system is to
approaches. assign each input to one of ‘c’ pattern classes. It is the
technique of assigning a label to each unknown input
2. Proposed Methodology image. In this work, the neuro fuzzy approach namely,
The methodology used for MR brain tumor image ANFIS is used to classify the images. The performance
classification is shown in Figure 1. The various stages measures used in this work are classification accuracy
of the proposed technique are MRI database (collected and convergence rate. The results are compared with the
96
D.J. Hemanth et al.: Application of Neuro-Fuzzy Model for MR Brain Tumor Image Classification
neural classifier and the fuzzy classifier to show the unit, fuzzification interface and a defuzzification
superior nature of ANFIS.. interface. By embedding the fuzzy inference system into
the framework of adaptive networks, a new architecture
3. Feature Extraction namely Adaptive neuro fuzzy inference system (ANFIS)
The purpose of feature extraction is to reduce the is formed which combines the advantages of neural
original data set by measuring certain properties, or networks and fuzzy theoretic approaches. In this work,
features, that distinguish one input pattern from another first order Sugeno model based ANFIS system is used
pattern. Six textural features based on gray level co- for brain tumor image classification.
occurrence matrices (GLCM) have been used in this
work. Spatial gray level co-occurrence estimates image 4.1. Fuzzy Rule Based Systems
properties related to second-order statistics. Harlick [20] Fuzzy if-then rules are highly concise and often
suggested the use of gray level co-occurrence matrices employed to capture the imprecise modes of reasoning
(GLCM) which have become one of the most well- that play an essential role in the human ability to make
known and widely used texture features. GLCM {P (d, θ) decisions in an environment of uncertainty and
(i, j)} represents the probability of occurrence of a pair imprecision. Fuzzy if-then rules can be viewed as a
of gray-levels (i, j) separated by a given distance d at local description of the system. The first step to proceed
angle θ. A detailed algorithm of calculation of GLCM with the fuzzy inference system is to frame a set of
{P (d, θ) (i, j)} has been given in [21]. The features such suitable fuzzy if-then rules. An example that describes a
as contrast, inverse difference moment, correlation, simple fact is:
variance, energy and entropy are calculated using the If temperature is 40 degree celsius, then climate is hot
formulae given below. where temperature is the linguistic variable and 40 C
Contrast: is the linguistic value which is characterized by the
(i − j ) p(i, j )
2 membership function.
SC = (1)
i j
In the proposed fuzzy system, six features are
calculated per image and hence the number of input
Inverse difference moment:
linguistic variables and linguistic values are six. The
1
SI = 1 + (i − j ) p(i, j )
i j
2
(2) number of output linguistic value is equal to the number
of patterns used in this work .A sample of fuzzy if-then
rules framed for the MR image classification is shown
Correlation:
below.
(ij ) p(i, j ) − μ x μy
SO =
i j
(3) If a is contrast1 and b is correlation1 and c is energy1
σ xσ y and d is entropy1 and e is IDM1 and f is variance1, then
output = 1
where μ x , μ y ,σ x ,σ y are the means and standard If a is contrast2 and b is correlation2 and c is energy2
and d is entropy2 and e is IDM2 and f is variance2, then
deviations of p x and py . output = 2
Variance: If a is contrast3 and b is correlation3 and c is energy3
(i − μ ) p(i, j )
2 and d is entropy3 and e is IDM3 and f is variance3, then
SV = (4)
i j
output = 3
If a is contrast4 and b is correlation4 and c is energy4
Energy:
2
and d is entropy4 and e is IDM4 and f is variance4, then
L −1
output = 4
S N = [ p(i, j )] (5) The number of membership functions used in this work
b =0
is 2 and hence there are 64 rules framed for this image
Entropy: classification system. These fuzzy if-then rules form the
L −1
input for the ANFIS architecture.
S E = − p(i, j ) log 2 {p(i, j )} (6)
b =0
4.2. ANFIS Architecture
The features used in this paper are selected based on the The structure of ANFIS consists of 6 inputs and single
previous works [20,22]. These features work well output.The six inputs represent the different textural
especially for MRI brain tumor images. features calculated from each image. Each of the
training sets forms a fuzzy inference system with sixty
4. Adaptive Neuro Fuzzy Inference System four fuzzy rules. Each input was given two generalized
An adaptive network is a multilayer feed forward bell curve membership functions and the output was
network in which each node performs a particular represented by two linear membership functions. The
function (node function) on incoming signals as well as outputs of the sixty four rules are condensed into one
asset of parameters pertaining to this node. Fuzzy single output, representing that system output for that
inference systems are the fuzzy rule based systems input image.
which consists of a rule base, database, decision making
97
International Journal of Biomedical Soft Computing and Human Sciences, Vol.16,No.1 (2010)
98
D.J. Hemanth et al.: Application of Neuro-Fuzzy Model for MR Brain Tumor Image Classification
and the cluster centers of the trained samples are corresponding to six features of each MR image. The
calculated. The testing data is assigned to the class with output layer consists of four neurons corresponding to
the cluster center whose distance is minimum. four predefined tumor categories in the classification.
When designing a neural network, one crucial and
difficult step is determining the number of neurons in
the hidden layers. The hidden layer is responsible for
5.2. Algorithm internal representation of the data and the information
Fuzzy c-means algorithm is based on minimization of transformation input and output layers. If there are too
the following objective function: few neurons in the hidden layer, the network may not
c c n contain sufficient degrees of freedom to form a
J (U , c1 , c2 ,..., cc ) = J i = uij d ij
m 2
(13) representation. If too many neurons are defined, the
i =1 i =1 j =1 network might become over trained. Therefore, an
uij is between 0 and 1; optimum design for the number of neurons in the hidden
ci is the centroid of cluster i; layer is required. In this research, we used one hidden
dij is the Euclidian distance between ith centroid (ci) and layer with 15 neurons.
jth data point.
m є [1,∞] is a weighting exponent. 6.2. Training Algorithm
Step 1 There are several training algorithms for feed forward
Fuzzy partitioning of the known data sample is carried networks. All these algorithms use the gradient of the
out through an iterative optimization of the objective performance function to determine how to adjust the
function shown in eqn (13), with the update of weights to minimize performance. The gradient is
membership u ij and the cluster centers c i by: determined using a technique called back propagation,
which involves performing computational backwards
1
n m
uij x j through the network. The simplest implementation of
uij = 2/(m−1) ; ci =
j =1
(14) back propagation learning adjusts the network weights
dij
n
u
m
k=1d
c in the direction in which the performance function
j =1 ij
decreases more rapidly. The algorithm used in this work
kj is extracted from [25].
At the (k+1)th iteration, if u (k + 1) − u (k ) < ε , then
7. Results and Discussions
the classifier is assumed to have reached the stabilized
This section presents the experimental results of the
condition. A detailed explanation is given in [24].
three classifiers namely ANFIS, fuzzy classifier and
Step 2
neural classifier on 460 abnormal brain images from
Observe the cluster center of the tumor region for all the
four different tumor types. A comparative analysis is
training samples. Store the cluster centers A1, A2, A3
performed between the classifiers based on
and A4 which corresponds to the four tumor types
classification accuracy and convergence rate. The
namely metastase, meningioma, glioma and
results are validated by human experts (radiologists)
astrocytoma.
from leading scan centres. Initially, the results of
Step 3:
ANFIS is analysed which is followed by the
For a new data, calculate the Euclidean distance
experimental analysis of fuzzy classifier and neural
between the data and all the cluster centers of the
classifier. Since the neuro-fuzzy system is used for
training samples.
classification, the prime figure of merit is classification
Step 4:
accuracy. Classification accuracy is the ratio of the total
Assign the data to the class with the cluster center
number of correctly classified images to the total
whose Euclidean distance is minimum.
number of misclassified images. Table 2 shows the
d ( X , Ai ) = min{d ( X , Ak )} (15) performance measure of ANFIS. (18)
1≤ k ≤ 4
The threshold value ( ε ) used in this work is 0.01. This
algorithm associates the image into any one of the four Table 2.Classification accuracy results of the ANFIS
different tumor types based on the cluster center of the Class TI CCI MI CA (%)
tumor region. Metastas 93 86 7 92.5
Meningioma 88 79 9 89.7
6. Back Propagation Neural Network Astrocytoma 77 72 5 93.5
Back propagation network is the primarily used Glioma 82 80 2 97.5
supervised artificial neural network. Prior to training, TI = Testing images; CCI = Correctly classified
the selection of architecture plays a vital role in images;MI = Misclassified images; CA = Classification
determining the classification accuracy. accuracy.
6.1. Network Design From the above table, it is evident that the
In this work, a three layer network is developed. The misclassification rate of meningioma tumor images is
input layer of network consists of six neurons,
99
International Journal of Biomedical Soft Computing and Human Sciences, Vol.16,No.1 (2010)
low. The reason behind this inferior classification From the above table, it is clearly evident that ANFIS
accuracy is the sparse distribution of the abnormal yields superior results than the other classifiers. The
tissues. The average classification accuracy of ANFIS main drawback of fuzzy nearest center classifier is the
architecture is 93.3%. selection of initial cluster center values. The fuzzy
Another performance measure used to analyse the nearest center classifier yields inferior classification
ANFIS architecture is the convergence rate. The accuracy as the initial seed points are selected randomly.
average training time period for 120 images is 1200 The convergence time period is also very high because
CPU secs and the average testing time period for 340 it requires updation of membership values and cluster
images is 340 secs. The total convergence rate of centers in an iterative manner. On the other hand, BPN
ANFIS is 1540 CPU secs. It is also analysed in terms of classifiers are computationally heavy since the network
mean square error of the training and testing process. has to be trained iteratively to achieve stabilization. It
The average training error is 0.001 and the testing error also does not guarantee high classification accuracy
0.15.Table 3 shows the results for the fuzzy classifier. because it requires large training data set which is not
practically feasible. Since the ANFIS classifier
Table 3. Classification accuracy results of the fuzzy combines the merits of both the neural classifier and the
classifier fuzzy classifier, it yields superior results than the other
classifiers. Figure 3 illustrates the simulated plot for the
Class TI CCI MI CA (%) comparison of the three classifiers in terms of training
Metastase 93 83 10 89.3 and testing error.
Meningioma 88 76 12 86.4
Astrocytoma 77 69 8 89.6 Table 5. Overall comparison of the classifiers
Glioma 82 73 9 89.0 Classifier Average Average Average
TI = Testing images; CCI = Correctly classified classification convergence Mean
images;MI = Misclassified images; CA = Classification accuracy time period square
accuracy. (%) (CPU secs) error
ANFIS 93.3 1540 0.151
Table 3 depicts the inferior classification accuracy of Fuzzy 88.6 15380 0.25
the meningioma tumor images. The classification classifier
accuracy of the other tumor types is approximately BPN 85.65 16245 0.37
equal. The overall classification accuracy is 88.6%.
The convergence rate of the fuzzy classifier is
inferior to the ANFIS classifier. The total convergence 0.9
rate of the fuzzy classifier is 15380 CPU secs which are
almost ten times higher than the fuzzy classifier. The 0.8
0.6
Meningioma 88 72 16 81.8
Astrocytoma 77 67 10 87.0 0.2 ANFIS
Glioma 82 72 10 87.8
TI = Testing images; CCI = Correctly classified 0.1
0 20 40 60 80 100 120 140 160 180 200
images;MI = Misclassified images; CA = Classification Epochs
The classification accuracy of all the tumor types are Figure 3 shows the superior nature of ANFIS over the
comaparitively lesser than the classification accuracy of other classifiers in terms of training and testing error.
ANFIS and fuzzy classifiers. The overall classification The three classifiers are subjected to 200 iterations and
accuracy is 85.65%. The back propagation neural the overall training and testing error curves are
classifiers are also computationally heavy. The simulated. The error rate of fuzzy classifier and the
convergence rate of the neural classifier is neural classifier are high as they suffer from the
approximately 16245 CPU secs. This includes the drawbacks of random initial cluster center selection and
training and testing time of the 420 abnormal brain requirement of large training data set respectively.
images. The mean square error is also considerably high.
The average training and testing error is 0.37. Table 5
list the resultsof all the classifiers.
100
D.J. Hemanth et al.: Application of Neuro-Fuzzy Model for MR Brain Tumor Image Classification
101
International Journal of Biomedical Soft Computing and Human Sciences, Vol.16,No.1 (2010)
102