Professional Documents
Culture Documents
Decision Support System For Medical Diagnosis Using Data Mining
Decision Support System For Medical Diagnosis Using Data Mining
1, May 2011
ISSN (Online): 1694-0814
www.IJCSI.org 147
2,3
Department of Computer Science and Engineering, Anna University of Technology,
Tiruchirappalli, Tamil Nadu, India
algorithms devised for the purposes outlined above. Campos-Delgado et al. developed a fuzzy-based controller
Section IV illustrates conclusions. that incorporates expert knowledge to regulate the blood
glucose level.Magni and Bellazzi devised a stochastic
Decision support systems are defined as interactive model to extract variability from a self-monitoring blood
computer based systems intended to help decision makers sugar level time series [17].
utilize data and models in order to identify problems, solve Diaconis,P. & Efron,B. (1983) developed an expert system
problems and make decisions. They incorporate both data to classify hepatitis of a patient. They used Computer-
and models and they are designed to assist decision Intensive Methods in Statistics.
makers in semi-structured and unstructured decision Cestnik,G., Konenenko,I, & Bratko,I. designed a
making processes. They provide support for decision Knowledge-Elicitation Tool for Sophisticated Users in the
making, they do not replace it. The mission of decision diagnosis of hepatitis.
support systems is to improve effectiveness, rather than
the efficiency of decisions [19]. Chen argues that the use
of data mining helps institutions make critical decisions 3. Analysis and results
faster and with a greater degree of confidence. He believes
that the use of data mining lowers the uncertainty in
decision process [20]. Lavrac and Bohanec claim that the 3.1 About the Datasets
integration of dm can lead to the improved performance of
The Aim of the present study is the development and
DSS and can enable the tackling of new types of problems
evaluation of a Clinical Decision Support System for the
that have not been addressed before. They also argue that
treatment of patients with Heart Disease, diabetes and
the integration of data mining and decision support can
hepatitis. According to one survey, heart disease is the
significantly improve current approaches and create new
leading cause of death in the world every year. Just in the
approaches to problem solving, by enabling the fusion of
United States, almost 930,000 people die and its cost is
knowledge from experts and Knowledge extracted from
about 393.5 billion dollars. Heart disease, which is usually
data [19].
called coronary artery disease (CAD), is a broad term that
can refer to any condition that affects the heart. Many
CAD patients have symptoms such as chest pain (angina)
2. Overview of related work and fatigue, which occur when the heart isn't receiving
adequate oxygen. Nearly 50 percent of patients, however,
Up to now, several studies have been reported that have have no symptoms until a heart attack occurs.
focused on medical diagnosis. These studies have applied Diabetes mellitus is a chronic disease and a major
different approaches to the given problem and achieved public health challenge worldwide. According to the
high classification accuracies, of 77% or higher, using the International Diabetes Federation, there are currently 246
dataset taken from the UCI machine learning repository million diabetic people worldwide, and this number is
[1]. Here are some examples: expected to rise to 380 million by 2025. Furthermore, 3.8
Robert Detrano’s [6] experimental results showed correct million deaths are attributable to diabetes complications
classification accuracy of approximately 77% with a each year. It has been shown that 80% of type 2 diabetes
logistic-regression-derived discriminant function. complications can be prevented or delayed by early
The John Gennari’s [7] CLASSIT conceptual clustering identification of people at risk. The American Diabetes
system achieved 78.9% accuracy on the Cleveland Association [2] categorizes diabetes into type-1 diabetes
database. [17], which is normally diagnosed in children and young
L. Ariel [8] used Fuzzy Support Vector Clustering to adults, and type-2 diabetes, i.e., the most common form of
identify heart disease. This algorithm applied a kernel diabetes that originates from a progressive insulin
induced metric to assign each piece of data and secretory defect so that the body does not produce
experimental results were obtained using a well known adequate insulin or the insulin does not affect the cells.
benchmark of heart disease. Either the fasting plasma glucose (FPG) or the 75-g oral
Ischemic -heart:-disease (IHD) -Support .Vector Machines glucose tolerance test (OGTT [19]) is generally
serve as excellent classifiers and predictors and can do so appropriate to screen diabetes or pre-diabetes.
with high accuracy. In this, tree based: classifier uses non- Hepatitis, a liver disorder requires continuous medical
linear proximal support vector machines.(PSVM). care and patient self-management education to prevent
Polat and Gunes [18] designed an expert system to acute complications and to decrease the risk of long-term
diagnose the diabetes disease based on principal complications. This is caused due to the condition of
component analysis. Polat et al. also developed a cascade anorexia (loss of appetite) and increased level of alkaline
learning system to diagnose the diabetes. phosphate. The disease can be classified in to Hepatitis a,
IJCSI International Journal of Computer Science Issues, Vol. 8, Issue 3, No. 1, May 2011
ISSN (Online): 1694-0814
www.IJCSI.org 149
b, etc,. All these datasets used in this study are taken from 4 Steroid no, yes
UCI KDD Archive [1]. 5 Antivirals no, yes
6 Fatigue no, yes
3.2 Experimental Data 7 Malaise no, yes
algorithms can be examined by confusion matrix produced 0.719 0.314 0.742 0.719 0.73 0.719 Yes
by them. We employed four performance measures:
precision, recall, F-measure and ROC space [5]. A Table 6: confusion matrix of id3 algorithm- diabetes dataset
distinguished confusion matrix (sometimes called TP Rate FP Rate Precision Recall F-Measure ROC Area Class
contingency table) is obtained to calculate the four 0.582 0.154 0.67 0.582 0.623 0.767 Yes
measures. Confusion matrix is a matrix representation of 0.846 0.418 0.791 0.846 0.817 0.767 No
the classification results. It contains information about
actual and predicted classifications done by a classification
system. The cell which denotes the number of samples C4.5 Algorithm
classifies as true while they were true (i.e., TP), and the
cell that denotes the number of samples classified as false At each node of the tree, C4.5 [15] chooses one attribute
while they were actually false (i.e., TN). The other two of the data that most effectively splits its set of samples
cells denote the number of samples misclassified. into subsets enriched in one class or the other. Its criterion
Specifically, the cell denoting the number of samples is the normalized information gain (difference in entropy)
classified as false while they actually were true (i.e., FN), that results from choosing an attribute for splitting the
and the cell denoting the number of samples classified as data. The attribute with the highest normalized
true while they actually were false (i.e., FP). Once the information gain is chosen to make the decision. C4.5 [16]
confusion matrixes were constructed, the precision, recall, made a number of improvements to ID3. Some of these
F-measure are easily calculated as: are:
Recall= TP/ (TP+FN) (1) a. Handling both continuous and discrete attributes
Precision = TP/ (TP+FP) (2) –creates a threshold and then splits the list into
F_measure = (2*TP)/ (2*TP+FP+FN) (3) those whose attribute value is above the threshold
Less formally, precision measures the percentage of the and those that are less than or equal to it.
actual patients (i.e. true positive) among the patients that b. Handling training data with missing attribute
got declared disease; recall measures the percentage of the values
actual patients that were discovered; F-measure balances c. Handling attributes with differing costs.
between precision and recall. A ROC (receiver operating d. Pruning trees after creation – C4.5 [16] goes back
characteristic [5]) space is defined by false positive rate through the tree once it’s been created and
(FPR) and true positive rate (TPR) as x and y axes attempts to remove branches that do not help by
respectively, which depicts relative tradeoffs between true replacing them with leaf nodes.
positive and false positive. When the three medical datasets are run against the C4.5
TPR= TP/ (TP+FN) (4) algorithm and the results are indicated in the tables 7, 8, 9
FPR= FP/ (FP+TN) (5) respectively.
0.719 0.314 0.742 0.719 0.73 0.719 Yes 0.597 0.186 0.632 0.597 0.614 0.751 Yes
0.814 0.403 0.79 0.814 0.802 0.751 No
Table 5: Confusion matrix of id3 algorithm- hepatitis dataset
TP Rate FP Rate Precision Recall F-Measure ROC Area Class
0.686 0.281 0.66 0.686 0.673 0.68 No
CART Algorithm
IJCSI International Journal of Computer Science Issues, Vol. 8, Issue 3, No. 1, May 2011
ISSN (Online): 1694-0814
www.IJCSI.org 151
compared with C4.5, the run time complexity of CART is San Francisco, CA, 2007.
satisfactory. [5] H.W. Ian, E.F., "Data mining: Practical machine learning
tools and techniques," 2005: Morgan Kaufmann.
Table 13: Prediction accuracy table [6] R. Detrano, A.J., W. Steinbrunn, M. Pfisterer, J.J. Schmid, S.
S.No Name of algorithm Accuracy % Sandhu, K.H.Guppy, S. Lee, and V. Froelicher,
"International application of a new probability algorithm for
1 CART Algorithm 83.2
the diagnosis of coronary artery disease," American Journal
2 ID3 Algorithm 64.8 of Cardiology,1989. 64: p. 304-310.
3 C4.5 Algorithm 71.4 [7] G. John, "Models if incremental concept formation," Journal
of Atificial Intelligence, 1989: p. 11-61.
[8] A. L. Gamboa, M.G.M., J. M. Vargas, N. H. Gress, and R. E.
We have done this research and we have found Orozco, "Hybrid Fuzzy-SV Clustering for Heart Disease
83.184% accuracy with the CART algorithm which is Identification," in Proceedings of CIMCA-IAWTIC'06.
greater than previous research of ID3 and C4.5 as 2006.
indicated in the table XVIII. [9] D. Resul, T.I., S. Abdulkadir, "Effective diagnosis of heart
disease through neural networks ensembles," Elsevier, 2008.
[10] Z. Yao, P.L., L. Lei, and J. Yin, "R-C4.5 Decision tree
4. Conclusions modeland its applications to health care dataset, in
roceedings of the 2005 International Conference on Services
The decision-tree algorithm is one of the most effective Systems and Services Management," 2005. p. 1099-1103.
classification methods. The data will judge the efficiency [11] K. Gang, P.Y., S. Yong, C. Zhengxin, "Privacy-preserving
and correction rate of the algorithm. We used 10-fold data mining of medical data using data separation-based
techniques," Data science journal, 2007. 6.
cross validation to compute confusion matrix of each
[12] L. Cao, “Introduction to Domain Driven Data Mining,”
model and then evaluate the performance by using Data Mining for Business Applications, pp. 3-10, Springer,
precision, recall, F measure and ROC space. As expected, 2009.
bagging algorithms, especially CART, showed the best [13] Quinlan, J.R., "Induction of Decision Trees," Machine
performance among the tested methods. The results Learning. Vol. 1. 1986. 81-106.
showed here make clinical application more accessible, [14] L. Breiman, J. Friedman, R. Olshen, and C. Stone.
which will provide great advance in healing CAD, Classification and Regression Trees. Wadsworth Int. Group,
hepatitis and diabetes. The survey is made on the decision 1984.
tree algorithms ID3, C4.5 and CART towards their steps [15] S. R. Safavin and D. Landgrebe. A survey of decision tree
classifier methodology. IEEE Trans. on Systems, Man and
of processing data and Complexity of running data.
Cybernetics, 21(3):660-674, 1991.
Finally it can be concluded that between the three [16] Kusrini, Sri Hartati, ”Implementation of C4.5 algorithm to
algorithms, the CART algorithm performs better in evaluate the cancellation possibility of new student
performance of rules generated and accuracy. This showed applicants at stmik amikom yogyakarta.” Proceedings of the
that the CART algorithm is better in induction and rules International Conference on Electrical Engineering and
generalization compared to ID3 algorithm and C4.5 Informatics Institut Technologic Bandung, Indonesia June
algorithm. Finally, the results are stored in the decision 17-19, 2007.
support repository. Since, the knowledge base is currently [17] P. Magni and R. Bellazzi, “A stochastic model to assess the
focused on a narrow set of diseases. The approach has variability of blood glucose time series in diabetic patients
been validated through the case study, it is possible to self-monitoring,” IEEE Trans. Biomed. Eng., vol. 53, no. 6,
pp. 977–985, Jun. 2006.
expand the scope of modeled medical knowledge. [18] K. Polat and S. Gunes, “An expert system approach based
Furthermore, in order to improve decision support, on principal component analysis and adaptive neuro-fuzzy
interactions should be considered between the different inference system to diagnosis of diabetes disease,” Dig.
medications that the patient is on. Signal Process., vol. 17, no. 4, pp. 702–710, Jul. 2007.
[19] J.Friedman, “Fitting functions to noisy data in high
References dimensions”, in Proc.20th Symp. Interface Amer. Statistical
[1] UCI Machine Learning Repository .Assoc. , E.J.Wegman.D.T.Gantz, and I.J. Miller.Eds.1988
http://www.ics.uci.edu/~mlearn/MLRepository.html . pp.13-43
[2] American Diabetes Association, “Standards of medical care [20] T.W.simpson, C.Clark and J.Grelbsh ,”Analysis of support
in diabetes—2007,” Diabetes Care, vol. 30, no. 1, pp. S4 vector regression for appreciation of complex engineering
S41, 2007. analyses “, presented as the ASME 2003.
[3] J. Du and C.X. Ling, “Active Learning with Generalized [21] L. B. Goncalves, M. M. B. R. Vellasco, M. A. C. Pacheco,
Queries,” Proc. Ninth IEEE Int’l Conf. Data Mining, pp. and F. J. de Souza, “Inverted hierarchical neuro-fuzzy BSP
120-128, 2009 system: A novel neuro-fuzzy model for pattern classification
[4] Jiawei Han and Micheline Kamber, “Data Mining Concepts and rule extraction in LEE AND WANG: FUZZY EXPERT
and techniques”, 2nd ed., Morgan Kaufmann Publishers, SYSTEM FOR DIABETES DECISION SUPPORT
IJCSI International Journal of Computer Science Issues, Vol. 8, Issue 3, No. 1, May 2011
ISSN (Online): 1694-0814
www.IJCSI.org 153