Professional Documents
Culture Documents
Research Article
A New Approach to Diagnose Parkinson’s Disease Using
a Structural Cooccurrence Matrix for a Similarity Analysis
Copyright © 2018 João W. M. de Souza et al. This is an open access article distributed under the Creative Commons Attribution
License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly
cited.
Parkinson’s disease affects millions of people around the world and consequently various approaches have emerged to help diagnose
this disease, among which we can highlight handwriting exams. Extracting features from handwriting exams is an important contri-
bution of the computational field for the diagnosis of this disease. In this paper, we propose an approach that measures the similarity
between the exam template and the handwritten trace of the patient following the exam template. This similarity was measured
using the Structural Cooccurrence Matrix to calculate how close the handwritten trace of the patient is to the exam template. The
proposed approach was evaluated using various exam templates and the handwritten traces of the patient. Each of these variations
was used together with the Naı̈ve Bayes, OPF, and SVM classifiers. In conclusion the proposed approach was proven to be better
than the existing methods found in the literature and is therefore a promising tool for the diagnosis of Parkinson’s disease.
1. Introduction others [6–12]. Most of the studies use signals from exams
to make a diagnosis. However, studies related to a diagnosis
According to the World Health Organization, neurological
through handwriting exams (handwriting exams based on
disorders such as Parkinson’s disease, multiple sclerosis,
the quality of the patient’s tracing results can be used for PD
Alzheimer’s disease, epilepsy, shingles, and stroke are nervous
diagnosis) are quite scarce [5].
system diseases that affect the brain, the spine, and the nerves
Handwriting exams may be conducted on paper [13] or
that connect them. Approximately 16 in 60 people suffer
by using more sophisticated methods such as digitizers [5]
from some neurological disease [1]. Parkinson’s disease (PD),
or even a smartphone [14]. This type of exam has advantages
first described by Parkinson [2], is a degenerative disease
of the central nervous system associated with a chronic as it is easily obtainable and can also provide diversity, such
and progressive movement disorder [1]. Parkinson’s Disease as spirals, ellipses, connected syllables, connected words, and
Foundation claims that this disease affects about 7–10 million many other ways to test a patient’s ability to trace such forms
people worldwide and 4% of people with PD are diagnosed [15–19]. However, the extraction of the features is complicated
before the age of 50. The cause is unknown and there is no since the paper exams have some printing error and the
cure for PD, but an early diagnosis helps in the treatment that information in this type of exam is not so clear.
continues throughout the patient’s life. This paper compares handwriting templates and patients
PD studies, in the computational field, are mainly focused handwriting using a novel Structural Cooccurrence Matrix-
on diagnosing the disease. The literature shows that some based approach which relies on similarity metrics as
works aim to recognize the presence or absence of PD attributes. This approach was used because feature extraction
and identify the patients degree of severity [3, 4], and through cooccurrence between similar images appeared as
another extracts features from handwriting exams [5], among a promising method for this application. The proposal was
2 Computational Intelligence and Neuroscience
evaluated using three classifiers and the results were com- images composed of handwriting exams known as HandPD
pared against those in [13]. dataset.
The rest of this paper is organized as follows. The essen- The HandPD dataset [13] consists of 736 images from
tials of handwriting exams and some machine learning meth- handwriting exams divided into two groups: the Control
ods are explained in Sections 2 and 3, respectively. Section 4 Group (CG) containing 144 images and the Patient Group
describes the Structural Cooccurrence Matrix features. Our (PG) containing 592 images. The exams were obtained from
proposal is presented in Section 5. The experimental setup is 92 individuals, in which 18 were healthy individuals (CG)
presented in Section 6. Then, the results and discussion are and 74 were patients (PG) diagnosed with PD. These exams
given in Section 7 and finally the conclusions are given in were performed at the Botucatu Medical School of the
Section 8. State University of São Paulo, Brazil, and include spiral and
meander handwriting exam templates. Figure 1 shows some
2. Diagnosis of Parkinson’s Disease through samples from this dataset [13].
Handwriting Exams Pereira et al. [13] used an approach to define the dataset
attributes based on the differences between the exam template
There are several examples in the literature that apply hand- (ET) and the handwritten trace (HT). Pereira et al. [13]
writing exams to diagnose PD. Drotár et al. recorded the described the HandPD dataset exams using the 9 attributes
examination time as a parameter for PD diagnosis [5] while listed below:
Surangsrirat used a polar coordinates interpretation to define
the features [20]. There are also works based on the difference (1) Root mean square (RMS) of the difference between
between the patient’s trace and the template [13]. HT and ET radius:
Pereira et al. [13] introduced a new method to obtain the
1 𝑛 𝑖 𝑖 2
exam which is performed on paper and relies on underlining RMS = √ ∑ (𝑟HT − 𝑟ET ), (1)
the template correctly. Pereira et al. also proposed a set of 𝑛 𝑖=0
Computational Intelligence and Neuroscience 3
where 𝑛 is the number of sample points drawn for Input signal SCM
𝑖 𝑖
each HT and ET skeleton and 𝑟HT and 𝑟ET denote the
HT and ET radius, which is basically the length of f f
the straight line that connects the 𝑖th sampled point,
respectively, to the center of the spiral or meander. Q Two-
Attributes
P dimensional
(2) Maximum difference between HT and ET radius: Q (3 groups)
histogram
𝑖 𝑖
Δ max = argmax {𝑟HT − 𝑟ET } .
(2) k k(f)
𝑖
Proposed approach
(a)
Grayscale
Input images
g f
p
Handwritten trace Exam template
Two-
dimensional
histogram
SCM
Color Exam
Segmentation process Erode Erode
threshold template
(a)
Figure 4: An example of the segmentation process: (a) segmentation of exam template; (b) segmentation of handwritten trace.
Computational Intelligence and Neuroscience 5
is applied again with the same structuring element to obtain (iii) Entropy (ENT): the randomness of the information is
the real size of the ET as shown in Figure 4. measured and it is given by
In order to obtain the HT segmentation the image is also
smoothed through the Median filter (5 × 5) to eliminate 𝑁−1
the noise picked up during the exams. Then, the handwriting ENT = − ∑ m𝑖𝑗 log (m𝑖𝑗 ) . (7)
exam is converted to the grayscale, after which the Otsu 𝑖𝑗=0
𝑁−1 m𝑖𝑗 At the end of the SCM process we have the attributes to be
IDM = ∑ ∈ [0, 1] . (6) applied as pattern recognition inputs to any machine learning
𝑖𝑗=0 1 + (𝑖 − 𝑗) method.
6 Computational Intelligence and Neuroscience
6. Experimental Setup present the patient’s ability to underline the exam template.
The results were obtained by applying machine learning
We conducted some experiments with the handwriting methods to the features extracted from cooccurrence matrix
exams used by Pereira et al. [13]. These exams concern the obtained over the SCM extractor used in this work.
patient’s ability to underline the two exam templates: spiral Table 1 presents the classification results of the combi-
and meander. First, the spiral and meander exam attributes nations between the images obtained in the segmentation
were extracted by the proposed approach presented in Sec- (ET and HT) and the handwritten exam using SCM, where
tion 5. Then, we applied three machine learning methods: the meander and spiral formats were evaluated separately
Naı̈ve Bayes, OPF, and SVM in 3 different experiments: (i) and together. The handwritten exam, exam template, and
considering only the spiral exam attributes; (ii) considering handwritten trace are represented in Table 1 as a, b, and c,
only the meander exam attributes; and (iii) considering spiral respectively.
and meander exam attributes together. That is, we evaluate Table 1 also shows that the combination of the meander
the proposed approach using the two handwriting formats and spiral exam obtained the lowest accuracy rates. The very
separately and also together. After that, we compared the significant difference between the spiral and meander formats
results with those of Pereira et al. [13]. justifies these low rates.
The number of HandPD dataset samples, used in all of Another important factor, observed in the best results
the experiments, are divided into 368 spiral exam samples obtained with the classifiers in Table 1, was the predominance
and 368 meander exam samples, resulting in 736 samples. We of the best results using the combination of the handwritten
emphasize that each subset is divided into 296 samples from trace and the exam template which proves that these two are
the CG and 72 samples from the PG. the most similar.
All the three experiments were conducted with 75% for The results of this work were compared with the results
the training set, 25% for testing set, and the remaining 25% for obtained by Pereira et al. approach [13] in Table 2 which shows
the validation set. We applied a cross-validation with 20 runs each classifier with subdivisions for the experiments using
for the reliability of the results. The setup of the OPF classifier handwriting exams in the formats of meanders, spirals, and
was configured with the Euclidean distance and the SVM with the combination of the meanders and spirals. Immediately
the radial basis function. The SVM and OPF classifiers were after that, there is a new subdivision between the results
automatically optimised by choosing the optimal parameters obtained with our proposal and those of Pereira et al. [13].
from each method. Parameters are considered optimal when In Table 2 the highest accuracy results are in underline font
the cross-validation estimates the minimal error [26–32]. and the lowest ones in italic font, for each of the classifiers.
Accuracy was used to classify the machine learning Also, highlight in bold are the highest and the lowest accuracy
methods. This metric is defined using the terms obtained in results of both approaches and experiments.
the confusion matrix generated after applying the machine The results obtained in this paper proved to be superior
learning methods and refers to the closeness of a measured in all of the experiments in comparison to those of Pereira
value to a standard or known value. proposal [13]. The highest accuracy was 85.54% using the
approach proposed. This highest result was provided with
7. Results and Discussion the SVM classifier, using the handwriting in a spiral format
with the combination of the handwritten trace and the
In this section, we provide an analysis of the results using exam template. The lowest accuracy among the best results
the handwriting exams from Pereira et al. [13]. These exams presented in Table 2 was 45.79%.
Computational Intelligence and Neuroscience 7
Table 2: Comparison between the best results of this paper and the best results of the Pereira et al. approach [13].
8. Conclusion [2] J. Parkinson, “An essay on the shaking palsy. 1817,” The Journal
of Neuropsychiatry and Clinical Neurosciences, vol. 14, no. 2, pp.
The proposal of this paper is based on the patient’s trace and 223–236, 2002.
the exam template using the SCM method for a similarity [3] J. Chen, Z. Lei, L. Liu, G. Zhao, and M. Pietikäinen, “RoLoD:
approximation. The SVM classifier with the RBF kernel and Robust local descriptors for computer vision,” Neurocomputing,
handwriting in the spiral format proved being the most vol. 184, pp. 1-2, 2016.
promising for this application. This configuration had an [4] N. Bouadjenek, H. Nemmour, and Y. Chibani, “Robust soft-
accuracy of 85.54% for the combination of the handwritten biometrics prediction from off-line handwriting analysis,”
trace and the exam template in the feature extraction. The Applied Soft Computing, vol. 46, pp. 980–990, 2016.
results obtained in this paper were 21.31% superior to the best [5] P. Drotár, J. Mekyska, I. Rektorová, L. Masarová, Z. Smékal,
result achieved by Pereira et al. approach [13]. and M. Faundez-Zanuy, “Evaluation of handwriting kinematics
We conclude that this is promising approach to help in the and pressure for differential diagnosis of Parkinson’s disease,”
diagnosis of PD. Another advantage of this proposal is that Artificial Intelligence in Medicine, vol. 67, pp. 39–46, 2016.
there is no need to configure a filter to obtain the structured [6] M. S. Baby, A. J. Saji, and C. S. Kumar, “Parkinsons disease
cooccurrence matrix, facilitating its application. classification using wavelet transform based feature extraction
These results encourage us to propose future works for of gait data,” in Proceedings of the 2017 IEEE International
handwriting feature extraction. Conference on Circuit, Power and Computing Technologies,
ICCPCT 2017, India, April 2017.
Conflicts of Interest [7] A. Brahim, L. Khedher, J. M. Gorriz et al., “A proposed
computer-aided diagnosis system for Parkinson’s disease classi-
The authors declare that there are no conflicts of interest fication using 123I-FP-CIT imaging,” in Proceedings of the 3rd
regarding the publication of this paper. International Conference on Advanced Technologies for Signal
and Image Processing, ATSIP 2017, Morocco, May 2017.
[8] C. R. Pereira, S. A. T. Weber, C. Hook, G. H. Rosa, and J. P.
Acknowledgments Papa, “Deep learning-aided Parkinson’s disease diagnosis from
handwritten dynamics,” in Proceedings of the 29th SIBGRAPI
Pedro P. Rebouças Filho acknowledges the sponsorship from Conference on Graphics, Patterns and Images, SIBGRAPI 2016,
the IFCE via Grant PROINFRA PPG/2017. João W. M. pp. 340–346, Brazil, October 2016.
de Souza acknowledges the CNPq for financial support. [9] V. V. Shah, S. Goyal, and H. J. Palanthandalam-Madapusi, “A
Jefferson S. Almeida acknowledges the FUNCAP for financial perspective on the use of high-frequency stimulation in deep
support. brain stimulation for Parkinson’s disease,” in Proceedings of the
2nd Indian Control Conference, ICC 2016, pp. 19–24, India,
References January 2016.
[10] N. Zhi, B. K. Jaeger, A. Gouldstone, R. Sipahi, and S. Frank,
[1] WHO, Neurological Disorders: Public Health Challenges, World “Toward Monitoring Parkinson’s Through Analysis of Static
Health Organization, 2006. Handwriting Samples: A Quantitative Analytical Framework,”
8 Computational Intelligence and Neuroscience
IEEE Journal of Biomedical and Health Informatics, vol. 21, no. [25] G. L. Bezerra Ramalho, D. S. Ferreira, P. P. Rebouças Filho,
2, pp. 488–495, 2017. and F. N. S. de Medeiros, “Rotation-invariant feature extraction
[11] A.-M. Schiffer, A. J. Nevado-Holgado, A. Johnen, A. R. using a structural co-occurrence matrix,” Measurement, vol. 94,
Schönberger, G. R. Fink, and R. I. Schubotz, “Intact action pp. 406–415, 2016.
segmentation in Parkinson’s disease: Hypothesis testing using [26] S. L. Gomes, E. D. S. Rebouças, E. C. Neto et al., “Embedded
a novel computational approach,” Neuropsychologia, vol. 78, pp. real-time speed limit sign recognition using image processing
29–40, 2015. and machine learning techniques,” Neural Computing and
[12] R. Guzman-Cabrera, M. Gomez-Sarabia, M. Torres-Cisneros, Applications, vol. 28, pp. 573–584, 2017.
M. A. Escobar-Acevedo, and J. R. Guzman-Sepulveda, “Parkin- [27] P. P. R. Filho, A. C. D. S. Barros, G. L. B. Ramalho et al.,
son’s disease: Improved diagnosis using image processing,” in “Automated recognition of lung diseases in CT images based
Proceedings of the 2017 Photonics North (PN), pp. 1-1, Ottawa, on the optimum-path forest classifier,” Neural Computing and
ON, Canada, June 2017. Applications, pp. 1–14, 2017.
[13] C. R. Pereira, D. R. Pereira, F. A. Silva et al., “A new computer [28] P. P. Rebouças Filho, E. D. S. Rebouças, L. B. Marinho, R. M.
vision-based approach to aid the diagnosis of Parkinson’s Sarmento, J. M. R. S. Tavares, and V. H. C. de Albuquerque,
disease,” Computer Methods and Programs in Biomedicine, vol. “Analysis of human tissue densities: A new approach to extract
136, pp. 79–88, 2016. features from medical images,” Pattern Recognition Letters, vol.
[14] R. Graça, R. S. E. Castro, and J. Cevada, “Parkdetect: Early 94, pp. 211–218, 2017.
diagnosing parkinson’s disease,” in Proceedings of the 9th IEEE [29] P. P. Rebouças Filho, R. M. Sarmento, G. B. Holanda, and D. de
International Symposium on Medical Measurements and Appli- Alencar Lima, “New approach to detect and classify stroke in
cations, IEEE MeMeA 2014, Portugal, June 2014. skull CT images via analysis of brain tissue densities,” Computer
[15] C. R. Pereira, D. R. Pereira, F. A. D. Silva et al., “A step Methods and Programs in Biomedicine, vol. 148, pp. 27–43, 2017.
towards the automated diagnosis of parkinson’s disease: Ana- [30] E. C. Neto, S. L. Gomes, P. P. Rebouças Filho, and V. H. C.
lyzing handwriting movements,” in Proceedings of the 28th IEEE De Albuquerque, “Brazilian vehicle identification using a new
International Symposium on Computer-Based Medical Systems, embedded plate recognition system,” Measurement, vol. 70, pp.
CBMS 2015, pp. 171–176, Brazil, June 2015. 36–46, 2015.
[16] P. Drotár, J. Mekyska, I. Rektorová, L. Masarová, Z. Smékal, and [31] L. B. Marinho, J. S. Almeida, J. W. M. Souza, V. H. C.
M. Faundez-Zanuy, “Analysis of in-air movement in handwrit- Albuquerque, and P. P. Rebouças Filho, “A novel mobile robot
ing: A novel marker for Parkinson’s disease,” Computer Methods localization approach based on topological maps using classi-
and Programs in Biomedicine, vol. 117, no. 3, pp. 405–411, 2014. fication with reject option in omnidirectional images,” Expert
[17] P. Drotar, J. Mekyska, Z. Smekal, I. Rektorova, L. Masarova, Systems with Applications, vol. 72, pp. 1–17, 2017.
and M. Faundez-Zanuy, “Contribution of different handwriting [32] P. P. Rebouças Filho, J. C. D. Santos, F. N. C. Freitas et al.,
modalities to differential diagnosis of Parkinson’s Disease,” “New approach to evaluate a non-grain oriented electrical
in Proceedings of the 2015 IEEE International Symposium on steel electromagnetic performance using photomicrographic
Medical Measurements and Applications, MeMeA 2015, pp. 344– analysis via digital image processing,” Journal of Materials
348, Italy, May 2015. Research and Technology, 2017.
[18] C. Taleb, M. Khachab, C. Mokbel, and L. Likforman-Sulem,
“Feature selection for an improved Parkinson’s disease identi-
fication based on handwriting,” in Proceedings of the 2017 1st
International Workshop on Arabic Script Analysis and Recogni-
tion (ASAR), pp. 52–56, Nancy, France, April 2017.
[19] Z. Smekal, J. Mekyska, I. Rektorova, and M. Faundez-Zanuy,
“Analysis of neurological disorders based on digital processing
of speech and handwritten text,” in Proceedings of the 2013
International Symposium on Signals, Circuits and Systems, ISSCS
2013, Romania, July 2013.
[20] D. Surangsrirat, A. Intarapanich, C. Thanawattano, R. Bhi-
dayasiri, S. Petchrutchatachart, and C. Anan, “Tremor assess-
ment using spiral analysis in time-frequency domain,” in
Proceedings of the IEEE SoutheastCon 2013: Moving America into
the Future, USA, April 2013.
[21] S. Theodoridis and K. Koutroumbas, Pattern Recognition, fourth
edition Edition, Academic Press, fourth edition Edition, 2009.
[22] J. P. Papa, A. X. Falcão, and C. T. N. Suzuki, “Supervised pattern
classification based on optimum-path forest,” International
Journal of Imaging Systems and Technology, vol. 19, no. 2, pp.
120–131, 2009.
[23] J. P. Papa, C. T. N. Suzuki, and A. X. Falcão, A library for
the design of optimum-path forest classifiers, 2014, http://www.ic
.unicamp.br/afalcao/libopf/index.htmlLibopf.
[24] V. N. Vapnik, Statistical Learning Theory, John Wiley Sons, Inc,
2009.
Advances in
Multimedia
Applied
Computational
Intelligence and Soft
Computing
The Scientific
Engineering
Journal of
Mathematical Problems
Hindawi
World Journal
Hindawi Publishing Corporation
in Engineering
Hindawi Hindawi Hindawi
www.hindawi.com Volume 2018 http://www.hindawi.com
www.hindawi.com Volume 2018
2013 www.hindawi.com Volume 2018 www.hindawi.com Volume 2018 www.hindawi.com Volume 2018
Advances in
International Journal of
Fuzzy
Reconfigurable Submit your manuscripts at Systems
Computing www.hindawi.com
Hindawi
www.hindawi.com Volume 2018 Hindawi Volume 2018
www.hindawi.com
Journal of
Computer Networks
and Communications
Advances in International Journal of
Scientific Human-Computer Engineering Advances in
Programming
Hindawi
Interaction
Hindawi
Mathematics
Hindawi
Civil Engineering
Hindawi
Hindawi
www.hindawi.com Volume 2018
www.hindawi.com Volume 2018 www.hindawi.com Volume 2018 www.hindawi.com Volume 2018 www.hindawi.com Volume 2018
International Journal of
Biomedical Imaging