You are on page 1of 6

CiiT International Journal of Digital Image Processing, Vol 8, No 02, February 2016 45

Application of Echo State Neural Network in


Identification of Microcalcification in Breast
J. Jebathangam, S. Purushothaman and P. Rajeswari

Abstract---This paper presents a combination of wavelet with echo chest/abdominal/pelvic diagnostic CT, flurodeoxyglucose
state neural network in identifying the microcalcification (MC) in a (FDG) PET scan and the methods used for DCIS
mammogram image. Mammogram image is decomposed using (www.nccn.org/patients).
Daubauchi wavelet to 5 levels. Statistical features are extracted from Manuel et al., 2015 have discussed microcalcifications
the wavelet coefficients. Training of the ESNN/BPA is done using the
features as inputs to the network along with a labeling of presence or
formations in the breast. Sukassini and Velmurugan, 2015;
non-presence of MC. The classification performance of ESNN is Minavathi and Amrutha, 2015, detected the Microcalcifications
compared with back propagation algorithm. in Ultrasound images using watershed segmentation and
artificial neural networks. Hatice et al., 2015, studied the
Keywords---Microcalcification, Wavelet, Neural Network, Echo invasive breast carcinoma stereotactic vacuum-assisted biopsy.
State Neural Network, Backpropagation Algorithm This is meant for MCs-only lesions. BY this process, the
reasons could be estimated.
I. INTRODUCTION Shradhananda et al., 2015; Lowis et al., 2015, proposed the
use of Dual-Tree Complex Wavelet Transform (DTCWT) with
B REAST cancer cause cells in the body to grow out of control.
The tumor is formed from the cancer cells. The breast
cancers affect the breast tissue. The milk-producing glands and
neural network mammography analysis. Kim et al., 2015,
assessed the sonographic visibility and feasibility of biopsy
ducts connecting the lobules to the nipple are part of the breast. under ultrasound guidance of mammographically suspicious
To detect breast cancer at an early stage, mammography is microcalcification-only lesions.
preferred. Mammograms cannot be used for detecting all types Summrina Kanwal Wajid and Amir Hussain, 2015; Nazeem
of breast cancers. et al., 2015, studied associations between mammographic MCs
Busing et al., 1990, mentioned that microcalcifications are and tumor pathology. They compared outputs of a mammogram
grouped into type I-calcium oxalate (CO) and type II - calcium with that of biopsy outputs. Zobi et al., 2015, worked on
hydroxyapatite (HA). Benign breast condition is of Type-I. automatic detection of MC using blob through supervised
Benign and malignant breast tissue correspond to Type-II. learning.
Johnson et al., 1999, stated that MCs are presence of calcium Zobia et al., 2015; Imad et al., 2015; Seung et al., 2015,
in breast tissues. It is considered as an early mammographic developed a cascaded classification framework for automatic
evidence of breast cancer. detection of individual and clusters of MC. Their framework
A condition called Ductal carcinoma in situ (DCIS) presence comprised three classification stages: i) a random forest (RF)
in a breast. In this normal epithelial cells are replaced b classifier for simple features capturing the second order local
abnormal cells. Due to this expansion of the ducts and lobules structure of individual MCs. ii) Boltzmann machine (BM)
take place. classifier for MC candidates determined in the RF stage and iii)
The analysis for DCIS can be through, history and physical a detector to detect clusters of MCs from the individual MC
examination, diagnostic bilateral mammogram, Pathology detection results, using two different criteria. From the two-
review, determination of tumour estrogen receptor (ER) status, stage RF-DRBM classifier, the algorithm distinguishes MCs
Genetic counselling if the patient is at high risk for hereditary using explicitly computed features, as well as learn implicit
breast cancer, and breast magnetic resonance imaging. There features that can further discriminate between confusing cases.
are invasive or infiltrating breast cancers. The walls of the Experimental evaluation is conducted on the original
glands or ducts are broken during origination of the cancers. Mammographic Image Analysis Society (MIAS) and mini-
They grow into surrounding breast tissue. The identification of MIAS databases. Joberth et al., 2015; Julian and Ravi, 2015;
invasive cancer can be done through complete blood count, Durgadevi and Himanshu, 2015, implemented k-means
platelets, liver function test, fertility counselling if clustering algorithm for diagnosis of breast cancer. Kanchana
premenopausal, bone scan or sodium fluoride Positron and Varalakshmi, 2015; Ayman, 2015, used multi-statistical
Emission Tomography (PET)/ computed tomography (CT), filters and wavelet decomposition transform for classifying the

Manuscript received on February 25, 2016, review completed on March 05, S. Purushothaman is with the Institute of Technology, Haramaya University,
2016 and revised on March 14, 2016. Ethiopia. E-Mail: dr.s.purushothaman.2015@gmail.com
J. Jebathangam is with the Mother Teresa Women’s University, Kodaikanal, P. Rajeswari is with the Mother Teresa Women’s University, Kodaikanal,
India. E-Mail: jeba_mca@yahoo.co.in India. E-Mail: rajeswaripuru@gmail.com
Digital Object Identifier: DIP022016002.

0974-9691/CIIT–IJ-6322/06/$20/$100 © 2016 CiiT Published by the Coimbatore Institute of Information Technology


CiiT International Journal of Digital Image Processing, Vol 8, No 02, February 2016 46

MCs. Dar-Ren Chen and Yi-Hsuan, 2008 used computer aided


diagnosis with ultrasound for detection of breast cancer.

II. METHODS
A. Wavelets

Fig.1 Wavelet Segmentation

The wavelet transform (WT) was developed as an alternative


to the short-time Fourier transform (STFT). A wavelet is a Fig.2 Schematic flow for MC Detection
waveform with a limited duration. Scaling the wavelet and Figure 2 presents schematic flow for MC detection.
shifting the wavelet are used for breaking the signals. The
B. Echo State Neural Network for MC Detection
features are obtained by decompositions at various levels using
the following equations: Harikumar R., and Vinoth kumar B., 2015 have used
V1=1/d ∑ (Approximation details) (1) artificial neural networks in breast diagnosis. Figure 3 presents
Where d = Samples in a frame and an ESNN architecture. The ESNN architecture is made of
V1 = Mean value of approximation neurons with interconnections. The interconnection is a
V2=1/d ∑ (Approximation or details –V1)) (2) recurrent architecture. The outputs of the processing elements
Where V2=Standard Deviation of approximation are input to the network output. The training is done with
V3=maximum (Approximation or details) (3) memory less readout.
V4=minimum (Approximation or details) (4)
V5=norm (Approximation or Details)2 (5)
Where V5 = Energy value of frequency
Wavelet segmentation steps (Figure 1)
1. Read Mammogram and Decompose the image to five
levels
2. Apply inverse wavelet
3. Apply segmentation for spotting the calcification
4. Apply morphological operations
5. Filter out the excess unwanted information and Mark
squares around the calcifications
Fig.3 An Echo State Neural Network (ESNN)

The echo state condition is defined regarding the spectral


radius of the reservoir’s weight matrix (|| W ||<1). The spectral
radius refers to the largest among the absolute values of the
eigenvalues of a matrix, denoted by (|| ||).
The recurrent network is a reservoir. The network is
interconnected dynamical components. Echo states refer to
different situations (states) of dynamics. The output is obtained
by training the memory less linear readout.
Figure 3 shows ‘A’ input units, ‘B’ internal PEs, and
‘C’output units. The value of the input unit at time ‘k’is u(k) =
[u1(k), u2(k), . . . , uM(k)]T,
The internal units are
x(k) = [x1(k), x2(k), . . . , xN(k)]T (6)
Output units are
y(k) = [y1(k), y2(k), . . . , yL(k)]T (7)

0974-9691/CIIT–IJ-6322/06/$20/$100 © 2016 CiiT Published by the Coimbatore Institute of Information Technology


CiiT International Journal of Digital Image Processing, Vol 8, No 02, February 2016 47

The connection weights are given III. RESULTS AND DISCUSSIONS


 W
back back
a) In an (B x A) weight matrix W ij for
connections between the input and the internal PEs,
 W ij
in in
b) In an B× B matrix W represents
connections between the internal PEs
 W ij
out out
c) In an C × B matrix W represents
connections from PEs to the output units and
 W ij
back back
d) In an B × C matrix W represents
connections from the output to the internal PEs.
The activation of the internal PEs (echo state) is updated
according to
x(k + 1) = p(Win u(k + 1) + Wx(k) +Wbacky(k)), (8)
where p = ( p1, p2, . . . , pN) are the internal PEs’ activation Fig.4 Original Image
functions. 50

x 100

e e
x
150

Here, all pi’s are hyperbolic tangent functions x


. The 200

e e
x
250

Rows
read out network’s outputs are obtained by: 300

350

y(k + 1) = pout(Woutx(k + 1)), . (9) 400

where 450

500

pout=(pout1, pout2,…..,poutc) are the output unit’s nonlinear 550

functions. 100 200 300 400


Columns
500 600 700

Fig.5 Level-1 Decomposition


2.2.1 Training ESNN algorithm
Step 1: Read a Pattern (I) 50

100

Step 2: Decide the number of reservoirs. 150

Step 3: Decide the number of sides in the input layer = length 200

250

of the pattern.
Rows

300

Step 4: Decide the number of sides in the output layer = a 350

400

number of target values. 450

Step 5: Initialize random weights between input and hidden 500

550
layer (Ih) hidden and output. 100 200 300 400 500 600 700
Columns

Step 6: Store Wout = Pseudo inverse (tan h(Ih*I + Ho * T + Fig.6 Level-2 Decomposition
R*S)) x T.
50

2.2.2 The algorithm for testing the ESNN is as follows: 100

Step 1: Read a Pattern (I) . 150

200

Step 2: Calculate F=Ih*I. 250


Rows

Step 3: TH = Ho * T. 300

350

Step 4: TT = R*S. 400

Step 5: S = tan h(F+TT+TH). 450

500
Step 6: a = Pseudo inverse (S). 550

Step 7: estimated = a * Wout. 100 200 300 400


Columns
500 600 700

Step 8: Locate MC. Fig.7 Level-3 Decomposition


50

Training patterns were formed from sample mammogram 100

150

under consideration. Ten mammogram images are considered 200

from mammographic image analysis (MIAS) database for 250


Rows

300

evaluating the performance of ESNN / BPA. The number of 350

400
input features used is five in the input layer of ESNN/ BPA, and 450

the number of targets used is 1 in the output layer. The weights 500

550
in the ESNN/ BPA are initialized. At the end of training, the 100 200 300 400
Columns
500 600 700

final weights are stored for testing the ESNN/BPA to identify Fig.8 Level-4 Decomposition
the MC in mammogram images.

0974-9691/CIIT–IJ-6322/06/$20/$100 © 2016 CiiT Published by the Coimbatore Institute of Information Technology


CiiT International Journal of Digital Image Processing, Vol 8, No 02, February 2016 48

50

100

150

200

250
Rows

300

350

400

450

500

550

100 200 300 400 500 600 700


Columns

Fig.9 Level-5 Decomposition

Figure 4 shows original mammogram of a breast. Figures 5-


Fig.12 Vertical at all Five Levels of Decomposition
9 shows decomposed images. In each image, the
approximation, horizontal, vertical and diagonal have been
combined and displayed.
Figures 10-13 show coefficients of all levels for
approximation, Horizontal, Vertical and Diagonal. These
coefficients are used as inputs to equations 1-5 for generating
patterns. These patterns are used for training the ESNN / BPA
network.

Fig.13 Diagonal at all Five Levels of Decomposition


Table 1 shows the method of assigning values for TP, TN,
FP, FN based on the output of ESNN / BPA.

Fig.10 Approximation at all Five Levels of Decomposition IV. RECEIVER OPERATING CHARACTERISTIC (ROC)
CURVES
ROC is the plot between false positive rate and true positive
rate. The points plotted here represent the performance of an
algorithm in meeting the expected criteria, it is 80% or above.
When mammogram image is presented to algorithm, how
well an algorithm is able to identify the presence of MC to the
maximum extent, and how much the algorithm wrongly detects
MC. The explanation for TP, TN, FP, FN are as follows:
1. True positive (TP) - If the pattern contains MC and if
the proposed algorithm detects the presence of MC,
then it is true positive.
2. False negative (FN)- If the pattern contains MC and if
Fig.11 Horizontal at All Five Levels of Decomposition the proposed algorithm does not detect the presence of
MC, then it is False negative.
3. True negative (TN): If the pattern does not have MC
and if the proposed algorithm does not detect MC, then
it is true negative.
4. False positive (FP): If the pattern has “no MC” and if
the proposed algorithm detects the presence of MC,
then it is false positive.

0974-9691/CIIT–IJ-6322/06/$20/$100 © 2016 CiiT Published by the Coimbatore Institute of Information Technology


CiiT International Journal of Digital Image Processing, Vol 8, No 02, February 2016 49

Fig.16 Accuracy in Detecting MC

Figure 16 shows higher accuracy for the ESNN / BPA


Fig.14 ROC Plot for ESNN algorithms in detecting MC in 10 mammogram images. The
ESNN algorithm has more accuracy when compared to that of
Figure 14 presents the plot for FPR versus TPR. The points BPA in detecting MC in mammogram image.
obtained are above the diagonal. Hence, the ESNN is suitable
for detecting MC in mammogram image. V. CONCLUSIONS
In this work, daubauchi wavelets, echo state neural network,
and back propagation algorithm have been used on
mammographic image analysis (MIAS) mammogram database.
The MC identification accuracy of ESNN is better than that of
BPA. Performance of the ESNN algorithm can be tested using
other mammogram database.

REFERENCES
[1] Busing C.M., Keppler U., and Menges V., 1990, Differences in
microcalcification in breast tumors. Virchows Archiv, Vol.393, pp.307–
313.
[2] Dar-Ren Chen and Yi-Hsuan Hsiao, 2008, Computer-aided Diagnosis in
Breast Ultrasound, Journal of ecology of Health and Environment,
Vol.16, No.1, pp.46-56.
[3] Durgadevi G., and Himanshu Shekhar, 2015, Identification of tumour
using K-means algorithm, IJARIIE, Vol.1, Issue 5, pp.227-231.
[4] Harikumar R., and Vinoth kumar B., 2015, Performance analysis of neural
Fig.15 ROC plot for BPA networks for classification of medical images with wavelets as a feature
extractor, International Journal of Imaging Systems and Technology,
Figure 15 presents the plot for FPR versus TPR. The points Vol.25, Issue 1, pp.33–40.
[5] Hatice Gümüş, Philippa Mills, David Fish, Metehan Gümüş, Karina Cox,
obtained are above the diagonal. Hence, the detection of MC by Haresh Devalia, Sue Jones, Peter Jones, and Ali R. Sever, 2015, Predictive
BPA is within acceptable region. factors for invasive cancer in surgical specimens following an initial
The accuracy refers how correctly, the ESNN/BPA diagnosis of ductal carcinoma in situ after stereotactic vacuum-assisted
breast biopsy in microcalcification-only lesions, Diagn Interventional
algorithms identify the presence of MC and “no MC” in Radiology, DOI 10.5152/dir.2015.14453.
mammogram images. If there are about 50 MC on 200 different [6] Imad Zyout, Joanna Czajkowska, and Marcin Grzegorzek, 2015, Multi-
mammogram images and if the ESNN/BPA algorithms can scale textural feature extraction and particle swarm optimization based
model selection for false positive reduction in mammography,
exactly identify all the 50 MC without identifying a non-MC as Computerized Medical Imaging and Graphics, Vol.46, Part 2, pp.95–107.
MC, then, the algorithms possess the capability of providing [7] Joberth de Nazaré Silva, Antonio Oseas de Carvalho Filho, Aristófanes
100% MC identification accuracy. The detection rate is Corrêa Silva, Anselmo Cardoso de Paiva, and Marcelo Gattass, 2015,
Automatic Detection of Masses in Mammograms Using Quality
computed using the equations (9 to 10). Threshold Clustering, Correlogram Function, and SVM, Journal of
TP Digital Imaging, Vol.28, Issue 3, pp.323-337.
Sensitivit y  (9) [8] Johnson J.M., Dalton R.R., Wester S.M., Landercasper J., and Lambert
TP  FN P.J., 1999, Histological correlation of microcalcifications in breast biopsy
specimens, Archieves of Surgery, Vol.134, pp.712-715.
[9] Julian Savari Antony S., and Ravi S., 2015, A New Approach to
TP  TN
Accuracy  (10) Determine the Classification of Mammographic Image Using K-Means
TP  TN  FP  FN Clustering Algorithm, International Journal of Advancements in Research
and Technology, Vol.4, Issue 2, pp.40-44.
Where FP—False Positive, FN—False Negative, TP—True [10] Kanchana M. and Varalakshmi P., 2015, Breast Cancer Diagnosis Using
Positive, and TN—True Negative. Wavelet Based Threshold Method, Middle-East Journal of Scientific
Research, Vol.23, No.6, pp.1030-1034.

0974-9691/CIIT–IJ-6322/06/$20/$100 © 2016 CiiT Published by the Coimbatore Institute of Information Technology


CiiT International Journal of Digital Image Processing, Vol 8, No 02, February 2016 50

[11] Kim T.E., Kim D.B. , Jung J.H., and Lee E.K. , 2015, Sonographic
Visibility and Feasibility of Biopsy under Ultrasound Guidance of
Suspicious Microcalcification-only Breast Lesions: a Single-centre
Study,Hong Kong Journal Radiology, Vol.18, pp.125-133.
[12] Lowis, Hendra and Lavinia, 2015, The Use of Dual-Tree Complex
Wavelet Transform (DTCWT) Based Feature for Mammogram
Classification,International Journal of Signal Processing, Image
Processing and Pattern Recognition Vol.8, No.3,pp.87-96.
[13] Manuel Scimeca, Chiara Antonacci and Elena Bonanno, 2015, Breast
Microcalcifications: A Focus, Journal of Cell Science and Therapy,
http://dx.doi.org/10.4172/2157-7013.S8-e101.
[14] Minavathi and Amrutha M, 2015, Detection of Micro Calcifications in
Ultrasound Images, International Journal of Computer Science and
Information Technology Research, Vol.3, Issue 2, pp.905-910.
[15] Naseem, Madiha, Joshua Murray, John F Hilton, Jason Karamchandani,
Derek Muradali, Hala Faragalla, Chanele Polenz, Dolly Han, David C
Bell, and Christine Brezden-Masley. 2015. “Mammographic
microcalcifications and breast cancer tumorigenesis: a radiologic-
pathologic analysis.” BMC Cancer 15 (1): 307. doi:10.1186/s12885-015-
1312-z.,
[16] Seung Yeon Shin, Soochahn Lee, Dong Yun, Ho Yub Jung, Yong Seok
Heo, Sun Mi Kim, and Kyoung Mu Lee, 2015, Novel Cascade Classifier
for Automatic Microcalcification Detection, PLoS ONE 10(12):
e0143725. doi:10.1371/journal.pone.0143725, pp.1-22.
[17] Shradhananda Beura,Banshidhar Majhi, and Ratnakar Dash, 2015,
Mammogram classification using two dimensional discrete wavelet
transform and gray-level co-occurrence matrix for detection of breast
cancer, Neurocomputing, Vol.154, No.22, pp.1–14.
[18] Sukassini M. P., and Velmurugan T., 2015, Survey on the Analysis of
Segmentation Techniques in Mammogram Images, Indian Journal of
Science and Technology, Vol.8, No.22, IPL0259, pp.1-8.
[19] Summrina Kanwal Wajid and Amir Hussain, 2015, Local energy-based
shape histogram feature extraction technique for breast cancer diagnosis,
Expert Systems with Applications, Vol.42, Issue 20, pp.6990–6999.
[20] Zobia Suhail, Mansoor Sarwar and Kashif Murtaza, 2015, Automatic
detection of abnormalities in mammograms, BMC Medical Imaging,
Vol.15, Issue 53, p.1-8.

Dr.S. Purushothaman completed his PhD from Indian


Institute of Technology Madras, India in 1995. He has
168 publications to his credit. He has 23 years of teaching
experience. Presently he is working as Associate
Professor in Institute of Technology, Haramaya
University, Ethiopia.

J. Jebathangam completed her MCA in university of


Madras, Chennai, India. She has 8 years of teaching
experience. Currently she is working as Assistant
Professor in Vel’s University, Chennai, India.

Dr.P. Rajeswari completed her PhD in Mother Teresa


Women’s University, Kodaikanal, India in 2014. She has
32 publications to her credit. Her areas of research interest
is Intelligent Computing.

0974-9691/CIIT–IJ-6322/06/$20/$100 © 2016 CiiT Published by the Coimbatore Institute of Information Technology

You might also like