Multi-Classification

' of Brain Tumor Images

.
Using Deep Neural Network
TERM PAPER WRITING AND SEMINAR

Submitted by

GEETHA MUTHU.P
(912022403001)
MASTER OF ENGINEERING
IN
COMMUNICATION SYSTEMS

In partial fulfillment for the award of the degree of

DEPARTMENT OF ELECTRONICS AND

COMMUNICATION.ENGINEERING

PANDIAN SARASWATHI YADAV ENGINEERING COLLEGE

ARASANOOR-630561, SIVAGANGAI DISTRICT

ANNA UNIVERSITY : CHENNAI-25

APRIL/MAY 2023
 ANNA UNIVERSITY: CHENNAI 600025

BONAFIDE CERTIFICATE

Certify that this project report on “MULTI CLASSIFICATION OF BRAIN TUMER

USING DEEP NEURAL NETWORK” is the bonafide work of P.GEETHA MUTHU

(912022403001) who carried out research under my supervision.

MRS.P.PADMASRI M.E., MRS.M.NILOBHAR M.E.,

DEPARTMENT OF ELECTRONICS DEPARTMENT OF ELECTRONICS

AND COMMUNICAION ENGINEERING AND CON1N1UNICATION ENGINEERING

Submitted for project viva-voce examination held on ………………

INTERNAL EXAMINER EXTERNAL EXAMINAR

 Multi-Classification of Brain Tumor
ImagesUsing Deep Neural Network
ABSTRACT:

Brain tumor classification is a crucial task to evaluate the tumors

and make a treatment decision according to their classes. There are many
imaging techniques used to detect brain tumors. However, MRI is
commonly used due to its superior image quality and the fact of relying
on no ionizing radiation. Deep learning (DL) is a subfield of machine
learning and recently showed a remarkable performance, especially in
classification and segmentation problems. In this paper, a DL model
based on a convolutional neural network is proposed to classify different
brain tumor types using two publicly available datasets. The former one
classifies tumors into (meningioma, glioma, and pituitary tumor). The
other one differentiates between the three glioma grades (Grade II,
Grade III, and Grade IV). The datasets include 233 and 73 patients
with a total of 3064 and 516 images on T1-weighted contrast-enhanced
images for the first and second datasets, respectively. The proposed
network structure achieves a significant performance with the best
overall accuracy of 96.13% and 98.7%, respectively, for the two
studies. The results indicate the ability of the model for brain tumor
multi-classification purposes.
 LITERATURE SURVEY
1. AUTHOR: G.LITJENS,T.KOORI

TITLE: A SURVEY ON DEEP LEARNING IN MADICAL FIELD ANALYSIS

YEAR: Med. Image Anal., vol. 42, pp. 60–88, Dec. 2017.

Deep learning algorithms, in particular convolutional networks, have

rapidly become a methodology of choice for analyzing medical images.
This paper reviews the major deep learning concepts pertinent to medical
image analysis and summarizes over 300 contributions to the field, most
of which appeared in the last year. We survey the use of deep learning
for image classification, object detection, segmentation, registration, and
other tasks. Concise overviews are provided of studies per application
area: neuro, retinal, pulmonary, digital pathology, breast, cardiac,
abdominal, musculoskeletal. We end with a summary of the current state-
of-the-art, a critical discussion of open challenges and directions for future
research.

2. AUTHOR:L.DENG AND D.YU

TITLE: DEEP LEARNING METHODS AND APPLICATIONS

YEAR: JUNE 2014

Deep Learning: Methods and Applications provides an overview of general deep

learning methodology and its applications to a variety of signal and information
processing tasks. The application areas are chosen with the following three criteria in
mind: (1) expertise or knowledge of the authors; (2) the application areas that have
already been transformed by the successful use of deep learning technology, such as
speech recognition and computer vision; and (3) the application areas that have the
potential to be impacted significantly by deep learning and that have been benefitting
from recent research efforts, including natural language and text processing,
information retrieval, and multimodal information processing empowered by multitask
deep learning. Deep Learning: Methods and Applications is a timely and important
book for researchers and students with an interest in deep learning methodology and its
applications in signal and information processing.

3. AUTHOR: S.KHALID,T.KHALIL AND S.NASREEN

TITLE:A SURVEY OF FEATURE SELECTION AND FEATURE

EXTRACTION TECHNIQUES IN MACHINE LEARNING

YEAR: IEEE XPLORE: 09 OCTOBER 2014

Dimensionality reduction as a preprocessing step to machine learning is effective

in removing irrelevant and redundant data, increasing learning accuracy, and improving
result comprehensibility. However, the recent increase of dimensionality of data poses
a severe challenge to many existing feature selection and feature extraction methods
with respect to efficiency and effectiveness. In the field of machine learning and
pattern recognition, dimensionality reduction is important area, where many
approaches have been proposed. In this paper, some widely used feature selection and
feature extraction techniques have analyzed with the purpose of how effectively these
techniques can be used to achieve high performance of learning algorithms that
ultimately improves predictive accuracy of classifier. An endeavor to analyze
dimensionality reduction techniques briefly with the purpose to investigate strengths
and weaknesses of some widely used dimensionality reduction methods is presented.

4. AUTHOR:S.GOSWAMI AND L.K.P.BHAIYA

TITLE:BRAIN TUMOUR DETECTION USING UNSUPERVISED LEARNING

BASED NEURAL NETWORK.

YEAR: IEEE Xplore: 10 June 2013

The task of MRI (Magnetic resonance Imaging) brain tumor images

Classification is difficult due to the variance and complexity of tumors. This
 paper presents an unsupervised learning based Neural Network technique for the
classification of the magnetic resonance human brain images. Brain tumour
diagnosis requires a detailed histological analysis, which involves invasive
surgery that can be painful and can cause discomfort to patients. In this paper,
the brain tumour diagnostic procedure is divided into the following phases. The
first phase comprises of image pre-processing which includes histogram
equalization, edge detection, noise filtering, thresholding etc. In second phase,
the features of the MR brain image are extracted using Independent Component
Analysis (ICA). In third phase, brain tumour diagnosis is performed using Self
Organized Map (SOM). Finally, a kmeans clustering algorithm is applied to
segment the brain into different tissues. Classification results on a variety of MR
images for different pathologies indicate this technique to be promising.

5. AUTHOR:M.SHASHIDHAR,B.V.KUMAR AND V.S.RAJA

TITLE: MRI brain image segmen- tation using modified fuzzy C-means clustering
algorithm
YEAR: IEEE Xplore: 28 July 2011
Clustering approach is widely used in biomedical applications particularly for
brain tumor detection in abnormal magnetic resonance (MRI) images. Fuzzy clustering
using fuzzy C-means (FCM) algorithm proved to be superior over the other clustering
approaches in terms of segmentation efficiency. But the major drawback of the FCM
algorithm is the huge computational time required for convergence. The effectiveness
of the FCM algorithm in terms of computational rate is improved by modifying the
cluster center and membership value updating criterion. In this paper, the application of
modified FCM algorithm for MR brain tumor detection is explored. A comprehensive
feature vector space is used for the segmentation technique. Comparative analysis in
terms of segmentation efficiency and convergence rate is performed between the
conventional FCM and the modified FCM. Experimental results show superior results
for the modified FCM algorithm in terms of the performance measures.
6. AUTHOR: K. Machhale, H. B. Nandpuru, V. Kapur, and L. KosT

TITLE: MRI brain cancer classification using hybrid classifier (SVM-KNN)

YEAR: IEEE Xplore: 09 July 2015
This paper proposes an intellectual classification system to recognize
normal and abnormal MRI brain images. Nowadays, decision and treatment of
brain tumors is based on symptoms and radiological appearance. Magnetic
resonance imaging (MRI) is a most important controlled tool for the anatomical
judgment of tumors in brain. In the present investigation, various techniques
were used for the classification of brain cancer. Under these techniques, image
preprocessing, image feature extraction and subsequent classification of brain
cancer is successfully performed. When different machine learning techniques:
Support Vector Machine (SVM), K- Nearest Neighbor (KNN) and Hybrid
Classifier (SVM-KNN) is used to classify 50 images, it is observed from the
results that the Hybrid classifier SVM-KNN demonstrated the highest
classification accuracy rate of 98% among others. The main goal of this paper is
to give an excellent outcome of MRI brain cancer classification rate using SVM-
KNN.

7. AUTHOR: T. Rajesh and R. S. M. Malar

TITLE: Rough set theory and feed forward neural network based brain tumor
detection in magnetic resonance images
YEAR: IEEE Xplore: 26 September 2013
Segmentation of images holds an important position in the area of image
processing. Computer aided detection of abnormality in medical images is primarily
motivated by the necessity of achieving maximum possible accuracy. There are lots of
methods for automatic and semi- automatic image classification, though most of them
fail because of unknown noise, poor image contrast, inhomogeneity and boundaries
that are usual in medical images. The MRI (Magnetic resonance Imaging) brain tumor
segmentation is a complicated task due to the variance and intricacy of tumors. The
principle aim of the project is to perform the MRI Brain image classification of cancer,
based on Rough Set Theory and Feed Forward Neural Network classifier. For this
purpose, first the features are extracted from the input MRI images using Rough set
theory, and then the selected features are given as input to Feed Forward Neural
Network classifier. Finally, Feed Forward Neural Network classifier is utilized to
perform two functions. The first is to differentiate between normal and abnormal. The
second function is to classify the type of abnormality in benign or malignant tumor.

8. AUTHOR: E. I. Zacharaki, S. Wang, S. Chawla, D. S. Yoo, R. Wolf, E. R.

Melhem, and C. Davatzikos
TITLE: Classification of brain tumor type and grade using MRI texture and shape
in a machine learning scheme
YEAR: Dec. 2009.
The objective of this study is to investigate the use of pattern classification
methods for distinguishing different types of brain tumors, such as primary
gliomas from metastases, and also for grading of gliomas. The availability of an
automated computer analysis tool that is more objective than human readers can
potentially lead to more reliable and reproducible brain tumor diagnostic
procedures. A computer-assisted classification method combining conventional
MRI and perfusion MRI is developed and used for differential diagnosis. The
proposed scheme consists of several steps including region-of-interest definition,
feature extraction, feature selection, and classification. The extracted features
include tumor shape and intensity characteristics, as well as rotation invariant
texture features. Feature subset selection is performed using support vector
machines with recursive feature elimination. The method was applied on a
population of 102 brain tumors histologically diagnosed as metastasis (24),
meningiomas (4), gliomas World Health Organization grade II (22), gliomas
World Health Organization grade III (18), and glioblastomas (34). The binary
support vector machine classification accuracy, sensitivity, and specificity,
assessed by leave-one-out cross-validation, were, respectively, 85%, 87%, and
 79% for discrimination of metastases from gliomas and 88%, 85%, and 96% for
discrimination of high-grade (grades III and IV) from low-grade (grade II)
neoplasms. Multiclass classification was also performed via a one-vs-all voting
scheme.

9. AUTHOR: E. S. A. El-Dahshan, T. Hosny, and A. B. M. Salem

TITLE: Hybrid intelligent techniques for MRI brain images classification
YEAR: Mar. 2010.

This paper presents a hybrid technique for the classification of the magnetic
resonance images (MRI). The proposed hybrid technique consists of three stages,
namely, feature extraction, dimensionality reduction, and classification. In the first
stage, we have obtained the features related to MRI images using discrete wavelet
transformation (DWT). In the second stage, the features of magnetic resonance images
have been reduced, using principal component analysis (PCA), to the more essential
features. In the classification stage, two classifiers have been developed. The first
classifier based on feed forward back-propagation artificial neural network (FP-ANN)
and the second classifier is based on k-nearest neighbor (k-NN). The classifiers have
been used to classify subjects as normal or abnormal MRI human images. A
classification with a success of 97% and 98% has been obtained by FP-ANN and k-NN,
respectively. This result shows that the proposed technique is robust and effective
compared with other recent work.

10. AUTHOR: J. Cheng, W. Huang, S. Cao, R. Yang, W. Yang

TITLE: Enhanced performance of brain tumor classification via tumor region
augmentation and partition
YEAR: 2 Dec 2015
Automatic classification of tissue types of region of interest (ROI) plays an
important role in computer-aided diagnosis. In the current study, we focus on the
classification of three types of brain tumors (i.e., meningioma, glioma, and pituitary
tumor) in T1-weighted contrast-enhanced MRI (CE-MRI) images. Spatial pyramid
matching (SPM), which splits the image into increasingly fine rectangular subregions
and computes histograms of local features from each subregion, exhibits excellent
results for natural scene classification. However, this approach is not applicable for
brain tumors, because of the great variations in tumor shape and size. In this paper, we
propose a method to enhance the classification performance. First, the augmented
tumor region via image dilation is used as the ROI instead of the original tumor region
because tumor surrounding tissues can also offer important clues for tumor types.
Second, the augmented tumor region is split into increasingly fine ring-form
subregions. We evaluate the efficacy of the proposed method on a large dataset with
three feature extraction methods, namely, intensity histogram, gray level co-occurrence
matrix (GLCM), and bag-of-words (BoW) model. Compared with using tumor region
as ROI, using augmented tumor region as ROI improves the accuracies to 82.31% from
71.39%, 84.75% from 78.18%, and 88.19% from 83.54% for intensity histogram,
GLCM, and BoW model, respectively. In addition to region augmentation, ring-form
partition can further improve the accuracies up to 87.54%, 89.72%, and 91.28%. These
experimental results demonstrate that the proposed method is feasible and effective for
the classification of brain tumors in T1-weighted CE-MRI.

11. AUTHOR: M. G. Ertosun and D. L. Rubin

TITLE: Automated grading of gliomas using deep learning in digital pathology
images: A modular approach with ensemble of convolutional neural networks
YEAR: 2015 Nov 5
Brain glioma is the most common primary malignant brain tumors in adults with
different pathologic subtypes: Lower Grade Glioma (LGG) Grade II, Lower Grade
Glioma (LGG) Grade III, and Glioblastoma Multiforme (GBM) Grade IV. The survival
and treatment options are highly dependent of this glioma grade. We propose a deep
learning-based, modular classification pipeline for automated grading of gliomas using
digital pathology images. Whole tissue digitized images of pathology slides obtained
from The Cancer Genome Atlas (TCGA) were used to train our deep learning modules.
Our modular pipeline provides diagnostic quality statistics, such as precision,
sensitivity and specificity, of the individual deep learning modules, and (1) facilitates
training given the limited data in this domain, (2) enables exploration of different deep
learning structures for each module, (3) leads to developing less complex modules that
are simpler to analyze, and (4) provides flexibility, permitting use of single modules
within the framework or use of other modeling or machine learning applications, such
as probabilistic graphical models or support vector machines. Our modular approach
helps us meet the requirements of minimum accuracy levels that are demanded by the
context of different decision points within a multi-class classification scheme.
Convolutional Neural Networks are trained for each module for each sub-task with
more than 90% classification accuracies on validation data set, and achieved
classification accuracy of 96% for the task of GBM vs LGG classification, 71% for
further identifying the grade of LGG into Grade II or Grade III on independent data set
coming from new patients from the multi-institutional repository.

12. AUTHOR: J. S. Paul, A. J. Plassard, B. A. Landman, and D. Fabbri

TITLE: Deep learning for brain tumor classification
YEAR: 2022 Dec 22
Diagnosing a brain tumor takes a long time and relies heavily on the
radiologist’s abilities and experience. The amount of data that must be handled
has increased dramatically as the number of patients has increased, making old
procedures both costly and ineffective. Many researchers investigated a variety of
algorithms for detecting and classifying brain tumors that were both accurate and
fast. Deep Learning (DL) approaches have recently been popular in developing
automated systems capable of accurately diagnosing or segmenting brain tumors
in less time. DL enables a pre-trained Convolutional Neural Network (CNN)
model for medical images, specifically for classifying brain cancers. The
proposed Brain Tumor Classification Model based on CNN (BCM-CNN) is a
CNN hyperparameters optimization using an adaptive dynamic sine-cosine
fitness grey wolf optimizer (ADSCFGWO) algorithm. There is an optimization of
hyperparameters followed by a training model built with Inception-ResnetV2.
The model employs commonly used pre-trained models (Inception-ResnetV2) to
improve brain tumor diagnosis, and its output is a binary 0 or 1 (0: Normal, 1:
Tumor). There are primarily two types of hyperparameters: (i) hyperparameters
that determine the underlying network structure; (ii) a hyperparameter that is
responsible for training the network. The ADSCFGWO algorithm draws from
both the sine cosine and grey wolf algorithms in an adaptable framework that
uses both algorithms’ strengths. The experimental results show that the BCM-
CNN as a classifier achieved the best results due to the enhancement of the
CNN’s performance by the CNN optimization’s hyperparameters. The BCM-
CNN has achieved 99.98% accuracy with the BRaTS 2021 Task 1 dataset.

13. AUTHOR: P. Afshar, K. N. Plataniotis, and A. Mohammadi

TITLE: Capsule Networks for Brain Tumor Classification Based on MRI
Images and Coarse Tumor Boundarie

YEAR: IEEE Xplore: 17 April 2019

According to official statistics, cancer is considered as the second
leading cause of human fatalities. Among different types of cancer, brain tumor is
seen as one of the deadliest forms due to its aggressive nature, heterogeneous
characteristics, and low relative survival rate. Determining the type of brain tumor
has significant impact on the treatment choice and patient's survival. Human-
centered diagnosis is typically error-prone and unreliable resulting in a recent surge
of interest to automatize this process using convolutional neural networks (CNNs).
CNNs, however, fail to fully utilize spatial relations, which is particularly harmful
for tumor classification, as the relation between the tumor and its surrounding tissue
is a critical indicator of the tumor's type. In our recent work, we have incorporated
newly developed CapsNets to overcome this shortcoming. CapsNets are, however,
highly sensitive to the miscellaneous image background. The paper addresses this
 gap. The main contribution is to equip CapsNet with access to the tumor
surrounding tissues, without distracting it from the main target. A modified CapsNet
architecture is, therefore, proposed for brain tumor classification, which takes the
tumor coarse boundaries as extra inputs within its pipeline to increase the CapsNet's
focus. The proposed approach noticeably outperforms its counterparts.

14. AUTHOR: A. K. Anaraki, M. Ayati, and F. Kazemi

TITLE: Magnetic resonance imaging- based brain tumor grades classification and
grading via convolutional neural networks and genetic algorithms
YEAR: January–March 2019
Gliomas are the most common type of primary brain tumors in adults and
their early detection is of great importance. In this paper, a method based on
convolutional neural networks (CNNs) and genetic algorithm (GA) is proposed in order
to noninvasively classify different grades of Glioma using magnetic resonance imaging
(MRI). In the proposed method, the architecture (structure) of the CNN is evolved
using GA, unlike existing methods of selecting a deep neural network architecture
which are usually based on trial and error or by adopting predefined common
structures. Furthermore, to decrease the variance of prediction error, bagging as an
ensemble algorithm is utilized on the best model evolved by the GA. To briefly
mention the results, in one case study, 90.9 percent accuracy for classifying three
Glioma grades was obtained. In another case study, Glioma, Meningioma, and Pituitary
tumor types were classified with 94.2 percent accuracy. The results reveal the
effectiveness of the proposed method in classifying brain tumor via MRI images. Due
to the flexible nature of the method, it can be readily used in practice for assisting the
doctor to diagnose brain tumors in an early stage.
15. AUTHOR: M. L. Goodenberger and R. B. Jenkins
TITLE: Genetics of adult glioma
YEAR: 2012 Dec
Gliomas make up approximately 30% of all brain and central nervous system
tumors and 80% of all malignant brain tumors. Despite the frequency of gliomas, the
etiology of these tumors remains largely unknown. Diffuse gliomas, including
astrocytomas and oligodendrogliomas, belong to a single pathologic class but have
very different histologies and molecular etiologies. Recent genomic studies have
identified separate molecular subtypes within the glioma classification that appear to
correlate with biological etiology, prognosis, and response to therapy. The discovery of
these subtypes suggests that molecular genetic tests are and will be useful, beyond
classical histology, for the clinical classification of gliomas. While a familial
susceptibility to glioma has been identified, only a small percentage of gliomas are
thought to be due to single-gene hereditary cancer syndromes. Through the use of
linkage studies and genome-wide association studies, multiple germline variants have
been identified that are beginning to define the genetic susceptibility to glioma.