Early Identification and Detection of Brain
Tumor using Deep Learning Techniques
Vivek Kumar Sharma1
Department of Computer Science and Engineering
Parul University
Vadodara, India
vkshere4every1@gmail.com
Abstract: A brain tumor is a potentially fatal condition that
can seriously impair a patient's quality of life and interfere
with normal brain functioning. Early identification and
detection are essential for successful treatment. Deep learning
methods for image analysis and detection have been
increasingly important in the medical profession recently,
yielding more dependable and accurate findings. To detect
brain cancers, segmentation is an act of differentiating between
normal and aberrant brain cells or tissues. In this study, we use
magnetic resonance imaging (MRI) imageries to examine
several methods for brain tumor detection and segmentation.
To find anomalies, the symmetric and asymmetric shapes of the
brain are first analysed in the detection procedure. After that
categorization of the cells is performed as tumors or non-
tumorigenic. The goal of this research is to develop a brain
tumor detection technique that is more precise and effective.
For detection and classification, different deep learning models
like DenseNet201, CNN, U-Net, and U-Net++ are applied to the
MRI image dataset. As the result for classification DenseNet
shows best accuracy 98.11% and for segmentation of tumor
UNet++ shows 98% accuracy.
Keywords- Brain-Tumor detection, Deep Learning,
Convolutional Neural Network (CNN), DenseNet, Magnetic
Resonance Imageries
I. INTRODUCTION
The health and wellness sector differs greatly from other
sectors of the economy. People always demand a high
degree of awareness and comfort, when it comes to the brain
[1], it is an essential and highly sensitive organ that powers
the body, other organs, and facilitates decision-making. It
functions as the central nervous system's (CNS) control
centre. The brain is the controller of the body's daily
voluntary and involuntary functions.
In most cases, a brain tumor can result in serious health
conditions like cancer because it resembles a mesh of
harmful and undesired tissue growth in the brain. Brain
failure results from brain tumor cells growing to the point
where they eventually absorb all the nutrients meant for the
healthy cells and tissues. For the patient, the treatment, and
even the patient's survival, the tumour’s identification is
essential [2]. To manually identification for Tumors, medical
professionals use computed tomography (CT) and magnetic
resonance imaging (MRI) techniques. Being able to treat a
brain tumor in its early stages before it becomes malignant
depends on early detection of its existence.
XXX-X-XXXX-XXXX-X/XX/$XX.00 ©20XX IEEE
This project looks at a system that uses computational
methods to identify tumor blocks and classifies whether a
tumor is present or not. It does this by using Convolution
Dr. Gaurav Kumar Ameta2
Department of Computer Science and Engineering
Parul University
Vadodara, India
gauravameta1@gmail.com
Neural Networks (CNNs), a type of deep learning algorithm.
When these algorithms are applied to MRI scan imageries,
the presence of a brain tumor can be identified with greater
accuracy and speed, which helps patients receive treatment
more quickly.
This paper aims to compare various deep learning models
and identify the best model that can learn and get better
through repeated runs and parameter adjustments.
II. LITERATURE REVIEW
A deep learning model for automated segmentation and
classification of brain tumors is proposed [3]. Based on
convolutional neural network (CNN) architecture, the model
can identify whether a brain Tumor is benign or malignant
by dividing it into distinct regions. Using an MRI scan
dataset as a test dataset, the model produced segmentation
and classification accuracy of 96.2% and 97.4%,
respectively.
A multimodal deep learning method was suggested for
classifying and segmenting brain tumors [4]. To increase
segmentation and classification accuracy, the method
combines a long short-term memory (LSTM) network with a
convolutional neural network (CNN). Using an MRI scan
dataset as a test dataset, the model produced segmentation
and classification accuracy of 98.6% and 99.1%,
respectively.
A brain tumor detection method was developed by using
both intelligent and automatic system using Lee sigma
filtered histogram segmentation model [5]. Lee sigma
filtered histogram algorithm used for detection of tumor in
brain in minimum time. The tanh activation function used
for classification purpose. Gray bimodal histogram
segmentation process for measuring Jaccard index for
similarity among pixels.
An algorithm was proposed for the detection of brain tumor
from MRI imageries using deep convolutional neural
network [6]. Tumor is detected from two different classes
with different models i.e., binary class and multiclass.
Brain tumors are classified using a capsule network because
as per author it is a better option as compared to CNN. CNN
might lose track of information while processing it. To
increase classification accuracy, the Bayesian approach was
applied to the capsule network [7]. The benchmark brain
tumor dataset was used, and the BayesCap framework was
required for model testing.
III. METHODOLOGY
In this paper, segmentation methods like U-Net, U-Net++
are used for segmentation of the tumor from MRI imageries,
whereas Convolutional Neural Network (CNN) and
DenseNet are applied for the classification of tumor. These
methods are trained on MRI imageries dataset. Performance
was measured using performance matrix through the
parameters like accuracy, loss value, and recall value. The
performance matrix result assists in finding of best method
by comparing accuracies of all the methods.
A. Dataset
A dataset containing 3064 Magnetic Resonance Imaging
(MRI) of brain imageries was considered for investigation.
Imageries of meningiomas, gliomas, pituitary gland tumors,
and healthy brains were used for brain tumor detection from
MRI imageries. After collecting all imageries, masked
imageries were created manually using label-studio tool and
all imageries were saved as .png format. The masked
imageries are now added into dataset of Brain Tumor MRI
imageries. This dataset can be retrieved from github
repository and it is publicly available on ( https://github.com/MRI-
brain-tumor-detection/tree/main/image_dataset).
. results.
B. Data Pre-Preprocessing
All the imageries of the dataset are of different formats and
sizes. It will display an error when it reads different images
as an input at the time of training. To solve this problem, all
the imageries in the dataset are converted into same size of
256×256 pixels For pre-processing, in the first step all the
imageries are converted into same image format, here all
mask imageries are in .png format and original imageries are
in different image formats. In the second step, all the
imageries (original as well as mask imageries) are converted
into gray scale image format for saving time. Now, all
imageries are of 256×256×3 converted into 256×256×1.
Figure 1 shows the original image of size 256×256×3 of
healthy and tumorous imageries, gray scale imageries of the
sizes 256×256×1 and mask imageries of heathy and
tumorous.
C. Deep Learning based segmentation techniques for Brain
tumor detection
There are number of algorithms available for brain tumor
segmentation on MRI imageries like U-Net, U-Net++. In
this paper, segmentation techniques are used for extracting
tumor from MRI imageries. In all above algorithms
mentioned, different layers consist of convolution block,
encoder, and decoder block. These encoder and decoder
blocks consist of number of filters, pooling layer and skip
connection for segmenting tumor accurately. After
segmentation, performance matrix is calculated for finding
best algorithm for brain tumor segmentation.
1) U-Net algorithm
The U-Net algorithm is a deep learning segmentation
algorithm and its architecture is fully connected
convolutional network architecture. It is used in various
medical imaging applications [8]. This is a U shape
architecture, which consists of encoding and its
corresponding decoding path. There are three steps in the U-
Net: (1) encoder (2) bottleneck (3) decoder. At the encoder
step, the input image is passed through a series of max
pooling and the ReLU activation algorithm. It comes after
the convolutional layer to reduce the dimension of image
and to increase the features from the input image.
The bottleneck step emerges at the bottom of U-Net,
containing higher number of features and information about
the input image. Whereas, the decoder step concatenates the
features from the encoder block using skip connections for
increasing number of features at every stage for accurate
image segmentation.
Figure 2 shows the architecture of U-Net. In this architecture
input image passes through two-dimensional convolutional
layer with 32 convolution filters, 3×3 kernel size, followed
by size of 2×2 max pooling layer. After that input image is
passed into the process of encoder and decoder for finding
output. The output layer uses the kernel of size 1×1, number
of classes and sigmoid function as activation function. After
Figure 2. U-Net Model
defining the model, training of model is done for finding out
the training parameters, loss, accuracy, and validation
2) U-Net++
U-Net++ architecture is an extension of U-Net architecture
as shown in Figure 3. This nested architecture is created
recursively by connecting the skip connection of U-Net.
This process allows the model to extract more features from
the images of different resolution and scale. It helps in
accurately segmenting the object from the image [9]. This
has same encoder and decoder block as in U-Net, but there
is a nested connection between the encoder and decoder
block at different resolutions. This nested feature in encoder
and decoder block gives more accurate features and
accuracy.
Figure 3. U-Net++ model
3) Convolutional Neural Network
 A type of artificial neural network (ANN) frequently Comparison of the different methods and algorithms used
employed in picture analysis and recognition. The visual for segmentation and classification purposes are discussed in
cortex, the area of the brain responsible for processing of this section. The number of deep learning algorithms like U-
visual data, serves as an inspiration for the design and Net, U-Net++, DenseNet and CNN are discussed in this
operation of CNN. paper. This section compares the performance of model
A sequence of filters is applied to an input image by CNNs explored in this paper. On training of these entire models on
to function. A certain area of the image is subjected to a the brain imageries dataset, different accuracy loss and
filter, which is essentially a tiny weight matrix. Each filter values were achieved. Table 1 and Table 2 represents
produces a feature map, or a map of the filter's activation accuracy and performance analysis respectively. The table 1
values throughout the image. After going through several shows the accuracies of different models like for
pooling layers, the feature maps lose some of their size and classification CNN gives 96%, DenseNet gives 98%,
become more resilient to noise and changes in the input accuracy while for segmentation of tumor UNet and UNet+
image [10]. + gives 76% and 98% respectively.
A fully connected layer receives the output from the pooling
layers and uses it to categorize the image. Backpropagation TABLE1. Comparison of accuracy analysis
is a technique used to train the fully connected layer. It
modifies the filter and pooling layer weights into reduces the Validation Validation
discrepancy between the image's actual and expected Model Accuracy Loss
Accuracy Loss
classification.
CNN 0.9733 0.09 0.9600 0.051
4) DenseNet DenseNet 0.9700 0.023 0.9811 0.032
U-Net 0.8621 0.010 0.7633 0.033
The CNN architecture known as DenseNet, or Dense
Convolutional Network, has demonstrated encouraging U-Net++ 0.9583 NAN 0.9760 NAN
outcomes in the identification of brain Tumors [11]. The
capacity of DenseNets to extract intricate patterns and TABLE2. Performance analysis of models
features from medical imageries makes them especially
suitable for this kind of work. The architecture of DenseNet Method Precision Recall F1 score
is shown in Figure 4.
CNN 0.49 0.48 0.49
DenseNet 0.49 0.47 0.48
U-Net 0.53 0.67 0.33
U-Net++ 0.88 0.93 0.90

Figure 5 shows Graphical representation of training

accuracy versus epochs of CNN model, Figure 6
Graphical representation of Loss accuracy versus epochs
of CNN model, Figure 7 Graphical representation of
training accuracy versus epochs of DenseNet model,
Figure 8. Graphical representation of Loss accuracy
versus epochs of DenseNet model, Figure 9 Graphical
representation of training accuracy versus epochs of
UNet model, Figure 10. Graphical representation of Loss
versus epochs of UNet model and Figure 11. Graphical
representation of training accuracy versus epochs of
UNet++ model and Loss versus epochs of UNet++
model.

Figure 4. DenseNet Architecture

Based on two situations, the brain tumor was graded by

cropping the tumor lesions, and uncropped brain imageries.
CNN architecture is used rather than using transfer learning
techniques and pre-trained CNN like DenseNet201.
IV. RESULT ANALYSIS
 Fig 8. Graphical representation of Loss accuracy versus epochs of
DenseNet model
Fig 5 Graphical representation of training accuracy versus epochs of CNN
model

Fig 9 Graphical representation of training accuracy versus epochs of

UNet model
Fig 6 Graphical representation of Loss accuracy versus epochs of CNN
model

Fig 10. Graphical representation of Loss versus epochs of UNet model

Fig 7 Graphical representation of training accuracy versus epochs of

DenseNet model

Fig 11. Graphical representation of training accuracy versus epochs of
UNet++ model and Loss versus epochs of UNet++ model.
V. CONCLUSION
It is essential to detect brain Tumors accurately, since
misidentification can result in an irreversible illness. The
medical team in neurology department mostly remain
overburdened due to a considerable increase in patients and
an increasing likelihood of brain tumors. Consequently, to
solve these problems, an accurate and effective brain tumor
detection approach is desperately needed. The segmentation
and classification algorithms are used to segment and
classify tumor from the MRI brain imageries by dividing the
whole image into small pixels and extract all the relevant
features from the brain imageries. These algorithms help
professionals in finding out the tumor in particular region in
lesser time with more accuracy. Segmentation plays an
important role in classification of tumor. After performing
segmentation, the accuracy of classification becomes higher.
By observing results of these algorithms on the same
dataset, the U-Net++ deep learning model gives higher
accuracy as compared to the U-Net for segmenting tumor
from brain imageries.
REFERENCES
[1] Sadad, Tariq, Amjad Rehman, Asim Munir, Tanzila Saba, Usman
Tariq, Noor Ayesha, and Rashid Abbasi, "Brain tumor detection and
multi‐classification using advanced deep learning techniques."
Microscopy Research and Technique 84, no. 6 (2021): 1296-1308.
[2] Dipu, Nadim Mahmud, Sifatul Alam Shohan, and K. M. A. Salam,
"Deep learning based brain tumor detection and classification." In
2021 International conference on intelligent technologies (CONIT),
pp. 1-6. IEEE, 2021.
[3] AL-HILO, R. U. A. A., and MASHKOOR MAHMOOD, "BRAIN
TUMOR SEGMENTATION AND CLASSIFICATION USING
MACHINE LEARNING." PhD diss., 2023.
[4] Li, Yuexiang, and Linlin Shen, "Deep learning based multimodal
brain tumor diagnosis." In Brainlesion: Glioma, Multiple Sclerosis,
Stroke and Traumatic Brain Injuries: Third International Workshop,
BrainLes 2017, Held in Conjunction with MICCAI 2017, Quebec
City, QC, Canada, September 14, 2017, Revised Selected Papers 3,
pp. 149-158. Springer International Publishing, 2018.
[5] Kurian, Simy Mary, and Sujitha Juliet, "An automatic and intelligent
brain tumor detection using Lee sigma filtered histogram
segmentation model." Soft Computing 27, no. 18 (2023): 13305-
13319.
[6] Khan, Md Saikat Islam, Anichur Rahman, Tanoy Debnath, Md Razaul
Karim, Mostofa Kamal Nasir, Shahab S. Band, Amir Mosavi, and
Iman Dehzangi, "Accurate brain tumor detection using deep
convolutional neural network." Computational and Structural
Biotechnology Journal 20 (2022): 4733-4745.
[7] Afshar, Parnian, Arash Mohammadi, and Konstantinos N. Plataniotis,
"Brain tumor type classification via capsule networks." In 2018 25th
IEEE international conference on image processing (ICIP), pp. 3129-
3133. IEEE, 2018.
[8] Ronneberger, Olaf, Philipp Fischer, and Thomas Brox, "U-net:
Convolutional networks for biomedical image segmentation."
In Medical Image Computing and Computer-Assisted Intervention–
MICCAI 2015: 18th International Conference, Munich, Germany,
October 5-9, 2015, Proceedings, Part III 18, pp. 234-241. Springer
International Publishing, 2015.
[9] Zhou, Zongwei, Md Mahfuzur Rahman Siddiquee, Nima Tajbakhsh,
and Jianming Liang, "Unet++: A nested u-net architecture for medical
image segmentation." In Deep Learning in Medical Image Analysis
and Multimodal Learning for Clinical Decision Support: 4th
International Workshop, DLMIA 2018, and 8th International
Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018,
Granada, Spain, September 20, 2018, Proceedings 4, pp. 3-11.
Springer International Publishing, 2018.
[10] Pavani, D., Durgalaxmi, K., Datta, B. S., & Nagajyothi, D., “Brain
Tumor Detection Using Convolutional Neural Networks in MRI
Imageries”. In International Conference on Soft Computing and
Signal Processing (pp. 751-760). Singapore: Springer Nature
Singapore, (2021, June).
[11] Özkaraca, Osman, Okan İhsan Bağrıaçık, Hüseyin Gürüler, Faheem
Khan, Jamil Hussain, Jawad Khan, and Umm E. Laila.,"Multiple
Brain Tumor Classification with Dense CNN Architecture Using
Brain MRI Images." Life 13, no. 2 (2023): 349.
[12] Mahmud, Md Ishtyaq, Muntasir Mamun, and Ahmed Abdelgawad, "A
deep analysis of brain tumor detection from mr images using deep
learning networks." Algorithms 16, no. 4 (2023): 176.
[13] Asad, Rimsha, Saif Ur Rehman, Azhar Imran, Jianqiang Li, Abdullah
Almuhaimeed, and Abdulkareem Alzahrani, "Computer-Aided Early
Melanoma Brain-Tumor Detection Using Deep-Learning Approach."
Biomedicines 11, no. 1 (2023): 184.