Deep Learning Approach for Classification of Xrays using Keras

Godwin Emmanuel J@ and Narayanan Prasanth$

@
Godwin Emmanuel J
School of Computer Science
Vellore Institute of Technology
Vellore, Tamil Nadu, India

$Dr N.Narayanan Prasanth

Associate Professor
School of Computer Science and Engineering
Vellore Institute of Technology
Vellore, Tamil Nadu, India
Abstract:
Coronavirus causes respiratory infections which affect both humans and animals. It leads to
pneumonia in human beings. The majority of the COVID-19 infected suffer from respiratory
illness, and they also get recovered without much medication. Medical imaging technology
has made them easier for classification,The project's main objective is to organize the x-ray
using a deep learning technique such as Keras. It works based on a multi-layer image
classification algorithm, which produces more accuracy. Due to a limited number of medical
facilities and medical personnel and exponential increasing cases of COVID_19 day by day,
it is essential to use machine learning for the classification of covid-19, based on the X-rays,
which would classify rapidly as positive or negative. The accuracy gained by the
classification will help the medical personnel and patients who have difficulty approaching
radiologists to read their chest X-rays. The study has attempted Keras library using the
Tensor flow backend with almost cent percent accuracy.

Keywords:Covid-19,medical image,Keras

Introduction:

The first case of the infectious diseases COVID-19 got reported in the city of Wuhan, China.
It rapidly got spread worldwide. When an infected person coughs or sneezes, the infection
passes to the nearby contacts. The symptoms are tiredness, cough with dryness, and fever. In
severe cases, it leads to difficulty in breathing.Around 79,031,626 individuals diagnosed with
COVID-19 worldwide, and 1,736,583fatalities got reported on December 23, 2020 [1]. Due
to the rapid increase in cases day by day, there is a shortage of medical personnel and
facilities. Machine learning techniques are generally used to reduce the medical workers'
burden; they save time, cost, and human resources. The results have more accuracy. Deep
learning and Neural networks currently provide better solutions to several problems related to
image classification and analysis. Keras is one of the deep learning structures or frameworks.
It is an open-source library for 'neural networks' for classification,more scalable and accurate.
Keras offers a simple application programming interface (API), flexible and powerful and
provides actionable error messages[2].

Earlier images were compared and analyzed using multiple data augmentation methods in
image classification, using convolution neural networks to improve the result [3]. The
primary focus was on perturbations bound in p-norms and found the best and worst-case
image classification concerns [4]. More than 300 deep learning techniques for image
classification, object detection, segmentation in the field of neuro, retinal, plumb nary
pathology, etc., were reviewed [5]. Comparison between the pre fine trained set and trained
from scratch for convolution neural networks was performed earlier for more sensitivity [6].
Also, a Comparison between GAN and Segan for better image segmentation, where GAN's
discriminator may be ineffective and produce regular and sufficient gradient feedback to the
networks, Segan gave better performance[7]. Computer-Aided Detection (CADe) Scale
transformation and using convNet classifier improved the sensitivity [8]. Also, variable input
partitioning leads to a flexible decision-making framework and reasonably accurate results
with a small number of rules and a simple, fast, and robust training process[5]. The masses
was classified as malignant or benign. An earlier study showed that 84.8 % of the
classification accuracy could be obtained using the SVM with RBF kernel trained on the
wavelet approximation coefficients of decomposed signals[9].Comparing Local Difference
Pattern (LDP) and single-center classifier, LDP gives better accurate feature selection than
single-centered classifier for lung cancer [10].

Materials and methods:

Our study used a data set taken from Kaggle. It is a dataset of X-rays kept open for research
[2,11]. For convolution Neural Networks (CNN), Keras with backend TensorFlow was
used[12].

Procedure:
Keras's has helped to build a more accurate prediction model to identify disease conditions
using chest X-rays[13]. The Keras dataset contains the lungs X-ray images of both infected
with and without COVID 19 infection.

Keras with TensorFlow used as backend helped create an image classifier from the raw image
to classify patients as infected with COVID 19 or not using their chest x-ray images.

The x-rays dataset downloaded from the source was given as input. In this classification
problem, the data was labeled using two classes: training (148 images) and testing (40
7images). The data set was split into 80% data for training, 20% data for validation. The
models were trained using the training dataset to classify normal versus COVID-19 images
using validation data.

Generally data augmentation is used to increase data by adding modified copies or newly
created synthetic data.The images were downloaded from the folders and were given to train
for testing.

Then the training was performed using the neural network.

. The activation function used were ReLU and sigmoid. The first four layers followed the
ReLU function, and the last layer, the sigmoid function; further by the binary class mode.

The ReLU function (a non-linear function) is given by 

f(x)=max(0,x).f(x)=max(0,x)._____(1)

The ReLU was commonly used, and the training of the neural network was much faster. The
function (1) was used to the output of the convolution layer.

Figure 1: Implementation and workflow

Results:

The segmented and detected masses were classified by means of CNN with ‘accuracy
95.64%, MCC of 89.91%, AUC of 94.78%, and F1-score of 96.84%’ [14]. The schematic
diagram (Fig 1) shows the workflow of the study.

To get an output likematrix vector product it was applied element wise. The improvement
was scaled up in the neural networks by training the data set. Here flatten, dense, and max-
pooling were done using the activation function. The sigmoid function, or the logistic
function, was applied after the four layers of the ReLU function. The 'Dropout function' was
used to eliminate the noise and the outliers (Fig 2).

Table I: Training data set Table II: Validation data set

Accuracy Loss Accuracy Loss

0.8788 0.3908 1.0000 0.9260
0.8182 0.4623 0.5833 1.2355
0.8542 0.4339 1.0000 0.0380
0.9167 0.2762 1.0000 0.0217
0.947 0.1323 1.0000 0.0238
0.9167 0.2125 1.0000 0.0123
0.9091 0.3020 0.7500 0.0477
0.9091 0.2985 1.0000 0.0518
0.9091 0.3647 0.8750 0.1184
0.9242 0.2059 1.0000 0.0471
 Figure 2:Accuracy vs Epoch of the CNN

Finally, by training the CNN, the model was generated. The validation accuracy achieved
was almost 100%, and validation loss was 0.0250 for 10 Epoch.

Conclusion

Earlier deep learning studies [14,15,16] have experimented using X-rays of Pneumonia,
Mammograms, and COVID 19 infection. The authors have developed a novel deep learning
model for predicting COVID 19 on X-ray images using Tenseflow deep convolution neural
network architecture in the present study. Our model achieved almost 100% accuracy with
the acceptable model loss and better AUC Scores. The authors' plan is to explore the
technique for the classification of brain tumors and MRI images.

Reference:
1. https://www.worldometers.info/coronavirus/ Accessed on December 24, 2020.
2. https://keras.ioAccessed on August 10, 2020
3. A. Mikolajczyk and M. Grochowski, “Data augmentation for improving deep learning in
an image classification problem” in Proc. Int. Interdiscipl.Ph.D. Workshop (IIPhDW),
May 2018, pp. 117–122.
4. L. Engstrom, D. Tsipras, L. Schmidt, and A.Madry, “ rotation and a translation suffice:
Fooling CNN with simple transformations,” 2017, arXiv:1712.02779.
5. G. Litjens, T. Kooi, B. E. Bejnordi, A. A. A. Setio, F. Ciompi, M. Ghafoorian, J. A. W.
M. van der Laak, B. van Ginneken, and C. I. Sánchez, “A survey on deep learning in
medical image analysis,” Med. Image Anal., vol. 42, pp. 60–88, Dec. 2017.
6. N. Tajbakhsh, J. Y. Shin, S. R. Gurudu, R. T. Hurst, C. B. Kendall, M. B. Gotway, and J.
Liang, “Convolutional neural networks for medical image analysis: Full training or fine-
tuning”, IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1299–1312, May 2016
7. Y. Xue, T. Xu, H. Zhang, L. R. Long, and X. Huang, “Segan: Adversarial network with
multi-scale l1 loss for medical image segmentation,” Neuroinformatics, vol. 16, nos. 3–4,
pp. 383–392, Oct. 2018.
8. H. R. Roth, L. Lu, J. Liu, J. Yao, A. Seff, K. Cherry, L. Kim, and R. M. Summers,
“Improving computer-aided detection using convolutional neural networks and random
view aggregation,” IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1170–1181, May 2016.
9.  loannisGadaras and Ludmil Mikhailov, "An interpretable fuzzy rule-based classification
methodology for medical diagnosis, " Artificial Intelligence in Medicine, vol. 47, no. 1,
pp. 25-41, September 2009
10. H. Osta, R. Qahwaji, and S. Ipson, "Wavelet-based feature extraction and classification
for mammogram images using RBF and SVM, " in Proceeding Visualization, Imaging,
and Image Processing, 2008, p. 630.
11. K. Mao Mao and Z. Deng, "Lung Nodule Image Classification Based on Local Difference
Pattern and Combined Classifier," Computational and Mathematical Methods in
Medicine, vol. 2016, pp. 1-7, 2016.
12. https://github.com/JordanMicahBennett/SMART-CT-SCAN_BASED-
COVID19_VIRUS_DETECTOR/ Accessed on August 10, 2020
13. https://www.kaggle.com/khoongweihao/covid19-xray-dataset-train-test-sets Accessed on
August 10, 2020
14. S. Mondal, K. Agarwal, and M. Rashid, “Deep Learning Approach for Automatic
Classification of X-Ray Images using Convolutional Neural Network,” 2019 Fifth
International Conference on Image Information Processing (ICIIP), 2019 pp. 326-331,
doi:10.1109/ICIIP47207.2019.8985687
15. “Coronavirus disease (COVID-19) Situation report-209 Situation in numbers (by WHO
Region),” Tech. Rep., August
2020, https://www.who.int/docs/default-source/coronaviruse/situation-reports/20200816-
covid-19-sitrep-209.pdf?sfvrsn=5dde1ca2_2.
16. Mujahid, Mohammed, TaekChoibSeung-MooHana “A fully integrated computer-aided
diagnosis system for digital X-ray mammograms via deep learning detection,
segmentation, and classification” International Journal of Medical Informatics, Volume
117, September 2018