Professional Documents
Culture Documents
Abstract - Deep learning models have become the province of being investigated and reported. High-quality imag ing aids
cutting-edge machine learning models that are widely used in patient decision-making and has the potential to save lives.
medical imaging in multiple kinds of ranging from image
recognition to natural language processing. This article presents An ever-changing technology is med ical imag ing.
a brief overview on the recent developments and some relevant
issues in medical image processing and image analysis as they With advances in the field of mach ine learning, medical
related to machine learning. The proposed article will not cover imaging is evolving on a daily basis. This suggests that in
the entire application landscape becau se it is becoming a very the future, as more and more co mputer vision experts and
large and rapidly growing field, but will instead focus primarily med ical practitioners work together to develop medical
on deep learning theory and techniques in medical imaging. Our imaging, the results of it will continue to improve [1]. In the
goal is threefold: (i) To provide such a brief overview to deep previous era, the value of medical imag ing, s uch as
medical imaging learning; (ii) To represent different approaches Co mputed To mography (CT), Magnetic Resonance imaging
as well as comparisons of how deep learning has been (MR), Positron Emission Tomography (PET),
accomplished, from image retrieval to segmentation to disease Mammography, Ultrasound, X-ray and so on. It has been
prediction; (iii) Provide the current medical imaging-related deep
learning applications. observed in the detection and diagnosis of illnesses at an
early stage. In the hospital research center, hu man
specialists such as radiologists and doctors have mostly
Keywords-Big data, Convolutional Neural Network, Deep
learning, Disease Prediction, Healthcare, Medical Imaging.
conducted medical image analysis in the clinic Brody et al.
[2013][46].
1. INTRODUCTION
Traditionally, hu man experts have mostly
developed functional or task-related factors based on their
The healthcare industry is a large-priority field focus on a specific do main, making non-experts unable to
where most medical data assessments are conducted by use machine learn ing methods for their own research. Deep
med ical experts. Due to its scope, variety of criteria and learning, on the other hand, has reduced such barriers by
most basic core knowledge of the subject, understanding of incorporating the feature selection step into the learning
med ical images is very limited to s pecific experts. process. That is, deep learning requires only a collect ion of
Healthcare med ical imag ing is a collection of procedures or data with minor preprocessing rather than hand-designing
strategies used to generate visual representations of internal features and then exploring the insightful embodiments in a
body sections, such as organs or tissues, for medical self-taught manner Bengio et al. [2009][45]. When the
purposes, such as health monitoring, diagnosis, treatment of sample size available throughout a training process is hug e,
diseases and injuries. It also aids in the establishment of deep learning methods are highly successful. More than 1
anatomy and physiology databases. Because of recent million illustrated images were given, for instance, in the
advancements in the field, med ical imaging has the potential ImageNet Large Scale Visual Recognition Challenge
to collect hu man body knowledge for a wide range of (ILSVRC). As for clin ical uses, however, we typically have
valuable medical applicat ions. Various types of medical a small group of images, For examp le, appro ximately 1,000
imaging technology provide varying levels of detail about images. The small number of training samples required to
the location of the body to be examined or treated. The use generate deep models without overfitting is one of the most
of medical imag ing for med ical procedures is regarded as major challenges in applying deep learning to medical
critical validation of many diseases and illnesses that are images, according to Russakovsky et al. [2015][47].
Fig 1. Why deep learning for medical imaging? Localization of anatomical artefacts such as organs
Jotheeswaran et al. [2018] / lesions is an essential pre -processing aspect of the
segmentation task. Several systems have been suggested in
Figure 1 depicts the importance of deep learning order to locate an object in an image, 3D image parsing
involvement in various image modalit ies as for the medical involves transforming 3D space as a co mbination o f 2D
image processing. Deep learn ing is unquestionably critical orthogonal planes. There was a long rev iew pattern using
in med ical imaging. The research includes everything fro m computer-aided strategies in the identificat ion of lesions in a
short guides to articles. Lakhani et al. [2017]; Litjens et al. med ical p icture, enhancing the precision of detection or
[2017]; Erickson et al. [2017]; Hagerty et al. [2017]; reducing detection time for humans. Interestingly, the first
Seebock et al. [2015]; Shen et al. [2017]; Su zuki et al. such methodology was designed in 1995 to d iagnose
Rajchl et al., 2018; Brein inger et al., 2018; Cornelisse et al., nodules in X-ray images that used a CNN with 4 layers Liu
2018; to co mplete books Gareon et al., 2017; Lu et al., et al. [2004].
2017; Zhou et al., 2017.
Medical image segmentation of organs and other
There are nu merous introductions to the topic. structural elements consists of detailed analysis of shape,
They each serve a unique purpose and provide a unique size and volu me. Usually, the segmentation task is
perspective on this rapidly evolving deep learning characterized as the identification of a co llect ion of pixels
technology. defining contours or artefacts. In terms of imp lementation of
deep learning algorith ms, feature extraction involves the
The goal of this review is to provide the reader activities of target recognition as well as organ and
with availab le deep learning for medical imaging and to substructure segmentation. Class imbalance is one issue that
assist medical experts. This research work's main injury seg mentation associates with object recognition,
contribution is because the majority of the pixels in an image belong to a
non-infected category.
1. It all started with a solid foundation of deep learning in
medical imaging. Often referred to as spatial alignment, the typical
task of image analysis is to measure the transformation of
coordinates fro m one image to the next. In this situation
mostly carried out in a proprioceptive where a specific type
of transition is presumed and a pre -trained met ric is 2.2.1 Preparation of Datasets and Data Collection
optimized. While detection of lesions and object
This consists of gathering objects of medical info rmation
segmentation are seen as the primary use of deep learning
fro m mult iple sources such as health facilities, patient
algorith ms. Researchers have discovered that deep networks
discharge slips, as well as the UCI repository, and then
can be helpful in achieving the optimal output for
collecting preprocessing. The data that will remove all
registration.
redundant data while extracting relevant data features .
empowered or tested on how they work once trained in the Accuracy for
absence of such data. Hu miliation, paranoia or emot ional T uberculosis
pain may be experienced by patients whose private medical Rahul
GoogLeNet Microscopic 95.79%
Duggal et
informat ion is availab le. While these injuries do not have al.[2016]
and AlexNet Images Accuracy
observable external consequences, they are still injuries. Five layers Wireless
Patients may experience no financial damage or stigma fro m Xiao Jia et Convolutional Capsule 99%
others. Big data also increases the risk fo r mo re damage to al.[2016] Neural Endoscopy Accuracy
Network (WCE) images
dignity. Facts are especially sensitive and private about
Gastrointestina Rongsheng Convolutional 80%
wellbeing. In certain cases, big data allows so meone that we l (GI) Diseases Zhu et Neural ImageNet
would not like to access the data to direct knowledge of Accuracy
Detection al.[2015] Network
health, whether by inadvertent exposure or harmfu l Syed H
Fast features
activities such as hacking [2]. extraction Upto 90%
Shirazi et GI tract of KID
using CNN accuracy
al.[2016]
architecture
3. COMPARISON AND ANALYSIS OF DEEP Jelmer M Convolutional 482
87%
LEARNING MEDICAL IMAGING Wolterink et Neural Mammographi
Accuracy
al.[2015] Network c Images
Nu merous image specific d iagnostic tasks require a 736 oblique
and
new search in order to detect ano malies, calculate Convolutional craniocaudal
measurements, and change on the fly. The primary enablers Weidi Xie et 82.6%
Neural mediolateral
al.[2016] Accuracy
are automated image analysis tools based on machine Network mammographi
learning algorithms, wh ich improve image diagnosis and c views of 344
Tumor cancer patients.
perception by making it easier to classify findings. Deep Detection
Breast
learning is a popular method for determin ing the aft state's ultrasound
Yixuan Convolutional
accuracy. This recently opened previously uncharted Yuan et Neural
images of 1125 88%
territory in med ical image analysis. Deep learning patients with Accuracy
al.[2017] Network
applications in healthcare address a wide range of issues, 2393 regions
of concern.
including cancer screening and disease tracking, as well as Convolutional 219 lesions in
personalized treatment reco mmendations. However, we are Jiang et 86%
Neural 607 breast
al.[2017] Accuracy
still lacking in methods for converting all of this data into Network images.
usable data in Table 1. major deep learning research in 270900
Images,
med ical image analysis in multip le disease detection was Sarraf et validated and 96.86%
highlighted. LeNet-5
al.[2016] checked in Accuracy
fMRI on 90300
TABLE 1. Major Deep Learning Research in Medical Image Analysis Alzheimer’s images.
with Multiple Disease Detection and Accuracies
Parkinsons Deep up to
Hjelm et
Diseases Boltzmann ADNI Dataset 92.38%,
Performanc al.[2014]
Analysis Re fe re nce Model Dataset Used Detection Machine 92.20% and
e Factor
95.35%.
Deep 97.5% 3D-
Varun
Convolutional EyePACS, Sensitivity, Hosseini CAD
Gulshan et Convolutiona
Neural Messidor 93.4% asl et Dementia 98.84%
al.[2016] l Neural
Network Specificity al.[2016] M RI
Convolutional 94% Network
Kathirvel Neural Sensitivity
Kaggle-fundus
[2016] Network with 96%
dropout layer Specificity
Cu-Deep The availability of b ig data, the new hu man brain -
Diabe tic Harry Pratt Convolutional 75% modeled deep learn ing algorith m, and co mputing power are
Kaggle
Re tinopathy et al.[2016] Neural Accuracy
Network three developments driving the deep learning revolution.
Five layers 98% While the long-term economic advantages of deep learning
Xiao Jia et Convolutional Sensitivity are substantial, the initial effo rt and costs are also
Massidor ROC
al.[2016] Neural 97% significant. However, despite major stakeholders' efforts and
Network Specificity projections about the development of deep learn ing and
Deep
Konstantino
Convolutional 45%
med ical imaging. There will be a debate about replacing
s Kamnitsas EyePACS humans with machines. Deep learn ing may have advantages
Neural Accuracy
et al.[2017]
Network of patient prevention and treatment. Moreover, there have
Convolutional been some issues that must be addressed before this can
Neslihan Neural ImageNet
99% for happen faster.
Histological Bayramoglu Network with HistoPheno Hookworm
and et al.[2016] transfer types
Microscopical approach
Ele me nts Deep 100%
John A
De te ction Convolutional Microscopic Accuracy for
Quinn et
Neural Images Malaria
al.[2016]
Network 99%
and can solve a wide range of reflexive and cognitive connected crf for accurate brain lesion segmentation. Medical Image
problems. Analysis, 36:61–78, 2017.
[21] P. Lakhani, D.L. Gray, C.R. Pett, P. Nagy, G. Shih.Hello world deep
learning in medical imaging J Digit Imaging, 31 (2018), pp. 283-289
[22] G. Litjens, T. Kooi, B.E. Bejnordi, A.A.A. Setio, F. Ciompi, M.
REFERENCES
Ghafoorian, et al.
[1] https://nanonets.com/blog/deep-learning-for-medical-imaging/#what- [23] A survey on deep learning in medical image analysis Med Image
Anal, 42 (2017), pp. 60-88.
is-medical-imaging.
[24] Liu, Xiang & Kim, Wangdo & Drerup, Burkhard. (2004). 3D
[2] https://www.lexalytics.com/lexablog/ai-healthcare-data-privacy-ethics-
characterization and localization of anatomical landmarks of the foot
issues.
by FastSCAN. Real-T ime Imaging. 10. 217-228.
[3] Brody H. Medical imaging. Nature. 2013;502: S81–S81.
10.1016/j.rti.2004.05.009.
[4] Bengio Y. Learning deep architectures for ai. Foundations and Trends
[25] L. Lu, Y. Zheng, G. Carneiro, L. Yang. Deep learning and
in Machine Learning. 2009; 2:1–127.
convolutional neural networks for medical image
[5] K. Breininger, T . Würfl. Tutorial: how to build a deep learning
computing.Springer (2017).
framework (2018) https://github.com/kbreininger/tutorial-dlframework
[6] Choudhary, Dr & saxena, Dr & abhishek, Dr & Gulati, Dr & Khare, Dr [26] Neslihan Bayramoglu and Janne Heikkil¨a. Transfer learning for cell
nu-clei classification in histopathology images. In Computer Vision–
& Prasad, Dr. (2016). Artefact & Classification. Saudi Journal of
ECCV 2016 Workshops, pages 532–539. Springer, 2016.
Medical and Pharmaceutical Sciences. 2. 141-145.
[27] N. Pawlowski, S.I. Ktena, M.C. Lee, B. Kainz, D. Rueckert, B.
10.21276/sjmps.2016.2.6.4.
Glocker, et al. DLT K: state of the art reference implementations for
[7] D. Cornelisse An intuitive guide to Convolutional Neural Networks
deep learning on medical images, (2017), arXiv:1711.06853.
(2018) https://medium.freecodecamp.org/an-intuitive-guide-to-
[28] Pugalendhi, Ganeshkumar. (2018). Content based image retrieval
convolutional-neural-networks-260c2de0a050.
using deep learning process. Cluster Computing.
[8] B.J. Erickson, P. Korfiatis, Z. Akkus, T.L. Kline.Machine learning for
[29] Rahul Duggal, Anubha Gupta, Ritu Gupta, Manya Wadhwa, and
medical imaging Radiographics, 37 (2017), pp. 505-515.
[9] A. Géron. Hands-on machine learning with Scikit -Learn and Chirag Ahuja. Overlapping cell nuclei segmentation in microscopic
TensorFlow: concepts, tools, and techniques to build intelligent images using deep belief networks. In Proceedings of the T enth
Indian Conference on Computer Vision, Graphics and Image
systems O’Reilly Media, Inc. (2017).
Processing, page 82. ACM, 2016.
[10] Ginneken, Bram & Summers, Ronald. (2016). Guest Editorial Deep
[30] M. Rajchl, S.I. Ktena, N. Pawlowski. An introduction to biomedical
Learning in Medical Imaging: Overview and Future Promise of an
image analysis with TensorFlow and DLTK, (2018).
Exciting New Technique. IEEE Transactions on Medical Imaging.
https://medium.com/tensorflow/an-introduction-to-biomedical-
35. 1153-1159. 10.1109/TMI.2016.2553401.
image-analysis-with-tensorflow-and-dltk-2c25304e7c13.
[11] J. Hagerty, R.J. Stanley, W.V. Stoecker. Medical image processing
[31] Rongsheng Zhu, Rong Zhang, and Dixiu Xue. Lesion detection of
in the age of deep learning Proceedings of the 12th international joint
en-doscopy images based on convolutional neural network features.
conference on Computer Vision, Imaging and Computer Graphics
T heory and Applications (VISIGRAPP) (2017), pp. 306-311. In Im-age and Signal Processing (CISP), 2015 8th International
Congress on, pages 372–376. IEEE, 2015.
[12] Harry Pratt, Frans Coenen, Deborah M Broadbent, Simon P Harding,
[32] Russakovsky O, Deng J, Su H, Krause J, Satheesh S, et al. ImageNet
and Yalin Zheng. Convolutional neural networks for diabetic
Large Scale Visual Recognition Challenge. International Journal of
retinopathy. Procedia Computer Science, 90:200–205, 2016.
Computer Vision. 2015; 115:211–252.
[13] Hjelm, R Devon & Calhoun, Vince & Salakhutdinov, Ruslan &
[33] Sarraf, Saman & Tofighi, Ghassem. (2016). Deep Learning-based
Allen, Elena & Adali, T ülay & Plis, Sergey. (2014). Restricted
Pipeline to Recognize Alzheimer's Disease using fMRI Data.
Boltzmann Machines for Neuroimaging: An Application in
10.1109/FTC.2016.7821697.
Identifying Intrinsic Networks. NeuroImage. 96.
[34] P. Seebock.Deep learning in medical image analysis (Master's
10.1016/j.neuroimage.2014.03.048.
[14] Hosseini asl, Ehsan & Keynton, Robert & El-Baz, Ayman. (2016). thesis), Vienna University of Technology, Faculty of Informatics
Alzheimer's Disease Diagnostics by Adaptation of 3D Convolutional (2015).
[35] D. Shen, G. Wu, H.-I. Suk.Deep learning in medical image analysis
Network. 10.1109/ICIP.2016.7532332.
Annu Rev Biomed Eng, 19 (2017), pp. 221-248.
[15] Jelmer M Wolterink, T im Leiner, Max A Viergever, and Ivana
[36] K. Suzuki. Survey of deep learning applications to medical image
Iˇsgum. Automatic coronary calcium scoring in cardiac ct
analysis. MEd Imaging Technol, 35 (2017), pp. 212-226.
angiography using convolutional neural networks. In International
[37] Syed H Shirazi, Arif Iqbal Umar, Saeeda Naz, and Muhammad I
Conference on Medical Image Computing and Computer-Assisted
Razzak. Efficient leukocyte segmentation and recognition in
Intervention, pages 589–596. Springer, 2015.
peripheral blood im-age. Technology and Health Care, 24(3):335–
[16] Jiang, Fan & Liu, Hui & Yu, Nicolas & Xie, Yaoqin. (2017). Breast
347, 2016.
mass lesion classification in mammograms by transfer learning. 59-
62. 10.1145/3035012.3035022. [38] Varun Gulshan, Lily Peng, Marc Coram, Martin C Stumpe, Derek
Wu, Arunachalam Narayanaswamy, Subhashini Venugopalan,
[17] John A Quinn, Rose Nakasi, Pius KB Mugagga, Patrick Byanyima,
Kasumi Wid-ner, Tom Madams, Jorge Cuadros, et al. Development
William Lubega, and Alfred Andama. Deep convolutional neural
and validation of a deep learning algorithm for detection of diabetic
net-works for microscopy-based point of care diagnostics. arXiv
retinopathy in retinal fundus photographs. JAMA, 316(22):2402–
preprint arXiv:1608.02989, 2016.
2410, 2016.
[18] Jotheeswaran, Jeevanandam & T anwar, Sushama. (2018). Survey on
[39] Weidi Xie, J Alison Noble, and Andrew Zisserman. Microscopy cell
Deep Learning for Medical Imaging. 5. 1608-20.
counting and detection with fully convolutional regression networks.
[19] C. T. R. Kathirvel. Classifying Diabetic Retinopathy using Deep
Computer Methods in Biomechanics and Biomedical Engineering:
Learn-ing Architecture. International Journal of Engineering
Research T ech-nology, 5(6), 2016. Imaging & Visualization, pages 1–10, 2016.
[20] Konstantinos Kamnitsas, Christian Ledig, Virginia FJ Newcombe, [40] Wu, Q., Boueiz, A., Bozkurt, A., Masoomi, A., Wang, A., DeMeo,
D. L., Weiss, S. T., & Qiu, W. (2018). Deep Learning Methods for
Joanna P Simpson, Andrew D Kane, David K Menon, Daniel
Predicting Disease Status Using Genomic Data. Journal of
Rueckert, and Ben Glocker. Efficient multi-scale 3d CNN with fully
biometrics & biostatistics, 9(5), 417.
[41] Xiao Jia and Max Q-H Meng. A deep convolutional neural network
for bleeding detection in wireless capsule endoscopy images. In
Engineer-ing in Medicine and Biology Society (EMBC), 2016 IEEE
38th Annual International Conference of the, pages 639–642. IEEE,
2016.
[42] Yixuan Yuan and Max Q-H Meng. Deep learning for polyp
recognition in wireless capsule endoscopy images. Medical Physics,
2017.
[43] S.K. Zhou, H. Greenspan, D. Shen. Deep learning for medical image
analysis. Academic Press (2017).
[44] R-Prabha M, Prabhu R, Suganthi SU, Sridevi S, Senthil GA, Babu
DV. Design of Hybrid Deep Learning Approach for Covid-19
Infected Lung Image Segmentation. In Journal of Physics:
Conference Series 2021 Oct 1 (Vol. 2040, No. 1, p. 012016). IOP
Publishing. doi:10.1088/1742-6596/2040/1/012016.
[45] R. Prabha, M. S. G. A, P. Anandan, S. Sivarajeswari, C.
Saravanakumar and D. Vijendra Babu, "Design of an Automated
Recurrent Neural Network for Emotional Intelligence Using Deep
Neural Networks," 2022 4th International Conference on Smart
Systems and Inventive Technology (ICSSIT), 2022, pp. 1061-1067,
doi: 10.1109/ICSSIT 53264.2022.9716420.
[46] Prabha, R., G. A. Senthil, A. Lazha, D. VijendraBabu, and Ms D.
Roopa. "A Novel Computational Rough Set Based Feature
Extraction for Heart Disease Analysis." In I3CAC 2021: Proceedings
of the First International Conference on Computing, Communication
and Control System, I3CAC 2021, 7-8 June 2021, Bharath
University, Chennai, India, p. 371. European Alliance for
Innovation, 2021. DOI:10.4108/eai.7-6-2021.2308575.
[47] K.C. Suresh, R. Prabha, N. Hemavathy, S Sivarajeswari, D
Gokulakrishnan, M. Jagadeesh kumar, A Machine Learning
Approach for Human Breath Diagnosis with Soft Sensors,
Computers and Electrical Engineering, Volume 100, 2022, 107945,
ISSN0045-7906,
https://doi.org/10.1016/j.compeleceng.2022.107945.