You are on page 1of 11

JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO.

14, 2019

ª 2019 PUBLISHED BY ELSEVIER ON BEHALF OF THE

AMERICAN COLLEGE OF CARDIOLOGY FOUNDATION

STATE-OF-THE-ART REVIEW

Impact of Artificial Intelligence on


Interventional Cardiology
From Decision-Making Aid to Advanced Interventional
Procedure Assistance

Partha Sardar, MD,a J. Dawn Abbott, MD,a Amartya Kundu, MD,b Herbert D. Aronow, MD,a Juan F. Granada, MD,c
Jay Giri, MD, MPHd,e

ABSTRACT

Access to big data analyzed by supercomputers using advanced mathematical algorithms (i.e., deep machine learning)
has allowed for enhancement of cognitive output (i.e., visual imaging interpretation) to previously unseen levels and
promises to fundamentally change the practice of medicine. This field, known as “artificial intelligence” (AI), is making
significant progress in areas such as automated clinical decision making, medical imaging analysis, and interventional
procedures, and has the potential to dramatically influence the practice of interventional cardiology. The unique nature of
interventional cardiology makes it an ideal target for the development of AI-based technologies designed to improve
real-time clinical decision making, streamline workflow in the catheterization laboratory, and standardize catheter-based
procedures through advanced robotics. This review provides an introduction to AI by highlighting its scope,
potential applications, and limitations in interventional cardiology. (J Am Coll Cardiol Intv 2019;12:1293–303)
© 2019 Published by Elsevier on behalf of the American College of Cardiology Foundation.

A rtificial Intelligence (AI) is a general term that


signifies the use of mathematical algorithms
which give machines the ability to reason
and perform cognitive functions such as problem
that can be used to integrate and interpret complex
biomedical data as well as advance technological
automation (3–6). Years of research have finally
brought AI into our daily lives with popular practical
solving, object/word recognition and decision- applications such as self-driving cars and speech
making (1,2). AI encompasses a family of operations recognition software such as Amazon’s Alexa Voice
including machine learning (ML), deep learning (Amazon, Seattle, Washington) and IBM’s Watson
(DL), natural language processing (NLP), cognitive (IBM, Armonk, New York). However, the rate of adop-
computing, computer vision and robotics (Figure 1) tion of AI in medicine is slow, as compared with other

From the aCardiovascular Institute, Warren Alpert Medical School at Brown University, Providence, Rhode Island; bDivision of
Cardiovascular Medicine, University of Massachusetts Medical School, Worcester, Massachusetts; cCardiovascular Research
Foundation, Columbia University Medical Center, New York, New York; dPenn Cardiovascular Outcomes, Quality and Evaluative
Research Center, Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, Pennsylvania; and the
e
Cardiovascular Medicine Division, University of Pennsylvania, Philadelphia, Pennsylvania. Dr. Granada has received institutional
grant/research support (to Skirball Center for Innovation) from Abbott Vascular, Amaranth Medical, Amber Medical, Amgen,
Baylis, BIO2 Medical, Bristol-Myers Squibb, Boston Scientific, Cagent Vascular, Caliber Therapeutics, Cephea, Columbia Medical,
Corindus Vascular, Celyad, Freudenberg Medical, Intact Vascular, JenaValve, Keystone Heart, LimFlow Medical, LoneStar Heart,
Marvel Medical, Medtronic, Meril Life Sciences, MicroVention, Motus GI, Navigate Cardiac Structures, New York University,
OrbusNeich Medical, SoundBite Medical, Spectranetics, Toray Industries, Vetex Medical, Volcano (Philips), and Zimmer Biomet.
Dr. Giri has served on an advisory board for AstraZeneca; and has received research support to the institution from Recor Medical
and Abbott Vascular. All other authors have reported that they have no relationships relevant to the contents of this paper to
disclose.

Manuscript received August 8, 2018; revised manuscript received February 26, 2019, accepted April 2, 2019.

ISSN 1936-8798/$36.00 https://doi.org/10.1016/j.jcin.2019.04.048


1294 Sardar et al. JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019

Artificial Intelligence and Interventional Cardiology JULY 22, 2019:1293–303

ABBREVIATIONS industries such as financial technology, in-


AND ACRONYMS HIGHLIGHTS
formation technology, and the aerospace
industry.  The field of AI has initiated a paradigm
AI = artificial intelligence
The application of AI in interventional shift in health care with advanced
AR = augmented reality
cardiology (IC) can be divided into 2 main analytical techniques.
DL = deep learning
branches, virtual and physical. The virtual
EMR = electronic medical  Potential applications of AI in IC are
branch includes informatics from ML/DL,
record image and video analysis, clinical deci-
NLP, and cognitive computing to control
FDA = Food and Drug sion support, robotic assistance with
health management systems (i.e., electronic
Administration
procedure, and novel approaches to
health records and medical image analysis
IC = interventional cardiology clinical database analysis.
software), and automated clinical decision
ML = machine learning
support systems. The physical branch is best  The current development of AI in IC is in
NLP = natural language
represented by robotic interventional pro- its early stage, but it has the potential to
processing
cedures. Applications of AI within medicine transform IC practice.
PCI = percutaneous coronary
intervention have been predicted to fundamentally
VR = virtual reality
transform the landscape of health care de-
livery. However, as with many emerging DL is a subfield of ML and is characterized by al-
technologies, the true promise of AI within medicine gorithms that are inspired by the workings of the
at large, and IC specifically, may be lost if it is not human brain, including a class of algorithms called
developed correctly. neural networks (1,7) (Table 1, Figure 1). In the case of
traditional ML, an algorithm needs to be programmed
CONCEPTS UNDERLYING AI METHODS how to make a precise prediction by providing it with
additional information. With DL, algorithms analyze
AI is an umbrella term for a set of algorithms that large datasets, automatically discover patterns, and
imitate intelligent human behavior. ML refers to an learn without human intervention. A DL neural
automated system that learns to perform a task or network consists of digitized inputs, such as an im-
make decisions automatically from an available data age, audio or video, which proceeds through multiple
source, rather than having its behavior explicitly layers of connected “neurons” that progressively
programmed (Table 1). Although the terms artificial identify features, and ultimately provides an output
intelligence and machine learning are often used more (1,2). DL is the underlying platform for image recog-
or less synonymously, in more precise terms, ML is a nition applications that are likely to be used in car-
set of techniques to enable AI. AI and ML are used diovascular imaging modalities (e.g., angiography,
in several overlapping fields such as NLP, echocardiography, computed tomography, cardiac
cognitive computing, computer vision, and robotics magnetic resonance, intravascular ultrasound, and
(Central Illustration). Major techniques/approaches in optical coherence tomography) (7,8). Creating DL
AI and ML include supervised, unsupervised, and networks can take a significant amount of time and
reinforcement learning (Figure 1). resources. The transfer learning approach, which in-
ML methods can complement and extend con- volves transferring the knowledge gained by a DL
ventional statistical methods. Existing statistical system in 1 dataset to another dataset with different
methods primarily help to explore relationships data, may mitigate this issue. (4).
between a limited number of variables. By contrast,
ML methods identify features from the data, SUPERVISED LEARNING. Supervised learning is a
perform prediction, and provide tools and algo- type of ML in which training of datasets are con-
rithms to understand patterns from large, complex, ducted with specific labels or annotations (Figure 1).
and heterogeneous data (7,8). Additionally, ML al- This approach develops a model to predict or classify
gorithms are based on fewer assumptions and can, future events, or to find variables relevant to a spec-
in some cases, provide superior and more robust ified outcome. It often involves classification of an
predictions (2). For example, Azzalini et al. (9) used observation into one or more categories or outcomes
generalized boosted regression (an ML approach) to (e.g., “Does this angiogram represent coronary
identify whether contrast media type was an inde- dissection or thrombosis?”). Supervised learning in-
pendent predictor of contrast-induced acute kidney volves classification and regression problems, but it
injury after percutaneous coronary intervention requires a lot of data and is time-consuming, because
(PCI). the source data have to be labeled by humans (2,6,7).
JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019 Sardar et al. 1295
JULY 22, 2019:1293–303 Artificial Intelligence and Interventional Cardiology

F I G U R E 1 Types of Machine Learning

However, some successes have already been seen pre-specified environment to maximize a reward
with supervised learning with models developed (1,2) (Figure 1). The program thus identifies the
to successfully improve heart failure readmission appropriate behavior using a “reward criteria” to
prediction and accurately grade echocardiographic influence the decision-making process. It attempts to
mitral regurgitation (8). accomplish a task (e.g., driving a car, inferring
medical decisions) while learning from its own suc-
UNSUPERVISED LEARNING. Unsupervised learning
cess and failures (2,6). The main aim of reinforce-
seeks to discover underlying structure or relation-
ment learning is to maximize the accuracy of
ships among variables in a dataset (Figure 1). The
algorithms using trial and error. Many clinical
training of dataset is conducted without any spe-
problems can be formatted to fit the format of a
cific labels, and the algorithm clusters data to
reinforcement learning problem. Hence, reinforce-
reveal underlying patterns. It seeks to identify
ment learning algorithms may be used to aid clinical
novel disease mechanisms, genotypes, or pheno-
decision making, intelligently segment medical im-
types from hidden patterns present in the data
aging data, and select personalized medications
(2,7). Unsupervised learning algorithms including
(1,2). Application of reinforcement learning to med-
artificial neural networks that analyzed surface
icine and cardiology thus far has been limited.
echocardiograms have already been found to be
Studies have demonstrated promising results with
useful in the automated discrimination of hyper-
reinforcement learning in optimization of treatment
trophic cardiomyopathy from physiological hyper-
decisions for chronic illnesses and recommending
trophy seen in athletes (10). Shah et al. (11) used
mechanical ventilator weaning protocols that have
agglomerative hierarchical clustering, a commonly
led to superior clinical outcomes (7).
used unsupervised learning tool for analysis of
phenotypic data, and the phenomapping resulted in NATURAL LANGUAGE PROCESSING. NLP, a conflu-
a novel classification of heart failure with preserved ence of AI and linguistics, focused upon developing a
ejection fraction. computer’s ability to understand human language (6)
(Central Illustration, Table 1). ML and DL have some
REINFORCEMENT LEARNING. Reinforcement learning, overlap with NLP; however, NLP has a strong lin-
based on behavioral psychology, uses an alternate guistics component (not represented in images) that
approach where a software program acts in a requires an understanding of how we use language.
1296 Sardar et al. JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019

Artificial Intelligence and Interventional Cardiology JULY 22, 2019:1293–303

real-time adverse events and assist intraprocedural


T A B L E 1 Commonly Used Terms in AI
clinical decision making.
AI A branch of applied computer science wherein computer algorithms are
trained to perform tasks, and have the capability to imitate intelligent
human intelligence. VIRTUAL APPLICATION OF AI IN IC
ML Subfield of AI, a machine learns to perform a task or make decisions
automatically from an available data source without being explicitly IMAGING INTERPRETATION. AI promises to have a
programmed.
major impact on imaging reconstruction, analysis and
DL DL is a type of ML that mimics the operation of the human brain and
includes a class of algorithms called neural networks. interpretation. The analysis of large amounts of im-
NLP NLP is an area of computer science and artificial intelligence related to the aging data and the use of dedicated imaging software
organization of unstructured narrative text into a structured form that has allowed the advancement of the imaging display
can be interpreted by a machine and allows for automated information
extraction. into more “anatomic layouts” allowing the simplifi-
Cognitive Cognitive computing platforms integrate machine learning, reasoning, cation of imaging interpretation (4,8). A study by Du
computing natural language processing, speech and object recognition, et al. (14) showed the preliminary feasibility of DL
human–computer interaction, dialog and narrative generation.
technology in angiographic recognition based on a
Computer vision Computer vision is a branch of computer science concerned with objects
and feature recognition in images or multi-dimensional data, including convolutional neural network model. For training
digital video frames. data, 3,990 images were used to establish the model,
Robotics Robotics deals with the design, construction, operation, and use of robotic and 2,711 images were used to evaluate it. The preci-
devices that can move and react to sensory input. Robotics also
concerned with creation of computer systems for their control, sensory sion (percentage of the correct pixels) and recall rate
feedback, and information processing. (percentage of retrieved relevant pixels) were used to
evaluate the effectiveness of the model. For detecting
AI ¼ artificial intelligence; DL ¼ deep learning; ML ¼ machine learning; NLP ¼ natural language processing.
lesion characteristics, including diameter stenosis,
calcification, thrombus, and dissection, the recall rate
was 88.2%, 82.6%, 85.5%, and 85.8%, respectively
NLP has been used for largescale database analysis of
(14). Another study by Ciusdel et al. (15), evaluated an
the electronic medical record (EMR) to detect adverse
AI-based solution for fully automated cardiac phase
events and post-operative complications from physi-
and end-diastolic frame detection on coronary an-
cian documentation, to achieve automated claims
giograms. The workflow was trained with a deep
coding, and to improve workflow (6,12). Sohn et al.
neural network on 17,800 angiograms from 3,900
(13) demonstrated the feasibility of NLP techniques in
patients and evaluated on 27,900 angiograms from
processing radiology reports and developed a rule-
6,250 patients. Cardiac phase detection had an accu-
based algorithm to identify abdominal aortic aneu-
racy of 92.6%, a sensitivity of 92.4% and a specificity
rysm. NLP can be used to scan thousands of data
of 92.9% on the evaluation set (15). A group from
sources (EMRs, image libraries, and so on) to screen
Emory University has developed an ML method for
and identify patients with critical valvular or vascular
segmenting intravascular ultrasound images and
stenosis, hypertrophic cardiomyopathy, atrial septal
automatically calculating lumen area and plaque
defects, and so on.
burden that showed excellent agreement with an
COMPUTER VISION. Computer vision is a branch of expert analyst (16). This method can segment single
computer science dealing with objects and feature images in a fraction of a second and has the potential
recognition in digital images, including digital video for online use in the catheterization laboratory.
frames (1,5). It is a combination of image processing The anatomic and functional assessment of coro-
(for feature extraction) plus ML (using these features nary stenosis is now possible with the use of nonin-
to build a model). Unsupervised learning algorithms vasive imaging using DL (HeartFlow, Redwood City,
including different neural network can be used for California) (17). In the catheterization lab, computa-
model building. An important health care–related tional fluid dynamics has allowed the development of
application of computer vision is acquisition and wire-free algorithms for the detection of functionally
interpretation of cardiac images, including computer- significant coronary stenoses with use of computer
aided diagnosis and image-guided procedures/ vision and 3-dimensional reconstruction (angiog-
surgery. A real-time analysis of laparoscopic videos raphy-based fractional flow reserve; Cathworks Ltd,
yielded 92.8% accuracy in automated identification of Kfar-Saba, Israel) (18). Recently, Siemens Healthi-
the steps of sleeve gastrectomy and also successfully neers received Food and Drug Administration
identified missing or unexpected steps (5). Although (FDA) clearance for TrueFusion, a cardiovascular
predictive video analysis is in its infancy, evidence application that integrates advanced ultrasound and
exists that AI can be leveraged to process large angiographic imaging for improved navigation
amounts of interventional data to identify or predict and guidance during structural heart disease
JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019 Sardar et al. 1297
JULY 22, 2019:1293–303 Artificial Intelligence and Interventional Cardiology

C ENTR AL I LL U STRA T I O N Applications of AI in IC

Sardar, P. et al. J Am Coll Cardiol Intv. 2019;12(14):1293–303.

Applications of artificial intelligence (AI) includes AI-guided diagnosis, image interpretation, clinical decision support, data driven therapeutics, research
and development, population health, efficient administration, workflow and regulation, and AI-assisted interventional procedures. CT-FFR ¼ computed
tomography fractional flow reserve; EHR ¼ electronic health record; IVUS ¼ intravascular ultrasound; OCT ¼ optical coherence tomography.

interventions (19). This system integrates the cor- CEREBRIA-1 (Machine Learning vs Expert Human
egistration of angiographic images and echo images Opinion to Determine Physiologically Optimized
into the workflow via ML-based probe detection and Coronary Revascularization Strategies), evaluated
automated registration updates, enabling clinical whether an ML algorithm based on computational
teams to identify soft tissue–based structures that are interpretation of pressure-wire pull back data would
provided directly from the integrated ultrasound be similar to expert human interpretation for treat-
system. TrueFusion can enable echocardiographers ment strategies in patients with stable coronary ar-
and interventionalists to better communicate and tery disease (20). The study included 1,008
achieve more intuitive anatomical orientation during instantaneous wave-free ratio pullback traces,
challenging procedures. This may result in reduced including 317 duplicates, which were analyzed by
contrast usage, procedure time, and radiation expo- both the ML algorithm and a multinational team of
sure (19). In the future, via DL, automated diagnosis interventionalists. They found that the computer-
of imaging-based pathologies may be possible inde- based ML program was noninferior to the expert
pendent of an imaging specialist. consensus decision for both appropriateness of PCI
and determining PCI strategy (20).
CLINICAL DECISION SUPPORT. Clinical decision IBM’s Watson for Health applies cognitive tech-
support systems with cognitive computing are under nology to extract and analyze information from the
development and include self-learning systems using EMR, lab reports, imaging reports, the published
ML, pattern recognition, and NLP to mimic human medical reports, guidelines, and various Internet
thought processes (Figure 2). A multinational study, sources (2,3). This technology combines ML and
1298 Sardar et al. JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019

Artificial Intelligence and Interventional Cardiology JULY 22, 2019:1293–303

F I G U R E 2 Future Catheterization Laboratory With Artificial Intelligence-Enabled Technologies

Artificial intelligence-enabled future catheterization laboratory with clinical decision support system, voice-powered virtual assistant,
augmented reality platforms, and semiautonomous/autonomous robotic system.

systems neuroscience to build powerful, general- anxiety and stress (22). The FDA-approved True 3D
purpose learning algorithms into neural networks system developed by EchoPixel (Santa Clara, Califor-
that mimic the human brain. The IBM Watson for nia) renders patient-specific anatomy in an intuitive,
Oncology cognitive computing system can provide interactive VR format (23). SentiAR Inc, a St. Louis,
confidence-ranked, evidence-based treatment rec- Missouri–based company, received a $2.2 million
ommendations for cancer. Treatment recommenda- research grant from the National Institutes of Health
tions by Watson and a tumor board were concordant to develop an AR cardiac hologram technology that
in 96% of lung, 81% of colon, and 93% of rectal cancer allows real-time viewing, measurement and manip-
cases (21). Currently, IBM is developing Medical ulation of patient anatomy in a holographic display
Sieve, an automated cognitive assistant for cardiolo- for procedural guidance (24) (Figure 3). Similar
gists and radiologists designed to aid clinical AR systems can be used to overlay important infor-
decision-making. This IBM project has addressed mation required during procedures that is typically
many modalities of cardiac imaging including displayed on multiple monitors stacked around the
automatic detection of coronary stenoses in interventionist.
angiography.
VOICE-POWERED VIRTUAL ASSISTANTS. Voice-powered
virtual assistants, such as Apple’s Siri, Amazon’s
VIRTUAL REALITY, AUGMENTED REALITY, Alexa, and Google’s Assistant, employ AI speech
AND AI recognition that has now improved to the point of
exceeding human accuracy in transcribing conversa-
Although there are technological differences in vir- tion. Compared with typing on keyboards for
tual reality (VR)/augmented reality (AR) and AI, searching data in EMR or online medical information,
combined application of these technologies may be voice is easier, faster, more convenient, and with the
useful for interventional procedures (Figure 2). VR help of a unique voiceprint, can eliminate the need
platforms are currently being used in periprocedural for passwords (25). Voice-powered virtual assistants
planning of structural heart interventions, as well use speech recognition and NLP to “understand”
as pre-procedure patient experiences to decrease and process spoken data for output. AI empowered,
JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019 Sardar et al. 1299
JULY 22, 2019:1293–303 Artificial Intelligence and Interventional Cardiology

voice-powered virtual assistants have the potential to


F I G U R E 3 Augmented Reality Cardiac Holographic Display for Procedural Guidance
process the input of multimodal data/images, and
then present them in a meaningful way to the
physician or operator. A voice-powered virtual assis-
tant system in the catheterization laboratory could
help operators control equipment, navigate the EMR
system or access image libraries more effectively in a
hands-free fashion.

“BIG DATA” RESEARCH AND


PREDICTIVE ANALYSIS

“To date, big data, such as “omics” data, human gut


microbiome sequencing, social media, and cardiac
imaging, are too large and heterogeneous to be
stored, analyzed, and used to their full potential” (2).
AI techniques may solve this issue as well as allow for
automatic generation of new hypotheses, instead of INTEGRATION OF AI-BASED DECISION-MAKING
requiring that physicians postulate them (1,6). ACROSS ALL PHASES OF PATIENT CARE
Traditionally, regression-based statistical methods
are limited to using a small number of predictors, In the future, interventional cardiologists will likely
which operate in the same way on everyone with see AI analysis of population- and patient-specific
uniformity throughout their range. Moreover, in- data augmenting each phase of care. AI algorithms
teractions mediating physiological processes may be will be used in the emergency department to triage
extremely complex to be captured using common chest pain patients. In a pilot study, ML algorithms
regression techniques. Unsupervised DL may facili- showed 94% accuracy for predicting a myocardial
tate exploration of novel factors in score systems and infarction in patients presenting with chest pain in
better prediction analysis, or add hidden risk factors the emergency department (28). Automated analysis
to existing models (2,7). This could lead to new of all pre-operative mobile and clinical data will
models for antiplatelet/anticoagulant therapy, provide patient-specific risk scores for procedural
bleeding versus stroke risk, mortality risk with pro- planning and yield valuable predictors to inform
cedures, and so on (2,6). ML-based techniques also post-procedural care. Algorithms may be applied to
can highlight long-term outcomes or late complica- patients with cardiogenic shock in order to deter-
tions for patients who have undergone a specific mine who might benefit from mechanical circulatory
procedure or are prescribed a specific drug. Previ- support. DL prediction models will predict the
ously, ML has been used in cardiology to predict periprocedural risk of death, bleeding, contrast
1-year mortality in heart failure patients and 5-year nephropathy, and stroke (1,2). Predictive analytics
mortality from coronary angiography datasets in pa- with the use of cognitive computing may support
tients with suspected coronary artery disease (4,7). clinical decision-making and help prioritize tasks
Several recent studies have used ML-based tech- in the catheterization laboratory. Intraprocedural
niques for advanced analysis of a dataset. Boone et al. monitoring of various data may lead to the real-
(26) evaluated the cardiovascular disease profile of time prediction and avoidance of adverse events.
hematological malignancy patients undergoing PCI Integration of pre-, intra-, and post-procedural
and used bivariable analysis with bootstrapping data could help to monitor recovery, predict com-
and result validation by an ML-generated neural plications, and recommend the optimal duration
network. A study by Ganim et al. (27) assessed racial of medical therapy (2,5). After discharge, post-
disparities in procedural complications after trans- operative data from personal devices could
catheter aortic valve replacement using ML-driven, continue to be integrated with data from the
backward propagation neural networks. Topological hospitalization to optimize patient recovery and
data analysis within an ML framework can be helpful decrease readmission rates. AI-enabled applications
in large volume multidimensional data interpreta- and apps may encourage and incentivize healthier
tion, such as describing new phenotypes of diseases behavior in individuals and may help with the
or combining imaging, clinical, and other nonstruc- preventive strategies of a healthy lifestyle and
tured data. medication adherence (2).
1300 Sardar et al. JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019

Artificial Intelligence and Interventional Cardiology JULY 22, 2019:1293–303

reduction in wiring time among a highly experienced


F I G U R E 4 Applications of Robotics in IC
group of physicians when comparing robotic wiring
versus robotic wiring with Rotate on Retract enabled.
Future generations of vascular robotic platforms will
be more aware of the procedures being performed
and use that knowledge to provide intelligent assis-
tance to interventional cardiologists. Companies such
as Verb Surgical, a collaboration between Google and
Ethicon Endo-Surgery, have indicated that their sur-
gical robots will include ML and awareness, which
will aim to identify potential issues during a proced-
ure (30). They plan to link the robot to a cloud su-
percomputer service akin to IBM’s Watson, so that
information on thousands of similar procedures will
be accessible to both the surgeon and the robot to
improve performance (5,30). Additional projects un-
der development include the development of micro-
bots that can travel through blood vessels to deliver
medications to a specific target. Future applications
of such microbots include the potential to repair
damaged cells or perform microprocedures, which
might include a variety of vascular interventions (1,5).
Abbreviations as in Figure 2. Robots can be useful in interventional training
simulator and teleintervention. Outside the cathe-
terization lab, robots can help in post-procedural
rehabilitation, and can be useful in other areas of
PHYSICAL APPLICATION OF AI health care such as pharmabotics, disinfectant robots,
supply chain robots, and personal assistance (2,5,31).
ROBOTICS. AI, through procedural automation, has The true potential of AI in robotics remains to be seen
the potential to increase the value of robotics in the and is difficult to predict at this time. Therefore,
catheterization lab by reducing the variability of practicing interventional cardiologists should be
procedure time and improving overall patient care engaged in assessing the quality and applicability of
(Figures 2 and 4). Although robotic interventions AI advances to ensure appropriate translation to the
show promise, limitations and hurdles remain. Cur- clinical sector.
rent systems do not comprehend the anatomy they Several organizations and startup companies are
display to the interventionalist, the procedures they presently evaluating the application of AI-based
are being used to perform, or know what the inter- technologies in other areas of health care that may
ventionalist intends to do. It is possible to enhance influence IC. These include virtual nurses, digital
these robotic tools using AI technologies such as consultation, medication management by patients,
computer vision and image analysis (5). Although drug creation, health monitoring with wearable
truly autonomous robotic vascular procedures will health trackers and health care system analysis
remain out of reach for some time, synergy across (1,6,31).
fields will likely accelerate the capabilities of AI in
augmenting interventional care. LIMITATIONS OF AI-BASED TECHNOLOGIES
Corindus Vascular Robotics (Waltham, Massachu-
setts) recently received 510(k) clearance from the FDA As with any novel technology, AI and its sub-
for the first automated robotic movement designed specialties are subjected to unrealistic expectations,
for the CorPath GRX platform (29). The proprietary which may lead to disappointment and disillusion-
software feature, named “Rotate on Retract,” is an ment in the future (Figure 5). As noted by experts in
automated robotic movement that allows the oper- the field, “ML is a natural extension of traditional
ator to quickly navigate to a targeted lesion by auto- approaches, not a magical device that can spin data
matically rotating the guidewire upon joystick into gold” (32). There are instances where traditional
retraction. Preclinical data demonstrated a significant analytical methods can outperform ML or where the
JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019 Sardar et al. 1301
JULY 22, 2019:1293–303 Artificial Intelligence and Interventional Cardiology

F I G U R E 5 Advantages and Challenges of AI in IC

Abbreviations as in Figures 2 and 4.

addition of ML does not improve results (2,5). For generative adversarial networks have been used to
instance, Frizzell et al. (33) reported that a number of compensate for this deficiency and synthetically
ML algorithms did not improve prediction of 30-day produce large image datasets, including angiograms
heart failure readmissions compared with more and echocardiograms, at high resolution that could be
traditional prediction models. “As more control is used to help train deep neural networks (34).
ceded to algorithms, it is important to note that these There are concerns that robotization may lead to an
new algorithmic decision-making tools come with no increase in unnecessary interventions, take focus
guarantees of fairness, equitability, or even veracity” away from patient expectations, or exacerbate exist-
(32). Issues likely to arise with the application of ML/ ing socioeconomic biases related to care delivery.
DL on various datasets include: 1) issues with data Wireless connectivity of wearable and implantable
integrity (just a newer version of the classic adage: devices, cloud-based AI technologies, and robots face
“garbage in, garbage out”); 2) issues related to lack of cyber security risks. A proposed solution to mitigate
diversity in training datasets; and 3) an impaired or this issue is a custom-built “health care blockchain”
absent ability to fully evaluate for methodological technology that can store health information on an
bias in analysis. Of particular concern is the latter encrypted digital ledger in order to minimize cyber
issue as it relates to neural networks, which are based security risks (35).
on a ‘‘black box’’ design (1,5). Although the auto- One looming question is whether AI technologies
mated nature of neural networks allows for detection could eventually replace a human interventional
of patterns missed by humans, human scientists are cardiologist. This does not look possible in the fore-
left with little ability to assess how or why the com- seeable future. Current technologies have several
puter discerned such patterns. Human physicians, shortcomings in comparison to activities of the hu-
therefore, must critically evaluate the predictions man brain. Structurally, bio-inspired neural networks
generated by AI and interpret the data in clinically resemble at best the outer layers of the retina or the
meaningful ways (1,8). Large, well-curated datasets visual cortex where images are just sensed or repre-
are required for training of DL algorithms to provide sented (36). The capacity of complex decision making
diagnostic and predictive capabilities. However, the or performing a procedure independently would
lack of large datasets of carefully annotated images be quite arduous for current AI/ML algorithms. AI,
and videos have been limiting across various disci- although widely publicized for its amazing perfor-
plines in medicine including IC. Interestingly, mance, is actually quite shallow in intelligence in its
1302 Sardar et al. JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019

Artificial Intelligence and Interventional Cardiology JULY 22, 2019:1293–303

current form (1,36). Robotic systems geared towards AI, physicians should seek to expand involvement in
the technical performance of cardiovascular in- local, national, or international clinical data regis-
terventions are far too primitive to operate indepen- tries. As data cleaning techniques improve, registries
dently on patients. In the aviation industry, pilots could become linked to expand their utility and in-
embraced autopilot technology; however, most pas- crease the availability of clinical, genomic, proteomic,
sengers would not want to do away with pilots. radiographic, and angiographic data available for AI-
Similarly, we anticipate AI will assist rather than based analysis. Interventionalists have the clinical
replace the human operator in the catheterization insight that can guide data scientists and engineers to
laboratory. The societal and ethical complexities of answer the right questions with the right data;
applications of AI require further reflection, proof of whereas engineers can provide automated, compu-
their medical utility, economic valuing, and devel- tational solutions to data analytics problems that
opment of interdisciplinary strategies for their wider would otherwise be too costly or time-consuming for
application (37). manual methods. If appropriately developed and
implemented, AI has the potential to revolutionize
SYNERGIZING IC AND AI the way IC is taught and practiced.

There will always be a need for the expertise, CONCLUSIONS


compassion, and skill of a physician in the practice of
IC. AI is not a replacement for human intellect. AI has initiated a paradigm shift in health care,
Rather, it has the potential to complement and rein- powered by the increasing availability of health care
force it. The current practice of IC already represents data and rapid evolution of analytic techniques. It is
a paradigm of clinician–machine interaction, and this expanding its footprint in clinical systems, including
synergy is likely to accelerate in the coming age of AI. databases, image and intraprocedural video analysis,
Interventional cardiologists are uniquely positioned evidence-based, real-time clinical decision support,
to help drive these innovations rather than passively and robotics. The unique nature of interventional
wait for such technology to become useful. With AI- practice leaves the interventionalist well-positioned
based systems providing more information for pa- to help usher in the next phase of AI, one focused
tient care, interventional cardiologists may see their on synergistic interaction between man and machine,
roles shift. Physicians, including interventional car- which ultimately will transform IC practice in efforts
diologists, need to develop additional skills, which to improve clinical care.
machines cannot master in the near future, such as
ethics, leadership, and empathy. Training programs
must put a greater emphasis on how to optimize new ADDRESS FOR CORRESPONDENCE: Dr. Jay Giri,
AI tools. Important issues include posing the right Hospital of the University of Pennsylvania,
questions to machines, interpreting their outputs, Cardiovascular Medicine Division, Gates Pavilion,
identifying when machines make mistakes, and 9th Floor, 3400 Spruce Street, Philadelphia, Penn-
integrating machine-generated data in patient care. sylvania 19104. E-mail: giri.jay@gmail.com. Twitter:
Because lack of data can limit the predictions made by @parthasardarmd, @jaygirimd.

REFERENCES

1. Shameer K, Johnson KW, Glicksberg BS, 5. Hashimoto DA, Rosman G, Rus D, Meireles OR. large cohort of all-comers undergoing percuta-
Dudley JT, Sengupta PP. Machine learning in car- Artificial intelligence in surgery: promises and neous coronary intervention: Comparison of five
diovascular medicine: are we there yet? Heart perils. Ann Surg 2018;268:70–6. contrast media. Int J Cardiol 2018;273:69–73.
2018;104:1156–64.
6. Jiang F, Jiang Y, Zhi H, et al. Artificial intelli- 10. Narula S, Shameer K, Salem Omar AM,
2. Krittanawong C, Zhang H, Wang Z, Aydar M, gence in healthcare: past, present and future. Dudley JT, Sengupta PP. Machine-learning algo-
Kitai T. Artificial intelligence in precision cardio- Stroke Vasc Neurol 2017;2:230–43. rithms to automate morphological and functional
vascular medicine. J Am Coll Cardiol 2017;69: 7. Johnson KW, Torres Soto J, Glicksberg BS, et al. assessments in 2D echocardiography. J Am Coll
2657–64. Artificial intelligence in cardiology. J Am Coll Cardiol 2016;68:2287–95.

3. Syeda-Mahmood T. Role of big data and ma- Cardiol 2018;71:2668–79. 11. Shah SJ, Katz DH, Selvaraj S, et al. Pheno-
chine learning in diagnostic decision support in 8. Al’Aref SJ, Anchouche K, Singh G, et al. Clinical mapping for novel classification of heart failure
radiology. J Am Coll Radiol 2018;15 Pt B:569–76. applications of machine learning in cardiovascular with preserved ejection fraction. Circulation 2015;
disease and its relevance to cardiac imaging. Eur 131:269–79.
4. Henglin M, Stein G, Hushcha PV, Snoek J,
Wiltschko AB, Cheng S. Machine learning Heart J 2019;40:1975–86. 12. Small AM, Kiss DH, Zlatsin Y, et al. Text mining
approaches in cardiovascular imaging. Circ Car- 9. Azzalini L, Vilca LM, Lombardo F, et al. Inci- applied to electronic cardiovascular procedure
diovasc Imaging 2017;10:e005614. dence of contrast-induced acute kidney injury in a reports to identify patients with trileaflet aortic
JACC: CARDIOVASCULAR INTERVENTIONS VOL. 12, NO. 14, 2019 Sardar et al. 1303
JULY 22, 2019:1293–303 Artificial Intelligence and Interventional Cardiology

stenosis and coronary artery disease. J Biomed optimized coronary revascularization strategies. patients presenting with chest pain in the emer-
Inform 2017;72:77–84. Paper presented at: Transcatheter Cardiovascular gency department (abstr). J Am Coll Cardiol 2018;
Therapeutics Symposium (TCT) 18; September 24, 71 Suppl:A225.
13. Sohn S, Ye Z, Liu H, Chute CG, Kullo IJ. Iden-
2018; San Diego, CA.
tifying abdominal aortic aneurysm cases and con- 29. Corindus Receives FDA Clearance for First
trols using natural language processing of 21. Somashekhar SP, Sepúlveda MJ, Norden AD, Automated Robotic Movement in technIQ Series
radiology reports. AMIA Jt Summits Transl Sci Proc et al. Early experience with IBM Watson for for CorPath GRX Platform [press release]. March 5,
2013;2013:249–53. Oncology (WFO) cognitive computing system for 2018. Available at: https://goo.gl/Sb1B2i.
lung and colorectal cancer treatment (abstr). Accessed October 10, 2018.
14. Du T, Xie L, Liu X, et al. Intelligent recognition
J Clin Oncol 2017;35:15 Suppl:8527.
of coronary angiography by deep learning tech- 30. Two Industry Leaders Make for One Extraor-
nology: a novel computer-aided diagnostic sys- 22. Project Brave Heart: Studying the Impact of dinary Verb. Verb Surgical website. Available at:
tem. Paper presented at: Transcatheter Virtual Reality Preparation and Relaxation Therapy. http://www.verbsurgical.com/about/. Accessed
Cardiovascular Therapeutics Symposium (TCT) 18; Lucile Packard Children’s Hospital Stanford web- October 19, 2018.
September 21–25, 2018; San Diego, CA. site. Available at: http://www.stanfordchildrens.
31. Elson DS, Cleary K, Dupont P, Merrifield R,
org/en/innovation/virtual-reality/anxiety-research.
15. Ciusdel C, Turcea A, Puiu A, et al. An artificial Riviere C. Medical robotics. Ann Biomed Eng 2018;
Accessed October 10, 2018.
intelligence based solution for fully automated 46:1433–6.
cardiac phase and end-diastolic frame detection 23. Silva JNA, Southworth M, Raptis C, Silva J.
32. Beam AL, Kohane IS. Big data and
on coronary angiographies. Paper presented at: Emerging applications of virtual reality in cardio-
machine learning in health care. JAMA 2018;319:
Transcatheter Cardiovascular Therapeutics Sym- vascular medicine. J Am Coll Cardiol Basic Trans
1317–8.
posium (TCT) 18; September 21–25, 2018; San Science 2018;3:420–30.
Diego, CA. 33. Frizzell JD, Liang L, Schulte PJ, et al. Predic-
24. Improving Visualization and Interaction During
tion of 30-day all-cause readmissions in patients
16. Molony D, Hosseini H, Samady H. Deep IVUS: a Transcatheter Ablation Using A Mixed Reality
hospitalized for heart failure: comparison of ma-
machine learning framework for fully automatic System: First-In-Human Experience. SentiAR
chine learning and other statistical approaches.
IVUS segmentation. Paper presented at: Trans- Technology website. Available at: https://sentiar.
JAMA Cardiol 2017;2:204–9.
catheter Cardiovascular Therapeutics Symposium com/#!info-graph. Accessed October 10, 2018.
(TCT) 18; September 21–25, 2018; San Diego, CA. 34. Topol EJ. High-performance medicine: the
25. Steinhubl SR, Topol EJ. Now we’re talking:
convergence of human and artificial intelligence.
17. Fairbairn TA, Nieman K, Akasaka T, et al. Real- bringing a voice to digital medicine. Lancet 2018;
Nat Med 2019;25:44–56.
world clinical utility and impact on clinical 392:627.
decision-making of coronary computed tomogra- 35. Ichikawa D, Kashiyama M, Ueno T.
26. Boone D. Cardiovascular disease and percuta-
phy angiography-derived fractional flow reserve: Tamper-Resistant Mobile Health Using Block-
neous coronary intervention in hematological
lessons from the ADVANCE registry. Eur Heart J chain Technology. JMIR Mhealth Uhealth 2017;5:
malignancies: knowledge is power. Paper pre-
2018;39:3701–11. e111.
sented at: Transcatheter Cardiovascular Thera-
18. Fearon WF, Achenbach S, Engstrøm T. Accu- peutics Symposium (TCT) 18; September 21–25, 36. Sengupta PP, Adjeroh DA. Will artificial intel-
racy of fractional flow reserve derived from coro- 2018; San Diego, CA. ligence replace the human echocardiographer?
nary angiography. Circulation 2019;139:477–84. Circulation 2018;138:1639–42.
27. Ganim N, Monlezun D, Balan P. Racial dispar-
19. Siemens Healthineers. Siemens Healthineers ities in procedural complications after trans- 37. He J, Baxter SL, Xu J, Xu J, Zhou X, Zhang K.
Receives FDA Clearance for TrueFusion Structural catheter aortic valve replacement (TAVR): a The practical implementation of artificial intelli-
Heart Disease Feature. September 6, 2017. Available retrospective single-center case-control study. gence technologies in medicine. Nat Med 2019;25:
at: https://usa.healthcare.siemens.com/news/ Paper presented at: Transcatheter Cardiovascular 30–6.
fdaclearanceoftruefusionfeature.html. Accessed Therapeutics Symposium (TCT) 18; September
October 19, 2018. 21–25, 2018; San Diego, CA.

20. Davies J. CEREBRIA-1: machine learning vs 28. Lindholm D, Holzmann M. Machine learning KEY WORDS artificial intelligence,
expert human opinion to determine physiologically for improved detection of myocardial infarction in interventional cardiology

You might also like