VR Final
VR Final
Submitted by
YUVASHREE.T(211422104566)
T.KAVYA SRI(211422104932)
BACHELOR OF ENGINEERING
in
October 2024
1
BONAFIDE CERTIFICATE
SIGNATURE SIGNATURE
Dr.L.JABASHEELA,M.E.,Ph.D ., T TAMILVIZHI
POONAMALLEE, POONAMALLEE,
Certified that the above candidates were examinied the Mini Project Viva-Voce
Examination held on…………….
ACKNOWLEDGEMENT
2
We express our deep gratitude to our respected Secretary and
Correspondent Dr.P.CHINNADURAI, M.A., Ph.D.for his kind words and
enthusiastic motivation, which inspired us a lot in completing this project.
We would like to thank my Project Guide T TAMILVIZHI and all the faculty
members of the Department of CSE for their advice and suggestions for the
successful completion of the project.
ABSTRACT
3
Interventional angiography is essential for diagnosing and
treating cardiovascular diseases but poses challenges in training
due to limited practice cases, high costs, and ethical concerns.
This project proposes a Virtual Reality (VR) simulation platform
to address these challenges by offering an immersive,
interactive environment for mastering angiography techniques.
Users can practice the full procedure—from catheter insertion
to stent placement—using real-time imaging, 3D vessel
reconstructions, and fluoroscopy-like guidance. Haptic feedback
will simulate tactile responses, while customizable scenarios
and adjustable difficulty levels accommodate a range of training
needs.The platform will also provide real-time feedback on key
performance metrics, including procedural time, radiation
exposure, and device placement accuracy, helping users refine
their skills and adapt to complex cases. By simulating
complications, such as dissection or embolization, users will
gain experience in high-stress scenarios, enhancing decision-
making and technical dexterity. Accessible to both novice and
experienced practitioners, the system offers a scalable, cost-
effective solution that reduces dependence on cadavers and live
patients.In conclusion, this VR platform aims to revolutionize
medical training in interventional angiography, improving
training efficiency and patient outcomes, while laying the
foundation for future advancements such as AI integration and
remote collaboration.
TABLE OF CONTENTS
4
CHAPTER
TITLE PAGENO.
NO.
ABSTRACT
LIST OF TABLES
1. INTRODUCTION
1.1 Overview
2. LITERATURE SURVEY
4. SYSTEM MODEL
4.1 Preprocessing
5. PROPOSED METHODOLOGY
6. SYSTEM IMPLEMENTATION
6.1 Coding
7. PERFORMANCE ANALYSIS
5
7.2 Experimental Results
7.3 Discussion
8. CONCLUSION
8.1 Conclusion
APPENDICES
A.2 Publications
REFERENCES
LIST OF TABLES
6
Table 1: Comparative Analysis of Different Laser Skin
Resurfacing Techniques (CO2 Laser, Erbium Laser,
Fractional Laser)
CHAPTER-1
7
INTRODUCTION
Introduction:
8
and providing detailed feedback, the platform will improve technical
skills, decision-making, and patient outcomes.
In the following sections, we will explore the system's technical
aspects, its role in medical education, and its potential impact on
clinical practice.
Introduction:
1.1 Overview
Overview:
The Virtual Reality (VR) simulation project for interventional
angiography aims to create an immersive and interactive training
platform that replicates the real-world conditions of cardiovascular
procedures. Interventional angiography involves using real-time
imaging, typically
fluoroscopy, to guide the placement of catheters, guidewires, and
stents in diagnosing and treating various cardiovascular conditions.
Given the complexity and high-risk nature of these procedures,
traditional training methods such as supervised practice, animal
models, and cadaveric simulations have limitations, including cost,
ethical concerns, and restricted availability.
9
needed for interventional angiography in a safe, controlled
environment. The platform will simulate the entire procedure, from
vascular access and catheter navigation to guidewire manipulation
and stent deployment. Additionally, users will be able to perform
these tasks with the added challenge of dealing with potential
complications, such as vessel dissection or improper stent
placement, thereby improving their problem-solving abilities in
high-pressure situations.
2.Fluoroscopy Simulation:
Users will have access to simulated fluoroscopic views,
replicating the X-ray imaging used to guide catheter navigation and
stent placement in live procedures.
3.Haptic Feedback:
The system will integrate haptic devices that mimic the
tactile response of catheters and guidewires as they interact with
the vascular walls, enabling users to feel resistance, friction, and
tension.
10
4.Interactive Clinical Scenarios:
The VR platform will offer a variety of clinical cases
ranging from routine interventions to complex, high-risk
procedures. Users will be able to adjust difficulty levels and work
through scenarios involving coronary, peripheral, and
neurovascular interventions.
7.Complication Management:
The VR simulation will present users with realistic
complications such as vessel perforation, thrombus formation, or
device malfunction, requiring them to make quick decisions and
implement corrective actions—key skills in the actual clinical
environment.
11
1.2 Problem Definition
Problem Definition:
Interventional angiography is a crucial procedure used in the
diagnosis and treatment of cardiovascular diseases, requiring high
levels of technical skill, precision, and real-time decision-making.
The procedure involves the insertion and manipulation of catheters
and guidewires through a patient's vascular system under
fluoroscopic guidance to diagnose blockages and treat conditions
like coronary artery disease or peripheral vascular disease through
interventions such as stent placement or balloon angioplasty.
However, traditional methods for training medical professionals in
interventional angiography present several challenges:
12
Learning in a real-life clinical setting involves risks to patient safety,
as the margin for error is extremely low during high-stakes
cardiovascular procedures. Novice practitioners may be less adept
at handling complications such as arterial perforation or improper
device placement, leading to potentially serious outcomes.
13
skills like catheter manipulation, guidewire navigation, and device
placement under real-world conditions.
14
Integrating real-time performance metrics to enable immediate
feedback, allowing trainees to adjust and refine their techniques on
the spot.
Presenting customizable case scenarios, including rare and complex
cases, to give practitioners the experience needed to handle
complications confidently.
This project aims to fill the gap between traditional training
methods and the increasing demand for safer, more efficient, and
technologically advanced medical training tools.
CHAPTER-2
LITERATURE SURVEY
15
Virtual reality and haptics enhance a medical model's realism in a
clinical learning environmentThis paper highlights the value of
haptic feedback in VR simulations. The authors found that adding
tactile sensations to the simulation significantly improved the
learners’ ability to transfer skills from a virtual environment to real
procedures. This directly relates to your project, where haptic
feedback would play a crucial role in replicating the tactile
experience of catheter manipulation during angiography.
Author: Ma, Y., Zheng, B., & Panton, N
Year:2016
Simulation-based training in flexible bronchoscopy and simulation-
based certification: A randomized controlled trial
This study found that VR-based simulations provide a scalable and
effective method of training complex, minimally invasive
procedures. The study focused on bronchoscopy but is applicable to
interventional angiography, as both require real-time imaging
guidance and precise hand-eye coordination. The authors also
emphasized the value of immediate feedback during training, which
is a feature of your proposed VR system.
Author: Andersen, S. A. W., Mikkelsen, P. T., Konge, L.
Year:2016
Impact of core competencies on surgical outcomes: A pilot study
usinga virtual reality simulator
The authors evaluated the impact of a VR simulator on learning core
competencies in surgery, concluding that VR training effectively
enhances procedural skill acquisition. This study supports the idea
that VR systems, like your angiography simulator, are valuable for
16
developing core skills in a controlled, repeatable environment
without the risks associated with live patient training.
Author: Zahiri, H. R.
Year:2011
The development and validation of a simulation model for
interventional
This paper discusses the development of a VR model specifically for
interventional cardiology. The authors validated their model by
comparing its outcomes with traditional training methods,
demonstrating the effectiveness of VR in enhancing both technical
and cognitive skills. This study provides a foundation for your
project, showing how VR can simulate procedures like angiography
and improve the ability to handle real-life scenarios
Author: Chin, K
Year:2019
The efficacy of virtual reality training in interventional procedures
This paper reviews various VR applications in interventional
procedures, including angiography. It concludes that VR systems
effectively enhance technical skills, particularly when integrated
with performance metrics and feedback. The study suggests that VR
can significantly improve procedural outcomes, reinforcing the idea
that your VR system could lead to better training outcomes and
patient safety.
Author: Lerner, C
Year:2020
17
Training interventional cardiology in the 21st century
This article discusses the need for advanced training tools like VR in
interventional cardiology. It emphasizes the importance of
replicating real-life challenges, such as anatomical variations and
complications, to better prepare trainees for actual procedures. The
study supports your aim of incorporating customizable scenarios
and difficulty levels in your simulation platform
Author: Beyar, R., & Gruberg, L
Year:2013
Systematic review on the effectiveness of augmented reality
applications medical training
This review covers the growing field of augmented and virtual
reality in medical education. It notes that AR and VR applications
improve procedural confidence and reduce errors by allowing
repeated practice in a realistic but controlled environment.
Although it covers a broader range of applications, the review's
findings support the incorporation of VR into interventional
angiography training, as it enhances both cognitive and technical
skills
Author: Barsom, E. Z., Graafland, M., & Schijven, M. P
Year:2016
18
TABULATION:
Virtual reality enhance a medical model's realism in a Ma, Y., Zheng, B., 2016
and haptics clinical learning environmentThis paper & Panton, N
highlights the value of haptic feedback in
VR simulations. The authors found that
adding tactile sensations to the simulation
significantly improved the learners’
ability to transfer skills from a virtual
environment to real procedures
19
based that VR systems, like your angiography
certification simulator, are valuable for developing
core skills in a controlled, repeatable
The environment without the risks associated Chin, K 2019
Development and
validation of a This paper discusses the development of a
simulation VR model specifically for interventional
cardiology. The authors validated their
model by comparing its outcomes with
training methods, demonstrating the
effectiveness of VR in enhancing both
technical and cognitive skills. This study
provides a foundation for your project,
showing how VR can simulate procedures
like angiography and improve the ability
to handle real-life scenarios
Systematic This review covers the growing field of Barsom, E. Z., 2016
review on the augmented and virtual reality in medical Graafland, M., &
effectiveness of education. It notes that AR and VR Schijven, M. P
augmented applications improve procedural
reality confidence and reduce errors by allowing
applications repeated practice in a realistic but
medical training controlled environment. Although it
covers a broader range of applications,
the review's findings support the
incorporation of VR into interventional
angiography training, as it enhances both
20
cognitive and technical skills
CHAPTER-3
MATERIAL AND METHODS
This section outlines the approach and tools used to develop a VR
Simulator for Interventional Angiography. The methods involve
designing a virtual environment, implementing realistic simulations,
and integrating feedback mechanisms to support the learning
process.
21
o Sensors/Trackers: Hand tracking sensors (e.g., Leap
Motion) or controllers to capture the user’s hand
movements and interactions with virtual surgical tools.
Software:
o Unity 3D/Unreal Engine: A game development engine
for building the VR environment and simulating the
angiography procedure, including real-time image
rendering.
o 3D Modeling Software: Blender or Autodesk Maya for
creating 3D models of medical instruments and
anatomical structures (e.g., coronary arteries).
o Haptic API: Integration of APIs like CHAI3D or
OpenHaptics to enable tactile feedback during tool
manipulation within the simulation.
o Medical Imaging Software: Tools for converting DICOM
files into 3D models for patient-specific anatomy
simulation.
Data:
o DICOM Files: Patient imaging data (CT or MRI scans)
used to generate accurate 3D reconstructions of blood
vessels for the simulation.
o Anatomical Models: Pre-built 3D models of human
anatomy, specifically the cardiovascular system, obtained
from medical imaging libraries.
22
3.2 Development Environment
Virtual Operating Room Design:
o The first step is to create a realistic 3D virtual
environment representing the interventional
angiography suite. This includes the angiography table,
medical instruments, X-ray screens, and patient
monitoring systems. The design is done using 3D
modeling software, ensuring that the layout and scale
match real-world clinical settings.
3D Modeling of Anatomy:
o Using DICOM files or anatomical libraries, detailed 3D
models of vascular systems (e.g., coronary arteries) are
developed. These models include complex anatomical
features like bifurcations, calcifications, and variations in
arterial pathologies, which users will navigate during the
simulation.
Simulation of Procedures:
o The simulation workflow replicates key steps in
interventional angiography, such as catheter insertion,
contrast dye injection, and guidewire navigation through
the arteries. Physics-based simulation engines are used to
model the resistance and fluid dynamics as the guidewire
moves through the virtual arteries.
23
o Fluoroscopy Simulation: A virtual X-ray system mimics
fluoroscopy by rendering real-time, 2D projections of the
3D anatomical structures, allowing users to navigate
the vascular system as they would during an actual
procedure.
24
scenarios involving tortuous arteries or complications
like dissections.
o The scenarios are designed with varying levels of
difficulty, allowing trainees to progress from basic to
advanced procedures.
Complication Simulation:
o The VR system includes potential complications such as
arterial dissection, embolization, or device malfunction,
which the user must recognize and address. These
scenarios help prepare trainees for real-world challenges
in a controlled, risk-free environment.
Performance Evaluation:
o Key performance indicators (KPIs) such as procedural
time, radiation exposure, and accuracy of device
placement are tracked throughout the simulation. After
each session, users receive a detailed report highlighting
their strengths and areas for improvement.
25
Validation and Testing
User Testing:
o The VR simulator is tested by a group of medical students,
residents, and experienced clinicians to validate its
accuracy and realism. User feedback is collected through
surveys and direct observation to improve the system’s
usability and instructional value.
Technical Validation:
o The performance of the VR system, including latency,
resolution, and haptic responsiveness, is tested under
different conditions to ensure it meets the technical
requirements for real-time interaction.
CHAPTER-4
SYSTEM MODEL
This system model describes the structure and processes involved
in developing the VR simulator for interventional angiography. It
focuses on two key areas: Preprocessing and the System Flow
Diagram that outlines the procedural steps.
4.1 Preprocessing
26
Preprocessing involves preparing the necessary data and inputs for
the VR simulation. This step ensures that anatomical models and
procedural simulations are accurate, high-quality, and ready for
integration into the virtual environment.
Steps in Preprocessing:
1.Data Acquisition:
Medical imaging data, typically from CT or MRI scans, is
acquired to create accurate 3D models of human vascular
anatomy. The data is collected in DICOM format (Digital
Imaging and Communications in Medicine), which
contains high-resolution images of the cardiovascular
system.
2.Image Segmentation:
The DICOM files are processed using image
segmentation techniques to isolate the vascular
structures. This is done using specialized software (e.g.,
3D Slicer or Mimics), which extracts relevant anatomical
features such as coronary arteries, peripheral arteries,
and major blood vessels.
27
Tools like Blender or MeshLab can be used to clean and
optimize the 3D models.
5.Tool Design:
Virtual models of the interventional tools (e.g.,
catheters, guidewires, stents) are created. These virtual tools
are designed with realistic dimensions and behaviors,
mimicking their physical counterparts.
6.Scenario Definition:
Different clinical scenarios are prepared,
such as standard angiography, cases with arterial
blockages, or complex procedures requiring stent
placement. These scenarios will be programmed into the
system with varying levels of difficulty.
28
1.Define Medical Objectives:
The user selects a clinical scenario from a list (e.g., coronary artery
disease, peripheral blockages). This triggers the initialization of the
virtual environment.
2.Preprocessing Completed:
The system loads the preprocessed data, including patient-specific
anatomical models and tools necessary for the procedure. The
environment and case scenario are set up based on this data.
3.Background Information:
The user is placed in a virtual operating room where medical tools
and instruments are available. Hand tracking or haptic devices are
initialized to allow interaction with the environment.
29
from haptic devices to simulate the feel of tools moving through the
arteries.
9.End of Session:
The session concludes, and the user’s performance data is saved.
The user can review the session results or select a new case to
simulate.
30
FLOW DIAGRAM
31
CHAPTER-5
PROPOSED METHODOLOGY
32
support smooth, responsive interactions and provide
immersive environments.
Software Tools: Select appropriate development
environments such as Unity 3D or Unreal Engine to build
the VR environment. These tools will be used to model 3D
vascular structures and integrate real-time imaging
features.
Haptic Feedback Integration: Integrate force-feedback
devices that allow users to feel the resistance and pressure
of manipulating catheters and guidewires, closely
replicating the tactile experience of the procedure.
3. 3D Modeling and Simulation Environment Development
Anatomical Modeling: Develop detailed 3D models of the
vascular system using patient data such as CT or MRI scans.
These models will represent various anatomical
complexities, including coronary arteries, tortuous vessels,
and calcifications.
Dynamic Blood Flow Simulation: Implement a real-time
simulation of blood flow to enhance the realism of catheter
navigation and stent placement. The behavior of tools
interacting with the blood vessels will be carefully
modeled to reflect real-life challenges.
Fluoroscopy-Like Imaging: Create a real-time imaging
system within the VR environment that simulates the X-ray
guidance used in interventional angiography. This includes
fluoroscopy-like views, where contrast dye injections
reveal vascular pathways.
33
4. Development of Training Scenarios
Basic to Advanced Cases: Build a range of clinical
scenarios, from standard coronary artery disease to more
complex cases such as acute myocardial infarction or
peripheral vascular disease. The system should support a
progression of difficulty levels.
Emergency Simulations: Include scenarios that involve
complications like arterial dissection, thrombosis, or
device malfunctions, challenging users to make rapid
decisions in high-pressure environments.
Customizable Scenarios: Allow trainers and users to
customize the complexity and clinical focus of each
scenario, enabling a tailored training experience based on
the trainee’s skill level.
5. User Interaction and Interface Design
Intuitive Control Systems: Develop an intuitive user
interface that allows seamless interaction with virtual
tools (e.g., catheters, guidewires). The control system
should mimic real-world instrument manipulation in a
surgical suite.
Performance Feedback Display: Incorporate a real-time
feedback system within the simulator that provides users
with key metrics such as procedural time, accuracy,
radiation exposure, and success in handling complications.
34
6. Algorithm Design
Collision Detection Algorithm: Implement algorithms for
accurate collision detection between the virtual tools
(catheters, guidewires) and the vessel walls. This will
ensure precise responses to the user's actions.
Pathfinding Algorithm for Guidewire: Develop a
pathfinding algorithm to simulate the movement of
guidewires through complex vascular pathways. The
algorithm should handle obstacles such as tortuous
arteries or stenosis.
AI-Driven Complication Simulation: Incorporate AI-based
algorithms to dynamically generate complications during
a procedure (e.g., arterial rupture or stent misplacement),
requiring the user to adapt to unexpected challenges.
7. Real-time Feedback and Performance Analytics
Data Tracking: The system will collect real-time data on
user performance metrics, including accuracy, time to
complete the procedure, success in stent deployment, and
radiation dose used.
Performance Evaluation: Design a performance evaluation
algorithm that analyzes the user’s proficiency based on
these metrics. This algorithm will provide feedback on
areas for improvement and suggest targeted exercises.
35
8. Testing and Validation
Pilot Testing: Conduct initial tests with medical students,
residents, and experienced clinicians to gather feedback
on the system's usability, realism, and effectiveness.
Iteration and Improvement: Based on user feedback,
refine the simulation environment, improve the accuracy
of haptic feedback, and fine-tune the performance metrics
to ensure they reflect real-world training needs.
Validation Studies: Perform validation studies comparing
training outcomes from the VR system to traditional
training methods, assessing improvements in procedural
skills, decision-making, and user confidence.
9. Deployment and Training
User Documentation and Tutorials: Provide
comprehensive training modules and user manuals to
guide trainees and instructors through the use of the VR
simulator. Include tutorials that familiarize users with the
VR controls and interface.
Scalability for Institutions: Develop the system with
scalability in mind, allowing deployment in medical
schools, teaching hospitals, and training centers, where it
can accommodate multiple users and scenarios.
36
Architecture Diagram
37
Algorithm
The following simplified algorithm outlines the steps involved
in the simulation of an interventional angiography procedure:
1. Initialization
o Load patient-specific anatomical models and clinical
scenario data.
o Initialize VR environment with proper imaging,
catheter, and guidewire models.
2. User Interaction
o Detect and track hand movements through VR
controllers.
o Simulate guidewire and catheter manipulation based
on user input.
3. Real-Time Feedback
o Display fluoroscopic view with real-time catheter
position.
o Provide haptic feedback to simulate the feel of
navigating through vessels.
4. Procedure Simulation
o Execute pathfinding algorithm for guidewire
navigation through vessels.
o Detect collisions and interactions between the
catheter and vessel walls.
38
o Simulate blood flow dynamics and guidewire
behavior in real-time.
5. Complication Handling
o AI dynamically generates procedural complications
based on predefined probabilities.
o User receives immediate feedback and must adapt to
the complication (e.g., stent misplacement).
6. Performance Evaluation
o Track key performance indicators (e.g., time taken,
device accuracy, complication resolution).
o Provide real-time feedback and end-of-scenario
evaluation to the user.
7. Completion
o Log the user’s performance and suggest areas for
improvement.
CHAPTER-6
SYSTEM IMPLEMENTATION
6.1 Coding
1. Preparation (Pre-procedure Simulation)
This phase involves presenting the user with patient data
and interaction to confirm the procedure.
39
Code snippet for Patient Data Display:
using UnityEngine;
using UnityEngine.UI;
void Start()
{
// Example patient data
patientName.text = "Patient: John Doe";
heartRate.text = "Heart Rate: 72 bpm";
bloodPressure.text = "Blood Pressure: 120/80";
instructions.text = "Please confirm patient information to
proceed.";
}
40
public void OnConfirmButtonClick()
{
// Logic to proceed to the next step of the procedure
instructions.text = "Patient confirmed. Preparing for the next
step.";
}
}
using UnityEngine;
41
public GameObject catheter;
public Transform insertionPoint; // Starting point of the catheter
public float insertionSpeed = 0.1f;
void Update()
{
if (Input.GetKey(KeyCode.Space)) // Simulate pressing a button
to insert catheter
{
InsertCatheter();
}
}
void InsertCatheter()
{
if (catheter.transform.position.z < insertionPoint.position.z +
10.0f) // Limit insertion length
{
catheter.transform.Translate(Vector3.forward *
insertionSpeed * Time.deltaTime);
}
42
}
}
using UnityEngine;
43
void Update()
{
if (Input.GetKey(KeyCode.W)) // Press 'W' to move forward
{
MoveToNextWaypoint();
}
}
void MoveToNextWaypoint()
{
if (currentWaypointIndex < arteryWaypoints.Length)
{
catheterTip.transform.position =
Vector3.MoveTowards(catheterTip.transform.position,
arteryWaypoints[currentWaypoin
tIndex].position,
moveSpeed * Time.deltaTime);
if (catheterTip.transform.position ==
arteryWaypoints[currentWaypointIndex].position)
{
44
currentWaypointIndex++; // Proceed to next waypoint
}
}
}
}
4. Balloon Angioplasty
This step involves inflating a balloon at the blockage site to expand
the artery.
using UnityEngine;
void Update()
{
45
if (Input.GetKey(KeyCode.I)) // Press 'I' to inflate
{
InflateBalloon();
}
else if (Input.GetKey(KeyCode.D)) // Press 'D' to deflate
{
DeflateBalloon();
}
}
void InflateBalloon()
{
if (balloon.transform.localScale.x < maxInflation)
{
balloon.transform.localScale += new Vector3(inflationSpeed,
inflationSpeed, inflationSpeed) * Time.deltaTime;
}
}
void DeflateBalloon()
{
46
if (balloon.transform.localScale.x > 1.0f)
{
balloon.transform.localScale -= new Vector3(inflationSpeed,
inflationSpeed, inflationSpeed) * Time.deltaTime;
}
}
}
5. Stent Placement
In this step, after the artery is expanded, the stent is placed and
deployed.
using UnityEngine;
47
void Update()
{
if (Input.GetKey(KeyCode.S)) // Press 'S' to deploy stent
{
DeployStent();
}
}
void DeployStent()
{
if (!isDeployed)
{
// Expand stent
stent.transform.localScale += new Vector3(deploySpeed,
deploySpeed, deploySpeed) * Time.deltaTime;
48
}
}
}
6. Post-procedure Monitoring
The user can now view the result of the angioplasty and stent
placement, confirming successful blood flow.
using UnityEngine;
void Update()
49
{
if (stentPlaced) // After stent is deployed
{
if (!bloodParticles.isPlaying)
{
bloodParticles.Play(); // Start blood flow visualization
}
}
}
50
using UnityEngine;
using UnityEngine.UI;
void Start()
{
recoveryText.text = "Procedure complete. Follow these steps for
recovery:\n" +
"1. Take prescribed medications.\n" +
"2. Maintain a heart-healthy diet.\n" +
"3. Attend follow-up appointments.";
}
}
VR Integration
Once the basic systems are coded, you can integrate this into a VR
environment using Unity's XR Interaction Toolkit or similar VR
51
frameworks. This involves adding hand controllers for catheter
manipulation, balloon inflation, and stent deployment.
using UnityEngine;
using UnityEngine.XR.Interaction.Toolkit;
void Update()
{
if
(leftHand.inputDevice.TryGetFeatureValue(CommonUsages.triggerB
utton, out bool triggerPressed) && triggerPressed)
{
// Use the left hand trigger to control catheter insertion
catheter.Translate(Vector3.forward * Time.deltaTime);
52
}
if
(rightHand.inputDevice.TryGetFeatureValue(CommonUsages.trigge
rButton, out bool inflatePressed) && inflatePressed)
{
// Use right hand to inflate balloon
InflateBalloon();
}
}
void InflateBalloon()
{
// Similar balloon inflation logic for VR
}
}
CHAPTER-7
PERFORMANCE ANALYSIS
The performance analysis of the VR simulator for interventional
angiography focuses on various factors that measure the
effectiveness, realism, and utility of the system in medical training.
53
Below are the key aspects considered in the performance evaluation
of the simulator.
1. Accuracy of Simulation
The realism of the simulator is crucial for the training process,
ensuring that users experience near-real procedures:
Anatomical Accuracy: The 3D vascular models are based on real
patient data (e.g., CT or MRI scans) and converted into high-fidelity
virtual representations. Accurate simulation of vascular anatomy,
blood flow, and surrounding structures contributes to the
effectiveness of the training.
Tool Interaction: The system must accurately simulate the physical
interaction of tools (catheters, guidewires) with vascular walls. The
tactile feedback provided by haptic devices must closely match the
resistance and pressure felt in real procedures, allowing users to
develop the necessary manual dexterity.
54
The feedback response should be immediate, with minimal lag
between the user’s actions and the feedback received.
Complication Handling: The simulator must accurately reproduce
complications such as arterial dissections or blockages, requiring
users to make quick decisions. The performance of the complication
simulation is measured by how realistically and unpredictably these
scenarios are triggered.
3. Usability and Training Effectiveness
The VR simulator is evaluated based on its utility as a training tool:
Ease of Use: The user interface and VR controls should be intuitive
for medical professionals, allowing for easy navigation through
different training modules. High usability ensures that even novice
users can quickly grasp how to operate the simulator and interact
with the tools and environment.
Progressive Learning: The simulator’s ability to scale in difficulty—
from beginner-level scenarios to advanced, complex cases—
enhances its performance as a versatile training tool. It should
provide a clear learning curve, enabling users to gradually increase
their proficiency in handling angiography procedures.
User Satisfaction: The simulator is evaluated through user feedback
from trainees and instructors. High satisfaction indicates that the
simulator meets the training needs effectively, providing valuable
practice without the risks associated with live procedures.
4. Performance Metrics and EvaluationTo ensure consistent skill
development, the VR simulator should track the following metrics in
real-time:
55
Procedural Time: Measures the duration of each procedure, helping
to track improvement in speed over multiple sessions.
Radiation Exposure: Simulates radiation doses during fluoroscopy,
prompting users to minimize unnecessary exposure, thereby
reflecting real-world best practices.
Precision of Device Placement: Tracks how accurately the
guidewires, catheters, and stents are placed within the vessels.
Higher accuracy is a critical performance indicator in interventional
procedures.
Success Rate in Handling Complications: Evaluates how effectively
users manage complications like arterial dissection or incorrect
stent placement, reflecting their decision-making abilities under
pressure.
5. System Performance and Hardware Integration
Processing Speed and Graphics Rendering: The simulator requires
high computational power to render the 3D environment in real-
time without latency or frame drops. Any lag in rendering or
feedback can reduce the effectiveness of the simulation, particularly
in high-stress scenarios.
Hardware Compatibility: The system’s performance also depends on
its integration with the VR headset, hand controllers, and haptic
devices. These must work seamlessly together to provide an
uninterrupted, immersive experience. The performance is also
tested based on system stability during prolonged use.
6. Scalability and Adaptability
56
Scenario Customization: The simulator’s ability to offer
customizable scenarios, from basic coronary artery procedures to
complex cases involving tortuous vessels or emergencies, is
essential. This adaptability ensures that the simulator remains
relevant for different user levels and specialties (e.g., cardiology,
radiology, neurovascular).
Training Module Updates: The system should be designed to easily
incorporate updates, whether to add new anatomical models,
procedures, or advancements in medical technology. The
performance is evaluated based on how easily new content can be
integrated without requiring extensive reconfiguration of the
system.
7. Cost-effectiveness and Accessibility
While traditional training methods using cadaveric models or
supervised procedures are expensive and limited in availability, the
VR simulator provides a more scalable solution. The performance is
assessed by the extent to which the system reduces overall training
costs, increases access to complex case simulations, and allows for
repeated practice without additional expenses.
8. Safety and Risk Mitigation
A key performance advantage of the VR simulator is the elimination
of patient risk during the training process. The system allows
trainees to practice complicated techniques, make mistakes, and
learn from them in a risk-free environment, ultimately leading to
improved performance in real-world procedures.
57
CONCLUSION:
The development of a virtual reality(VR) simulation or laser
skin resurfacing represents a significant advancement in medical
training, particularly with dermatology. By creating an immersive
learning environment, this project allows practitioners to engage
with realistic scenarios that closely mimic actual cinical procedures.
The VR simulation provides a safe and controlled setting where
users can practice skills without the inherent risk associated with
real-life treatments. This is particularly beneficial for complex
procedures like laser resurfacing, where precision and technique
are critical for successful outcomes.
Research has shown that VR technology is not only technically
feasible but also highly effective for enhancing learning outcomes in
medical education. For instance, studies have demonstrated that
students who engage with VR simulations report increased
confidence in their abilities and improved retention of procedural
knowledge compared to traditional training methods. The
interactive nature of VR allows user to visualize the entire process
from patient preparation to the application of the laser while
receiving real-time feedback on their actions. This immediate
reinforcement fosters a deeper understanding of the nuances
involved in laser treatments, ultimately improving their clinical
skills.
Moreover,the integration of VR into dermatological training aligns
with current trends towards more innovative educational
approaches that prioritize experiential learning.
Future Enhancements
58
The VR simulator for interventional angiography offers a robust
platform for medical training, but several enhancements can further
improve its utility and effectiveness. Here are some potential future
directions:
1. Integration with Artificial Intelligence (AI)Personalized Feedback:
AI algorithms can be integrated into the system to analyze user
performance in real-time, providing personalized recommendations
for improvement. AI could track patterns in user errors, procedural
efficiency, and success rates, helping users to focus on specific skill
areas.Automated Performance Scoring: AI could be used to
automatically score user performance based on precision, speed,
radiation exposure, and handling of complications, offering more
objective assessments.
2. Multi-user Collaboration and Remote Training
Telemedicine and Remote Collaboration: The system could be
enhanced to allow for multi-user sessions where trainees and
instructors interact in a shared virtual space. This would allow
remote mentorship and collaboration among healthcare
professionals, particularly useful for training sessions with
specialists in different locations.Simulated Team Environments:
Integrating multi-user functionality could allow the VR simulator to
mimic a real surgical team environment, where users practice
communication, coordination, and decision-making as a group.
3. Enhanced Haptic Feedback
Advanced Tactile Simulation: Future versions of the system could
incorporate more advanced haptic feedback technology, simulating
the finer nuances of force, texture, and pressure in a more realistic
59
manner. This would allow users to better feel the interaction
between catheters, guidewires, and the vascular walls.Device-
Specific Feedback: Tailoring the haptic feedback to specific medical
devices like stents, balloons, or drug-eluting systems could provide
an even more detailed and accurate simulation of real-life
procedures.
4. Expanded Clinical Scenarios
Rare and Complex Cases: Future iterations could include more rare
and complex cases that are not frequently encountered in clinical
practice, such as highly calcified arteries or congenital vascular
anomalies. This would give trainees the opportunity to experience
and prepare for unusual but critical situations.Emergency Scenarios:
Incorporating high-stress emergency situations such as acute
myocardial infarctions or ruptured aneurysms would prepare
trainees to handle high-pressure conditions requiring rapid
decision-making.
5. Cross-specialty Applications
Neurovascular and Peripheral Interventions: The VR system could
be expanded to cover a wider range of interventional procedures,
including neurovascular and peripheral vascular interventions. This
would increase its applicability for a broader audience, including
neurologists and vascular surgeons.Expanded Anatomical Regions:
The simulator could eventually be used to train for interventional
procedures across various anatomical regions beyond the
cardiovascular system, such as pulmonary or gastrointestinal
procedures.
6. Integration with Real-time Patient Data
60
Real Patient Case Integration: In the future, the VR simulator could
allow users to import real patient data (e.g., CT or MRI scans) to
practice procedures on patient-specific anatomies. This could serve
as a preparatory step before real-life interventions, offering users a
chance to practice on a virtual model of the actual case.Augmented
Reality (AR) Overlay: The simulator could incorporate augmented
reality features, allowing trainees to perform procedures with real
patient data overlaid on their simulation.
7. Virtual Reality Hardware Upgrades
Next-generation VR Headsets: As VR hardware continues to evolve,
incorporating newer, more advanced VR headsets with better
resolution, wider fields of view, and more immersive experiences
can significantly enhance the realism of the simulation.Improved
Motion Tracking: Enhanced motion-tracking technologies could
make user interactions with virtual tools even more precise, closely
mimicking the fine motor skills required in interventional
angiography.
8. Simulated Long-term Outcomes
Patient Outcome Simulations: Future iterations could simulate long-
term patient outcomes based on procedural decisions made during
the training. This would allow trainees to see how their actions
during the procedure impact the long-term health of patients,
providing a more holistic learning experience.Simulated Post-
Operative Care: The VR system could be expanded to include post-
operative care and follow-up, allowing users to experience the full
patient journey and gain insights into managing post-procedural
complications or recovery.
61
9. Adaptive Learning Algorithms
Dynamic Learning Paths: Adaptive learning algorithms could tailor
the simulation to the user's performance. If a user struggles with a
particular aspect of the procedure.
SAMPLE SCREENSHOTS
62
63