7th Edition Mentoring Session

Virtual Bronchial Tree Navigation

and Registration

Author Author
1 2
Photo Photo

Arya Jadhav Ritesh

Gaikwad

Sanjivani College of Engineering

Kopargaon

Umesh Sangule
Restricted Circulation | L&T Technology Services | www.Ltts.com
Click to edit Title Text
Challenge Statement
The challenge is to do registration of real-time bronchoscopy video and showcase in the
3D model generated from CT lung dataset of that person to understand the location
where the scope has reached in the bronchial tree.
A offline video of real-time bronchoscopy and the CT images of Lung of the same patient
will be shared and a algorithm has to be developed for registration of both.
3D segmented airway model in STL(Standard Triangle Language) format (segmented
from CT lung dataset of a patient). Virtual Navigation video on the STL model video.
Real-time video of bronchoscopy navigation on same patient.

Restricted Circulation | L&T Technology Services | www.LTTS.com 2

Click to edit Title Text
Concept / Solution
Goal: Create an algorithm that registers live bronchoscopy footage with an already-
existing CT lung dataset so that the location of the bronchoscope in the patient's airway
can be seen and tracked.

Suggested Resolution: Image Registration: To align the CT slices and bronchoscopy video
frames, apply an image registration technique. One can investigate strategies such as
intensity-based approaches, point-based registration, or feature matching.

3D Reconstruction: Using the segmented airway model created from CT scans, create a
3D model of the patient's airway. To see where the scope is, place the registered
bronchoscopy video over this 3D model.

Restricted Circulation | L&T Technology Services | www.LTTS.com 3

Click to edit Title Text
Current Status of POC

 Currently studying
the algorithms for
2D to 3D model
conversion.
 Working on
collecting the
dataset from real
world as well as
online data sets.

Flowchart for dataset Restricted

generationCirculation | L&T Technology Services | www.LTTS.com 4
Click to edit Title Text
Further Plans and Testing process

To combine 3D images and videos to form a single video clip.

To prepare a complete video that will make the doctors easier to identify
the diseases or any type of disorders in the lungs.
Testing the data with the help of a training dataset by providing correct
data about lungs with various parameters.
Final testing will be done on real time problems and will be tested for
accuracy.
Further changes will be done in model according to the accuracy rates
and outputs.

Restricted Circulation | L&T Technology Services | www.LTTS.com 5

Click to edit Title Text
Queries to the mentors
Can we get help with building our individual algorithms for converting 2D to 3D models?
Can we use already build apps for 2D to 3D?

Restricted Circulation | L&T Technology Services | www.LTTS.com 6

Thank You