An extension for virtual endoscopy

Dear All,

We already have an Endoscopy module in Slicer. However that requires the lumen being already segmented. I have been working on a module which performs the centerline extraction followed by lumen segmentation, for pancreatic duct (it can be used for other lumens too). This may be a useful module for lumen analysis.

I have not made a demonstration webpage yet, just have the repository at:

I’m hoping to add this through the extension management system and would like to hear about your suggestions/opinions.

Thanks!
yi

6 Likes

You have all kinds of cool projects, thanks Yi!

If you haven’t already seen it should have a look at Delphine Naine’s master’s thesis, one of the original driving use cases for Slicer. It would be great to see some of that functionality come back.

https://dspace.mit.edu/handle/1721.1/87240

I am very interested in your work. Thank you for sharing

May I ask / suggest this would be very useful for us for the lung to map the airways … especially if there is a nodule to which we have to reach endoscopically. Often these nodules are peripheral (outer one third of the lung) as since the airways get narrow and branch it’s difficult to reach them with confidence. There is a ton of new equipment being pumped by many companies into this technology (Lung point, Electromagnetic navigation, Robotic bronchoscopy, Cone Beam CT etc etc ) but for a low cost setting / open source we have very little… it would be ideal if you could help design something which will help navigate the airways to a lesion of interest with your background work on Pancreas

Happy to hear from you

Warm Regards
Dr Kedar Hibare
kedarhibare@gmail.com

Hi Steve,

Of course I remember Delphine’s great work. I still remember using that module in the Tcl/Tk based Slicer 1.6 version. :smiley:

Best,
yi

Hi Dr. Hibare,

Sure! I believe it should be straightforward to extend such a module to the airway endoscopy. I’ll work on that.

Thanks for your suggestion!

Best,
yi

Dear Professor Gao:

   Can you share some pictures about the result  of the virtual endoscopy project?
 
    thanks

Thanks a lot for submitting these extensions!

There is some overlap with the VMTK extension, which offers an opportunity in reducing maintenance workload. For example, VMTK can compute vesselness, segment lumen automatically using a few simple methods, and create a centerline tree. The tree is compatible with curves module so that you can automatically find the shortest path between two points (maybe the tree that your modules extract could be used, too):

The resulting tree in the Slicer core Endoscopy module (if your modules create a curve node as output then that can be used there, too).

We should review what is common between existing and new modules and how to consolidate them, so that they combine all the good properties and features.

What is in the gth818n folder?
What does SegmentLumenFromAxis module do?
How the VIrtualEndoscopy module differs from the Endoscopy module in Slicer core? Could they be merged into a single module?
Could we make some segmentation features available in the Segment Editor as effects?

These could be all great projects for the upcoming project week.

1 Like

And this paper for short: Nain D. An interactive virtual endoscopy tool with automotive path generation[D]. Massachusetts Institute of Technology, 2002.
Shows the centerline idea.
This does not affect the innovation of the project。

I agree. there might be some overlapping the the VMTK package.

I recall that I had some discussion with Luca back in the old days that VMTK is computing the vessel lumen surface using level set evolution, then computing the center line from from the lumen segmentation. I thought that such level set evolution that perfectly grabbing the vessel without leaking is particularly hard except some high contrast cases such as the big air way wall.

In contrast, the Virtual Endoscopy module is computing the center line first and the “grow out” from the center line. This is what the “SegmentLumenFromAxis” dose.

:joy: gth818n was my student ID back in Georgia Tech and I used it as a namespace storing my tools/functions…

The current Endoscopy assumes an already extracted surface. But both VMTK and the Virtual Endoscopy proposed here starts from volumetric image. They could be combined.

Also i agree that making an effect for centerline computation in Segment Editor would be a good idea. I’ll look into that.

I’ll check the wiki for the upcoming project week. Project week has always been so much fun!

Best,
yi

Agreed. It only works for a single, very well contrasted vessel branch, but you can segment that using simple thresholding or grow from seeds, so I did not find the levelset method useful (other than it creates smoother surface). A few more segmentation tools were added to VMTK, but I did not have much luck using them either.

Growing segmentation from a manually defined curve could be a good approach for challenging cases. I would be interested to see if it can be used for segmentation of intestines.

I agree. We should split the functionalities so that we can pick any of the segmentation and centerline extraction methods and then use the created centerline for visualization (travel along the centerline).

The current Endoscopy module does not deal with centerline extraction and segmentation, so probably it could be left as is (or some features added from your endoscopy module, if anything is missing). For the segmentation from centerline we could add a Segment Editor effect, as you suggested. If you have time next week, then we could make this a project for the project week.

Sounds great! I’ve just registered for the Project week. I’ll populate the project i’m planning to work on on the wiki.

Yes I used the same algorithm in the “Grow From Seed” for lumen segmentation in SegmentLumenFromAxis.

I’ve tried that but found little luck… The intestine is very hard because the touching outer surfaces and the collapsed lumen make the recognition of the topology very hard even for human. So it’s even very hard to draw the seed. It relatively easy for the inflated colon. It’s even hard to prepared colon (without inflation).

1 Like

Great that you can join Project Week @gaoyi.cn :+1: I really like the idea of a custom editor effect for vessels. It would be great to have something interactive that traces tubular structures.

We have “Draw tube effect” (in SegmentEditorExtraEffects extension), which can draw a uniform-radius tube in the selected segment. Maybe we could add a feature to this effect: snap the tube walls to the image content.

1 Like