Seeking Guidance: Developing a Real-Time 3D Visualization System Using 3D Slicer and IGT

Development
1

Hello 3D Slicer Community,

I’m currently working on a project that involves real-time 3D visualization and tracking for image-guided surgery using 3D Slicer. The goal is to create a system that integrates medical imaging data with tracking mechanisms to assist in procedures like brain tumor visualization and needle guidance.

I would greatly appreciate your insights, suggestions, or advice on the following aspects of the project:

2

Hi

I have similar experience as shown in the video.

—-

The first one is a basic image-guided navigation system.

—-

The second one combines image-guided navigation with simulation.
This project was applied to focused ultrasound.

If you think my experience would be helpful for your project, please feel free to contact me.

1 Like
3

Thank you for your response! Your experience with optical tracking and real-time simulation-guided navigation is exactly what I am looking for in my project. Your work with 3D Slicer and IGT sounds very impressive.
I wanted to share an idea on how we could achieve tracking using a webcam. Below is a brief outline of the process:

4

Sorry to say, I cannot see the outline of your process.

5

Oh sorry, I forgot to include the outline of my process earlier, so here it is:

Outline of the Process:

Step 1: Convert MRI Images to a 3D Model

  • I have patient MRI images that need to be converted into a 3D model.
  • Using 3D Slicer, I plan to segment the brain and tumor separately and generate a 3D model of the brain with the tumor.
  • The goal is to visualize the brain and tumor accurately in a 3D space for surgical planning.

Step 2: Align 3D Model with Patient’s Head Using a QR Marker

  • A QR marker is securely placed on the patient’s head to serve as a reference for real-time tracking.
  • The QR marker is tracked using the Plus Server in combination with 3D Slicer’s OpenIGTLink module.
  • Using fiducial registration, the MRI-based 3D model is aligned with the patient’s head position.

Step 3: Real-Time Tracking and Surgery Navigation

  • During surgery, the patient’s head movement is tracked in real time using the QR marker.
  • The aligned 3D model dynamically updates to reflect the live position of the patient’s head.
  • This setup aims to help surgeons visualize the tumor and surrounding anatomy precisely, enabling accurate navigation during surgery.

Request for Support

I am seeking guidance from the 3D Slicer community on:

  1. Optimizing the workflow for real-time alignment and tracking using the QR marker.
  2. Ensuring smooth integration between the Plus Server, OpenIGTLink, and 3D Slicer.
  3. Any best practices or additional tools/modules to improve the accuracy and responsiveness of this setup.

Thank you again for your support, and I look forward to hearing your thoughts!

6

Thanks for the sepcific request.

I think you following this tutorial step by step is very helpful to your project.

1 Like
7

Thank you for your response! very helpful for me