# Seeking Guidance: Developing a Real-Time 3D Visualization System Using 3D Slicer and IGT

**URL:** <https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451>\
**Category:** Development\
**Tags:** surgical-navigation\
**Created:** [February 2, 2025, 1:09pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451 "2025-02-02T13:09:03Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![Navneet](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/navneet/32/81766_2.png) [@Navneet](https://discourse.slicer.org/u/Navneet)\
**Post date:** [February 2, 2025, 1:09pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/1 "2025-02-02T13:09:03Z")

</div>

**Hello 3D Slicer Community,**

I’m currently working on a project that involves real-time 3D visualization and tracking for image-guided surgery using **3D Slicer**. The goal is to create a system that integrates medical imaging data with tracking mechanisms to assist in procedures like brain tumor visualization and needle guidance.

I would greatly appreciate your insights, suggestions, or advice on the following aspects of the project:

---

<div class="post-metadata">

**Author:** ![park](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/park/32/5717_2.png) [@park](https://discourse.slicer.org/u/park)\
**Post date:** [February 2, 2025, 2:12pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/2 "2025-02-02T14:12:15Z")

</div>

Hi

I have similar experience as shown in the video.

—-

The first one is a basic image-guided navigation system.

[![](https://img.youtube.com/vi/lpnvMrpqjxs/maxresdefault.jpg "Optical tracking using 3D Slicer + IGT") ](https://www.youtube.com/watch?v=lpnvMrpqjxs)

—-

The second one combines image-guided navigation with simulation.  
This project was applied to focused ultrasound.

[![](https://img.youtube.com/vi/TRhmNf8oVCA/maxresdefault.jpg "Real-time simulation-guided navigation system using 3D cGAN") ](https://www.youtube.com/watch?v=TRhmNf8oVCA)

> **[Real-Time Acoustic Simulation Framework for tFUS: A Feasibility Study Using...](https://www.sciencedirect.com/science/article/pii/S1053811923005621)**
>
> Transcranial focused ultrasound (tFUS), in which acoustic energy is focused on a small region in the brain through the skull, is a non-invasive therap…

If you think my experience would be helpful for your project, please feel free to contact me.

---

<div class="post-metadata">

**Author:** ![Navneet](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/navneet/32/81766_2.png) [@Navneet](https://discourse.slicer.org/u/Navneet)\
**Post date:** [February 2, 2025, 3:47pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/3 "2025-02-02T15:47:28Z")

</div>

Thank you for your response! Your experience with optical tracking and real-time simulation-guided navigation is exactly what I am looking for in my project. Your work with 3D Slicer and IGT sounds very impressive.  
I wanted to share an idea on how we could achieve tracking using a webcam. Below is a brief outline of the process:

---

<div class="post-metadata">

**Author:** ![park](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/park/32/5717_2.png) [@park](https://discourse.slicer.org/u/park)\
**Post date:** [February 3, 2025, 1:33pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/4 "2025-02-03T13:33:41Z")

</div>

Sorry to say, I cannot see the outline of your process.

---

<div class="post-metadata">

**Author:** ![Navneet](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/navneet/32/81766_2.png) [@Navneet](https://discourse.slicer.org/u/Navneet)\
**Post date:** [February 3, 2025, 3:47pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/5 "2025-02-03T15:47:25Z")

</div>

Oh sorry, I forgot to include the outline of my process earlier, so here it is:

### **Outline of the Process:**

**Step 1: Convert MRI Images to a 3D Model**

- I have patient MRI images that need to be converted into a 3D model.
- Using 3D Slicer, I plan to segment the brain and tumor separately and generate a 3D model of the brain with the tumor.
- The goal is to visualize the brain and tumor accurately in a 3D space for surgical planning.

**Step 2: Align 3D Model with Patient’s Head Using a QR Marker**

- A QR marker is securely placed on the patient’s head to serve as a reference for real-time tracking.
- The QR marker is tracked using the Plus Server in combination with 3D Slicer’s OpenIGTLink module.
- Using fiducial registration, the MRI-based 3D model is aligned with the patient’s head position.

**Step 3: Real-Time Tracking and Surgery Navigation**

- During surgery, the patient’s head movement is tracked in real time using the QR marker.
- The aligned 3D model dynamically updates to reflect the live position of the patient’s head.
- This setup aims to help surgeons visualize the tumor and surrounding anatomy precisely, enabling accurate navigation during surgery.

* * *

### **Request for Support**

I am seeking guidance from the 3D Slicer community on:

1. Optimizing the workflow for real-time alignment and tracking using the QR marker.
2. Ensuring smooth integration between the Plus Server, OpenIGTLink, and 3D Slicer.
3. Any best practices or additional tools/modules to improve the accuracy and responsiveness of this setup.

Thank you again for your support, and I look forward to hearing your thoughts!

---

<div class="post-metadata">

**Author:** ![park](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/park/32/5717_2.png) [@park](https://discourse.slicer.org/u/park)\
**Post date:** [February 3, 2025, 11:10pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/6 "2025-02-03T23:10:57Z")

</div>

Thanks for the sepcific request.

I think you following [this tutorial](https://www.slicerigt.org/wp/user-tutorial/) step by step is very helpful to your project.

---

<div class="post-metadata">

**Author:** ![Navneet](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/navneet/32/81766_2.png) [@Navneet](https://discourse.slicer.org/u/Navneet)\
**Post date:** [February 4, 2025, 4:26am UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/7 "2025-02-04T04:26:12Z")

</div>

Thank you for your response! very helpful for me

---

<div class="post-metadata">

**Author:** ![Ziyu](https://avatars.discourse-cdn.com/v4/letter/z/3e96dc/32.png) [@Ziyu](https://discourse.slicer.org/u/Ziyu)\
**Post date:** [January 12, 2026, 7:01pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/9 "2026-01-12T19:01:16Z")

</div>

Hello, I can collaborate.

---

<div class="post-metadata">

**Author:** ![Navneet](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/navneet/32/81766_2.png) [@Navneet](https://discourse.slicer.org/u/Navneet)\
**Post date:** [January 12, 2026, 7:05pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/10 "2026-01-12T19:05:48Z")

</div>

Oh that’s nice. Yes we can collaborate

---

<div class="post-metadata">

**Author:** ![Navneet](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/navneet/32/81766_2.png) [@Navneet](https://discourse.slicer.org/u/Navneet)\
**Post date:** [January 24, 2026, 8:07pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/11 "2026-01-24T20:07:57Z")

</div>

oh yes we can collab

---

<div class="post-metadata">

**Author:** ![kareem\_abdelaziz](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/kareem_abdelaziz/32/82182_2.png) [@kareem\_abdelaziz](https://discourse.slicer.org/u/kareem_abdelaziz)\
**Post date:** [January 25, 2026, 12:39pm UTC](https://discourse.slicer.org/t/seeking-guidance-developing-a-real-time-3d-visualization-system-using-3d-slicer-and-igt/41451/12 "2026-01-25T12:39:02Z")

</div>

Hey Iam working on something similar can I contact you?