Help with 3D Model Registration to Patient’s Face for Image-Guided Surgery in 3D Slicer

Development
1

Hello everyone,

I am working on an image-guided surgery project using 3D Slicer, where I need to register a 3D MRI model to a patient’s face in real time. The goal is to track the patient’s face using a webcam and markers (QR codes, ArUco, or AprilTags) and update the 3D model accordingly.

The system should work automatically—detect the marker, register the face, and continuously update the MRI model’s position in real-time as the patient moves.

Has anyone worked on real-time registration and tracking in 3D Slicer? Any guidance, example scripts, or best practices would be greatly appreciated!

Thanks in advance!

2

Yes, it’s definitely possible to do. Here’s a prototype:

The engineering questions are things like accuracy, performance, etc. while the clinical questions include line of sight requirements, changes in the patient’s face (swelling, muscle tone) and draping requirements.

3

thank you so much this will be gonna helpful for me