Hi, I followed SlicerVR development updates through previous GitHub issues and NA-MIC project weeks. The in-VR widget seems to have had problems for a long time. Is there any specific previous version/commit/branch of SlicerVR that can access the Segment Editor in Slicer3D, and modify the segment in VR with controllers? We specifically want to use the Paint functionality in VR for manual correction.
If not, what would be the complexity of fixing this feature if we want to try it ourselves?
Infrastructure for displaying Qt widgets in immersive views is now in place, but I don’t think any modules have taken advantage of it yet.
I know that @cpinter and others have been planning to work on this, but I don’t think there is dedicated funding for it, so the progress may be very slow.
It would be great if you could work on it. To get started, you can build Slicer and the SlicerVirtualReality extension and try to display a vtkQWidgetWidget in Slicer.
How did you set up the Oculus/Meta Quest 2 headset to be accessible from Slicer?
Copied the json files as discussed in this topic to make controllers work.
Connected the Quest 2 headset to the PC using a cable and Oculus PC app.
In the Quest 2, opened the Oculus Link from the menu and went to the Virtual Desktop.
In the PC, launched the SteamVR.
In the PC, opened the Slicer, loaded my volume and segmentation data, and clicked the headset icon on the top left.
Finally, it started the application through the SteamVR.
I can see my controllers, fly around, grab and transform my segmentation (could not grab the volume). I can also see the volumes, but they disappear if I get close. Seems like volumes might have some clipping issues.
FYI I personally am most interested in the two-handed interaction and the in-VR widget. I will try to revive the two-handed interactions but my free time is very limited.