Transforming segmentations and images together in virtual reality

Operating system:Windows 10
Slicer version:4.10.0
Expected behavior: ‘grabbing’ a render in VR moves both the render and the segmented section
Actual behavior: Using the oculus joystick I can move both towards me, however when I then ‘grab’ the render the segmented section remains where it was.

Hi - I was hoping to show a foreign object highlighted in a volume render using overlapping renders (object breahed into lung). I read a support topic saying to use a segment with the render, which worked extremely well, except that grabbing the rendered lung, left the segmented section behind.

Is there a method of getting around this?

Many thanks
David

Probably the easiest is to prevent objects from moving by making them “non-selectable” and use two-handed gestures to move, rotate, scale the entire scene.

See more details and advanced manipulation options (for example, define groups of objects that are moved together) described in SlicerVirtualReality documentation.

By the way, avoid using “VR” acronym, because it may either mean “volume rendering” or “virtual reality” and it gets very confusing.

Many thanks for the reply (And I’ll try to remember the VR tip!)

Your tip - and the link solved my problems perfectly.

regards

David

1 Like

Hi,
Based upon this discussion, I tried to move the 3d segment into virtual reality frame.
My model was segmented by threshhold. I would like to clarify few things.

This is from virtual reality discussion" * Either left or right controller can be used to grab an object. Each controller can be used to grab an object and move independently."

  1. When its said that we can separate an object by moving the controller inside it, I was unable to separate the object. All my segments are individual. I have attached the screenshot here of my model. Can i separate individual colored segments by holding them and separate them.
  2. How would I be able to slice volume with controller according to " * Make position of controllers available as transforms in the Slicer scene. These transforms can be used in custom modules to reslice volumes (using Volume Reslice Driver module in SlicerIGT extension) or transform any nodes in the scene".

FYI: I have HP windows mixed reality headset.
Thanks,
Sarv

A segmentation node is one object. To move segments independently, I would recommend to export segments to models (and hide the segmentation node). You can also split the segmentation to have one segment per segmentation mode and then you can move each segment separately. [quote=“sarvpriya1985, post:4, topic:4932”]
How would I be able to slice volume with controller according to " * Make position of controllers available as transforms in the Slicer scene. These transforms can be used in custom modules to reslice volumes (using Volume Reslice Driver module in SlicerIGT extension) or transform any nodes in the scene".
[/quote]

Follow the instructions that you have copied here. If you stuck at any point then let us know what you did, what you expected to happen, and what happened instead.

Hi Andras,
I tried these methods but it happened in a different way.

I did export segmentation to models. But this is what happened when I try to grap one segment. It just extracted the entire model and left behind some external structures. I am not sure how this happened, but I was able to separate the extrernal structures but not the required model. Attached is the screenshot here.


(You can also split the segmentation to have one segment per segmentation mode and then you can move each segment separately): How to do this?

Thanks,
Sarv

Please see my answer on your other thread: Virtual reality controller to split segments/Labelling