# Collaborative surgery planning in virtual reality

**URL:** https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407
**Category:** Support
**Tags:** virtual-reality, creepy-cool
**Created:** [April 5, 2019, 2:53pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407 "2019-04-05T14:53:50Z")
**Posts on this page:** 11
**Page:** 1

<div class="post-metadata">

### Author: ![cpinter](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/cpinter/32/7995_2.png) [@cpinter](https://discourse.slicer.org/u/cpinter)
#### Post date: [April 5, 2019, 2:53pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/1 "2019-04-05T14:53:51Z")

</div>

Hi all,

While working on some potential clinical use cases, we (with @lassoan) made a video about collaborative planning in VR, in which two Slicer instances using the same scene are connected through OpenIGTLink, so we can see each other in VR. We thought you’ll find this interesting.

---

<div class="post-metadata">

### Author: ![cpinter](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/cpinter/32/7995_2.png) [@cpinter](https://discourse.slicer.org/u/cpinter)
#### Post date: [April 5, 2019, 6:44pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/2 "2019-04-05T18:44:04Z")

</div>

@pieper I like the new tag you created 🤣

---

<div class="post-metadata">

### Author: ![Nicholas.jacobson](https://avatars.discourse-cdn.com/v4/letter/n/ba8739/32.png) [@Nicholas.jacobson](https://discourse.slicer.org/u/Nicholas.jacobson)
#### Post date: [April 8, 2019, 5:10pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/3 "2019-04-08T17:10:31Z")

</div>

This is great guys! We’ve been trying to use your process in 3d slicer for VR but its been a big learning curve. This helps.

---

<div class="post-metadata">

### Author: ![sarvpriya1985](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/sarvpriya1985/32/4094_2.png) [@sarvpriya1985](https://discourse.slicer.org/u/sarvpriya1985)
#### Post date: [April 25, 2019, 1:45pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/4 "2019-04-25T13:45:47Z")

</div>

Hi,  
It looks great! Is there any tutorial for this (about linking)

Thanks,  
Sarv

---

<div class="post-metadata">

### Author: ![cpinter](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/cpinter/32/7995_2.png) [@cpinter](https://discourse.slicer.org/u/cpinter)
#### Post date: [April 25, 2019, 2:20pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/5 "2019-04-25T14:20:18Z")

</div>

There is no tutorial, because the process is not polished at all (it was quite lengthy to set up), and this was just an experiment.

We’re planning to develop a module in the near future that helps setting up the Slicer instances for VR collaboration. Probably we’ll make a tutorial for the module once it’s done.

---

<div class="post-metadata">

### Author: ![sarvpriya1985](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/sarvpriya1985/32/4094_2.png) [@sarvpriya1985](https://discourse.slicer.org/u/sarvpriya1985)
#### Post date: [April 25, 2019, 3:26pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/6 "2019-04-25T15:26:53Z")

</div>

Thanks for getting back.

One more question. I am working with windows mixed reality headset. I am planning to invest in a new headset. I read in one of the discussions somewhere that HTC vive is good one. Is there any specific thing that can be done by HTC vive regarding virtual display. Also any suggestions on the model of HTC vive to be used for use with SLicer.

Thanks,  
Sarv

---

<div class="post-metadata">

### Author: ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)
#### Post date: [April 25, 2019, 3:50pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/7 "2019-04-25T15:50:06Z")

</div>

The main difference of HTC Vive compared to Windows MR headsets is that HTC Vive uses fixed lighthouse devices, which make tracking initialization more robust (you don’t need to look around after you put on the headset but you can start tracking right away). So, if you have a dedicated place where you use your virtual reality system then I would recommend HTC Vive; if you want to have a portable system then I would recommend any Windows MR headset.

If you use a laptop then probably go with the classic HTC Vive (it is hard to find laptops that can drive an HTC Vive Pro), if you have a desktop system with one of the newest GPUs then you can use an HTC Vive Pro (it has somewhat better specs than the basic HTC Vive).

---

<div class="post-metadata">

### Author: ![sarvpriya1985](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/sarvpriya1985/32/4094_2.png) [@sarvpriya1985](https://discourse.slicer.org/u/sarvpriya1985)
#### Post date: [April 25, 2019, 4:16pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/8 "2019-04-25T16:16:04Z")

</div>

Thanks for clarifying Andras. I guess I have to stick to windows headset as I don’t have a dedicated place.

Thanks again,  
Sarv

---

<div class="post-metadata">

### Author: ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)
#### Post date: [May 7, 2019, 11:14pm UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/9 "2019-05-07T23:14:28Z")

</div>

> [@cpinter](#):
>
> There is no tutorial, because the process is not polished at all (it was quite lengthy to set up),

I think the setup is quite painless, especially if you just modify an existing scene that has the controller transforms sharing already configured. The setup could be also automated with a short Python script.

The main idea is that you run two instances of Slicer, each of them connected to a headset. Both instances contain the same data nodes (models, volumes, etc.) and their parent transforms are set as outgoing nodes in OpenIGTLinkIF module (which ensures the transform nodes are synchronized between the instances). The scene that we used in the video is available [here](https://1drv.ms/u/s!Arm_AFxB9yqHt6I_2zmVp7FhX9b0Cw).

---

<div class="post-metadata">

### Author: ![sarvpriya1985](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/sarvpriya1985/32/4094_2.png) [@sarvpriya1985](https://discourse.slicer.org/u/sarvpriya1985)
#### Post date: [May 8, 2019, 4:49am UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/10 "2019-05-08T04:49:04Z")

</div>

Thanks Andras.

I haven’t worked with Open IGTLimk module. So have to see if I can recreate the scene. I will post if I am able to achieve similar results.

Thanks,  
Sarv

---

<div class="post-metadata">

### Author: ![Isam\_Al\_Hassan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/isam_al_hassan/32/13520_2.png) [@Isam\_Al\_Hassan](https://discourse.slicer.org/u/Isam_Al_Hassan)
#### Post date: [December 15, 2021, 6:41am UTC](https://discourse.slicer.org/t/collaborative-surgery-planning-in-virtual-reality/6407/11 "2021-12-15T06:41:46Z")

</div>

Hi sir , I’m working with unity , is their any chance to exchange developments so we all reach to the best of it? i need MRI scan from hospitals so i do the experience. my email [isam.al.hassan@gmail.com](mailto:isam.al.hassan@gmail.com)

thank you
