# Panoramic 3D image

**URL:** <https://discourse.slicer.org/t/panoramic-3d-image/15208>\
**Category:** Development\
**Tags:** 3d-model\
**Created:** [December 24, 2020, 3:55am UTC](https://discourse.slicer.org/t/panoramic-3d-image/15208 "2020-12-24T03:55:14Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![aldoSanchez](https://avatars.discourse-cdn.com/v4/letter/a/5f9b8f/32.png) [@aldoSanchez](https://discourse.slicer.org/u/aldoSanchez)\
**Post date:** [December 24, 2020, 3:55am UTC](https://discourse.slicer.org/t/panoramic-3d-image/15208/1 "2020-12-24T03:55:14Z")

</div>

Hi today Im working with the images creater like  
cap = ScreenCapture.ScreenCaptureLogic().capture3dViewRotation(getNode(‘vtkMRMLViewNode1’),-180,180,15,0,“C:/Users/aldot/Desktop/python”,‘image\_%05d.png’)

and I want to do a panoramic image merge all of them in one I just want to know if is possible with a slicer or I need another program like PhotoShop

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [December 24, 2020, 5:36am UTC](https://discourse.slicer.org/t/panoramic-3d-image/15208/2 "2020-12-24T05:36:19Z")

</div>

360 degree photos make sense only for rendering scenes where you are in the middle and you _look around_, while in medical imaging you are usually outside the volume of interest and _look at_ a 3D object. That’s why we have the rotating video export option and have not added the 360 panorama option.

Anyway, we’ll soon update VTK in Slicer to VTK9, which has a [vtkPanoramicProjectionPass class](https://github.com/Kitware/VTK/blob/master/Rendering/OpenGL2/vtkPanoramicProjectionPass.h) that should make it very simple to create panoramic renderings.

Instead of a panoramic image, it would be generally more relevant to create VR180 video or side-by-side stereo video (viewable on a VR headset). Both should be quite straightforward to implement.

---

<div class="post-metadata">

**Author:** ![aldoSanchez](https://avatars.discourse-cdn.com/v4/letter/a/5f9b8f/32.png) [@aldoSanchez](https://discourse.slicer.org/u/aldoSanchez)\
**Post date:** [December 24, 2020, 6:13am UTC](https://discourse.slicer.org/t/panoramic-3d-image/15208/3 "2020-12-24T06:13:12Z")

</div>

The main idea is to use this panoramic picture to make **Augmented reality**  
so the 3D object could be used or panoramic for inside staff

---

<div class="post-metadata">

**Author:** ![lassoan](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/lassoan/32/13_2.png) [@lassoan](https://discourse.slicer.org/u/lassoan)\
**Post date:** [December 24, 2020, 6:29am UTC](https://discourse.slicer.org/t/panoramic-3d-image/15208/4 "2020-12-24T06:29:07Z")

</div>

Panoramic image is useful if you are inside the patient and want to render the surroundings, which only happens in endoscopic AR, but even then, typically you want to overlay tumors or trajectories and not an entire 360 box.

What would you like to display over the patient? Burr hole position, drill/needle insertion trajectory, vertebral models, …? They are all just take up a very small part of the field of view, so panoramic 360 view is not relevant. Normally you add a tracking reference on the patient and display a 3D model anchored relative to that reference marker (but if you don’t need robust registration then markerless tracking works, too).

You can try the open-source surgical AR system developed by Etienne Leger (it integrates with Slicer, I think Slicer or maybe Ibis renders the overlay and it is sent to the AR tablet using OpenIGTLink): [https://link.springer.com/article/10.1007/s11548-020-02155-6](https://link.springer.com/article/10.1007/s11548-020-02155-6)

There are some other earlier efforts related to this - some of the links may still be useful: [https://www.slicer.org/wiki/Documentation/Labs/Augmented\_Reality\_and\_Virtual\_Reality\_support](https://www.slicer.org/wiki/Documentation/Labs/Augmented_Reality_and_Virtual_Reality_support)

---

<div class="post-metadata">

**Author:** ![aldoSanchez](https://avatars.discourse-cdn.com/v4/letter/a/5f9b8f/32.png) [@aldoSanchez](https://discourse.slicer.org/u/aldoSanchez)\
**Post date:** [December 24, 2020, 6:55am UTC](https://discourse.slicer.org/t/panoramic-3d-image/15208/5 "2020-12-24T06:55:15Z")

</div>

Wow thanks for the information, I will give it a look and hopefully it will work I want to show the outside of the brain like 3D models and inside like panoramic 360 view in AR.