# PW35 Projects List

**URL:** <https://discourse.slicer.org/t/pw35-projects-list/17905>\
**Category:** Project Week\
**Created:** [June 1, 2021, 2:48pm UTC](https://discourse.slicer.org/t/pw35-projects-list/17905 "2021-06-01T14:48:59Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![Fernando](https://sea2.discourse-cdn.com/flex002/user_avatar/discourse.slicer.org/fernando/32/5640_2.png) [@Fernando](https://discourse.slicer.org/u/Fernando)\
**Post date:** [June 1, 2021, 3:48pm UTC](https://discourse.slicer.org/t/pw35-projects-list/17905/4 "2021-06-01T15:48:52Z")

</div>

Hi all,

Apart from supporting the [`MONAILabel`](https://github.com/Project-MONAI/MONAILabel) team, I would like to work on more generic and lower-level compatibility issues between [PyTorch](https://pytorch.org/) and Slicer.

Basically, I imagine the following scenario: a user has trained a deep learning segmentation model using PyTorch (and possibly [TorchIO](https://torchio.readthedocs.io/), [MONAI](https://monai.io/) or [both](https://colab.research.google.com/github/fepegar/torchio-notebooks/blob/main/notebooks/TorchIO_MONAI_PyTorch_Lightning.ipynb)). They want users (e.g., clinicians) to be able to use the model on their own data, without the need to code. The best solution is probably to contribute an extension. (I am in this situation, with [`resseg`](https://github.com/fepegar/resseg) and its corresponding extension [`SlicerEPISURG`](https://github.com/fepegar/SlicerEPISURG)).

Three issues I would like to address:

1. How to install PyTorch inside Slicer. The main question is whether to install a version with GPU support and, if it does, which version of the CUDA toolkit to install. I did a bit of work on this during the development of the [`SlicerTorchIO`](https://github.com/fepegar/SlicerTorchIO) extension.
2. How to handle the necessary conversion of Slicer nodes (e.g. `vtkMRMLScalarNode`) to PyTorch objects (e.g. `torch.Tensor`). A few additions to `slicer.util` might help here.
3. Possibly, contributing a full tutorial with a toy example using a publicly available dataset such as TorchIO’s [`IXITiny`](https://torchio.readthedocs.io/datasets.html#ixitiny) or a dataset from the [Medical Segmentation Decathlon](http://medicaldecathlon.com/)\*

If someone is interested in this stuff, please let me know and let’s work together!

Some related projects that are probably worth looking at are [DeepInfer](https://www.slicer.org/wiki/Documentation/Nightly/Modules/DeepInfer) and [TOMAAT](https://github.com/faustomilletari/TOMAAT-Slicer).

\*Many images from the Medical Decathlon cannot be easily read by Slicer due to their 4D shape. This can maybe be addressed within the `MONAILabel` projects – @diazandr3s, @SachidanandAlle

---

_[View the full topic](https://discourse.slicer.org/t/pw35-projects-list/17905)._