We are excited to announce that Nvidia AI-assisted segmentation extension is ready to use in latest Slicer Preview Release (rev28686 or later). The extension has been developed by Nvidia, with contributions from Slicer core developers. While there have been other AI-assisted segmentation modules in Slicer (such as DeepInfer, TOMAAT, SlicerCIP), this newest addition uses Nvidia Clara, a toolkit with significant industrial support and sufficient openness for researchers.
Few-minute overview video, showing guided MRI brain tumor and liver segmentation, and fully automatic liver, tumor, and spleen segmentation:
Tutorial and detailed description: see Nvidia AIAA extension documentation.
How does it work? The input image (and input points - in case of guided segmentation) are sent to a computer equipped with an Nvidia GPU, running Linux operating system and Nvidia Clara software. The server computes segmentation using the selected AI model and sends back the results to Slicer for display and further processing.
We have set up a demonstration server at the PerkLab (Queen’s University in Canada) to make it easier for Slicer users to get started without setting up their own processing computer. We uploaded a couple of AI models that Nvidia developed. We provide these models and the processing service as is, we don’t guarantee quality of this service (validity of segmentation results, speed, server uptime, etc.). No patient information is sent to the processing server and images and results are deleted from the server after processing, but users need to make sure they comply with their data management guidelines when using our server. If there are any confidentiality concerns then publicly available images may be used for testing: see Slicer’s Sample Data module or TCIA Browser extension, or download from other websites, such as Medical Decathlon.
If anyone would like to share their AI models for segmentation, let us know. As long as the model is compatible with Nvidia Clara, we should be able to install it on our server and make it available to the Slicer community.
Any questions and suggestions are welcome!