GPU not detected Total Segmentation

jamesobutler · February 10, 2025, 9:06pm

TotalSegmentator appears to have added the option for MPS where your Mac Pro AMD Radeon Pro Vega II card supports the mps backend for PyTorch.

It does seem to be a bit on the untested and new side as the following place in the readme hasn’t been updated to reflect the mps option although you can see that --device does allow the “mps” option.

github.com/wasserth/TotalSegmentator

README.md?plain=1

7bceedf0e


      
          ```
          TotalSegmentator -i ct.nii.gz -o segmentations -ta <task_name>
          ```
          
          Confused by all the structures and tasks? Check [this](https://backend.totalsegmentator.com/find-task/) to search through available structures and tasks.
          
          The mapping from label ID to class name can be found [here](https://github.com/wasserth/TotalSegmentator/blob/master/totalsegmentator/map_to_binary.py).
          
          
          ### Advanced settings
          * `--device`: Choose `cpu` or `gpu` or `gpu:X (e.g., gpu:1 -> cuda:1)`
          * `--fast`: For faster runtime and less memory requirements use this option. It will run a lower resolution model (3mm instead of 1.5mm).
          * `--roi_subset`: Takes a space-separated list of class names (e.g. `spleen colon brain`) and only predicts those classes. Saves a lot of runtime and memory. Might be less accurate especially for small classes (e.g. prostate).
          * `--preview`: This will generate a 3D rendering of all classes, giving you a quick overview if the segmentation worked and where it failed (see `preview.png` in output directory).
          * `--ml`: This will save one nifti file containing all labels instead of one file for each class. Saves runtime during saving of nifti files. (see [here](https://github.com/wasserth/TotalSegmentator#class-details) for index to class name mapping).
          * `--statistics`: This will generate a file `statistics.json` with volume (in mm³) and mean intensity of each class.
          * `--radiomics`: This will generate a file `statistics_radiomics.json` with the radiomics features of each class. You have to install pyradiomics to use this (`pip install pyradiomics`).
          
          
          ### Other commands
          If you want to know which contrast phase a CT image is you can use the following command (requires `pip install xgboost`). More details can be found [here](resources/contrast_phase_prediction.md):

github.com/wasserth/TotalSegmentator

totalsegmentator/bin/TotalSegmentator.py

7bceedf0e


      
          # "mps" is for apple silicon; the latest pytorch nightly version supports 3D Conv but not ConvTranspose3D which is
          # also needed by nnU-Net. So "mps" not working for now.
          # https://github.com/pytorch/pytorch/issues/77818
          parser.add_argument("-d",'--device', type=validate_device_type, default="gpu",
                              help="Device type: 'gpu', 'cpu', 'mps', or 'gpu:X' where X is an integer representing the GPU device ID.")

The SlicerTotalSegmentator utilizes the TotalSegmentator python package, but will need to be updated to handle the MPS option as right now if it doesn’t detect a CUDA compatible GPU it will use CPU. See the following code that would need to be updated.

github.com/lassoan/SlicerTotalSegmentator

TotalSegmentator/TotalSegmentator.py

c9dc3cf47


      
          tempFolder = slicer.util.tempDirectory()
          
          inputFile = tempFolder+"/total-segmentator-input.nii"
          outputSegmentationFolder = tempFolder + "/segmentation"
          # print (outputSegmentationFolder)
          outputSegmentationFile = tempFolder + "/segmentation.nii"
          
          # Recommend the user to switch to fast mode if no GPU or not enough memory is available
          import torch
          
          cuda = torch.cuda if torch.backends.cuda.is_built() and torch.cuda.is_available() else None
          
          if not fast and not cuda and interactive:
          
              import ctk
              import qt
              mbox = ctk.ctkMessageBox(slicer.util.mainWindow())
              mbox.text = "No GPU is detected. Switch to 'fast' mode to get low-resolution result in a few minutes or compute full-resolution result which may take 5 to 50 minutes (depending on computer configuration)?"
              mbox.addButton("Fast (~2 minutes)", qt.QMessageBox.AcceptRole)
              mbox.addButton("Full-resolution (~5 to 50 minutes)", qt.QMessageBox.RejectRole)
              # Windows 10 peek feature in taskbar shows all hidden but not destroyed windows

It appears that the MPS backend for PyTorch originally came out for PyTorch 2 with fixes and improvements over time. Since you are on an Intel Mac, you will be stuck on PyTorch 2.2.x as the latest since developers dropped support for it and were instead only going to support macOS on Apple Silicon.

Would you be willing to complete the code changes for SlicerTotalSegmentator and update the documentation for the TotalSegmentator package for your MPS use case? A majority of Slicer users are on Windows, so there has been less of a need for macOS specific tasks. Alternatively, a Windows machine with a CUDA enabled driver would be the easiest environment to immediately begin using.

Topic		Replies	Views
Apple M1 Max vs CUDA on chest analysis pack Support segmentation	1	13	March 25, 2025
TotalSegmentator problem - Macbook M1 Max Support extensions-manager	4	839	December 19, 2022
TotalSegmentator Issues Support segmentation , segmentations , segment-editor , totalsegmentator	2	126	August 5, 2024
Total Segmenter cannot detect my GPU (1080ti x 2) Support	4	1515	June 5, 2023
Total segmentator issue Support	5	962	April 3, 2023

GPU not detected Total Segmentation

Related topics