Pixelated 3D view in Volume Rendering

I loaded data via SlicerMorph SkyscanReconImport.

I go to Volume Rendering and slide the shift bar, everything as as usual, I reveal the bones I am interested in, but then the 3D render becomes pixelated blocks in the 3D view - I have attached a picture for reference.
When moving the 3D view, the image is in good resolution, but when it is stationary the large pixels occur again.
What could be the cause of this?

This looks like a graphics driver bug. What CPU, graphics card, and operating system do you use? What is the size of your volume? What is your Slicer version? Do you see any errors or warnings in the application log (menu: Help / Report a bug)?

Can you send a screenshot of the volumes dialog box and a copy of the *Rec.log file you used to import the volume? I want to rule out the unit issue (micron to mm)ā€¦

Is this screenshot adequate?

CPU: AMD Ryzen 7 5800X
GPU: Nvidia GeForce RTX 3090
Using Windows 64-bit

Yes, and based on these I see that SkyscanReconImport did correctly read the voxel sizes and units (5 micron). So it can be a rendering bug as @lassoan mentioned. If you can share the stack as a zip file, I can try the rendering with a RTX Titan, although normally Geforceā€™s usually work fine.

I also suggest setting the Rendering Quality to Normal from the default adaptive and see if that helps.

Even as a zip file, the data is 6.6GB. Do you have a different suggestion for sharing the data?
Thank you for all these comments to troubleshoot, I am still very much a beginner ^^ā€™

People typically upload to a cloud sharing site (google drive, onedrive etc) and then share the link, thatā€™s the preferred method.

Alternatively you can upload here, but then it is only going to be shared by me and slicermorph team.
https://faculty.washington.edu/maga/data_dropbox/

https://drive.google.com/file/d/19XhOvs4_6VAwLiZq4HhAN-XO-tOeZsgR/view?usp=sharing

It is not publicly shared, asking for permission.

1 Like

I downloaded this from google drive, but the zip file seems corrupt, I canā€™t unzip it.

I hope this will work. I found a smaller data file that showed the same output.

  1. Loading using SlicerMorph - during Volume Rendering, pixelation of the image is seen in the 3D view when stationary.
  2. When I load the series of png files using the drag/drop and unselecting ā€˜Single Fileā€™ - during Volume Rendering, the 3D view shows a black box that turns grey when manipulating the ā€˜Shiftā€™ bar.

Thank you in advance.

I am checking this.

Yes, thatā€™s expected. If you use the default data load menu in Slicer, PNG is treated as an RGB image, and it is not rendered. You need to use the VectorToScalarVolume to be able to render this. ImageStacks or SkyscanReconImport in SlicerMorph does this automatically.

I imported the data both via ImageStacks and SkyscanReconImport SlicerMorph modules, and cannot replicate the issue (see below). My laptop doesnā€™t have sufficient GPU RAM to render this in full resolution, so I did have to downsample a bit. Anyways, the issue is not the import or the data.

So going back to the rendering problem, it is possible a driver issue as @lassoan indicated above. Do you have the latest drivers for your Geforce 3090?

image
image

The 2 lines of warning I get are the following:
[WARNING][Qt] 27.01.2021 16:21:56 [] (unknown:0) - libpng warning: iCCP: profile ā€˜ICC Profileā€™: ā€˜CMYKā€™: invalid ICC profile color space
[WARNING][Qt] 27.01.2021 16:22:00 [] (unknown:0) - libpng warning: iCCP: known incorrect sRGB profile

The 1 line of error is:
[ERROR][VTK] 27.01.2021 16:23:11 [vtkITKArchetypeDiffusionTensorImageReaderFile (0000016515E34FE0)] (D:\D\S\Slicer-0\Libs\vtkITK\vtkITKArchetypeDiffusionTensorImageReaderFile.cxx:166) - There is more than one file, use the vtkITKArchetypeImageSeriesReader instead.

In terms of driver for GeForce RTX 3090, I have version 461.40.

I uploaded this data via drag/drop and used the VectorToScalarVolume as @muratmaga suggested and there is no pixelation in the Volume Rendering, so I will continue to use this for now.

Whatever the reason for the artifact was, it wasnā€™t due to the SkyScanReconImport or ImageStacks. As I canā€™t replicate this with a RTX Titan, full resolution volume renders perfectly fine after importing it via SkyscanReconImport .

You can continue to use the default image stack loading mechanism in Slicer, but you will have to do that VectorToScalar conversion everytime you do the import, plus you will have to enter the correct image spacing. These are taken care of during the import time if you ImageStack and even more automatically if you use the SkyscanReconImport (all you have to do is to point out to the log file and it will obtain the spacing etc). Thatā€™s why we developed those two modules.

We actually cannot be sure about this. If the image renders consistently well with the default ITK importer and not with the other modules then something might go wrong during the import. For example, there may be subtle differences in file sorting, or which method is used for grayscale conversion (luminance, average, single channel, ā€¦), etc. It could worth some more investigation.

We tested this quite a bit, and we are not aware of any issues. These are all single channel images to begin with, which default data load mechanism turns it into a multichannel image, in which all channels are identical. So regardless of what conversion you use, you end up in the same place you begin with.

What I wanted to test with that dataset is whether the voxel size read correctly from the log file with SkyscanReconImport. Thatā€™s a user customizable field in the Nrecon software and there are a number of prefixes that shows up in the log file over the years (mm, um, micron). And because voxel size seems to impact the 3D rendering quality in Slicer, I thought that might be an issue. It wasnā€™t.

I think this is rendering related.

I did some tests on two computers and it seems that you are right. If the voxel size is very small, such as in this image, then ā€œAdaptiveā€ quality mode of GPU volume rendering results in pixelated rendering when camera stops (full-quality image is worse than coarse quality). I check if there is an easy fix, but if it is not trivial then we can check again after the VTK9 update (that may fix it).

Setting quality mode to ā€œNormalā€ fixes the issue.

ā€œNormalā€ quality level is currently the default, but if an older Slicer version created the default settings then the default level was set to ā€œAdaptiveā€.

Thanks Andras. That adaptive setting has been causing quite a bit of issues, particularly for new users. It is particularly troublesome, if they install a new release but because the default settings were carried from older one, they still have to live with ā€œadaptiveā€. Personally, including an integrated GPUs, I havenā€™t seen a use case where adaptive makes sense.

Can this be overwritten automatically with a new install?