Extract pixel values from reformatted red slice

Support
1

Hi,

We want to extract pixel values from reformatted red slice to obtain a perpendicular view. To do that, we use endoscopy module in the following way:

    # Get curve info 
    curveNode = slicer.util.getNode(curveName)
    pointsCurve = vtk.util.numpy_support.vtk_to_numpy(curveNode.GetCurve().GetPoints().GetData())
    modelNode = slicer.util.getNode("model_" + curveName)

    # Set endoscopy params
    pointsEndoscopy = slicer.util.arrayFromModelPoints(modelNode)    
    endoscopyGUI = slicer.modules.endoscopy.widgetRepresentation().self()
    endoscopyGUI.flyTo(0)
   
    # Storage vectors
    volumeNodes_slices = []
    voxels_slices = []
    curvePoints = []

    for index in range(0, len(pointsEndoscopy)-1): 
        
        sliceNodeID = "vtkMRMLSliceNodeRed"
        
        # Get image data from slice view
        sliceNode = slicer.mrmlScene.GetNodeByID(sliceNodeID)
        appLogic = slicer.app.applicationLogic()
        sliceLogic = appLogic.GetSliceLogic(sliceNode)
        sliceLayerLogic = sliceLogic.GetBackgroundLayer()
        reslice = sliceLayerLogic.GetReslice()
        reslicedImage = vtk.vtkImageData()
        reslicedImage.DeepCopy(reslice.GetOutput())
        
        # Create new volume node using resliced image
        volumeNodeResliced = slicer.mrmlScene.AddNewNodeByClass("vtkMRMLScalarVolumeNode")
        volumeNodeResliced.SetIJKToRASMatrix(sliceNode.GetXYToRAS())
        volumeNodeResliced.SetAndObserveImageData(reslicedImage)
        volumeNodeResliced.CreateDefaultDisplayNodes()
        volumeNodeResliced.CreateDefaultStorageNode()
        
        volumeNodes_slices.append(volumeNodeResliced)
        
        # Get voxels as a numpy array
        voxels = slicer.util.arrayFromVolume(volumeNodeResliced)
        voxels_slices.append(voxels)

        # Save voxels as .npy

The problem is that pixel values in .npy file do not match with the values in slicer.
For example:

imagen
imagen494Ă—521 22.4 KB
imagen

Left: .npy file → HU = 470 in vessel center
Right: red slice → HU = 419 in vessel center

2

If you computed the coordinates correctly then probably the difference is due to interpolation. You can use nearest neighbor instead of interpolation if you want to see exactly matching values.

However, if you want to extract orthogonal slices along a curve then you don’t need to implement any new computations. Instead, you can use Curved Planar Reformat module in the Sandbox extension. It gives you all the reformatted slices conveniently in a 3D array.

3

Yes, it was due to interpolation.

However, we have observed another strange behaviour. The images saved as .npy with name “index” correspond to a flyTo(index+1) of the endoscopy module and we don’t know why there is no index correspondence (see code in the previous post).

Thanks

1 Like
4

Rendering pipeline update is limited by the screen refresh rate, while data may be modified thousands of times per second. If you capture data from the rendering pipeline then make sure you call slicer.util.forceRenderAllViews() before. The rendering pipeline is not intended for acquiring data for quantitative analysis, as it is optimized for visualization. Currently, there are not significant limitations (other than lower refresh rate and image resolution and field of view limited to display resolution at later stages of the pipeline, and your data potentially impacted by user’s visualization choices such as interpolation/nearest neighbor), but in the future we may implement features like dynamically lowering of rendering resolution when visualizing very large data sets, etc.

Reslicing/resampling the original image is a more robust way of extracting pixel values from reformatted slices. The non-linear transform based method that Curved Planar Reformat module uses is particularly powerful because it allows transforming any nodes between the world coordinate system and the straightened coordinate system.