Recorded sequence volume reconstruction for 3D ultrasound

Hi,

I work with tracked ultrasound and I am using the SlicerIGSIO Volume Reconstruction module to reconstruct a volume and then segment the liver using slicer.

I was able to correctly reconstruct a volume using the live reconstruction. However, I have some problems with the segmentation because the segmentation is interpolated in the orientation of the ultrasound slides and not in the orientation of the volume. Is this related to the frame of the volume? If not how can I fix this problem?

image

But also, I was looking forward to use the “Recorded sequence reconstruction” mode in order to obtain the volume to not have to use Plus and increase the volume reconstruction workflow. So, my question is, what exactly are the input files I need for the “Recorded sequence reconstruction” (input sequence browser and Input volume node). From the recording with Plus I obtained a igt.mha file that contains the image and tracking sequence (see attached to this post) but I don’t know how to succesfully sepate this file into sequence browser and Input volume node.

Thank you,

Scene files (Wetransfer link): https://we.tl/t-hkfXOULHsp

You can click on the slice orientation warning button to align the slice views with the volume axes:

image

Alternatively, if you want to segment on oblique slices then read the oblique slice segmentation recipe.

Thanks @lassoan, this is very helpful, I didn’t know about this feature and oblique slice sementation.

Otherwise what are the files to pass as parameters for the “Recorded sequence reconstruction” in the volume reconstruction module? And is it possible to get thoses files from a tracked image sequence (igt.mha) ?

If you drag and drop the recorded igs.mha into Slicer, it should create a sequence browser + sequence for the images/transforms.

After setting up the transform hierarchy to put the image in the correct reference frame, you can select the sequence browser and image for volume reconstruction.

Thanks @Sunderlandkyl, I was already able to do this with the example data provided in the IGT slicer tutorial, however I have some problems with my own data (obtained with the remote recording plus function, see the configuration files below). First of all, the images extracted from the igt.mha file are not in the right format (see below, images of the imported sequence in volume):
image

After modifying the .mha file header (transform, ElementNumberOfChannels and DimSize) to display the images in the axial plane and reducing from 3 to 1 channel (to display only one capture at a time and not 3 by 3), I can display the ultrasound image correctly (correct orientation and format) when I import the sequence as a volume.
image

However, when I import the igt.mha sequence as a sequence in slicer I only get a slice of the Ultrasound image sequence.
image

How can I solve this problem? Is the .mha transformation matrix in the header read when it is imported as a sequence in slicer? Otherwise, is this a configuration problem?

Here are attached my plus server aquisition and files, and my original and edited (to obtain the image in the right format and orientation): WeTransfer - Send Large Files & Share Photos Online - Up to 2GB Free

Update:

Regarding the image decoding issue, I’m pretty sure it’s a bug in PLUS when recording in RGB_COLOR mode (causing a mismatch between the NDims=3 and DimSize parameters containing 4 in the .mha sequence file) that was resolved by recording the ultrasound images in BRIGHTNESS mode.

However, I still have problems with the volume reconstruction. The volume I get from the recorded sequence reconstruction looks resampled/reconstructed in a different plane than the image. Could this be a calibration problem? If so, where to define this calibration matrix to reconstruct the volume in the right orientation?

Thanks a lot,