3D MRI / histology / optical image registration of cardiac images for tissue thickness analysis

Dear Slicer Community,

I am looking for help with the co-registration and analysis of 3 different types of data. I have started to develop a pipeline for analysis, but my approach so far has been limited by my experience at managing 3d datasets and I feel there is a lot of potential within 3d Slicer that I am yet to utilise. If anyone can help advise, I would be very appreciative.

I have pre-clinical data for hearts following myocardial infarction, with the following high-resolution data:

A) Ex vivo 3D MRI (T1w/ T2w) (voxel resolution 125- 175 microns)
B) Limited histological sections (masson’s staining) -3-4 per axial sections per heart
C) 2D optical mapping (OM) data (electrophysiology recordings from the front of the heart) from 100x100 pixel array, resolution 320 microns.

I am now looking at ways to improve the co-registration of these three data sets. The histological samples are limited and primarily intended to validate the MRI segmentations. Perhaps, by chance, there will also be some interesting electrophysiology where the histology was sampled.

My primary aim is to correlate structural features (such as scar thickness measured in the axial stack) with the overlying surface electrophysiology data (OM), recorded as a 2d data set from the front of the heart.

The following is my intended analysis pipeline:

  1. Histopathological validation of MRI to inform segmentation (i.e. SI characteristics of scar, fat, normal myocardium & perhaps heterogeneous tissue)
  •   registration of axial slices MRI to corresponding histology
    
  •   note imperfect slice alignment may therefore require 3d data transformation / manual alignment
    
  1. Segmentation of scar & normal myocardium
  •    seems to work well already with 3d slicer 
    
  1. Thickness measurement of (i) scar and (ii) myocardium (iii) mixed tissue from axial stack
  •   Need to develop methodology to measure thickness of scar/ myocardium & mixed at each radial position in the axial stack (i.e. is this possible using the mesh segmentation) 
    
  1. 3d volume render to generate epicardial surface with fiducials (i.e. scar and vascular markings)
  •   Working reasonably well in 3d slicer
    
  •   I am currently getting better results with Horos, but I suspect the same is possible with 3d slicer with more experience
    
  1. Mapping of thickness measurement values to surface
  •   Is this possible? Ideally to display this as a heat map on the 3d render
    
  •   Ideally, in a separate projection I would also display some measure of the change in thickness (i.e. high values corresponding to sudden changes in thickness)
    
  1. Identification of fiducial markers using a black & white photo taken in the same field of view & resolution as the OM data
  •   using the same vascular and scar features from the anterior heart as above
    
  1. Co-registration of fiducials from the 2D OM photo (above) with the fiducials on the 3D volume render from MRI
  •   ideally to achieve the best possible approximate location of the same fiducials as there will be limitations. Manually if necessary! 
    
  •   thereafter, using OM data in the same field of view (&resolution) project these results as a heat map onto the 3D volume (MRI) 
    
  1. Correlation of summative structural data (i.e. thickness) and relevant OM data

From this list I am primarily interested in advice regarding 3) 5) 7) & 8), nevertheless all advice is very welcome!

Many thanks for your time and consideration

Does anyone have any suggestions? All help would be really appreciated!

At one point DRAMMS package was developed specifically with that in mind. I do not know if it is maintained still.
https://www.nitrc.org/projects/dramms/

Hi thanks very much for the suggestion. There does seem to be some issues with that software unfortunately. I note that several other people have had the same issue.

Do you think any of my objectives above would be achievable using 3D slicer?