Combining different segmentations

Hello,
I have a problem with creating a model from a scan: instead of 1 scan with all 3 axes done simultaneously, I have 3 scans from 3 axes. For each of the scans, 1 is of great quality and 2 are of worse quality (probably interpolated). How can i combine them into 1 (as in the picture) for the purpose of creating a 3d model from all of them?


This question comes up fairly often, but we don’t have a good solution for it. This kind of scan is done to allow review by radiologists of high res images in the three scan planes. It’s possible that if they acquired one higher resolution volume and used reslicing to get the other views it would be better overall, but this is not the common practice.

Looking at images like this, it feels like it should be straightforward to combine them into a 3D isotropic image volume, but it is not. If the image slice voxels are 0.5 mm x 0.5 mm in-plane and slices are 4 mm apart, then we’re actually missing quite a bit of information if we wanted to construct an image volume which had voxels which were 0.5 mm^3. Looking only at the high resolution slices obscures how blurry the data acquisition actually is perpendicular to the that plane. I can imagine ways to fill in the data via interpolation, but I expect the results are much less than satisfactory, because I think if they looked good we would already have tools available which do this, and instead this apparently remains an unsolved problem.

Agreed, this seems like something where a superresolution machine learning tool would be really useful but I’ve never seen one for this problem. It could be trained on high res data and then take the three orthogonal thick slice images as input and generate a synthetic isotropic volume.

See more information here (and in topics mentioned in that post):