Abstract:The non-rigid multi-modal three-dimensional (3D) medical image registration is highly challenging due to the difficulty in the construction of similarity measure and the solution of non-rigid transformation parameters. A novel structural representation based registration method is proposed to address these problems. Firstly, an improved modality independent neighborhood descriptor (MIND) that is based on the foveated nonlocal self-similarity is designed for the effective structural representations of 3D medical images to transform multi-modal image registration into mono-modal one. The sum of absolute differences between structural representations is computed as the similarity measure. Subsequently, the foveated MIND based spatial constraint is introduced into the Markov random field (MRF) optimization to reduce the number of transformation parameters and restrict the calculation of the energy function in the image region involving non-rigid deformation. Finally, the accurate and efficient 3D medical image registration is realized by minimizing the similarity measure based MRF energy function. Extensive experiments on 3D positron emission tomography (PET), computed tomography (CT), T1, T2, and PD weighted magnetic resonance (MR) images with synthetic deformation demonstrate that the proposed method has higher computational efficiency and registration accuracy in terms of target registration error (TRE) than the registration methods that are based on the hybrid L-BFGS-B and cat swarm optimization (HLCSO), the sum of squared differences on entropy images, the MIND, and the self-similarity context (SSC) descriptor, except that it provides slightly bigger TRE than the HLCSO for CT-PET image registration. Experiments on real MR and ultrasound images with unknown deformation have also be done to demonstrate the practicality and superiority of the proposed method.

Point similarity measures based on MRF modeling of difference images for spline-based 2d-3d rigid registration of x-ray fluoroscopy to CT images

A Unifying MAP-MRF Framework for Deriving New Point Similarity Measures for Intensity-based 2D-3D Registration

Map-Mrf Based Similarity Measures For Intensity-Based 2d-3d Registration

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

Registration Of 3d Fmt And Ct Images Of Mouse Via Affine Transformation Using Sequential Monte Carlo

A Novel 3D/2D Correspondence Building Method for Anatomy-Based Registration

2D/3D Rigid Registration by Integrating Intensity Distance

2D-3D Medical Image Registration Based on Modified Sum of Local Normalized Correlation

Multiple Segmentation for Medical 2D/3D Registration

Non-rigid image registration using spatially region-weighted correlation ratio and GPU-acceleration

Non-Rigid Multi-Modal 3D Medical Image Registration Based on Foveated Modality Independent Neighborhood Descriptor.

2D/3D registration based on biplanar X-ray and CT images for surgical navigation

Non-Rigid Medical Image Registration Based on Mutual Information and Thin-Plate Spline

Unifying Energy Minimization And Mutual Information Maximization For Robust 2d/3d Registration Of X-Ray And Ct Images

Transformer-based 2D/3D medical image registration for X-ray to CT via anatomical features

An Optimized Spline-Based Registration of a 3D CT to a Set of C-Arm Images.

2D-3D Regularized Deformable B-Spline Registration: Application to the Proximal Femur.

Elastic X-Ray Image Registration Based on Mutual Information and Thin-Plate Spline

Medical Image Registration Using Thin-Plate Spline for Automatically Detecting and Matching of Point Sets

Assessing Spline-Based Multi-resolution 2D-3D Image Registration for Practical Use in Surgical Guidance

A Non-Rigid Medical Image Registration Approach Based on Hierarchical Mutual Information and Thin-Plate Spline