Abstract:PurposeDeformable multimodal image registration, which can benefit radiotherapy and image guided surgery by providing complementary information, remains a challenging task in the medical image analysis field due to the difficulty of defining a proper similarity measure. This article presents a novel, robust and fast binary descriptor, the discriminative local derivative pattern (dLDP), which is able to encode images of different modalities into similar image representations.MethodsdLDP calculates a binary string for each voxel according to the pattern of intensity derivatives in its neighborhood. The descriptor similarity is evaluated using the Hamming distance, which can be efficiently computed, instead of conventional L1 or L2 norms. For the first time, we validated the effectiveness and feasibility of the local derivative pattern for multimodal deformable image registration with several multi‐modal registration applications.ResultsdLDP was compared with three state‐of‐the‐art methods in artificial image and clinical settings. In the experiments of deformable registration between different magnetic resonance imaging (MRI) modalities from BrainWeb, between computed tomography and MRI images from patient data, and between MRI and ultrasound images from BITE database, we show our method outperforms localized mutual information and entropy images in terms of both accuracy and time efficiency. We have further validated dLDP for the deformable registration of preoperative MRI and three‐dimensional intraoperative ultrasound images. Our results indicate that dLDP reduces the average mean target registration error from 4.12 mm to 2.30 mm. This accuracy is statistically equivalent to the accuracy of the state‐of‐the‐art methods in the study; however, in terms of computational complexity, our method significantly outperforms other methods and is even comparable to the sum of the absolute difference.ConclusionsThe results reveal that dLDP can achieve superior performance regarding both accuracy and time efficiency in general multimodal image registration. In addition, dLDP also indicates the potential for clinical ultrasound guided intervention.

Fast and Robust Multimodal Image Registration Using A Local Derivative Pattern

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Deformable Registration of Ultrasound and Magnetic Resonance Imaging Using A New Self-Similarity Based Neighborhood Descriptor

DISA: DIfferentiable Similarity Approximation for Universal Multimodal Registration

A Dual-Domain Framework for Multimodal Medical Image Registration: Optimizing Phase Consistency with LPC-GIMI

Non-Rigid Multi-Modal 3D Medical Image Registration Based on Foveated Modality Independent Neighborhood Descriptor.

Multimodal Deformable Registration Based on Unsupervised Learning

Multimodal image registration with joint structure tensor and local entropy

Model-Independent, Multimodality Deformable Image Registration by Local Matching of Anatomical Features and Minimization of Elastic Energy

Deformable multi-modal registration using 3D-FAST conditioned mutual information.

LDM-Morph: Latent diffusion model guided deformable image registration

Unsupervised Multi-Modal Medical Image Registration Via Discriminator-Free Image-to-Image Translation.

The same modality medical image registration with large deformation and clinical application based on adaptive diffeomorphic multi-resolution demons

Deep Learning Based Data-Adaptive Descriptor for Non-Rigid Multi-Modal Medical Image Registration.

Two Phase Non-Rigid Multi-Modal Image Registration Using Weber Local Descriptor-Based Similarity Metrics and Normalized Mutual Information

Multimodality Image Registration Using Local Linear Embedding and Hybrid Entropy

A New Similarity Measure for Deformable Image Registration Based on Intensity Matching

INR-LDDMM: Fluid-based Medical Image Registration Integrating Implicit Neural Representation and Large Deformation Diffeomorphic Metric Mapping

Multimodal Registration Using the Discrete Wavelet Frame Transform

Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation

Towards Accurate and Robust Multi-Modal Medical Image Registration Using Contrastive Metric Learning.