Abstract:Medical image registration is a challenging task involving the estimation of spatial transformations to establish anatomical correspondence between pairs or groups of images. Recently, deep learning-based image registration methods have been widely explored, and demonstrated to enable fast and accurate image registration in a variety of applications. However, most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain, which is not always true, especially when registering images whose fields of view contain discontinuities at tissue/organ boundaries. In such scenarios, enforcing smooth, globally continuous deformation fields leads to incorrect/implausible registration results. We propose a novel discontinuity-preserving image registration method to tackle this challenge, which ensures globally discontinuous and locally smooth deformation fields, leading to more accurate and realistic registration results. The proposed method leverages the complementary nature of image segmentation and registration and enables joint segmentation and pair-wise registration of images. A co-attention block is proposed in the segmentation component of the network to learn the structural correlations in the input images, while a discontinuity-preserving registration strategy is employed in the registration component of the network to ensure plausibility in the estimated deformation fields at tissue/organ interfaces. We evaluate our method on the task of intra-subject spatio-temporal image registration using large-scale cinematic cardiac magnetic resonance image sequences, and demonstrate that our method achieves significant improvements over the state-of-the-art for medical image registration, and produces high-quality segmentation masks for the regions of interest.

MvMM-RegNet: A new image registration framework based on multivariate mixture model and neural network estimation

Unsupervised MMRegNet Based on Spatially Encoded Gradient Information.

Unsupervised Registration Method based on Deep Neural Network: Application to cardiac and liver MR images

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Multivariate Mixture Model for Myocardial Segmentation Combining Multi-Source Images.

Multivariate mixture model for myocardium segmentation combining multi-source images

VMambaMorph: a Multi-Modality Deformable Image Registration Framework based on Visual State Space Model with Cross-Scan Module

Deep learning-based 3D brain multimodal medical image registration

Multimodal MR Image Registration Using Weakly Supervised Constrained Affine Network

Cross-Modality Multi-Atlas Segmentation Using Deep Neural Networks

Joint segmentation and discontinuity-preserving deformable registration: Application to cardiac cine-MR images

Mutual Information Neural Estimation in CNN-based End-to-end Medical Image Registration

Multimodal Deformable Registration Based on Unsupervised Learning

Residual Aligner Network

Networks for Joint Affine and Non-parametric Image Registration

Multivariate Mixture Model for Cardiac Segmentation from Multi-Sequence MRI.

End-to-end multimodal image registration via reinforcement learning

DeepGMR: Learning Latent Gaussian Mixture Models for Registration

DELR-Net: a network for 3D multimodal medical image registration in more lightweight application scenarios

Weakly-supervised convolutional neural networks for multimodal image registration

Macjnet: Weakly-Supervised Multimodal Image Deformable Registration Using Joint Learning Framework and Multi-Sampling Cascaded MIND