Abstract:The main objective of anatomically plausible results for deformable image registration is to improve model's registration accuracy by minimizing the difference between a pair of fixed and moving images. Since many anatomical features are closely related to each other, leveraging supervision from auxiliary tasks (such as supervised anatomical segmentation) has the potential to enhance the realism of the warped images after registration. In this work, we employ a Multi-Task Learning framework to formulate registration and segmentation as a joint issue, in which we utilize anatomical constraint from auxiliary supervised segmentation to enhance the realism of the predicted images. First, we propose a Cross-Task Attention Block to fuse the high-level feature from both the registration and segmentation network. With the help of initial anatomical segmentation, the registration network can benefit from learning the task-shared feature correlation and rapidly focusing on the parts that need deformation. On the other hand, the anatomical segmentation discrepancy from ground-truth fixed annotations and predicted segmentation maps of initial warped images are integrated into the loss function to guide the convergence of the registration network. Ideally, a good deformation field should be able to minimize the loss function of registration and segmentation. The voxel-wise anatomical constraint inferred from segmentation helps the registration network to reach a global optimum for both deformable and segmentation learning. Both networks can be employed independently during the testing phase, enabling only the registration output to be predicted when the segmentation labels are unavailable. Qualitative and quantitative results indicate that our proposed methodology significantly outperforms the previous state-of-the-art approaches on inter-patient brain MRI registration and pre- and intra-operative uterus MRI registration tasks within our specific experimental setup, which leads to state-of-the-art registration quality scores of 0.755 and 0.731 (i.e., by 0.8% and 0.5% increases) DSC for both tasks, respectively.

Semantic-Aware Registration with Weakly-Supervised Learning

Semi-weakly-supervised neural network training for medical image registration

SeRN: A Two-Stage Framework of Registration for Semi-Supervised Learning for Medical Images

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Weakly supervised medical image registration with multi-information guidance

Weakly Supervised Registration of Prostate MRI and Histopathology Images

Learning Multi-Modal Volumetric Prostate Registration with Weak Inter-Subject Spatial Correspondence

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

Medical Image Registration Method Based on a Semantic Model with Directional Visual Words

Label-driven weakly-supervised learning for multimodal deformable image registration

LDM-Morph: Latent diffusion model guided deformable image registration

Exploring Weakly Supervised Semantic Segmentation Ensembles for Medical Imaging Systems

Weakly-supervised convolutional neural networks for multimodal image registration

Residual Aligner-based Network (RAN): Motion-separable structure for coarse-to-fine discontinuous deformable registration

Self-Supervised Learning for Non-Rigid Registration Between Near-Isometric 3D Surfaces in Medical Imaging.

From Local to Global: An Anatomy-Aware Deep Learning Approach for Deformable Registration of Brain MR Images

Residual Aligner Network

Semantic-Transferable Weakly-Supervised Endoscopic Lesions Segmentation

Learning Semi-Supervised Medical Image Segmentation from Spatial Registration

An Unsupervised Dual Attention Method for 3D Medical Image Registration

DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation