Abstract:The main objective of anatomically plausible results for deformable image registration is to improve model's registration accuracy by minimizing the difference between a pair of fixed and moving images. Since many anatomical features are closely related to each other, leveraging supervision from auxiliary tasks (such as supervised anatomical segmentation) has the potential to enhance the realism of the warped images after registration. In this work, we employ a Multi-Task Learning framework to formulate registration and segmentation as a joint issue, in which we utilize anatomical constraint from auxiliary supervised segmentation to enhance the realism of the predicted images. First, we propose a Cross-Task Attention Block to fuse the high-level feature from both the registration and segmentation network. With the help of initial anatomical segmentation, the registration network can benefit from learning the task-shared feature correlation and rapidly focusing on the parts that need deformation. On the other hand, the anatomical segmentation discrepancy from ground-truth fixed annotations and predicted segmentation maps of initial warped images are integrated into the loss function to guide the convergence of the registration network. Ideally, a good deformation field should be able to minimize the loss function of registration and segmentation. The voxel-wise anatomical constraint inferred from segmentation helps the registration network to reach a global optimum for both deformable and segmentation learning. Both networks can be employed independently during the testing phase, enabling only the registration output to be predicted when the segmentation labels are unavailable. Qualitative and quantitative results indicate that our proposed methodology significantly outperforms the previous state-of-the-art approaches on inter-patient brain MRI registration and pre- and intra-operative uterus MRI registration tasks within our specific experimental setup, which leads to state-of-the-art registration quality scores of 0.755 and 0.731 (i.e., by 0.8% and 0.5% increases) DSC for both tasks, respectively.

Landmark And Intensity-Based Images Elastic Registration Using Hierarchical B-Splines

Medical Image Elastic Registration Based on Contour and Feature Points

A hybrid registration of medical images using intensity information and landmark points

Registration of Medical Images Using Points and Curves

A New Elastic Registration Algorithm of Medical Image Based on Markov-Gibbs Random Field Model and B-Spline Wavelet

Hybrid multiscale landmark and deformable image registration

Landmark-based elastic registration using approximating thin-plate splines

A Local Registration Approach Of Medical Images With Niche Genetic Algorithm

Landmark and Intensity Based Registration with Large Deformations via Quasi-conformal Maps

A New Curves-Based Local Image Registration Method

Multiresolution Elastic Medical Image Registration in Standard Intensity Scale

Landmark Detection and Coupled Patch Registration for Cardiac Motion Tracking

Adaptive Weighting Landmark-Based Group-Wise Registration on Lung DCE-MRI Images

Dense Deformation Reconstruction Via Sparse Coding.

Nonrigid Registration of Cardiac DSCT Images by Integrating Intensity and Point Features

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

Landmark Optimization Using Local Curvature for Point-Based Nonlinear Rodent Brain Image Registration

Spatial landmark detection and tissue registration with deep learning

Influence of learned landmark correspondences on lung CT registration

Automatic landmark annotation and dense correspondence registration for 3D human facial images

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.