Abstract:Multimodal medical image registration remains a challenging problem when strong appearance variations and imprecise alignment exist in images. Previous deep network approaches cannot handle such a high degree of variability and prohibit the use of strong geometric constraints. The authors introduce a novel deep architecture that not only produces image representations that are well-suited for this challenging task, but also leverages knowledge of the geometry constraints for robust registration. By enforcing the representations of different modalities living in a common semantic space, they obtain convolutional features tending to respond to object parts consistently across modality. This yields a unique description for all object fragments and allows the end user to know the model's decision process, whereas most existing models remain unclear and difficult to explain. By using the differentiable spatial transformer to compensate transform, they integrate geometric consensus into the cost function to enable end-to-end model optimisation which has not yet been exploited before. The authors evaluate their method on a very challenging medical image dataset. Experiments demonstrate that the proposed method provides a plausible representation and outperforms state-of-the-art approaches by a significant margin.

Multi-modality Medical Image Registration Based on Gradient Generalized Nearest-neighbor Graph

IMAGE REGISTRATION BASED ON MAXIMIZATION OF GRADIENT CODE MUTUAL INFORMATION

Multi-Modality Image Registration with Gradient Orientation Information Based on Entropic Spanning Graph

Registration of Medical Images Using Points and Curves

Multi-Modality Medical Image Registration Based on Regional Joint Rényi Entropy

Minimum Spanning Tree Integrated with Gradient Information for Medical Image Registration

Research of Non-rigid Medical Image Registration Based on Gradient Information

Image registration algorithm combined with SURF descriptor and generalized nearest-neighbor graph

Complementary scale space keypoint medical image registration based on Rényi entropy

Entropic graph estimation integrated with SIFT features for medical image non-rigid registration

An Efficient Medical Image Registration Algorithm Based on Gradient Descent

A Local Registration Approach Of Medical Images With Niche Genetic Algorithm

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Image Registration Based on Rényi Entropic Graph Combined with Gradient Similarity

Multimodal Image Registration Algorithm Considering Grayscale and Gradient Information

Unsupervised MMRegNet Based on Spatially Encoded Gradient Information.

Medical Image Registration Based on Multi-resolution Analysis and Hybrid Optimization

A method based on mutual information and gradient information for medical image registration

A Hybrid Method for Medical Image Registration Based on Multi-resolution Analysis

Multi-modal Medical Image Registration Based on Adaptive Combination of Intensity and Gradient Field Mutual Information

Improved image registration by combining mutual information and gradient information