Abstract:Objective: This study aims to enhance medical image registration by addressing the limitations of existing approaches that rely on spatial transformations through U-Net, ConvNets, or Transformers. The objective is to develop a novel architecture that combines ConvNets, Graph Neural Networks (GNNs), and Capsule Networks to improve the accuracy and efficiency of medical image registration, which can also deal with the problem of rotating registration. Approach: We propose an deep learning-based approach which can be utilized in both unsupervised and semi-supervised manners, named as HGCMorph. It leverages a hybrid framework that integrates ConvNets and GNNs to capture lower-level features, specifically short-range attention, while also utilizing Capsule Networks (CapsNets) to model abstract higher-level features, including entity properties such as position, size, orientation, deformation, and texture. This hybrid framework aims to provide a comprehensive representation of anatomical structures and their spatial relationships in medical images. Main results: The results demonstrate the superiority of HGCMorph over existing state-of-the-art deep learning-based methods in both qualitative and quantitative evaluations. In unsupervised training process, our model outperforms the recent SOTA method TransMorph by achieving 7 /38 increase on Dice Score Coefficient (DSC), and 2 /7 improvement on Negative Jacobian Determinant (NJD) for OASIS and LPBA40 datasets, respectively. Furthermore, HGCMorph achieves improved registration accuracy in semi-supervised training process. In addition, when dealing with complex 3D rotations and secondary randomly deformations, our method still achieves the best performance. We also tested our methods on lung datasets, such as JSRT, Montgoermy and Shenzhen. Significance: The significance lies in its innovative design to medical image registration. HGCMorph offers a novel framework that overcomes the limitations of existing methods by efficiently capturing both local and abstract features, leading to enhanced registration accuracy, discontinuity-preserving, and pose-learning abilities. The incorporation of Capsule Networks introduces valuable improvements, making the proposed method a valuable contribution to the field of medical image analysis. HGCMorph not only advances the SOTA methods but also has the potential to improve various medical applications that rely on accurate image registration.

CoCycleReg: Collaborative Cycle-Consistency Method for Multi-Modal Medical Image Registration

CycleMorph: Cycle consistent unsupervised deformable image registration

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

Unimodal Cyclic Regularization for Training Multimodal Image Registration Networks.

Learning a Metric for Multimodal Medical Image Registration without Supervision Based on Cycle Constraints

Unsupervised Deformable Image Registration Using Cycle-Consistent CNN

Unsupervised Multimodal 3D Medical Image Registration with Multilevel Correlation Balanced Optimization

Image Synthesis-Based Multi-Modal Image Registration Framework by Using Deep Fully Convolutional Networks

Robust deformable image registration using cycle-consistent implicit representations

HGCMorph: joint discontinuity-preserving and pose-learning via GNN and capsule networks for deformable medical images registration

End-to-end multimodal image registration via reinforcement learning

Multimodal Deformable Image Registration for Long-COVID Analysis Based on Progressive Alignment and Multi-perspective Loss

Modality-Agnostic Structural Image Representation Learning for Deformable Multi-Modality Medical Image Registration

Breaking the Dilemma of Medical Image-to-image Translation

L2NLF: a novel linear-to-nonlinear framework for multi-modal medical image registration

Pair-Wise and Group-Wise Deformation Consistency in Deep Registration Network

Multi-modal Image Registration for Correlative Microscopy

A Coarse-to-Fine Deformable Transformation Framework for Unsupervised Multi-Contrast MR Image Registration with Dual Consistency Constraint

RS-MOCO: A deep learning-based topology-preserving image registration method for cardiac T1 mapping

ACSGRegNet: A Deep Learning-based Framework for Unsupervised Joint Affine and Diffeomorphic Registration of Lumbar Spine CT via Cross- and Self-Attention Fusion

Unsupervised End-to-end Learning for Deformable Medical Image Registration