Abstract:Background Deformable image registration is an essential technique of medical image analysis, which plays important roles in several clinical applications. Existing deep learning‐based registration methods have already achieved promising performance for the registrations with small deformations, while it is still challenging to deal with the large deformation registration due to the limits of the image intensity‐similarity‐based objective function. Purpose To achieve the image registration with large‐scale deformations, we proposed a multilevel network architecture FCNet to gradually refine the registration results based on semantic feature consistency constraint and flow normalization (FN) strategy. Methods At each level of FCNet, the architecture is mainly composed to a FeaExtractor, a FN module, and a spatial transformation module. FeaExtractor consists of three parallel streams which are used to extract the individual features of fixed and moving images, as well as their joint features, respectively. Using these features, the initial deformation field is estimated, which passes through a FN module to refine the deformation field based on the difference map of deformation filed between two adjacent levels. This allows the FCNet to progressively improve the registration performance. Finally, a spatial transformation module is used to get the warped image based on the deformation field. Moreover, in addition to the image intensity‐similarity‐based objective function, a semantic‐feature consistency constraint is also introduced, which can further promote the alignments by imposing the similarity between the fixed and warped image features. To validate the effectiveness of the proposed method, we compared our method with the state‐of‐the‐art methods on three different datasets. In EMPIRE10 dataset, 20, 3, and 7 fixed and moving 3D computer tomography (CT) image pairs were used for training, validation, and testing respectively; in IXI dataset, atlas to individual image registration task was performed, with 3D MR images of 408, 58, and 115 individuals were used for training, validation, and testing respectively; in the in‐house dataset, patient to atlas registration task was implemented, with the 3D MR images of 94, 3, and 15 individuals being training, validation, and testing sets, respectively. Results The qualitative and quantitative comparison results demonstrated that the proposed method is beneficial for handling large deformation image registration problems, with the DSC and ASSD improved by at least 1.0% and 25.9% on EMPIRE10 dataset. The ablation experiments also verified the effectiveness of the proposed feature combination strategy, feature consistency constraint, and FN module. Conclusions Our proposed FCNet enables multiscale registration from coarse to fine, surpassing existing SOTA registration methods and effectively handling long‐range spatial relationships.

Free Form Deformation and Symmetry Constraint‐based Multi‐modal Brain Image Registration Using Generative Adversarial Nets

Non-rigid Multi-Modal Brain Image Registration Based on Two-Stage Generative Adversarial Nets

SymReg-GAN: Symmetric Image Registration with Generative Adversarial Networks

Non-rigid Registration Algorithm Based on Modally Controlled Free Form Deformation

An Unsupervised Registration Method for Brain Images Based on Contour Guidance

Adversarial Learning for Deformable Registration of Brain MR Image Using a Multi-Scale Fully Convolutional Network

Anatomically Constrained and Attention-Guided Deep Feature Fusion for Joint Segmentation and Deformable Medical Image Registration.

BIRGU Net: Deformable Brain Magnetic Resonance Image Registration Using Gyral-Net Map and 3D Res-Unet

H-SGANet: Hybrid Sparse Graph Attention Network for Deformable Medical Image Registration

SEN-FCB: an Unsupervised Twinning Neural Network for Image Registration

PCANet-Based Structural Representation for Nonrigid Multimodal Medical Image Registration

Non-Rigid Multi-Modal 3D Medical Image Registration Based on Foveated Modality Independent Neighborhood Descriptor.

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

Functional Magnetic Resonance Imaging Progressive Deformable Registration Based on a Cascaded Convolutional Neural Network

MDH-Net: Advancing 3D Brain MRI Registration with Multi-Stage Transformer and Dual-Stream Feature Refinement Hybrid Network

GAN-DIRNet: A Novel Deformable Image Registration Approach for Multimodal Histological Images

A Novel Framework for Groupwise Registration of Fmri Images Based on Common Functional Networks.

Feature-based groupwise registration by hierarchical anatomical correspondence detection

A diffeomorphic unsupervised method for deformable soft tissue image registration

The Spiking Cortical Model Based Structural Representations for Non-Rigid Multi-Modal Medical Image Registration

Multilevel network for large deformation image registration based on feature consistency and flow normalization