Abstract:Objective: Existing registration networks based on cross-attention design usually divide the image pairs to be registered into patches for input. The division and merging operations of a series of patches are difficult to maintain the topology of the deformation field and reduce the interpretability of the network. Therefore, our goal is to develop a new network architecture based on a cross-attention mechanism combined with a multi-resolution strategy to improve the accuracy and interpretability of medical image registration. Approach: We propose a new deformable image registration network NCNet based on neighborhood cross-attention combined with multi-resolution strategy. The network structure mainly consists of a multi-resolution feature encoder, a multi-head neighborhood cross-attention module and a registration decoder. The hierarchical feature extraction capability of our encoder is improved by introducing large kernel parallel convolution blocks; the cross-attention module based on neighborhood calculation is used to reduce the impact on the topology of the deformation field and double normalization is used to reduce its computational complexity. Main result: We performed atlas-based registration and inter-subject registration tasks on the public 3D brain magnetic resonance imaging datasets LPBA40 and IXI respectively. Compared with the popular VoxelMorph method, our method improves the average DSC value by 7.9% and 3.6% on LPBA40 and IXI. Compared with the popular TransMorph method, our method improves the average DSC value by 4.9% and 1.3% on LPBA40 and IXI. Significance: We proved the advantages of the neighborhood attention calculation method compared to the window attention calculation method based on partitioning patches, and analyzed the impact of the pyramid feature encoder and double normalization on network performance. This has made a valuable contribution to promoting the further development of medical image registration methods.

New method for medical image registration based on neural networks

Medical Image Elastic Registration Based on Contour and Feature Points

Medical Image Registration via Neural Fields

Image registration based on neural network

Networks for Joint Affine and Non-parametric Image Registration

Medical Image Registration Based on Self-Adapting Pulse-Coupled Neural Networks and Mutual Information

A New Robust Markerless Method for Automatic Image-to-patient Registration in Image-Guided Neurosurgery System.

A More Robust Method for Multi-modality Medical Image Registration

Cascade connection-based channel attention network for bidirectional medical image registration

Rethinking medical image reconstruction via shape prior, going deeper and faster: Deep joint indirect registration and reconstruction

A Novel Hierarchical Medical Image Registration Method Based on Multiscale and Contour Line

A Non-Rigid Medical Image Registration Approach Based on Hierarchical Mutual Information and Thin-Plate Spline

A Hybrid Method for Medical Image Registration Based on Multi-resolution Analysis

3D Biological/Biomedical Image Registration with enhanced Feature Extraction and Outlier Detection

Medical Image Registration Algorithm in Image-Guided Noninvasive Surgery

A Novel Neurosurgery Registration Pipeline Based on Heat Maps and Anatomic Facial Feature Points.

A New 3d Multi-Modality Medical Bone Image Registration Algorithm

NCNet: deformable medical image registration network based on neighborhood cross-attention combined with multi-resolution constraints.

An Improved Medical Image Registration Algorithm Based on Mutual Information

L2NLF: a novel linear-to-nonlinear framework for multi-modal medical image registration

2D-3D Medical Image Registration Based on Modified Sum of Local Normalized Correlation