Abstract:Complicated image registration is a key issue in medical image analysis, and deep learning-based methods have achieved better results than traditional methods. The methods include ConvNet-based and Transformer-based methods. Although ConvNets can effectively utilize local information to reduce redundancy via small neighborhood convolution, the limited receptive field results in the inability to capture global dependencies. Transformers can establish long-distance dependencies via a self-attention mechanism; however, the intense calculation of the relationships among all tokens leads to high redundancy. We propose a novel unsupervised image registration method named the unified Transformer and superresolution (UTSRMorph) network, which can enhance feature representation learning in the encoder and generate detailed displacement fields in the decoder to overcome these problems. We first propose a fusion attention block to integrate the advantages of ConvNets and Transformers, which inserts a ConvNet-based channel attention module into a multihead self-attention module. The overlapping attention block, a novel cross-attention method, uses overlapping windows to obtain abundant correlations with match information of a pair of images. Then, the blocks are flexibly stacked into a new powerful encoder. The decoder generation process of a high-resolution deformation displacement field from low-resolution features is considered as a superresolution process. Specifically, the superresolution module was employed to replace interpolation upsampling, which can overcome feature degradation. UTSRMorph was compared to state-of-the-art registration methods in the 3D brain MR (OASIS, IXI) and MR-CT datasets. The qualitative and quantitative results indicate that UTSRMorph achieves relatively better performance. The code and datasets are publicly available at <a class="link-external link-https" href="https://github.com/Runshi-Zhang/UTSRMorph" rel="external noopener nofollow">this https URL</a>.

Learning Dual Transformer Network for Diffeomorphic Registration

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

TransMorph: Transformer for unsupervised medical image registration

MDReg-Net: Multi-resolution diffeomorphic image registration using fully convolutional networks with deep self-supervision

Diffeomorphic Image Registration with Neural Velocity Field

A Transformer-based Network for Deformable Medical Image Registration

Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration

Explicit–implicit symmetric diffeomorphic deformable image registration with convolutional neural network

Deformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration

A lightweight residual network for unsupervised deformable image registration

Dual-Flow Transformation Network for Deformable Image Registration with Region Consistency Constraint

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

TD-Net:unsupervised medical image registration network based on Transformer and CNN

TransDIR: Deformable imaging registration network based on transformer to improve the feature extraction ability

Fully Differentiable Correlation-driven 2D/3D Registration for X-ray to CT Image Fusion

UTSRMorph: A Unified Transformer and Superresolution Network for Unsupervised Medical Image Registration

Fast Diffeomorphic Image Registration using Patch based Fully Convolutional Networks

Symmetric Transformer-based Network for Unsupervised Image Registration

Deformable Cross-Attention Transformer for Medical Image Registration

NCNet: deformable medical image registration network based on neighborhood cross-attention combined with multi-resolution constraints.