Abstract:Complicated image registration is a key issue in medical image analysis, and deep learning-based methods have achieved better results than traditional methods. The methods include ConvNet-based and Transformer-based methods. Although ConvNets can effectively utilize local information to reduce redundancy via small neighborhood convolution, the limited receptive field results in the inability to capture global dependencies. Transformers can establish long-distance dependencies via a self-attention mechanism; however, the intense calculation of the relationships among all tokens leads to high redundancy. We propose a novel unsupervised image registration method named the unified Transformer and superresolution (UTSRMorph) network, which can enhance feature representation learning in the encoder and generate detailed displacement fields in the decoder to overcome these problems. We first propose a fusion attention block to integrate the advantages of ConvNets and Transformers, which inserts a ConvNet-based channel attention module into a multihead self-attention module. The overlapping attention block, a novel cross-attention method, uses overlapping windows to obtain abundant correlations with match information of a pair of images. Then, the blocks are flexibly stacked into a new powerful encoder. The decoder generation process of a high-resolution deformation displacement field from low-resolution features is considered as a superresolution process. Specifically, the superresolution module was employed to replace interpolation upsampling, which can overcome feature degradation. UTSRMorph was compared to state-of-the-art registration methods in the 3D brain MR (OASIS, IXI) and MR-CT datasets. The qualitative and quantitative results indicate that UTSRMorph achieves relatively better performance. The code and datasets are publicly available at <a class="link-external link-https" href="https://github.com/Runshi-Zhang/UTSRMorph" rel="external noopener nofollow">this https URL</a>.

Pyramid Attention Network for Medical Image Registration

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

Symmetric Pyramid Network for Medical Image Inverse Consistent Diffeomorphic Registration

Pyramid Medical Transformer for Medical Image Segmentation

A Transformer-based Network for Deformable Medical Image Registration

Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networks

Context-driven Pyramid Registration Network for Estimating Large Topology-Preserved Deformation.

Multimodal Medical Image Registration Via Common Representations Learning and Differentiable Geometric Constraints

TD-Net:unsupervised medical image registration network based on Transformer and CNN

Self-recursive Contextual Network for Unsupervised 3D Medical Image Registration

Edge-Aware Pyramidal Deformable Network for Unsupervised Registration of Brain MR Images

NCNet: deformable medical image registration network based on neighborhood cross-attention combined with multi-resolution constraints.

Similarity attention-based CNN for robust 3D medical image registration

MsMorph: An Unsupervised pyramid learning network for brain image registration

H-SGANet: Hybrid Sparse Graph Attention Network for Deformable Medical Image Registration

Deep learning-based 3D brain multimodal medical image registration

Explicit–implicit symmetric diffeomorphic deformable image registration with convolutional neural network

UTSRMorph: A Unified Transformer and Superresolution Network for Unsupervised Medical Image Registration

MSRA-Net: multi-channel semantic-aware and residual attention mechanism network for unsupervised 3D image registration

MrRegNet: Multi-resolution Mask Guided Convolutional Neural Network for Medical Image Registration with Large Deformations

An Unsupervised Convolution Neural Network for Deformable Registration of Mono/Multi-Modality Medical Images