Abstract:In non-rigid registration for medical imaging analysis, computation is complicated, and the high accuracy and robustness needed for registration are difficult to obtain. Recently, many studies have been conducted for nonrigid registration via unsupervised learning networks. This study proposes a method to improve the performance of this unsupervised learning network approach, through the use of a self-attention mechanism. In this paper, the self-attention mechanism is combined with deep learning networks to identify information of higher importance, among large amounts of data, and thereby solve specific tasks. Furthermore, the proposed method extracts both local and non-local information so that the network can create feature vectors with more information. As a result, the limitation of the existing network is addressed: alignment based solely on the entire silhouette of the brain is mitigated in favor of a network which also learns to perform registration of the parts of the brain that have internal structural characteristics. To the best of our knowledge, this is the first such utilization of the attention mechanism in this unsupervised learning network for non-rigid registration. The proposed attention network performs registration that takes into account the overall characteristics of the data, thus yielding more accurate matching results than those of the existing methods. In particular, matching is achieved with especially high accuracy in the gray matter and cortical ventricle areas, since these areas contain many of the structural features of the brain. The experiment was performed on 3D magnetic resonance images of the brains of 50 people. The measured average dice similarity coefficient after registration was 70.40%, which is an improvement of 17.48% compared to that before registration. This improvement indicates that application of the attention block can further improve the performance by an additional 8.5%, as relative to that without attention block. Ultimately, through implementation of non-rigid registration via the attention block method, the internal structure and overall shape of the brain can be addressed, without additional data input. Additionally, attention blocks have the advantage of being able to easily connect to existing networks without a significant computational overhead. Furthermore, by producing an attention map, the area of the brain around which registration was more performed can be visualized. This approach can be used for non-rigid registration with various types of medical imaging data.

CAR-Net: Unsupervised Co-Attention Guided Registration Network for Joint Registration and Structure Learning

Joint segmentation and discontinuity-preserving deformable registration: Application to cardiac cine-MR images

Unsupervised Registration Method based on Deep Neural Network: Application to cardiac and liver MR images

Unsupervised Deep Learning Network with Self-Attention Mechanism for Non-Rigid Registration of 3D Brain MR Images

NCNet: deformable medical image registration network based on neighborhood cross-attention combined with multi-resolution constraints.

CAR-Net: A Deep Learning-Based Deformation Model for 3D/2D Coronary Artery Registration

CAR: Contrast-Agnostic Deformable Medical Image Registration with Contrast-Invariant Latent Regularization

Structure-aware independently trained multi-scale registration network for cardiac images

ACSGRegNet: A Deep Learning-based Framework for Unsupervised Joint Affine and Diffeomorphic Registration of Lumbar Spine CT via Cross- and Self-Attention Fusion

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

PCANet-Based Structural Representation for Nonrigid Multimodal Medical Image Registration

MSRA-Net: multi-channel semantic-aware and residual attention mechanism network for unsupervised 3D image registration

ERNet: Unsupervised Collective Extraction and Registration in Neuroimaging Data

Unsupervised Image Registration towards Enhancing Performance and Explainability in Cardiac and Brain Image Analysis

PCNet: A Structure Similarity Enhancement Method for Multispectral and Multimodal Image Registration

Structure-aware Registration Network for Liver DCE-CT Images

MDReg-Net: Multi-resolution diffeomorphic image registration using fully convolutional networks with deep self-supervision

CARL: A Framework for Equivariant Image Registration

Non-rigid image registration using fully convolutional networks with deep self-supervision

AMCNet: Adaptive Matching Constraint for Unsupervised Point Cloud Registration.

F3RNet: Full-Resolution Residual Registration Network for Deformable Image Registration