Abstract:Purpose: Accurate deformable registration of magnetic resonance imaging (MRI) scans containing pathologies is challenging due to changes in tissue appearance. In this paper, we developed a novel automated three-dimensional (3D) convolutional U-Net based deformable image registration (ConvUNet-DIR) method using unsupervised learning to establish correspondence between baseline pre-operative and follow-up MRI scans of patients with brain glioma. Methods: This study involved multi-parametric brain MRI scans (T1, T1-contrast enhanced, T2, FLAIR) acquired at pre-operative and follow-up time for 160 patients diagnosed with glioma, representing the BraTS-Reg 2022 challenge dataset. ConvUNet-DIR, a deep learning-based deformable registration workflow using 3D U-Net style architecture as a core, was developed to establish correspondence between the MRI scans. The workflow consists of three components: (1) the U-Net learns features from pairs of MRI scans and estimates a mapping between them, (2) the grid generator computes the sampling grid based on the derived transformation parameters, and (3) the spatial transformation layer generates a warped image by applying the sampling operation using interpolation. A similarity measure was used as a loss function for the network with a regularization parameter limiting the deformation. The model was trained via unsupervised learning using pairs of MRI scans on a training data set (n = 102) and validated on a validation data set (n = 26) to assess its generalizability. Its performance was evaluated on a test set (n = 32) by computing the Dice score and structural similarity index (SSIM) quantitative metrics. The model's performance also was compared with the baseline state-of-the-art VoxelMorph (VM1 and VM2) learning-based algorithms. Results: The ConvUNet-DIR model showed promising competency in performing accurate 3D deformable registration. It achieved a mean Dice score of 0.975 ± 0.003 and SSIM of 0.908 ± 0.011 on the test set (n = 32). Experimental results also demonstrated that ConvUNet-DIR outperformed the VoxelMorph algorithms concerning Dice (VM1: 0.969 ± 0.006 and VM2: 0.957 ± 0.008) and SSIM (VM1: 0.893 ± 0.012 and VM2: 0.857 ± 0.017) metrics. The time required to perform a registration for a pair of MRI scans is about 1 s on the CPU. Conclusions: The developed deep learning-based model can perform an end-to-end deformable registration of a pair of 3D MRI scans for glioma patients without human intervention. The model could provide accurate, efficient, and robust deformable registration without needing pre-alignment and labeling. It outperformed the state-of-the-art VoxelMorph learning-based deformable registration algorithms and other supervised/unsupervised deep learning-based methods reported in the literature.

SC-RegNet: Unsupervised Self-Calibrated 3D Biomedical Image Registration Network

Deform U-Net: Unsupervised Deformable 3D Biomedical Image Registration Network

Unsupervised Deformable Image Registration Network for 3D Medical Images

RegFSC-Net: Medical Image Registration via Fourier Transform With Spatial Reorganization and Channel Refinement Network

BIRGU Net: Deformable Brain Magnetic Resonance Image Registration Using Gyral-Net Map and 3D Res-Unet

Deep learning-based 3D brain multimodal medical image registration

AMNet: Adaptive Multi-Level Network for Deformable Registration of 3D Brain MR Images

S3Reg: Superfast Spherical Surface Registration Based on Deep Learning

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

NCNet: deformable medical image registration network based on neighborhood cross-attention combined with multi-resolution constraints.

UDRSNet: An unsupervised deformable registration module based on image structure similarity

MSRA-Net: multi-channel semantic-aware and residual attention mechanism network for unsupervised 3D image registration

DELR-Net: a network for 3D multimodal medical image registration in more lightweight application scenarios

A New Unsupervised Learning Method for 3D Deformable Medical Image Registration

Deformable registration of magnetic resonance images using unsupervised deep learning in neuro-/radiation oncology

MrRegNet: Multi-resolution Mask Guided Convolutional Neural Network for Medical Image Registration with Large Deformations

An Unsupervised Network for Fast Microscopic Image Registration

An Unsupervised Registration Method for Brain Images Based on Contour Guidance

MICDIR: Multi-scale Inverse-consistent Deformable Image Registration using UNetMSS with Self-Constructing Graph Latent

Unsupervised End-to-end Learning for Deformable Medical Image Registration

Adversarial Learning for Deformable Registration of Brain MR Image Using a Multi-Scale Fully Convolutional Network