Abstract:Purpose: Accurate deformable registration of magnetic resonance imaging (MRI) scans containing pathologies is challenging due to changes in tissue appearance. In this paper, we developed a novel automated three-dimensional (3D) convolutional U-Net based deformable image registration (ConvUNet-DIR) method using unsupervised learning to establish correspondence between baseline pre-operative and follow-up MRI scans of patients with brain glioma. Methods: This study involved multi-parametric brain MRI scans (T1, T1-contrast enhanced, T2, FLAIR) acquired at pre-operative and follow-up time for 160 patients diagnosed with glioma, representing the BraTS-Reg 2022 challenge dataset. ConvUNet-DIR, a deep learning-based deformable registration workflow using 3D U-Net style architecture as a core, was developed to establish correspondence between the MRI scans. The workflow consists of three components: (1) the U-Net learns features from pairs of MRI scans and estimates a mapping between them, (2) the grid generator computes the sampling grid based on the derived transformation parameters, and (3) the spatial transformation layer generates a warped image by applying the sampling operation using interpolation. A similarity measure was used as a loss function for the network with a regularization parameter limiting the deformation. The model was trained via unsupervised learning using pairs of MRI scans on a training data set (n = 102) and validated on a validation data set (n = 26) to assess its generalizability. Its performance was evaluated on a test set (n = 32) by computing the Dice score and structural similarity index (SSIM) quantitative metrics. The model's performance also was compared with the baseline state-of-the-art VoxelMorph (VM1 and VM2) learning-based algorithms. Results: The ConvUNet-DIR model showed promising competency in performing accurate 3D deformable registration. It achieved a mean Dice score of 0.975 ± 0.003 and SSIM of 0.908 ± 0.011 on the test set (n = 32). Experimental results also demonstrated that ConvUNet-DIR outperformed the VoxelMorph algorithms concerning Dice (VM1: 0.969 ± 0.006 and VM2: 0.957 ± 0.008) and SSIM (VM1: 0.893 ± 0.012 and VM2: 0.857 ± 0.017) metrics. The time required to perform a registration for a pair of MRI scans is about 1 s on the CPU. Conclusions: The developed deep learning-based model can perform an end-to-end deformable registration of a pair of 3D MRI scans for glioma patients without human intervention. The model could provide accurate, efficient, and robust deformable registration without needing pre-alignment and labeling. It outperformed the state-of-the-art VoxelMorph learning-based deformable registration algorithms and other supervised/unsupervised deep learning-based methods reported in the literature.

Deformable registration of magnetic resonance images using unsupervised deep learning in neuro-/radiation oncology

Unsupervised Deformable Image Registration with Absent Correspondences in Pre-operative and Post-Recurrence Brain Tumor MRI Scans

Deep‐learning‐based joint rigid and deformable contour propagation for magnetic resonance imaging‐guided prostate radiotherapy

Deep learning-based deformable image registration with bilateral pyramid to align pre-operative and follow-up magnetic resonance imaging (MRI) scans

Unsupervised Deformable Image Registration Network for 3D Medical Images

BIRGU Net: Deformable Brain Magnetic Resonance Image Registration Using Gyral-Net Map and 3D Res-Unet

Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

Linear and Deformable Image Registration with 3D Convolutional Neural Networks

Robust Image Registration with Absent Correspondences in Pre-operative and Follow-up Brain MRI Scans of Diffuse Glioma Patients

MDH-Net: Advancing 3D Brain MRI Registration with Multi-Stage Transformer and Dual-Stream Feature Refinement Hybrid Network

Unsupervised deep learning registration model for multimodal brain images

Deform U-Net: Unsupervised Deformable 3D Biomedical Image Registration Network

Label-driven magnetic resonance imaging (MRI)-transrectal ultrasound (TRUS) registration using weakly supervised learning for MRI-guided prostate radiotherapy

An Unsupervised Learning Model for Deformable Medical Image Registration

HCS-Net: Multi-level deformation strategy combined with quadruple attention for image registration

Multitask Weakly Supervised Generative Network for MR-US Registration

Unsupervised End-to-end Learning for Deformable Medical Image Registration

Non-rigid MRI-CT Image Registration with Unsupervised Deep Learning-Based Deformation Prediction

3D deformable registration of longitudinal abdominopelvic CT images using unsupervised deep learning

CT MRI Pelvic Deformable Registration via Deep Learning

A New Unsupervised Learning Method for 3D Deformable Medical Image Registration