Abstract:Purpose: Accurate deformable registration of magnetic resonance imaging (MRI) scans containing pathologies is challenging due to changes in tissue appearance. In this paper, we developed a novel automated three-dimensional (3D) convolutional U-Net based deformable image registration (ConvUNet-DIR) method using unsupervised learning to establish correspondence between baseline pre-operative and follow-up MRI scans of patients with brain glioma. Methods: This study involved multi-parametric brain MRI scans (T1, T1-contrast enhanced, T2, FLAIR) acquired at pre-operative and follow-up time for 160 patients diagnosed with glioma, representing the BraTS-Reg 2022 challenge dataset. ConvUNet-DIR, a deep learning-based deformable registration workflow using 3D U-Net style architecture as a core, was developed to establish correspondence between the MRI scans. The workflow consists of three components: (1) the U-Net learns features from pairs of MRI scans and estimates a mapping between them, (2) the grid generator computes the sampling grid based on the derived transformation parameters, and (3) the spatial transformation layer generates a warped image by applying the sampling operation using interpolation. A similarity measure was used as a loss function for the network with a regularization parameter limiting the deformation. The model was trained via unsupervised learning using pairs of MRI scans on a training data set (n = 102) and validated on a validation data set (n = 26) to assess its generalizability. Its performance was evaluated on a test set (n = 32) by computing the Dice score and structural similarity index (SSIM) quantitative metrics. The model's performance also was compared with the baseline state-of-the-art VoxelMorph (VM1 and VM2) learning-based algorithms. Results: The ConvUNet-DIR model showed promising competency in performing accurate 3D deformable registration. It achieved a mean Dice score of 0.975 ± 0.003 and SSIM of 0.908 ± 0.011 on the test set (n = 32). Experimental results also demonstrated that ConvUNet-DIR outperformed the VoxelMorph algorithms concerning Dice (VM1: 0.969 ± 0.006 and VM2: 0.957 ± 0.008) and SSIM (VM1: 0.893 ± 0.012 and VM2: 0.857 ± 0.017) metrics. The time required to perform a registration for a pair of MRI scans is about 1 s on the CPU. Conclusions: The developed deep learning-based model can perform an end-to-end deformable registration of a pair of 3D MRI scans for glioma patients without human intervention. The model could provide accurate, efficient, and robust deformable registration without needing pre-alignment and labeling. It outperformed the state-of-the-art VoxelMorph learning-based deformable registration algorithms and other supervised/unsupervised deep learning-based methods reported in the literature.

Deformation-Compensated Learning for Image Reconstruction without Ground Truth

Deformation-Compensated Learning for Image Reconstruction without Ground Truth

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Inverse-Consistent Deep Networks for Unsupervised Deformable Image Registration

Distortion-Corrected Image Reconstruction with Deep Learning on an MRI-Linac

Pair-Wise and Group-Wise Deformation Consistency in Deep Registration Network

Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance

Self-supervised Deep Unrolled Reconstruction Using Regularization by Denoising

DefCor-Net: Physics-Aware Ultrasound Deformation Correction

HDM-Net: Monocular Non-Rigid 3D Reconstruction with Learned Deformation Model

Deep Image Reconstruction using Unregistered Measurements without Groundtruth

Non-iterative Coarse-to-fine Registration based on Single-pass Deep Cumulative Learning

Deep Learning-Based Image Reconstruction for Different Medical Imaging Modalities

Deformable registration of magnetic resonance images using unsupervised deep learning in neuro-/radiation oncology

Linear and Deformable Image Registration with 3D Convolutional Neural Networks

Reference-Driven Compressed Sensing MR Image Reconstruction Using Deep Convolutional Neural Networks without Pre-Training

Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networks

Deformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration

A Deep Network for Joint Registration and Reconstruction of Images with Pathologies

Symmetric Deformable Registration via Learning a Pseudomean for MR Brain Images

Adversarial Deformation Regularization for Training Image Registration Neural Networks