Abstract:Purpose: Accurate deformable registration of magnetic resonance imaging (MRI) scans containing pathologies is challenging due to changes in tissue appearance. In this paper, we developed a novel automated three-dimensional (3D) convolutional U-Net based deformable image registration (ConvUNet-DIR) method using unsupervised learning to establish correspondence between baseline pre-operative and follow-up MRI scans of patients with brain glioma. Methods: This study involved multi-parametric brain MRI scans (T1, T1-contrast enhanced, T2, FLAIR) acquired at pre-operative and follow-up time for 160 patients diagnosed with glioma, representing the BraTS-Reg 2022 challenge dataset. ConvUNet-DIR, a deep learning-based deformable registration workflow using 3D U-Net style architecture as a core, was developed to establish correspondence between the MRI scans. The workflow consists of three components: (1) the U-Net learns features from pairs of MRI scans and estimates a mapping between them, (2) the grid generator computes the sampling grid based on the derived transformation parameters, and (3) the spatial transformation layer generates a warped image by applying the sampling operation using interpolation. A similarity measure was used as a loss function for the network with a regularization parameter limiting the deformation. The model was trained via unsupervised learning using pairs of MRI scans on a training data set (n = 102) and validated on a validation data set (n = 26) to assess its generalizability. Its performance was evaluated on a test set (n = 32) by computing the Dice score and structural similarity index (SSIM) quantitative metrics. The model's performance also was compared with the baseline state-of-the-art VoxelMorph (VM1 and VM2) learning-based algorithms. Results: The ConvUNet-DIR model showed promising competency in performing accurate 3D deformable registration. It achieved a mean Dice score of 0.975 ± 0.003 and SSIM of 0.908 ± 0.011 on the test set (n = 32). Experimental results also demonstrated that ConvUNet-DIR outperformed the VoxelMorph algorithms concerning Dice (VM1: 0.969 ± 0.006 and VM2: 0.957 ± 0.008) and SSIM (VM1: 0.893 ± 0.012 and VM2: 0.857 ± 0.017) metrics. The time required to perform a registration for a pair of MRI scans is about 1 s on the CPU. Conclusions: The developed deep learning-based model can perform an end-to-end deformable registration of a pair of 3D MRI scans for glioma patients without human intervention. The model could provide accurate, efficient, and robust deformable registration without needing pre-alignment and labeling. It outperformed the state-of-the-art VoxelMorph learning-based deformable registration algorithms and other supervised/unsupervised deep learning-based methods reported in the literature.

A 3D Sparse Autoencoder for Fully Automated Quality Control of Affine Registrations in Big Data Brain MRI Studies

RegQCNET: Deep quality control for image-to-template brain MRI affine registration

Deep neural network ensemble for on-the-fly quality control-driven segmentation of cardiac MRI T1 mapping

Automatic quality control of brain T1-weighted magnetic resonance images for a clinical data warehouse

Automated detection of critical findings in multi-parametric brain MRI using a system of 3D neural networks

Joint affine and deformable three‐dimensional networks for brain MRI registration

Reducing Variations in Multi-Center Alzheimer’s Disease Classification with Convolutional Adversarial Autoencoder

An efficient semi-supervised quality control system trained using physics-based MRI-artefact generators and adversarial training

Deformable registration of magnetic resonance images using unsupervised deep learning in neuro-/radiation oncology

Automatic Alignment of Brain MR Scout Scans Using Data-Adaptive Multi-Structural Model

Quality assessment and control of unprocessed anatomical, functional, and diffusion MRI of the human brain using MRIQC

Joint Calibrationless Reconstruction and Segmentation of Parallel MRI

Multi-atlas image registration of clinical data with automated quality assessment using ventricle segmentation

Learning-Based Quality Control for Cardiac MR Images

Quality Control-Driven Image Segmentation Towards Reliable Automatic Image Analysis in Large-Scale Cardiovascular Magnetic Resonance Aortic Cine Imaging

Non-Rigid 2D-3D Registration Using Convolutional Autoencoders

Non-Reference Quality Assessment for Medical Imaging: Application to Synthetic Brain MRIs

Real-Time 2D/3D Registration via CNN Regression and Centroid Alignment

Scale-Space Autoencoders for Unsupervised Anomaly Segmentation in Brain MRI

Automated MRI Quality Assessment of Brain T1-weighted MRI in Clinical Data Warehouses: A Transfer Learning Approach Relying on Artefact Simulation