Abstract:Objective Fast and accurate deformable image registration (DIR) that include DIR uncertainty estimation are essential for safe and reliable clinical deployment. While recent deep learning models have shown promise in predicting DIR with its uncertainty, challenges persist in proper uncertainty evaluation and hyperparameter optimization for these methods. This work aims to develop and evaluate a model that can perform fast DIR and predict its uncertainty in seconds. Approach In this study, we introduce a novel probabilistic multi-resolution image registration model utilizing convolutional neural networks (CNNs) to estimate a multivariate normal distributed dense displacement field (DDF) in a multimodal image registration problem. To assess the quality of the DDF distribution predicted by the model, we propose a new metric based on the Kullback-Leibler divergence. The performance of our approach was evaluated against three other DIR algorithms (VoxelMorph, Monte Carlo Drop-Out, and Monte Carlo B-splines) capable of predicting uncertainty. The evaluation of the models included not only the quality of the deformation but also the reliability of the estimated uncertainty. Our application investigated registration of a treatment planning computed tomography (CT) to follow-up cone beam CT for daily adaptive radiotherapy. Main results The hyperparameter tuning of the models showed that there is a trade-off between the reliability of the estimated uncertainty and the accuracy of the deformation. In the optimal trade-off our model excelled in contour propagation and uncertainty estimation (p < 0.01) compared to existing uncertainty estimation models. We obtained an average dice similarity coefficient of 0.89 and a KL-divergence of 0.15. Significance By addressing challenges in DIR uncertainty estimation and evaluation, our work showed that both the DIR and its uncertainty can be reliably predicted paving the way for safe deployment in clinical environment.

NPB-REC: Non-parametric Assessment of Uncertainty in Deep-learning-based MRI Reconstruction from Undersampled Data

NPB-REC: A Non-parametric Bayesian Deep-learning Approach for Undersampled MRI Reconstruction with Uncertainty Estimation

NPBDREG: Uncertainty Assessment in Diffeomorphic Brain MRI Registration using a Non-parametric Bayesian Deep-Learning Based Approach

Uncertainty Assessment in Whole-Body Low Dose Pet Reconstruction Using Non-Parametric Bayesian Deep Learning Approach.

Uncertainty Estimation and Propagation in Accelerated MRI Reconstruction

SoftDropConnect (SDC) -- Effective and Efficient Quantification of the Network Uncertainty in Deep MR Image Analysis

Predictive uncertainty in deep learning–based MR image reconstruction using deep ensembles: Evaluation on the fastMRI data set

UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography

Enhancing quality and speed in database-free neural network reconstructions of undersampled MRI with SCAMPI

Uncertainty Estimation in Medical Image Denoising with Bayesian Deep Image Prior

Enhancing quality and speed in database‐free neural network reconstructions of undersampled MRI with SCAMPI

Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction using the Local Lipschitz

Bayesian MRI reconstruction with joint uncertainty estimation using diffusion models

Uncertainty-Aware Null Space Networks for Data-Consistent Image Reconstruction

Estimating Uncertainty in PET Image Reconstruction via Deep Posterior Sampling

Bayesian Uncertainty Estimation of Learned Variational MRI Reconstruction

Adaptive Local Neighborhood-based Neural Networks for MR Image Reconstruction from Undersampled Data

2D-MRI of the Central Nervous System: The effect of a deep learning-based reconstruction pipeline on the overall image quality

Uncertainty estimation and evaluation of deformation image registration based convolutional neural networks

Hierarchical uncertainty estimation for learning-based registration in neuroimaging