Abstract:Mistrust is a major barrier to implementing deep learning in healthcare settings. Entrustment could be earned by conveying model certainty, or the probability that a given model output is accurate, but the use of uncertainty estimation for deep learning entrustment is largely unexplored, and there is no consensus regarding optimal methods for quantifying uncertainty. Our purpose is to critically evaluate methods for quantifying uncertainty in deep learning for healthcare applications and propose a conceptual framework for specifying certainty of deep learning predictions. We searched Embase, MEDLINE, and PubMed databases for articles relevant to study objectives, complying with PRISMA guidelines, rated study quality using validated tools, and extracted data according to modified CHARMS criteria. Among 30 included studies, 24 described medical imaging applications. All imaging model architectures used convolutional neural networks or a variation thereof. The predominant method for quantifying uncertainty was Monte Carlo dropout, producing predictions from multiple networks for which different neurons have dropped out and measuring variance across the distribution of resulting predictions. Conformal prediction offered similar strong performance in estimating uncertainty, along with ease of interpretation and application not only to deep learning but also to other machine learning approaches. Among the six articles describing non-imaging applications, model architectures and uncertainty estimation methods were heterogeneous, but predictive performance was generally strong, and uncertainty estimation was effective in comparing modeling methods. Overall, the use of model learning curves to quantify epistemic uncertainty (attributable to model parameters) was sparse. Heterogeneity in reporting methods precluded the performance of a meta-analysis. Uncertainty estimation methods have the potential to identify rare but important misclassifications made by deep learning models and compare modeling methods, which could build patient and clinician trust in deep learning applications in healthcare. Efficient maturation of this field will require standardized guidelines for reporting performance and uncertainty metrics.

Tackling prediction uncertainty in machine learning for healthcare

Quantifying and leveraging predictive uncertainty for medical image assessment

Uncertainty-aware deep learning in healthcare: A scoping review

Second opinion needed: communicating uncertainty in medical machine learning

Bayesian Modelling in Practice: Using Uncertainty to Improve Trustworthiness in Medical Applications

Uncertainty-informed deep learning models enable high-confidence predictions for digital histopathology

Uncertainty Quantification in Computer-Aided Diagnosis: Make Your Model say "I don't know" for Ambiguous Cases

A Radiology-focused Review of Predictive Uncertainty for AI Interpretability in Computer-assisted Segmentation

Mitigating Diagnostic Errors in Lung Cancer Classification: A Multi-Eyes Principle to Uncertainty Quantification

Probabilistic Machine Learning for Healthcare

Uncertainty Aware Training to Improve Deep Learning Model Calibration for Classification of Cardiac MR Images

Quantifying Uncertainty in Deep Learning of Radiologic Images

Uncertainty Quantification for Clinical Outcome Predictions with (Large) Language Models

Towards Quality Management of Machine Learning Systems for Medical Applications

Reconfiguration of uncertainty: Introducing AI for prediction of mortality at the emergency department

Embracing the uncertainty in human-machine collaboration to support clinical decision-making for mental health conditions

Quantifying Uncertainty in Deep Learning Classification with Noise in Discrete Inputs for Risk-Based Decision Making

Improving Image-Based Precision Medicine with Uncertainty-Aware Causal Models

Linguistically Communicating Uncertainty in Patient-Facing Risk Prediction Models

Handling of uncertainty in medical data using machine learning and probability theory techniques: a review of 30 years (1991–2020)

Modeling the Uncertainty in Electronic Health Records: a Bayesian Deep Learning Approach