Abstract:Background/purpose: The use of artificial intelligence (AI) in radiotherapy (RT) is expanding rapidly. However, there exists a notable lack of clinician trust in AI models, underscoring the need for effective uncertainty quantification (UQ) methods. The purpose of this study was to scope existing literature related to UQ in RT, identify areas of improvement, and determine future directions. Methods: We followed the PRISMA-ScR scoping review reporting guidelines. We utilized the population (human cancer patients), concept (utilization of AI UQ), context (radiotherapy applications) framework to structure our search and screening process. We conducted a systematic search spanning seven databases, supplemented by manual curation, up to January 2024. Our search yielded a total of 8980 articles for initial review. Manuscript screening and data extraction was performed in Covidence. Data extraction categories included general study characteristics, RT characteristics, AI characteristics, and UQ characteristics. Results: We identified 56 articles published from 2015-2024. 10 domains of RT applications were represented; most studies evaluated auto-contouring (50%), followed by image-synthesis (13%), and multiple applications simultaneously (11%). 12 disease sites were represented, with head and neck cancer being the most common disease site independent of application space (32%). Imaging data was used in 91% of studies, while only 13% incorporated RT dose information. Most studies focused on failure detection as the main application of UQ (60%), with Monte Carlo dropout being the most commonly implemented UQ method (32%) followed by ensembling (16%). 55% of studies did not share code or datasets. Conclusion: Our review revealed a lack of diversity in UQ for RT applications beyond auto-contouring. Moreover, there was a clear need to study additional UQ methods, such as conformal prediction. Our results may incentivize the development of guidelines for reporting and implementation of UQ in RT.

Precision in the Face of Noise -- Lessons from Kahneman, Siboney, and Sunstein for Radiation Oncology

Precision radiotherapy via information integration of expert human knowledge and AI recommendation to optimize clinical decision making

A Radiology-focused Review of Predictive Uncertainty for AI Interpretability in Computer-assisted Segmentation

Heuristics and biases in medical decision-making under uncertainty: The case of neuropronostication for consciousness disorders

Towards Integrating Epistemic Uncertainty Estimation into the Radiotherapy Workflow

Novel Insights for Radiation Risk Assessment Unveiled by Deep Learning

The Future of Safety and Quality in Radiation Oncology

Bio-Inspired Strategies for Optimizing Radiation Therapy under Uncertainties

Exploring How Anomalous Model Input and Output Alerts Affect Decision-Making in Healthcare

A noise audit of human-labeled benchmarks for machine commonsense reasoning

Leading Through Noise: Operating Room Noise Challenges for Staff and Leadership Techniques to Ensure Optimal Operational Performance

Noise analysis, error estimates, and Gamma Radiation Measurement for limited detector computerized tomography application

Cognitive Biases in High-Stakes Decision-Making: Implications for Joint Pediatric Cardiology and Cardiothoracic Surgery Conference

Precision Oncology: Between Vaguely Right and Precisely Wrong.

Artificial Intelligence Uncertainty Quantification in Radiotherapy Applications - A Scoping Review

(De)Noise: Moderating the Inconsistency Between Human Decision-Makers

Mitigating Diagnostic Errors in Lung Cancer Classification: A Multi-Eyes Principle to Uncertainty Quantification

Harnessing the Power of Noise: A Survey of Techniques and Applications

Quality of Decision Making in Radiation Oncology

Origins of noise in both improving and degrading decision making

Robust optimization strategies for contour uncertainties in online adaptive radiation therapy