Abstract:Background: Clinical trial is a crucial step in the development of a new therapy (e.g., medication) and is remarkably expensive and time-consuming. Forecasting the approval of clinical trials accurately would enable us to circumvent trials destined to fail, thereby allowing us to allocate more resources to therapies with better chances. However, existing approval prediction algorithms did not quantify the uncertainty and provide interpretability, limiting their usage in real-world clinical trial management. Methods: This paper quantifies uncertainty and improves interpretability in clinical trial approval predictions. We devised a selective classification approach and integrated it with the Hierarchical Interaction Network, the state-of-the-art clinical trial prediction model. Selective classification, encompassing a spectrum of methods for uncertainty quantification, empowers the model to withhold decision-making in the face of samples marked by ambiguity or low confidence. This approach not only amplifies the accuracy of predictions for the instances it chooses to classify but also notably enhances the model's interpretability. Results: Comprehensive experiments demonstrate that incorporating uncertainty markedly enhances the model's performance. Specifically, the proposed method achieved 32.37%, 21.43%, and 13.27% relative improvement on area under the precision-recall curve over the base model (Hierarchical Interaction Network) in phase I, II, and III trial approval predictions, respectively. For phase III trials, our method reaches 0.9022 area under the precision-recall curve scores. In addition, we show a case study of interpretability that helps domain experts to understand model's outcome. The code is publicly available at https://github.com/Vincent-1125/Uncertainty-Quantification-on-Clinical-Trial-Outcome-Prediction. Conclusion: Our approach not only measures model uncertainty but also greatly improves interpretability and performance for clinical trial approval prediction.

Enhancing Uncertainty Quantification in Drug Discovery with Censored Regression Labels

Quantifying sources of uncertainty in drug discovery predictions with probabilistic models

Learning to rank for censored survival data

Evidential time-to-event prediction with calibrated uncertainty quantification

Laplace Regression with Censored Data

Assessing quantile prediction with censored quantile regression models

Uncertainty quantification for intervals

Model-free selective inference and its applications to drug discovery

Predicting Survival Outcomes in the Presence of Unlabeled Data

Data Tells the Truth: A Knowledge Distillation Method for Genomic Survival Analysis by Handling Censoring

Uncertainty Wrapper in the medical domain: Establishing transparent uncertainty quantification for opaque machine learning models in practice

Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction

Learning with uncertainty to accelerate the discovery of histone lysine-specific demethylase 1A (KDM1A/LSD1) inhibitors

Machine learning on DNA-encoded library count data using an uncertainty-aware probabilistic loss function

Decision-Focused Uncertainty Quantification

Confidence from uncertainty - A multi-target drug screening method from robust control theory

Identifying Causal-Effect Inference Failure with Uncertainty-Aware Models

A hybrid framework for improving uncertainty quantification in deep learning-based QSAR regression modeling

Uncertainty Quantification Using Neural Networks for Molecular Property Prediction

SurvRegCensCov: Weibull Regression for a Right-Censored Endpoint with a Censored Covariate

Achieving Well-Informed Decision-Making in Drug Discovery: A Comprehensive Calibration Study using Neural Network-Based Structure-Activity Models