Abstract:Motivation: Virtual screening of molecular compound libraries is a potentially powerful and inexpensive method for the discovery of novel lead compounds for drug development. The major weakness of virtual screening-the inability to consistently identify true positives (leads)-is likely due to our incomplete understanding of the chemistry involved in ligand binding and the subsequently imprecise scoring algorithms. It has been demonstrated that combining multiple scoring functions (consensus scoring) improves the enrichment of true positives. Previous efforts at consensus scoring have largely focused on empirical results, but they have yet to provide a theoretical analysis that gives insight into real features of combinations and data fusion for virtual screening. Results: We demonstrate that combining multiple scoring functions improves the enrichment of true positives only if (a) each of the individual scoring functions has relatively high performance and (b) the individual scoring functions are distinctive. Notably, these two prediction variables are previously established criteria for the performance of data fusion approaches using either rank or score combinations. This work, thus, establishes a potential theoretical basis for the probable success of data fusion approaches to improve yields in in silico screening experiments. Furthermore, it is similarly established that the second criterion (b) can, in at least some cases, be functionally defined as the area between the rank versus score plots generated by the two (or more) algorithms. Because rank-score plots are independent of the performance of the individual scoring function, this establishes a second theoretically defined approach to determining the likely success of combining data from different predictive algorithms. This approach is, thus, useful in practical settings in the virtual screening process when the performance of at least two individual scoring functions (such as in criterion a) can be estimated as having a high likelihood of having high performance, even if no training sets are available. We provide initial validation of this theoretical approach using data from five scoring systems with two evolutionary docking algorithms on four targets, thymidine kinase, human dihydrofolate reductase, and estrogen receptors of antagonists and agonists. Our procedure is computationally efficient, able to adapt to different situations, and scalable to a large number of compounds as well as to a greater number of combinations. Results of the experiment show a fairly significant improvement (vs single algorithms) in several measures of scoring quality, specifically "goodness-of-hit" scores, false positive rates, and "enrichment". This approach (available online at http://gemdock.life. nctu.edu.tw/dock/download.php) has practical utility for cases where the basic tools are known or believed to be generally applicable, but where specific training sets are absent.

Deep reinforcement learning enables better bias control in benchmark for virtual screening

A Case-Based Meta-Learning Algorithm Boosts the Performance of Structure-Based Virtual Screening.

MUBD-DecoyMaker 2.0: A Python GUI Application to Generate Maximal Unbiased Benchmarking Data Sets for Virtual Drug Screening

Validating the validation: reanalyzing a large-scale comparison of deep learning and machine learning models for bioactivity prediction

Benchmarking Methods and Data Sets for Ligand Enrichment Assessment in Virtual Screening.

An Unbiased Method to Build Benchmarking Sets for Ligand-Based Virtual Screening and Its Application to GPCRs

Topology-Based and Conformation-Based Decoys Database: An Unbiased Online Database for Training and Benchmarking Machine-Learning Scoring Functions

Deep Learning in Virtual Screening: Recent Applications and Developments

TocoDecoy: A New Approach to Design Unbiased Datasets for Training and Benchmarking Machine-Learning Scoring Functions

An Improved Metric and Benchmark for Assessing the Performance of Virtual Screening Models

Recent progress on the prospective application of machine learning to structure-based virtual screening

Are Bias Mitigation Techniques for Deep Learning Effective?

Establishing the foundations for a data-centric AI approach for virtual drug screening through a systematic assessment of the properties of chemical data

Consensus holistic virtual screening for drug discovery: a novel machine learning model approach

Consensus scoring criteria for improving enrichment in virtual screening

Deep Learning and Virtual Drug Screening

VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language Model

Deep contrastive learning enables genome-wide virtual screening

Algorithmic fairness and bias mitigation for clinical machine learning with deep reinforcement learning

MM-SpuBench: Towards Better Understanding of Spurious Biases in Multimodal LLMs

Deep-BIAS: Detecting Structural Bias using Explainable AI