Abstract:Motivation: Virtual screening of molecular compound libraries is a potentially powerful and inexpensive method for the discovery of novel lead compounds for drug development. The major weakness of virtual screening-the inability to consistently identify true positives (leads)-is likely due to our incomplete understanding of the chemistry involved in ligand binding and the subsequently imprecise scoring algorithms. It has been demonstrated that combining multiple scoring functions (consensus scoring) improves the enrichment of true positives. Previous efforts at consensus scoring have largely focused on empirical results, but they have yet to provide a theoretical analysis that gives insight into real features of combinations and data fusion for virtual screening. Results: We demonstrate that combining multiple scoring functions improves the enrichment of true positives only if (a) each of the individual scoring functions has relatively high performance and (b) the individual scoring functions are distinctive. Notably, these two prediction variables are previously established criteria for the performance of data fusion approaches using either rank or score combinations. This work, thus, establishes a potential theoretical basis for the probable success of data fusion approaches to improve yields in in silico screening experiments. Furthermore, it is similarly established that the second criterion (b) can, in at least some cases, be functionally defined as the area between the rank versus score plots generated by the two (or more) algorithms. Because rank-score plots are independent of the performance of the individual scoring function, this establishes a second theoretically defined approach to determining the likely success of combining data from different predictive algorithms. This approach is, thus, useful in practical settings in the virtual screening process when the performance of at least two individual scoring functions (such as in criterion a) can be estimated as having a high likelihood of having high performance, even if no training sets are available. We provide initial validation of this theoretical approach using data from five scoring systems with two evolutionary docking algorithms on four targets, thymidine kinase, human dihydrofolate reductase, and estrogen receptors of antagonists and agonists. Our procedure is computationally efficient, able to adapt to different situations, and scalable to a large number of compounds as well as to a greater number of combinations. Results of the experiment show a fairly significant improvement (vs single algorithms) in several measures of scoring quality, specifically "goodness-of-hit" scores, false positive rates, and "enrichment". This approach (available online at http://gemdock.life. nctu.edu.tw/dock/download.php) has practical utility for cases where the basic tools are known or believed to be generally applicable, but where specific training sets are absent.

Benchmarking Methods and Data Sets for Ligand Enrichment Assessment in Virtual Screening.

An Unbiased Method to Build Benchmarking Sets for Ligand-Based Virtual Screening and Its Application to GPCRs

Comparative Modeling and Benchmarking Data Sets for Human Histone Deacetylases and Sirtuin Families

A Case-Based Meta-Learning Algorithm Boosts the Performance of Structure-Based Virtual Screening.

A Thoroughly Validated Virtual Screening Strategy For Discovery Of Novel Hdac3 Inhibitors

An Improved Metric and Benchmark for Assessing the Performance of Virtual Screening Models

Consensus scoring criteria for improving enrichment in virtual screening

Maximal Unbiased Benchmarking Data Sets for Human Chemokine Receptors and Comparative Analysis

A comprehensive comparative assessment of 3D molecular similarity tools in ligand-based virtual screening

Deep reinforcement learning enables better bias control in benchmark for virtual screening

MUBD-DecoyMaker 2.0: A Python GUI Application to Generate Maximal Unbiased Benchmarking Data Sets for Virtual Drug Screening

A Benchmarking Study on Virtual Ligand Screening Against Homology Models of Human GPCRs

Comparative Assessment of Scoring Functions on an Updated Benchmark: 1. Compilation of the Test Set

Fine tuning for success in structure-based virtual screening

The Development of Target-Specific Pose Filter Ensembles to Boost Ligand Enrichment for Structure-Based Virtual Screening.

RealVS: Toward Enhancing the Precision of Top Hits in Ligand-Based Virtual Screening of Drug Leads from Large Compound Databases

The Discovery of Novel HDAC3 Inhibitors Via Virtual Screening and in Vitro Bioassay

Binding energy landscape analysis helps to discriminate true hits from high-scoring decoys in virtual screening.

Improving Docking-Based Virtual Screening Ability by Integrating Multiple Energy Auxiliary Terms from Molecular Docking Scoring.

Comparative analysis of machine learning methods in ligand-based virtual screening of large compound libraries.

Advancing Ligand Docking through Deep Learning: Challenges and Prospects in Virtual Screening