Abstract:CONSPECTUS: In structure-based drug design, scoring functions are widely used for fast evaluation of protein-ligand interactions. They are often applied in combination with molecular docking and de novo design methods. Since the early 1990s, a whole spectrum of protein-ligand interaction scoring functions have been developed. Regardless of their technical difference, scoring functions all need data sets combining protein-ligand complex structures and binding affinity data for parametrization and validation. However, data sets of this kind used to be rather limited in terms of size and quality. On the other hand, standard metrics for evaluating scoring function used to be ambiguous. Scoring functions are often tested in molecular docking or even virtual screening trials, which do not directly reflect the genuine quality of scoring functions. Collectively, these underlying obstacles have impeded the invention of more advanced scoring functions.In this Account, we describe our long-lasting efforts to overcome these obstacles, which involve two related projects. On the first project, we have created the PDBbind database. It is the first database that systematically annotates the protein-ligand complexes in the Protein Data Bank (PDB) with experimental binding data. This database has been updated annually since its first public release in 2004. The latest release (version 2016) provides binding data for 16 179 biomolecular complexes in PDB. Data sets provided by PDBbind have been applied to many computational and statistical studies on protein-ligand interaction and various subjects. In particular, it has become a major data resource for scoring function development. On the second project, we have established the Comparative Assessment of Scoring Functions (CASF) benchmark for scoring function evaluation. Our key idea is to decouple the "scoring" process from the "sampling" process, so scoring functions can be tested in a relatively pure context to reflect their quality. In our latest work on this track, i.e. CASF-2013, the performance of a scoring function was quantified in four aspects, including "scoring power", "ranking power", "docking power", and "screening power". All four performance tests were conducted on a test set containing 195 high-quality protein-ligand complexes selected from PDBbind. A panel of 20 standard scoring functions were tested as demonstration. Importantly, CASF is designed to be an open-access benchmark, with which scoring functions developed by different researchers can be compared on the same grounds. Indeed, it has become a popular choice for scoring function validation in recent years.Despite the considerable progress that has been made so far, the performance of today's scoring functions still does not meet people's expectations in many aspects. There is a constant demand for more advanced scoring functions. Our efforts have helped to overcome some obstacles underlying scoring function development so that the researchers in this field can move forward faster. We will continue to improve the PDBbind database and the CASF benchmark in the future to keep them as useful community resources.

Development of a New Benchmark for Assessing the Scoring Functions Applicable to Protein-Protein Interactions

Comparative Assessment of Scoring Functions on an Updated Benchmark: 1. Compilation of the Test Set

Development of a High-Quality Benchmark for Scoring Function Assessment

Comparative Assessment of Scoring Functions on an Updated Benchmark: 2. Evaluation Methods and General Results.

Forging the Basis for Developing Protein-LigandInteraction Scoring Functions

Comparative Assessment of Scoring Functions: The CASF-2016 Update.

ProteinInvBench: Benchmarking Protein Inverse Folding on Diverse Tasks, Models, and Metrics.

Progress in the Scoring Functions of Protein-Protein Docking

Comparative assessment of scoring functions on a diverse test set.

Assessment of scoring functions for computational models of protein-protein interfaces

Assessing protein–ligand interaction scoring functions with the CASF-2013 benchmark

A Diverse Benchmark Based on 3D Matched Molecular Pairs for Validating Scoring Functions

HawkRank: a New Scoring Function for Protein–protein Docking Based on Weighted Energy Terms

Comparative Evaluation of 11 Scoring Functions for Molecular Docking

Development of a New Scoring Function for Virtual Screening: APBScore

AA-Score: a New Scoring Function Based on Amino Acid-Specific Interaction for Molecular Docking

Further Development and Validation of Empirical Scoring Functions for Structure-Based Binding Affinity Prediction

An Extensive Test of 14 Scoring Functions Using the Pdbbind Refined Set of 800 Protein-Ligand Complexes

SCORE: A New Empirical Method for Estimating the Binding Affinity of a Protein-Ligand Complex

Comprehensive Evaluation of Fourteen Docking Programs on Protein-Peptide Complexes

Benchmarking of different molecular docking methods for protein-peptide docking