BigBind: Learning from Nonstructural Data for Structure-Based Virtual Screening

Michael Brocidiacono,Paul Francoeur,Rishal Aggarwal,Konstantin Popov,David Koes,Alexander Tropsha
DOI: https://doi.org/10.26434/chemrxiv-2022-3qc9t-v3
2023-11-14
Abstract:Deep learning methods that predict protein-ligand binding have recently been used for structure-based virtual screening. Many such models have been trained using protein-ligand complexes with known crystal structures and activities from the PDBBind dataset. However, because PDBbind only includes 20K complexes, models typically fail to generalize to new targets, and model performance is on par with models trained with only ligand information. Conversely, the ChEMBL database contains a wealth of chemical activity information but includes no information about binding poses. We introduce BigBind, a dataset that maps ChEMBL activity data to proteins from the CrossDocked dataset. BigBind comprises 583K ligand activities and includes 3D structures of the protein binding pockets. Additionally, we augmented the data by adding an equal number of putative inactives for each target. Using this data, we developed BANANA (BAsic NeurAl Network for binding Affinity), a neural network-based model to classify active from inactive compounds, defined by a 10 μM cutoff. Our model achieved an AUC of 0.72 on BigBind’s test set, while a ligand-only model achieved an AUC of 0.59. Furthermore, BANANA achieved competitive performance on the LIT-PCBA benchmark (median EF1\% 1.81) while running 16,000 times faster than molecular docking with GNINA. We suggest that BANANA, as well as other models trained on this dataset, will significantly improve the outcomes of prospective virtual screening tasks.
Chemistry
What problem does this paper attempt to address?
The problem addressed in this paper is how to improve the accuracy of structure-based virtual screening by utilizing unstructured data, especially in protein-ligand binding prediction. Traditional deep learning methods rely on protein-ligand complex data with known crystal structures and activities, such as the PDBbind database. However, the limited amount of such data leads to poor generalization of models on new targets. The paper introduces a new dataset called BigBind, which combines chemical activity information from the ChEMBL database with protein binding pocket structures from the CrossDocked dataset, providing 583,000 ligand activity data points with 3D protein binding pocket structures. Additionally, they enhance the data by adding an equal amount of assumed inactive compounds to prevent overfitting. The Banana model developed in the paper is a neural network-based classification model used to differentiate between active and inactive compounds. Banana achieves an AUC of 0.72 on the BigBind test set, outperforming models based solely on ligand information (0.59 AUC) and the KNN baseline (0.55 AUC). In the LIT-PCBA benchmark test, Banana performs comparable to Gnina but with a 16,000-fold faster speed. The research discovers that by employing the Stochastic Negative Addition (SNA) technique, the model can learn protein-ligand interactions not only from biases present in the dataset. This improves the model's generalization to new targets, indicating the potential of the Banana model in virtual screening tasks.