Pre-Training on Large-Scale Generated Docking Conformations with HelixDock to Unlock the Potential of Protein-ligand Structure Prediction Models

Lihang Liu,Shanzhuo Zhang,Donglong He,Xianbin Ye,Jingbo Zhou,Xiaonan Zhang,Yaoyao Jiang,Weiming Diao,Hang Yin,Hua Chai,Fan Wang,Jingzhou He,Liang Zheng,Yonghui Li,Xiaomin Fang

2024-05-22

Abstract:Protein-ligand structure prediction is an essential task in drug discovery, predicting the binding interactions between small molecules (ligands) and target proteins (receptors). Recent advances have incorporated deep learning techniques to improve the accuracy of protein-ligand structure prediction. Nevertheless, the experimental validation of docking conformations remains costly, it raises concerns regarding the generalizability of these deep learning-based methods due to the limited training data. In this work, we show that by pre-training on a large-scale docking conformation generated by traditional physics-based docking tools and then fine-tuning with a limited set of experimentally validated receptor-ligand complexes, we can obtain a protein-ligand structure prediction model with outstanding performance. Specifically, this process involved the generation of 100 million docking conformations for protein-ligand pairings, an endeavor consuming roughly 1 million CPU core days. The proposed model, HelixDock, aims to acquire the physical knowledge encapsulated by the physics-based docking tools during the pre-training phase. HelixDock has been rigorously benchmarked against both physics-based and deep learning-based baselines, demonstrating its exceptional precision and robust transferability in predicting binding confirmation. In addition, our investigation reveals the scaling laws governing pre-trained protein-ligand structure prediction models, indicating a consistent enhancement in performance with increases in model parameters and the volume of pre-training data. Moreover, we applied HelixDock to several drug discovery-related tasks to validate its practical utility. HelixDock demonstrates outstanding capabilities on both cross-docking and structure-based virtual screening benchmarks.

Machine Learning,Computational Engineering, Finance, and Science,Biomolecules

What problem does this paper attempt to address?

This paper focuses on the importance of protein-ligand structure prediction in drug discovery, which is a computational technique for predicting the binding mode of small molecules (ligands) with target proteins (receptors). Traditional physics-based docking tools have been widely used, but their accuracy is limited due to the constraints of limited conformational sampling and imprecise scoring functions. Recently, deep learning methods have been used to improve prediction accuracy, but their generalization ability is questioned due to limited experimental validation data.

The paper proposes a new method called HelixDock, which pre-trains on a large number of docking conformations generated by physics-based docking tools, and then fine-tunes on a small number of experimentally validated receptor-ligand complexes to obtain a high-performance protein-ligand structure prediction model. The researchers generated approximately 100 million docking conformations, which took about one million CPU core days. The pre-training process allows the model to acquire the knowledge contained in the physics-based docking tools. HelixDock performs well in benchmark tests, outperforming baseline methods based on physics and deep learning, with high accuracy and robust transferability.

In addition, the paper explores the scaling laws of pre-training models, indicating that increasing the model parameters and pre-training data volume can improve performance. HelixDock performs well in drug discovery-related tasks, including cross-docking and structure-based virtual screening, demonstrating its practical value. Overall, this research emphasizes the strategic advantage of leveraging abundant and diverse data generated by physics-based tools to drive AI-driven drug discovery.