ConfRank: Improving GFN-FF Conformer Ranking with Pairwise Training

Rick Oerder,Jan Hamaekers,Christian Hölzer,Stefan Grimme
DOI: https://doi.org/10.26434/chemrxiv-2024-tm991
2024-09-16
Abstract:Conformer ranking is a crucial task for drug discovery, with methods for generating conformers often based on molecular (meta)dynamics. These methods are constrained by the underlying force computation regarding runtime and energy ranking accuracy, limiting their effectiveness for large-scale screening applications. To address these ranking limitations, we introduce ConfRank, a machine learning-based approach that enhances conformer ranking using pairwise training. We demonstrate its performance using GFN-FF-generated conformer ensembles, leveraging the DimeNet++ architecture trained on pairs of 159 760 uncharged organic compounds from the GEOM dataset with r2SCAN-3c reference level. Instead of predicting only on single molecules, this approach captures relative energy differences between conformers, leading to a significant improvement of the overall conformational ranking, outperforming GFN-FF and GFN2-xTB. Thereby, the pairwise RMSD of the relative energy difference of two conformers can be reduced from 5.65 kcal mol−1 to 0.71 kcal mol−1 on the test dataset, allowing to correctly identify up to 81 % of all lowest lying conformers correctly (GFN-FF: 10 %, GFN2- xTB: 47 %). The ConfRank approach is cost-effective, allowing for scalable deployment on both CPU and GPU, achieving runtime accelerations by up to two orders of magnitude compared to GFN2-xTB. Out-of-sample investigations on CREST-generated conformer ensembles from the QM9 dataset and conformers taken from an extended GMTKN55 dataset show promising results for the robustness of this approach. Thereby, ranking correlation coefficient such as Spearman can be improved to 0.90 (GFN-FF: 0.39, GFN2-xTB: 0.84) reducing the probability of an incorrect sign flip in pairwise energy comparison from 32 % to 7 %. On the extended GMTKN55 subsets the pairwise MAD (RMSD) could be reduced on almost all subsets by up to 62 % (58 %) with an average improvement of 30 % (29 %). Furthermore, we motivate the usage of the pairwise training approach from a theoretical perspective, highlighting that while pairwise training can lead to a decline in single sample prediction of absolute energies for ML models, it significantly enhances conformer ranking performance. The data and models used in this study are available at https://github.com/grimme-lab/confrank.
Chemistry
What problem does this paper attempt to address?
The paper aims to address the issue of conformation ranking in drug discovery. Specifically, it introduces a method called ConfRank, which is a machine learning-based approach that improves the accuracy of conformation ranking through pairwise training. The paper points out that traditional molecular dynamics methods are limited by the underlying force field calculations in terms of runtime and energy ranking accuracy, restricting their effectiveness in large-scale screening applications. The ConfRank method significantly improves overall conformation ranking by capturing the relative energy differences between two conformations rather than predicting the energy of a single molecule in isolation. Experimental results show that this method reduces the root mean square deviation (RMSD) of relative energy differences on the test dataset from 5.65 kcal/mol to 0.71 kcal/mol and can correctly identify up to 81% of the lowest energy conformations, whereas traditional methods like GFN-FF can only achieve 10%, and GFN2-xTB achieves 47%. Additionally, the paper theoretically demonstrates the advantages of the pairwise training method. Although this training approach may lead to a decrease in the performance of machine learning models in predicting the absolute energy of individual samples, it significantly enhances the performance of conformation ranking. The study results indicate that this method is not only cost-effective but also deployable on both CPU and GPU, accelerating by two orders of magnitude compared to GFN2-xTB. Furthermore, the method also shows good robustness in out-of-sample testing, proving its effectiveness across different datasets.