Learning Regularized Positional Encoding for Molecular Prediction

Xiang Gao,Weihao Gao,Wenzhi Xiao,Zhirui Wang,Chong Wang,Liang Xiang
DOI: https://doi.org/10.48550/arXiv.2211.12773
2022-11-23
Abstract:Machine learning has become a promising approach for molecular modeling. Positional quantities, such as interatomic distances and bond angles, play a crucial role in molecule physics. The existing works rely on careful manual design of their representation. To model the complex nonlinearity in predicting molecular properties in an more end-to-end approach, we propose to encode the positional quantities with a learnable embedding that is continuous and differentiable. A regularization technique is employed to encourage embedding smoothness along the physical dimension. We experiment with a variety of molecular property and force field prediction tasks. Improved performance is observed for three different model architectures after plugging in the proposed positional encoding method. In addition, the learned positional encoding allows easier physics-based interpretation. We observe that tasks of similar physics have the similar learned positional encoding.
Machine Learning,Chemical Physics,Biomolecules
What problem does this paper attempt to address?