Discrepancies and Error Evaluation Metrics for Machine Learning Interatomic Potentials

Yunsheng Liu,Xingfeng He,Yifei Mo
DOI: https://doi.org/10.1038/s41524-023-01123-3
2023-09-29
Abstract:Machine learning interatomic potentials (MLPs) are a promising technique for atomic modeling. While high accuracy and small errors are widely reported for MLPs, an open concern is whether MLPs can accurately reproduce atomistic dynamics and related physical properties in their applications in molecular dynamics (MD) simulations. In this study, we examine the current state-of-the-art MLPs and uncover a number of discrepancies related to atom dynamics, defects, and rare events (REs), in their MD simulations compared to ab initio methods. Our findings reveal that low averaged errors by current MLP testing are insufficient, leading us to develop novel quantitative metrics that better indicate the accurate prediction of related properties by MLPs in MD simulations. The MLPs optimized by the RE-based evaluation metrics are demonstrated to have improved prediction in multiple properties. The identified errors, the developed evaluation metrics, and the proposed process of developing such metrics are general to MLPs, thus providing valuable guidance for future testing, development, and improvements of accurate, robust, and reliable MLPs for atomistic modeling.
Materials Science
What problem does this paper attempt to address?
The problem this paper attempts to address is whether machine learning interatomic potentials (MLIPs) can accurately reproduce atomic dynamics and related physical properties in molecular dynamics (MD) simulations. Although existing MLIPs report small average errors, these errors do not adequately reflect their performance in actual simulations. Therefore, the main objective of the paper is to reveal the differences in atomic dynamics, defects, and rare events among the current state-of-the-art MLIPs, and to propose new evaluation metrics to better measure the accuracy of MLIPs in predicting atomic dynamics. By optimizing these evaluation metrics, the paper demonstrates the improved performance of the enhanced MLIPs in predicting various properties, thereby providing valuable guidance for the future development of more accurate and reliable MLIPs.