Abstract:Advances in machine learning (ML) techniques have enabled the development of interatomic potentials that promise both the accuracy of first principles methods and the low-cost, linear scaling, and parallel efficiency of empirical potentials. Despite rapid progress in the last few years, ML-based potentials often struggle to achieve transferability, that is, to provide consistent accuracy across configurations that significantly differ from those used to train the model. In order to truly realize the promise of ML-based interatomic potentials, it is therefore imperative to develop systematic and scalable approaches for the generation of diverse training sets that ensure broad coverage of the space of atomic environments. This work explores a diverse-by-construction approach that leverages the optimization of the entropy of atomic descriptors to create a very large ($>2\cdot10^{5}$ configurations, $>7\cdot10^{6}$ atomic environments) training set for tungsten in an automated manner, i.e., without any human intervention. This dataset is used to train polynomial as well as multiple neural network potentials with different architectures. For comparison, a corresponding family of potentials were also trained on an expert-curated dataset for tungsten. The models trained to entropy-optimized data exhibited vastly superior transferability compared to the expert-curated models. Furthermore, while the models trained with heavy user input (i.e., domain expertise) yield the lowest errors when tested on similar configurations, out-sample predictions are dramatically more robust when the models are trained on a deliberately diverse set of training data. Herein we demonstrate the development of both accurate and transferable ML potentials using automated and data-driven approaches for generating large and diverse training sets.

Generating Minimal Training Sets for Machine Learned Potentials

Generating Minimal Training Sets for Machine Learned Potentials

De novo exploration and self-guided learning of potential-energy surfaces

Reducing the cost of neural network potential generation for reactive molecular systems

Synthetic pre-training for neural-network interatomic potentials

Quantum-Enhanced Neural Exchange-Correlation Functionals

Data Distillation for Neural Network Potentials toward Foundational Dataset

chemtrain: Learning Deep Potential Models via Automatic Differentiation and Statistical Physics

Random sampling versus active learning algorithms for machine learning potentials of quantum liquid water

Machine learning potentials with Iterative Boltzmann Inversion: training to experiment

Ab initio quantum chemistry with neural-network wavefunctions

Training Data Selection for Accuracy and Transferability of Interatomic Potentials

Optimal data generation for machine learned interatomic potentials

Force Training Neural Network Potential Energy Surface Models

The Potential of Neural Network Potentials

Accelerating finite-temperature Kohn-Sham density functional theory with deep neural networks

Implicit Delta Learning of High Fidelity Neural Network Potentials

A Hessian-Based Assessment of Atomic Forces for Training Machine Learning Interatomic Potentials

ANI-1: A data set of 20M off-equilibrium DFT calculations for organic molecules

Simple and efficient algorithms for training machine learning potentials to force data

Neural network distillation of orbital dependent density functional theory