Abstract:Machine learning interatomic potentials (MLIPs) have seen significant advances as efficient replacement of expensive quantum chemical calculations. Uncertainty estimations for MLIPs are crucial to quantify the additional model error they introduce and to leverage this information in active learning strategies. MLIPs that are based on Gaussian process regression provide a standard deviation as a possible uncertainty measure. An alternative approach are ensemble-based uncertainties. Although these uncertainty measures have been applied to active learning, it has rarely been studied how they correlate with the error, and it is not always clear whether active learning actually outperforms random sampling strategies. We consider GPR models with Coulomb and SOAP representations as inputs to predict potential energy surfaces and excitation energies of molecules. We evaluate, how the GPR variance and ensemble-based uncertainties relate to the error and whether model performance improves by selecting the most uncertain samples from a fixed configuration space. For the ensemble based uncertainty estimations, we find that they often do not provide any information about the error. For the GPR standard deviation, we find that often predictions with an increasing standard deviation also have an increasing systematical bias, which is not captured by the uncertainty. In these cases, selecting training samples with the highest uncertainty leads to a model with a worse test error compared to random sampling. We conclude that confidence intervals, which are derived from the predictive standard deviation, can be highly overconfident. Selecting samples with high GPR standard deviation leads to a model that overemphasizes the borders of the configuration space represented in the fixed dataset. This may result in worse performance in more densely sampled areas but better generalization for extrapolation tasks.

Efficient ensemble uncertainty estimation in Gaussian Processes Regression

Evaluation of uncertainty estimations for Gaussian process regression based machine learning interatomic potentials

Residual Gaussian Process: A Tractable Nonparametric Bayesian Emulator for Multi-Fidelity Simulations

Improved uncertainty quantification for Gaussian process regression based interatomic potentials

Gaussian Process Regression Approach for Robust Design and Yield Enhancement of Self-Assembled Nanostructures

On the Uncertainty Estimates of Equivariant-Neural-Network-Ensembles Interatomic Potentials

Improved Uncertainty Estimation of Graph Neural Network Potentials Using Engineered Latent Space Distances

Learning inducing points and uncertainty on molecular data by scalable variational Gaussian processes

Fast and Accurate Uncertainty Estimation in Chemical Machine Learning

Uncertainty Estimation for Molecules: Desiderata and Methods

Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forces

Statistical methods for resolving poor uncertainty quantification in machine learning interatomic potentials

Enhanced sampling of robust molecular datasets with uncertainty-based collective variables

Single-model uncertainty quantification in neural network potentials does not consistently outperform model ensembles

Calibrated Uncertainty for Molecular Property Prediction using Ensembles of Message Passing Neural Networks

Spatially resolved uncertainties for machine learning potentials

Robust and scalable uncertainty estimation with conformal prediction for machine-learned interatomic potentials

Beyond the Mean-Field: Structured Deep Gaussian Processes Improve the Predictive Uncertainties

Deep Ensemble as a Gaussian Process Approximate Posterior

Uncertainty quantification by direct propagation of shallow ensembles

Deep Ensembles vs. Committees for Uncertainty Estimation in Neural-Network Force Fields: Comparison and Application to Active Learning