Abstract:Chaotic systems, such as turbulent flows, are ubiquitous in science and engineering. However, their study remains a challenge due to the large range scales, and the strong interaction with other, often not fully understood, physics. As a consequence, the spatiotemporal resolution required for accurate simulation of these systems is typically computationally infeasible, particularly for applications of long-term risk assessment, such as the quantification of extreme weather risk due to climate change. While data-driven modeling offers some promise of alleviating these obstacles, the scarcity of high-quality simulations results in limited available data to train such models, which is often compounded by the lack of stability for long-horizon simulations. As such, the computational, algorithmic, and data restrictions generally imply that the probability of rare extreme events is not accurately captured. In this work we present a general strategy for training neural network models to non-intrusively correct under-resolved long-time simulations of chaotic systems. The approach is based on training a post-processing correction operator on under-resolved simulations nudged towards a high-fidelity reference. This enables us to learn the dynamics of the underlying system directly, which allows us to use very little training data, even when the statistics thereof are far from converged. Additionally, through the use of probabilistic network architectures we are able to leverage the uncertainty due to the limited training data to further improve extrapolation capabilities. We apply our framework to severely under-resolved simulations of quasi-geostrophic flow and demonstrate its ability to accurately predict the anisotropic statistics over time horizons more than 30 times longer than the data seen in training.

Learning tapestries, a statistical learning substrate for open chaotic systems measured with error

Chaotic uncertainty and statistical inference for natural chaotic systems: Choosing predictors for multiple season ahead prediction of precipitation, Extended and Annotated

A simple statistical approach to prediction in open high dimensional chaotic systems

Constraining Chaos: Enforcing dynamical invariants in the training of recurrent neural networks

Learning to Assimilate in Chaotic Dynamical Systems

Machine Learning for predicting chaotic systems

On Statistical Methods of Parameter Estimation for Deterministically Chaotic Time-Series

Small-sample Bayesian error estimation for ergodic, chaotic systems of ordinary differential equations

Learning Chaotic Systems from Noisy Data Via Multi-Step Optimization and Adaptive Training

Deciphering Complexity: Machine Learning Insights into Chaotic Dynamical Systems

Distinguishing error from chaos in ecological time series

Learning and Designing Stochastic Processes from Logical Constraints

Training neural operators to preserve invariant measures of chaotic attractors

Model selection of chaotic systems from data with hidden variables using sparse data assimilation

Optimal Reconstruction of Vector Fields from Data for Prediction and Uncertainty Quantification

Nonlinear forecasting as a way of distinguishing chaos from measurement error in time series

Machine-learning optimized measurements of chaotic dynamical systems via the information bottleneck

Asymptotically consistent prediction of extremes in chaotic systems:1 stationary case

Analysis of noisy chaotic time series prediction error

A probabilistic framework for learning non-intrusive corrections to long-time climate simulations from short-time training data

Model scale versus domain knowledge in statistical forecasting of chaotic systems