Abstract:The forecasting and computation of the stability of chaotic systems from partial observations are tasks for which traditional equation-based methods may not be suitable. In this computational paper, we propose data-driven methods to (i) infer the dynamics of unobserved (hidden) chaotic variables (full-state reconstruction); (ii) time forecast the evolution of the full state; and (iii) infer the stability properties of the full state. The tasks are performed with long short-term memory (LSTM) networks, which are trained with observations (data) limited to only part of the state: (i) the low-to-high resolution LSTM (LH-LSTM), which takes partial observations as training input, and requires access to the full system state when computing the loss; and (ii) the physics-informed LSTM (PI-LSTM), which is designed to combine partial observations with the integral formulation of the dynamical system's evolution equations. First, we derive the Jacobian of the LSTMs. Second, we analyse a chaotic partial differential equation, the Kuramoto-Sivashinsky (KS), and the Lorenz-96 system. We show that the proposed networks can forecast the hidden variables, both time-accurately and statistically. The Lyapunov exponents and covariant Lyapunov vectors, which characterize the stability of the chaotic attractors, are correctly inferred from partial observations. Third, the PI-LSTM outperforms the LH-LSTM by successfully reconstructing the hidden chaotic dynamics when the input dimension is smaller or similar to the Kaplan-Yorke dimension of the attractor. This work opens new opportunities for reconstructing the full state, inferring hidden variables, and computing the stability of chaotic systems from partial data.

Data-driven modeling from biased small training data using periodic orbits

Designing Chaotic Attractors: A Semi-supervised Approach

Prediction and control of spatiotemporal chaos by learning conjugate tubular neighborhoods

Chaotic attractor reconstruction using small reservoirs -- the influence of topology

Data-Driven Modeling and Forecasting of Chaotic Dynamics on Inertial Manifolds Constructed as Spectral Submanifolds

Constraining Chaos: Enforcing dynamical invariants in the training of recurrent neural networks

Data-driven reduced-order modeling of spatiotemporal chaos with neural ordinary differential equations

Optimal Reconstruction of Vector Fields from Data for Prediction and Uncertainty Quantification

Detecting Unstable Periodic Orbits Based Only on Time Series: when Adaptive Delayed Feedback Control Meets Reservoir Computing.

Data-driven ODE modeling of the high-frequency complex dynamics via a low-frequency dynamics model

Predicting multi-parametric dynamics of externally forced oscillator using reservoir computing and minimal data

Training neural operators to preserve invariant measures of chaotic attractors

Oscillations enhance time-series prediction in reservoir computing with feedback

Reconstruction, forecasting, and stability of chaotic dynamics from partial data

Data-driven modeling and parameter estimation of Nonlinear systems

Leveraging Neural Differential Equations and Adaptive Delayed Feedback to Detect Unstable Periodic Orbits Based on Irregularly Sampled Time Series.

Attractor reconstruction with reservoir computers: The effect of the reservoir’s conditional Lyapunov exponents on faithful attractor reconstruction

Reconstructing dynamics from sparse observations with no training on target system

Learning Chaotic Dynamics with Embedded Dissipativity

Model-Free Prediction of Chaotic Systems Using High Efficient Next-generation Reservoir Computing

Attractor reconstruction with reservoir computers: The effect of the reservoir's conditional Lyapunov exponents on faithful attractor reconstruction