Abstract:This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic parameterizations to reduce the original equations' complexity while capturing the key effects of unresolved scales. It works for both Gaussian and Levy-type noise. Our parameterizations offer two key advantages. First, they approximate stochastic invariant manifolds when the latter exist. Second, even when such manifolds break down, our formulas can be adapted by a simple optimization of its constitutive parameters. This allows us to handle scenarios with weak time-scale separation where the system has undergone multiple transitions, resulting in large-amplitude solutions not captured by invariant manifold or other time-scale separation methods. The optimized stochastic parameterizations capture how small-scale noise impacts larger scales through the system's nonlinear interactions. This effect is achieved by the very fabric of our parameterizations incorporating non-Markovian coefficients into the reduced equation. Such coefficients account for the noise's past influence using a finite memory length, selected for optimal performance. The specific "memory" function, which determines how this past influence is weighted, depends on the noise's strength and how it interacts with the system's nonlinearities. Remarkably, training our theory-guided reduced models on a single noise path effectively learns the optimal memory length for out-of-sample predictions, including rare events. This success stems from our "hybrid" approach, which combines analytical understanding with data-driven learning. This combination avoids a key limitation of purely data-driven methods: their struggle to generalize to unseen scenarios, also known as the "extrapolation problem."

Learning noise-induced transitions by multi-scaling reservoir computing

Non-Markovian Reduced Models to Unravel Transitions in Non-equilibrium Systems

Stabilizing machine learning prediction of dynamics: Novel noise-inspired regularization tested with reservoir computing

Emergence of a stochastic resonance in machine learning

Potential landscape of high dimensional nonlinear stochastic dynamics and rare transitions with large noise

Data-driven approximation for extracting the transition dynamics of a genetic regulatory network with non-Gaussian Lévy noise

Reservoir Computing with Noise

Recurrence Resonance -- Noise-Enhanced Dynamics in Recurrent Neural Networks

Predicting Noise-Induced Critical Transitions in Bistable Systems.

Noise-aware neural network for stochastic dynamics simulation

Saddle avoidance of noise-induced transitions in multiscale systems

Lévy noise-induced transitions in gene regulatory networks

Noise Helps Optimization Escape from Saddle Points in the Synaptic Plasticity

Noise Can Create or Erase Long Transient Dynamics

Reservoir Computing with Error Correction: Long-term Behaviors of Stochastic Dynamical Systems

Transition phenomena between metastable states play an important role in complex systems due to noisy fluctuations

Optimizing quantum noise-induced reservoir computing for nonlinear and chaotic time series prediction

Noise Helps Optimization Escape from Saddle Points in the Neural Dynamics.

Adaptable reservoir computing: A paradigm for model-free data-driven prediction of critical transitions in nonlinear dynamical systems

Anticipating synchronization with machine learning

Data-driven method to learn the most probable transition pathway and stochastic differential equations