Abstract:In real-world problems, environmental noise is often idealized as Gaussian white noise, despite potential temporal dependencies. The Linear Inverse Model (LIM) is a class of data-driven methods that extract dynamic and stochastic information from finite time-series data of complex systems. In this study, we introduce a new variant of LIM, called Colored-LIM, which models stochasticity using Ornstein-Uhlenbeck colored noise. Despite the non-trivial correlation between observable and colored noise, we show that Colored-LIM unveils the desired information merely from the correlation function of the observable. Therefore, this approach not only accounts for the memory effects of environmental noise, traditionally represented by time-uncorrelated white noise in the Classical LIM framework, but does so using the same observation dataset without requiring additional data. Furthermore, we show that Colored-LIM does not reduce to Classical LIM in the white noise limit, underscoring the importance of temporal dependencies in stochastic systems. In this paper, we rigorously develop the Colored-LIM, explore its connections with the Classical LIM and Dynamic Mode Decomposition, and validate its effectiveness on both ideal linear and nonlinear systems. In addition, we illustrate the potential applications and implications of Colored-LIM for real-world problems, including the El Niño-Southern Oscillation and the electricity network of Tohoku University.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in real - world problems, environmental noise is usually idealized as Gaussian white noise, but there may actually be temporal correlations. The traditional Linear Inverse Model (Classical LIM) assumes that the noise is temporally uncorrelated white noise, which may lead to inaccurate extraction of dynamic and stochastic information in complex systems. To solve this problem, the author proposes a new LIM variant - Colored - LIM (Colored LIM), which uses Ornstein - Uhlenbeck (OU) colored noise with temporal correlations to model randomness. Specifically, Colored - LIM aims to: 1. **Consider the temporal correlation of noise**: By introducing colored noise, Colored - LIM can capture the memory effect of environmental noise, rather than just temporally uncorrelated white noise. 2. **Extract information from the same observational data set**: Without the need for additional data, Colored - LIM can extract the required dynamic and stochastic information from the existing observational data. 3. **Handle non - white - noise limit cases**: Unlike the traditional LIM, Colored - LIM does not degenerate into the Classical LIM in the white - noise limit case, emphasizing the importance of temporal dependence in stochastic systems. ### Main contributions - **Theoretical development**: Rigorously derived the mathematical framework of Colored - LIM and explored its connections with Classical LIM and Dynamic Mode Decomposition (DMD). - **Effectiveness verification**: Verified the effectiveness of Colored - LIM through numerical experiments on ideal linear and nonlinear systems. - **Application prospects**: Demonstrated the potential applications of Colored - LIM in practical problems, such as the study of El Niño - Southern Oscillation and the power network of Northeastern University. ### Formula summary The main formulas involved in the paper include: - Correlation function of colored noise: \[ \langle \eta(t + s)\eta(t)^T\rangle=\frac{1}{2\tau}e^{-|s|/\tau}I \] - SDE of OU process: \[ \frac{d}{dt}\eta = -\frac{1}{\tau}\eta+\frac{1}{\tau}\xi \] - Generalized fluctuation - dissipation relation: \[ 0 = AC_{xx}+C_{xx}A^T+QB^T + BQ \] - First - order, second - order, and third - order derivatives of the correlation function: \[ K'(0)=\frac{1}{2}(AC_{xx}-C_{xx}A^T+QB^T - BQ) \] \[ K''(0)=\frac{1}{2}(A(K'(0)+\frac{1}{\tau}C_{xx})+(K'(0)^T+\frac{1}{\tau}C_{xx})A^T) \] \[ K'''(0)=\frac{1}{2}(\frac{1}{\tau^2}K'(0)+A(K''(0)-\frac{1}{\tau^2}C_{xx})-\frac{1}{\tau^2}K'(0)^T-(K''(0)-\frac{1}{\tau^2}C_{xx})A^T) \] Through these formulas, Colored - LIM can more accurately describe and analyze complex systems with temporally correlated randomness.

Colored-LIM: A Data-Driven Method for Studying Dynamical Systems with Temporally Correlated Stochasticity

A Liang-Kleeman Causality Analysis based on Linear Inverse Modeling

Data-Driven Automated Discovery of Variational Laws Hidden in Physical Systems

On the Cyclostationary Linear Inverse Models: A Mathematical Insight and Implication

Depicting Network Structures from Variable Data Produced by Unknown Colored-Noise Driven Dynamics

Coloured Noise from Stochastic Inflows in Reaction-Diffusion Systems

Solving the inverse problem of noise-driven dynamic networks.

Weak Collocation Regression for Inferring Stochastic Dynamics with Lévy Noise

Non-Markovian stochastic processes: Colored noise

Impact of environmental colored noise in single-species population dynamics

Enhancing the description of multi-time-scale geophysical phenomena: Incorporating finite time Scale separation and feedback, illustrated with the case of a 1D variable of interest

Role of the Colored Noise in Spatio-Temporal Behavior of Two Competing Species

Decomposed Linear Dynamical Systems (dLDS) for learning the latent components of neural dynamics

Non-Markovian Reduced Models to Unravel Transitions in Non-equilibrium Systems

Automated Global Analysis of Experimental Dynamics through Low-Dimensional Linear Embeddings

Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics

Anticipating critical transitions in multidimensional systems driven by time- and state-dependent noise

LINOCS: Lookahead Inference of Networked Operators for Continuous Stability

Investigation of dissipative particle dynamics with colored noise

Effect of colored noise on logical stochastic resonance in bistable dynamics.