Abstract:A general theory for computing information transfers in nonlinear stochastic systems driven by deterministic forcing and additive and/or multiplicative noises, is presented. It extends the Liang-Kleeman framework of causality inference to nonlinear cases based on information transfer across system variables (Liang, 2016). We present an effective method of computing formulas of the rates of Shannon entropy transfer (RETs) between selected causal and consequential variables, relying on the estimation from data of conditional expectations of the system forcing and their derivatives. Those expectations are approximated by nonlinear differentiable regressions, leading to a much easier and more robust way of computing RETs than the brute-force approach calling for numerical integrals over the state-space and the knowledge of the multivariate probability density of the system. The approach is fully adapted to the case where no model equations are available, starting with a nonlinear model fitting from data of the consequential variables, and the subsequent application of method to the fitted model. RETs are decomposed into sums of single one-to-one RETs plus synergetic terms (of pure nonlinear nature) accounting for the joint causal effect of groups of variables. State-dependent RET formulas are also introduced, showing where in state-space the entropy transfers and local synergies are more relevant. A comparison of the RETs estimations is performed with previous methods in the context of two models: (i) a model derived from a potential function and (ii) the classical chaotic Lorenz system, both forced by additive and/or multiplicative noises. The analysis demonstrates that the new estimations are robust, cheaper, and less data-demanding, providing evidence of the possibilities and generalizations offered by the method and opening new perspectives on real-world applications.

Nonlinear Noise Reduction Scheme Based on Information Flow

A Noise Reduction Method for Continuous Chaotic Systems Based on Symplectic Geometry

Machine-learning optimized measurements of chaotic dynamical systems via the information bottleneck

Complexity Measure of Traffic Flow Based on Approximate Entropy and Statistical Complexity

A Neural Filter-Based Scheme for Synchronizing Chaotic Systems.

Nonlinear Dynamics in Complexity Quantification

A general theory to estimate Information transfer in nonlinear systems

A Symbolic Dynamics Based Method for Noise Reduction in Chaotic Sequence

Characterizing information loss in a chaotic double pendulum with the Information Bottleneck

An Unstructured Mesh Approach to Nonlinear Noise Reduction for Coupled Systems

A method of estimating the noise level in a chaotic time series

Noise reduction in chaotic measurement systems

Noise Flow: Noise Modeling with Conditional Normalizing Flows

Nonlinear Biochemical Signal Processing via Noise Propagation

Noise-induced chaos: a conditioned random dynamics perspective

No-propagate algorithm for linear responses of random chaotic systems

Nonlinear stochastic dynamics research on a Lorenz system with white Gaussian noise based on a quasi‐potential approach

Information Theory in Nonlinear Error Growth Dynamics and Its Application to Predictability:Taking the Lorenz System As an Example

Information theory in nonlinear error growth dynamics and its application to predictability: Taking the Lorenz system as an example

Real-Time Monitoring of Chaotic Systems with Known Dynamical Equations

Causation and Information Flow with Respect to Relative Entropy