Abstract:Uncovering causal interdependencies from observational data is one of the great challenges of a nonlinear time series analysis. In this paper, we discuss this topic with the help of an information-theoretic concept known as Rényi's information measure. In particular, we tackle the directional information flow between bivariate time series in terms of Rényi's transfer entropy. We show that by choosing Rényi's parameter α, we can appropriately control information that is transferred only between selected parts of the underlying distributions. This, in turn, is a particularly potent tool for quantifying causal interdependencies in time series, where the knowledge of "black swan" events, such as spikes or sudden jumps, are of key importance. In this connection, we first prove that for Gaussian variables, Granger causality and Rényi transfer entropy are entirely equivalent. Moreover, we also partially extend these results to heavy-tailed α-Gaussian variables. These results allow establishing a connection between autoregressive and Rényi entropy-based information-theoretic approaches to data-driven causal inference. To aid our intuition, we employed the Leonenko et al. entropy estimator and analyzed Rényi's information flow between bivariate time series generated from two unidirectionally coupled Rössler systems. Notably, we find that Rényi's transfer entropy not only allows us to detect a threshold of synchronization but it also provides non-trivial insight into the structure of a transient regime that exists between the region of chaotic correlations and synchronization threshold. In addition, from Rényi's transfer entropy, we could reliably infer the direction of coupling and, hence, causality, only for coupling strengths smaller than the onset value of the transient regime, i.e., when two Rössler systems are coupled but have not yet entered synchronization.

Information theoretic results for stationary time series and the Gaussian-generalized von Mises time series

Limit Theory for A General Class of Garch Models with Just Barely Infinite Variance

On the Information Dimension of Multivariate Gaussian Processes

Hypothesis Testing in Time Series Via the Empirical Characteristic Function: A Generalized Spectral Density Approach

On the Information-theoretic Limits of Graphical Model Selection for Gaussian Time Series

Central Limit Theorems for Generalizedu-Statistics with Applications in Nonparametric Specification

High-dimensional latent Gaussian count time series: Concentration results for autocovariances and applications

Bernstein-von Mises theorems for time evolution equations

Information Geometric Complexity of Entropic Motion on Curved Statistical Manifolds under Different Metrizations of Probability Spaces

Quasi-invariant Theorem on the Gaussian Path Space

Causal Inference in Time Series in Terms of Rényi Transfer Entropy

Relative Entropy and Mutual Information in Gaussian Statistical Field Theory

Multivariate limit theorems in the context of long-range dependence

Information Geometry of the Gaussian Space

On stochastic properties of past varentropy with applications

General Information Theory: Time and Information

Geometric Insights into the Multivariate Gaussian Distribution and Its Entropy and Mutual Information

Statistical features of systems driven by non-Gaussian processes: theory & practice

Gaussian Approximation For Non-stationary Time Series with Optimal Rate and Explicit Construction

Geometric theory of (extended) time-reversal symmetries in stochastic processes: I. Finite dimension

Stochastic metrology and the empirical distribution