Abstract:Uncovering causal interdependencies from observational data is one of the great challenges of a nonlinear time series analysis. In this paper, we discuss this topic with the help of an information-theoretic concept known as Rényi's information measure. In particular, we tackle the directional information flow between bivariate time series in terms of Rényi's transfer entropy. We show that by choosing Rényi's parameter α, we can appropriately control information that is transferred only between selected parts of the underlying distributions. This, in turn, is a particularly potent tool for quantifying causal interdependencies in time series, where the knowledge of "black swan" events, such as spikes or sudden jumps, are of key importance. In this connection, we first prove that for Gaussian variables, Granger causality and Rényi transfer entropy are entirely equivalent. Moreover, we also partially extend these results to heavy-tailed α-Gaussian variables. These results allow establishing a connection between autoregressive and Rényi entropy-based information-theoretic approaches to data-driven causal inference. To aid our intuition, we employed the Leonenko et al. entropy estimator and analyzed Rényi's information flow between bivariate time series generated from two unidirectionally coupled Rössler systems. Notably, we find that Rényi's transfer entropy not only allows us to detect a threshold of synchronization but it also provides non-trivial insight into the structure of a transient regime that exists between the region of chaotic correlations and synchronization threshold. In addition, from Rényi's transfer entropy, we could reliably infer the direction of coupling and, hence, causality, only for coupling strengths smaller than the onset value of the transient regime, i.e., when two Rössler systems are coupled but have not yet entered synchronization.

Limit Theorems for the Symbolic Correlation Integral and the Renyi-2 Entropy under Short-range Dependence

Limit Theory for A General Class of Garch Models with Just Barely Infinite Variance

Entropy and long-range correlations in random symbolic sequences

Causal Inference in Time Series in Terms of Rényi Transfer Entropy

The Limit Theorem for Dependent Random Variables with Applications to Autoregression Models

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

Asymptotic Distribution Theory for Nonparametric Entropy Measures of Serial Dependence

The affinely invariant distance correlation

Estimating entropy rate from censored symbolic time series: a test for time-irreversibility

On the maximal correlation of some stochastic processes

Limit Distribution Theory for Quantum Divergences

Exact and asymptotic distribution theory for the empirical correlation of two AR(1) processes

Temporal fluctuations of correlators in integrable and chaotic quantum systems

Testing independence in high dimensions with sums of rank correlations

Signed Rényi Entropy and Quantum Second Laws

Building Entanglement Entropy out of Correlation Functions for Interacting Fermions

On Conditional Correlations

The Empirical Distribution of a Large Number of Correlated Normal Variables

When are correlations strong?

Limiting Spectral Distribution of Large Dimensional Spearman?s Rank Correlation Matrices