Distances between time-series and their autocorrelation statistics

Tryphon T. Georgiou

DOI: https://doi.org/10.48550/arXiv.math/0701181

2007-01-05

Optimization and Control

Abstract:We begin with an interpretation of the L1-distance between two power spectral densities and then, following an analogous rationale, we develop a natural metric for quantifying distance between respective covariance matrices.

What problem does this paper attempt to address?

Distances between power spectral densities

Tryphon T. Georgiou

DOI: https://doi.org/10.48550/arXiv.math/0607026

2006-07-01

Optimization and Control

Abstract:We present several natural notions of distance between spectral density functions of (discrete-time) random processes. They are motivated by certain filtering problems. First we quantify the degradation of performance of a predictor which is designed for a particular spectral density function and then it is used to predict the values of a random process having a different spectral density. The logarithm of the ratio between the variance of the error, over the corresponding minimal (optimal) variance, produces a measure of distance between the two power spectra with several desirable properties. Analogous quantities based on smoothing problems produce alternative distances and suggest a class of measures based on fractions of generalized means of ratios of power spectral densities. These distance measures endow the manifold of spectral density functions with a (pseudo) Riemannian metric. We pursue one of the possible options for a distance measure, characterize the relevant geodesics, and compute corresponding distances.
Distances and Riemannian Metrics for Multivariate Spectral Densities

Xianhua Jiang,Lipeng Ning,T. T. Georgiou,Tryphon T. Georgiou

DOI: https://doi.org/10.1109/tac.2012.2183171

IF: 6.549

2012-07-01

IEEE Transactions on Automatic Control

Abstract:The paper is concerned with the practical problem of how to compare power spectral densities of multivariable time-series. For scalar time-series several notions of distance (divergences) have been proposed and studied starting from the early 1970s while multivariable ones have only recently began to receive any attention. In the paper, two classes of divergence measures inspired by classical prediction theory are introduced. These divergences naturally induce Riemannian metrics on the cone of multivariable densities. The metrics amount to the quadratic term in the divergence between “infinitesimally close to each other” power spectra. For one of the two we provide explicit formulae for the corresponding geodesics and geodesic distance. A close connection between the geometry of power spectra and the geometry of the Fisher-Rao metric is noted.

automation & control systems,engineering, electrical & electronic
The affinely invariant distance correlation

Johannes Dueck,Dominic Edelmann,Tilmann Gneiting,Donald Richards

DOI: https://doi.org/10.3150/13-bej558

IF: 1.5

2014-11-01

Bernoulli

Abstract:Székely, Rizzo and Bakirov (Ann. Statist. 35 (2007) 2769–2794) and Székely and Rizzo (Ann. Appl. Statist. 3 (2009) 1236–1265), in two seminal papers, introduced the powerful concept of distance correlation as a measure of dependence between sets of random variables. We study in this paper an affinely invariant version of the distance correlation and an empirical version of that distance correlation, and we establish the consistency of the empirical quantity. In the case of subvectors of a multivariate normally distributed random vector, we provide exact expressions for the affinely invariant distance correlation in both finite-dimensional and asymptotic settings, and in the finite-dimensional case we find that the affinely invariant distance correlation is a function of the canonical correlation coefficients. To illustrate our results, we consider time series of wind vectors at the Stateline wind energy center in Oregon and Washington, and we derive the empirical auto and cross distance correlation functions between wind vectors at distinct meteorological stations.

statistics & probability
Asymptotics of Distances Between Sample Covariance Matrices

Roberto Pereira,Xavier Mestre,David Gregoratti

2023-12-22

Abstract:This work considers the asymptotic behavior of the distance between two sample covariance matrices (SCM). A general result is provided for a class of functionals that can be expressed as sums of traces of functions that are separately applied to each covariance matrix. In particular, this class includes very conventional metrics, such as the Euclidean distance or Jeffrery's divergence, as well as a number of other more sophisticated distances recently derived from Riemannian geometry considerations, such as the log-Euclidean metric. In particular, we analyze the asymptotic behavior of this class of functionals by establishing a central limit theorem that allows us to describe their asymptotic statistical law. In order to account for the fact that the sample sizes of two SCMs are of the same order of magnitude as their observation dimension, results are provided by assuming that these parameters grow to infinity while their quotients converge to fixed quantities. Numerical results illustrate how this type of result can be used in order to predict the performance of these metrics in practical machine learning algorithms, such as clustering of SCMs.

Statistics Theory,Signal Processing
Test for independence of long-range dependent time series using distance covariance

Annika Betken,Herold Dehling

2024-01-04

Abstract:We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution of the test statistic, and we show consistency against arbitrary alternatives. The asymptotic theory developed in this paper is based on a novel non-central limit theorem for stochastic processes with values in an $L^2$-Hilbert space. This limit theorem is of general theoretical interest which goes beyond the context of this article. Subject to the dependence in the data, the standardization and the limit distributions of the proposed test statistic vary. Since the limit distributions are unknown, we propose a subsampling procedure to determine the critical values for the proposed test, and we provide a proof for the validity of subsampling. In a simulation study, we investigate the finite-sample behavior of our test, and we compare its performance to tests based on the empirical cross-covariances. As an application of our results we analyze the cross-dependencies between mean monthly discharges of three rivers.

Statistics Theory
Partial Distance Correlation with Methods for Dissimilarities

Gabor J. Szekely,Maria L. Rizzo

DOI: https://doi.org/10.48550/arXiv.1310.2926

2014-07-09

Abstract:Distance covariance and distance correlation are scalar coefficients that characterize independence of random vectors in arbitrary dimension. Properties, extensions, and applications of distance correlation have been discussed in the recent literature, but the problem of defining the partial distance correlation has remained an open question of considerable interest. The problem of partial distance correlation is more complex than partial correlation partly because the squared distance covariance is not an inner product in the usual linear space. For the definition of partial distance correlation we introduce a new Hilbert space where the squared distance covariance is the inner product. We define the partial distance correlation statistics with the help of this Hilbert space, and develop and implement a test for zero partial distance correlation. Our intermediate results provide an unbiased estimator of squared distance covariance, and a neat solution to the problem of distance correlation for dissimilarities rather than distances.

Methodology,Statistics Theory
A New Correlation Coefficient for Bivariate Time-Series Data

Orhan Erdem,Elvan Ceyhan,Yusuf Varli

DOI: https://doi.org/10.2139/ssrn.2390065

2014-01-01

SSRN Electronic Journal

Abstract:The correlation in time series has received considerable attention in literature. Its use has attained an important role in the social sciences and finance. For example, pair trading in finance is concerned with the correlation between stock prices, returns, etc. In general, Pearson’s correlation coefficient is employed in these areas although it has many underlying assumptions which restrict its use. Here, we introduce a new correlation coefficient which takes into account the lag difference of data points. We investigate the properties of this new correlation coefficient. We demonstrate that it is more appropriate for showing the direction of the covariation of the two variables over time. We also compare the performance of the new correlation coefficient with the Pearson’s correlation coefficient and Detrended Cross-Correlation Analysis (DCCA) via simulated examples.
The Local Partial Autocorrelation Function and Some Applications

Rebecca Killick,Marina I. Knight,Guy P. Nason,Idris A. Eckley

DOI: https://doi.org/10.1214/20-EJS1748

2020-04-27

Abstract:The classical regular and partial autocorrelation functions are powerful tools for stationary time series modelling and analysis. However, it is increasingly recognized that many time series are not stationary and the use of classical global autocorrelations can give misleading answers. This article introduces two estimators of the local partial autocorrelation function and establishes their asymptotic properties. The article then illustrates the use of these new estimators on both simulated and real time series. The examples clearly demonstrate the strong practical benefits of local estimators for time series that exhibit nonstationarities.

Statistics Theory,Methodology,Other Statistics
Goodness-of-Fit Testing for Time Series Models via Distance Covariance

Phyllis Wan,Richard A. Davis

DOI: https://doi.org/10.48550/arXiv.1903.00708

2019-03-02

Abstract:In many statistical modeling frameworks, goodness-of-fit tests are typically administered to the estimated residuals. In the time series setting, whiteness of the residuals is assessed using the sample autocorrelation function. For many time series models, especially those used for financial time series, the key assumption on the residuals is that they are in fact independent and not just uncorrelated. In this paper, we apply the auto-distance covariance function (ADCV) to evaluate the serial dependence of the estimated residuals. Distance covariance can discriminate between dependence and independence of two random vectors. The limit behavior of the test statistic based on the ADCV is derived for a general class of time series models. One of the key aspects in this theory is adjusting for the dependence that arises due to parameter estimation. This adjustment has essentially the same form regardless of the model specification. We illustrate the results in simulated examples.

Statistics Theory,Methodology
Deterministic Equivalent of the Log-Euclidean Distance between Sample Covariance Matrices

Xavier Mestre,Roberto Pereira

2024-08-08

Abstract:Log-Euclidean distances are commonly used to quantify the similarity between positive definite matrices using geometric considerations. This paper analyzes the behavior of this distance when it is used to measure closeness between independent sample covariance matrices. A closed form expression is given for the deterministic equivalent of such distance, which asymptotically approximates the actual distance in the large observation regime (both sample size and observation dimension grow to infinity at the same rate). The deterministic equivalent can be used to analyze the performance of the log-Euclidean metric when compared to other commonly used metrics such as the Euclidean norm or the symmetrized Kullback-Leibler divergence.

Signal Processing
Wasserstein distance bounds on the normal approximation of empirical autocovariances and cross-covariances under non-stationarity and stationarity

Andreas Anastasiou,Tobias Kley

2023-05-07

Abstract:The autocovariance and cross-covariance functions naturally appear in many time series procedures (e.g., autoregression or prediction). Under assumptions, empirical versions of the autocovariance and cross-covariance are asymptotically normal with covariance structure depending on the second and fourth order spectra. Under non-restrictive assumptions, we derive a bound for the Wasserstein distance of the finite sample distribution of the estimator of the autocovariance and cross-covariance to the Gaussian limit. An error of approximation to the second-order moments of the estimator and an $m$-dependent approximation are the key ingredients in order to obtain the bound. As a worked example, we discuss how to compute the bound for causal autoregressive processes of order 1 with different distributions for the innovations. To assess our result, we compare our bound to Wasserstein distances obtained via simulation.

Statistics Theory
Derivation of Correlation Dimension from Spatial Autocorrelation Functions

Yanguang Chen

DOI: https://doi.org/10.48550/arXiv.1901.03837

2019-01-12

Physics and Society

Abstract:Spatial autocorrelation coefficients such as Moran's index proved to be an eigenvalue of the spatial correlation matrixes. An eigenvalue represents a kind of characteristic length for quantitative analysis. However, if a spatial correlation is based on self-organized evolution, complex structure, and the distributions without characteristic scale, the eigenvalue will be ineffective. In this case, the single Moran index cannot lead to reliable statistic inferences. This paper is devoted to finding advisable approach to measure spatial autocorrelation for the scale-free processes of complex systems by means of mathematical reasoning and empirical analysis. Based on relative step function as spatial contiguity function, a series of ordered spatial autocorrelation coefficients are converted into the corresponding spatial autocorrelation functions. Then the mathematical relation between spatial correlation dimension and spatial autocorrelation functions is derived by decomposition of spatial autocorrelation functions. As results, a set of useful mathematical models are constructed for spatial analysis. Using these models, we can utilize spatial correlation dimension to make simple spatial autocorrelation analysis, and use spatial autocorrelation functions to make complex spatial autocorrelation analysis for geographical phenomena. This study reveals the inherent association of fractal patterns with spatial autocorrelation processes in nature and society. The work may inspire new ideas of spatial modeling and analysis for complex geographical systems.
Testing for Independence Between Two Covariance Stationary Time Series

YM Hong

DOI: https://doi.org/10.1093/biomet/83.3.615

IF: 3.0279

1996-01-01

Biometrika

Abstract:A one-sided asymptotically normal test for independence between two stationary time series is proposed by first prewhitening the two time series and then basing the test on the residual cross-correlation function. The test statistic is a properly standardised version of the sum of weighted squares of residual cross-correlations, with weights depending on a kernel function. Haugh's (1976) test can be viewed as a special case of our approach in the sense that it corresponds to the use of the truncated kernel. Many kernels deliver better power than Haugh's test. A simulation study shows that the new test has good power against short and long cross-correlations.
Hypothesis Testing in Time Series Via the Empirical Characteristic Function: A Generalized Spectral Density Approach

YM Hong

DOI: https://doi.org/10.1080/01621459.1999.10473874

IF: 4.369

1999-01-01

Journal of the American Statistical Association

Abstract:The standardized spectral density completely describes serial dependence of a Gaussian process. For non-Gaussian processes, however, it may become an inappropriate analytic tool, because it misses the nonlinear processes with zero autocorrelation. By generalizing the concept of the standardized spectral density, I propose a new spectral tool suitable for both linear and nonlinear time series analysis. The generalized spectral density is indexed by frequency and a pair of auxiliary parameters. Ir is well defined for both continuous and discrete random variables, and requires no moment condition. Introduction of the auxiliary parameters renders the spectrum able to capture all pairwise dependencies, including those with zero autocorrelation. The standardized spectral density can be derived by properly differentiating the generalized spectral density with respect to the auxiliary parameters at the origin. The consistency of a class of Parzen's kernel-type estimators, for the generalized spectral density is established, and their optimal convergence rates are derived using the integrated mean squared error criterion. A data-dependent asymptotically optimal bandwidth (or lag order) is introduced. The kernel estimators and their derivatives are applied to construct a class of asymptotically one-sided N(0, 1) tests for generic serial dependence and hypotheses on various specific aspects of serial dependence. The latter include serial uncorrelatedness, martingale, conditional homoscedasticity, conditional symmetry, and conditional homokurtosis. All of the proposed tests, which include Hong's spectral density test for serial correlation, can be derived from a unified framework. An empirical application to Deutschemark exchange rates highlights the approach.
Assessing time series correlation significance: A parametric approach with application to physiological signals

Johan Medrano,Abderrahmane Kheddar,Sofiane Ramdani

DOI: https://doi.org/10.2139/ssrn.4700967

IF: 5.1

2024-03-28

Biomedical Signal Processing and Control

Abstract:Correlation coefficients play a pivotal role in quantifying linear relationships between random variables. Yet, their application to time series data is very challenging due to temporal dependencies. This paper introduces a novel approach to estimate the statistical significance of correlation coefficients in time series data, addressing the limitations of traditional methods based on the concept of effective degrees of freedom (or effective sample size, ESS). These effective degrees of freedom represent the independent sample size that would yield comparable test statistics under the assumption of no temporal correlation. We propose to assume a parametric Gaussian form for the autocorrelation function. We show that this assumption, motivated by a Laplace approximation, enables a simple estimator of the ESS that depends only on the temporal derivatives of the time series. Through numerical experiments, we show that the proposed approach yields accurate statistics while significantly reducing computational complexity, from O(nlogn) to O(n) . In addition, we evaluate the adequacy of our approach on real physiological signals, for assessing the connectivity measures in electrophysiology and detecting correlated arm movements in motion capture data. Our methodology provides a simple tool for researchers working with time series data, enabling robust hypothesis testing in the presence of temporal dependencies.

engineering, biomedical
Distance Correlation Test for High-Dimensional Independence

Weiming Li,Qinwen Wang,Jianfeng Yao

DOI: https://doi.org/10.3150/23-bej1710

IF: 1.5

2024-01-01

Bernoulli

Abstract:In this paper, a new self-normalized and scale invariant statistic Tn, which is based on distance correlations, is developed for testing mutual independence of a high-dimensional random vector. The asymptotic normality of the statistic is established under mild moment conditions by assuming both the dimension p of the vector and the sample size n grow to infinity. In particular, the test procedure has the consistency against sparse alternatives where the dependence can be nonlinear and non-monotonic. Technically, the asymptotic normality of the test statistic is built upon martingale decomposition and novel moment method with appropriate combinatorics.
Detecting practically significant dependencies in infinite dimensional data via distance correlations

Holger Dette,Marius Kroll

2024-11-25

Abstract:In this paper we take a different look on the problem of testing the independence of two infinite dimensional random variables using the distance correlation. Instead of testing if the distance correlation vanishes exactly, we are interested in the null hypothesis that it does not exceed a certain threshold. Our formulation of the testing problem is motivated by the observation that in many cases it is more reasonable to test for a practically significant dependency since it is rare that a null hypothesis of perfect independence is exactly satisfied. This point of view also reflects statistical practice, where one often classifies the strength of the association in categories such as 'small', 'medium' and 'large' and the precise definitions depend on the specific application. To address these problems we develop a pivotal test for the hypothesis that the distance correlation $\mathrm{dcor}(X,Y)$ between two random variables $X$ and $Y$ does not exceed a pre-specified threshold $\Delta$, that is $H_0 : \mathrm{dcor}(X,Y) \leq \Delta$ versus $H_1 : \mathrm{dcor}(X,Y) > \Delta$. We also determine a minimum value $\hat \Delta_\alpha$ from the data such that $H_0$ is rejected for all $\Delta \leq \hat \Delta_\alpha$ at controlled type I error $\alpha$. This quantity can be interpreted as a measure of evidence against the hypothesis of independence. The new test is applicable to data modeled by a strictly stationary and absolutely regular process with components taking values in separable metric spaces of negative type, which includes Euclidean as well as functional data. Our approach is based on a new functional limit theorem for the sequential distance correlation process.

Statistics Theory,Probability
Eigenvalue Distribution of a High-Dimensional Distance Covariance Matrix with Application

Weiming Li,Qinwen Wang,Jianfeng Yao

DOI: https://doi.org/10.5705/ss.202020.0327

IF: 1.4

2021-01-01

Statistica Sinica

Abstract:We introduce a new random matrix model called distance covariance matrix in this paper, whose normalized trace is equivalent to the distance covariance. We first derive a deterministic limit for the eigenvalue distribution of the distance covariance matrix when the dimensions of the vectors and the sample size tend to infinity simultaneously. This limit is valid when the vectors are independent or weakly dependent through a finite-rank perturbation. It is also universal and independent of the details of the distributions of the vectors. Furthermore, the top eigenvalues of this distance covariance matrix are shown to obey an exact phase transition when the dependence of the vectors is of finite rank. This finding enables the construction of a new detector for such weak dependence where classical methods based on large sample covariance matrices or sample canonical correlations may fail in the considered high-dimensional framework.

Distances between time-series and their autocorrelation statistics

Distances between power spectral densities

Distances and Riemannian Metrics for Multivariate Spectral Densities

The affinely invariant distance correlation

Asymptotics of Distances Between Sample Covariance Matrices

Test for independence of long-range dependent time series using distance covariance

Partial Distance Correlation with Methods for Dissimilarities

A New Correlation Coefficient for Bivariate Time-Series Data

The Local Partial Autocorrelation Function and Some Applications

Goodness-of-Fit Testing for Time Series Models via Distance Covariance

Deterministic Equivalent of the Log-Euclidean Distance between Sample Covariance Matrices

Wasserstein distance bounds on the normal approximation of empirical autocovariances and cross-covariances under non-stationarity and stationarity

Derivation of Correlation Dimension from Spatial Autocorrelation Functions

Testing for Independence Between Two Covariance Stationary Time Series

Hypothesis Testing in Time Series Via the Empirical Characteristic Function: A Generalized Spectral Density Approach

Assessing time series correlation significance: A parametric approach with application to physiological signals

Distance Correlation Test for High-Dimensional Independence

Detecting practically significant dependencies in infinite dimensional data via distance correlations

Eigenvalue Distribution of a High-Dimensional Distance Covariance Matrix with Application