On relationships between the Pearson and the distance correlation coefficients

Dominic Edelmann,Tamás F. Móri,Gábor J. Székely

DOI: https://doi.org/10.1016/j.spl.2020.108960

2021-02-01

Abstract:In this paper we show that for any fixed Pearson correlation coefficient strictly between − 1 and 1, the distance correlation coefficient can take any value in the open unit interval ( 0 , 1 ) .

statistics & probability

What problem does this paper attempt to address?

Pearson Correlations on Networks: Corrigendum

Michele Coscia,Karel Devriendt

2024-02-14

Abstract:Recently, the first author proposed a measure to calculate Pearson correlations for node values expressed in a network, by taking into account distances or metrics defined on the network. In this technical note, we show that using an arbitrary choice of distances might result in imaginary or unbounded correlation values, which is undesired. We prove that this problem is solved by restricting to a special class of distances: negative type metrics. We also discuss two natural classes of negative type metrics on graphs, for which the network correlations are properly defined.

Social and Information Networks,Data Analysis, Statistics and Probability,Physics and Society
The relation between Pearson's correlation coefficient r and Salton's cosine measure

Leo Egghe,Loet Leydesdorff

DOI: https://doi.org/10.48550/arXiv.0911.1318

2009-11-06

Information Retrieval

Abstract:The relation between Pearson's correlation coefficient and Salton's cosine measure is revealed based on the different possible values of the division of the L1-norm and the L2-norm of a vector. These different values yield a sheaf of increasingly straight lines which form together a cloud of points, being the investigated relation. The theoretical results are tested against the author co-citation relations among 24 informetricians for whom two matrices can be constructed, based on co-citations: the asymmetric occurrence matrix and the symmetric co-citation matrix. Both examples completely confirm the theoretical results. The results enable us to specify an algorithm which provides a threshold value for the cosine above which none of the corresponding Pearson correlations would be negative. Using this threshold value can be expected to optimize the visualization of the vector space.
The Earth Mover's Correlation

Tamás F. Móri,Gábor J. Székely

DOI: https://doi.org/10.48550/arXiv.2009.04313

2020-09-09

Abstract:Since Pearson's correlation was introduced at the end of the 19th century many dependence measures have appeared in the literature. Recently we have suggested four simple axioms for dependence measures of random variables that take values in Hilbert spaces. We showed that distance correlation satisfies all these axioms. We still need a new measure of dependence because existing measures either do not work in general metric spaces (that are not Hilbert spaces) or they do not satisfy our four simple axioms. The earth mover's correlation introduced in this paper applies in general metric spaces and satisfies our four axioms (two of them in a weaker form).

Statistics Theory
Pearson's correlation coefficient in the theory of networks: A comment

Zafar Ahmed,Sachin Kumar

DOI: https://doi.org/10.48550/arXiv.1803.06937

2018-03-16

Disordered Systems and Neural Networks

Abstract:In statistics, the Pearson correlation coefficient $r_{x,y}$ determines the degree of linear correlation between two variables and it is known that $-1 \le r_{x,y} \le 1$. In the theory of networks, a curious expression proposed in [PRL {\bf 89} 208701 (2002)] for degree-degree correlation coefficient $r_{j_i,k_i}, i\in [1,M]$ has been in use. We realize that the suggested form is the conventional Pearson's coefficient for $\{(j_i,k_i), (k_i,j_i)\}$ for $2M$ data points and hence it is rightly dedicated to undirected networks.
A Multi-Way Correlation Coefficient

Benjamin M. Taylor

DOI: https://doi.org/10.48550/arXiv.2003.02561

2020-03-05

Abstract:Pearson's correlation is an important summary measure of the amount of dependence between two variables. It is natural to want to generalise the concept of correlation as a single number that measures the inter-relatedness of three or more variables e.g. how `correlated' are a collection of variables in which non are specifically to be treated as an `outcome'? In this short article, we introduce such a measure, and show that it reduces to the modulus of Pearson's $r$ in the two dimensional case.

Methodology
On Conditional Correlations

Lei Yu

DOI: https://doi.org/10.48550/arXiv.1811.03918

2019-05-26

Abstract:The Pearson correlation, correlation ratio, and maximal correlation have been well-studied in the literature. In this paper, we study the conditional versions of these quantities. We extend the most important properties of the unconditional versions to the conditional versions, and also derive some new properties. Based on the conditional maximal correlation, we define an information-correlation function of two arbitrary random variables, and use it to derive an impossibility result for the problem of the non-interactive simulation of random variables.

Probability,Information Theory,Statistics Theory
The affinely invariant distance correlation

Johannes Dueck,Dominic Edelmann,Tilmann Gneiting,Donald Richards

DOI: https://doi.org/10.3150/13-bej558

IF: 1.5

2014-11-01

Bernoulli

Abstract:Székely, Rizzo and Bakirov (Ann. Statist. 35 (2007) 2769–2794) and Székely and Rizzo (Ann. Appl. Statist. 3 (2009) 1236–1265), in two seminal papers, introduced the powerful concept of distance correlation as a measure of dependence between sets of random variables. We study in this paper an affinely invariant version of the distance correlation and an empirical version of that distance correlation, and we establish the consistency of the empirical quantity. In the case of subvectors of a multivariate normally distributed random vector, we provide exact expressions for the affinely invariant distance correlation in both finite-dimensional and asymptotic settings, and in the finite-dimensional case we find that the affinely invariant distance correlation is a function of the canonical correlation coefficients. To illustrate our results, we consider time series of wind vectors at the Stateline wind energy center in Oregon and Washington, and we derive the empirical auto and cross distance correlation functions between wind vectors at distinct meteorological stations.

statistics & probability
Measuring Linear Correlation Between Random Vectors

Giovanni Puccetti

DOI: https://doi.org/10.2139/ssrn.3116066

2018-01-01

SSRN Electronic Journal

Abstract:We introduce a new scalar coefficient to measure linear correlation between random vectors which preserves all the relevant properties of Pearson’s correlation in arbitrary dimensions. The new measure and its bounds are derived from a mass transportation approach in which the expected inner product of two random vectors is taken as a measure of their covariance and then standardized by the maximal attainable value given their marginal covariance matrices. In several simulative studies we show the limiting distribution of the empirical estimator of the newly defined index and of the corresponding rank correlation. A comparative study shows that our proposed correlation, though derived from a novel approach, behaves similarly to some of the multivariate dependence notions recently introduced in the literature. Throughout the paper, we also give some auxiliary results of independent interest in matrix analysis and mass transportation theory, including an improvement to the Cauchy-Schwarz inequality for positive definite covariance matrices.
Is Distance Correlation Robust?

Sarah Leyder,Jakob Raymaekers,Peter J. Rousseeuw

2024-03-06

Abstract:Distance correlation is a popular measure of dependence between random variables. It has some robustness properties, but not all. We prove that the influence function of the usual distance correlation is bounded, but that its breakdown value is zero. Moreover, it has an unbounded sensitivity function, converging to the bounded influence function for increasing sample size. To address this sensitivity to outliers we construct a more robust version of distance correlation, which is based on a new data transformation. Simulations indicate that the resulting method is quite robust, and has good power in the presence of outliers. We illustrate the method on genetic data. Comparing the classical distance correlation with its more robust version provides additional insight.

Methodology
Partial Distance Correlation with Methods for Dissimilarities

Gabor J. Szekely,Maria L. Rizzo

DOI: https://doi.org/10.48550/arXiv.1310.2926

2014-07-09

Abstract:Distance covariance and distance correlation are scalar coefficients that characterize independence of random vectors in arbitrary dimension. Properties, extensions, and applications of distance correlation have been discussed in the recent literature, but the problem of defining the partial distance correlation has remained an open question of considerable interest. The problem of partial distance correlation is more complex than partial correlation partly because the squared distance covariance is not an inner product in the usual linear space. For the definition of partial distance correlation we introduce a new Hilbert space where the squared distance covariance is the inner product. We define the partial distance correlation statistics with the help of this Hilbert space, and develop and implement a test for zero partial distance correlation. Our intermediate results provide an unbiased estimator of squared distance covariance, and a neat solution to the problem of distance correlation for dissimilarities rather than distances.

Methodology,Statistics Theory
Improved distance correlation estimation

Blanca E. Monroy-Castillo,Jácome,Ricardo Cao

2024-05-03

Abstract:Distance correlation is a novel class of multivariate dependence measure, taking positive values between 0 and 1, and applicable to random vectors of arbitrary dimensions, not necessarily equal. It offers several advantages over the well-known Pearson correlation coefficient, the most important is that distance correlation equals zero if and only if the random vectors are independent.

Computation,Statistics Theory
On Correlation Coefficients

Alexei Stepanov

2024-05-26

Abstract:In the present paper, we discuss the Pearson, Spearman, Kendall correlation coefficients and their statistical analogues. We propose a new correlation coefficient r and its statistical analogue. The coefficient r is based on Kendal's and Spearman's correlation coefficients. A new extension of the Pearson correlation coefficient is also discussed. We conduct simulation experiments and study the behavior of the above correlation coefficients. We observe that the behavior of Pearson's sample correlation coefficient can be very different from the behavior of the rank correlation coefficients, which, in turn, behave in a similar way. The question arises: which correlation coefficient better measures the dependence rate? We try to answer this question in the final conclusion.

Statistics Theory
A new correlation coefficient between categorical, ordinal and interval variables with Pearson characteristics

M. Baak,R. Koopman,H. Snoek,S. Klous

DOI: https://doi.org/10.1016/j.csda.2020.107043

2020-12-01

Abstract:A prescription is presented for a new and practical correlation coefficient, <math>ϕK</math>, based on several refinements to Pearson's hypothesis test of independence of two variables. The combined features of <math>ϕK</math> form an advantage over existing coefficients. Primarily, it works consistently between categorical, ordinal and interval variables, in essence by treating each variable as categorical, and can therefore be used to calculate correlations between variables of mixed type. Second, it captures nonlinear dependency. The strength of <math>ϕK</math> is similar to Pearson's correlation coefficient, and is equivalent in case of a bivariate normal input distribution. These are useful properties when studying the correlations between variables with mixed types, where some are categorical. Two more innovations are presented: to the proper evaluation of statistical significance of correlations, and to the interpretation of variable relationships in a contingency table, in particular in case of sparse or low statistics samples and significant dependencies. Two practical applications are discussed. The presented algorithms are easy to use and available through a public Python library.<a class="workspace-trigger" href="#fn1">1</a> 

statistics & probability,computer science, interdisciplinary applications
On Correlation and Prediction Interval Reduction

Romain Piaget-Rossel,Valentin Rousson

DOI: https://doi.org/10.48550/arXiv.2405.04895

2024-05-08

Abstract:Pearson's correlation coefficient is a popular statistical measure to summarize the strength of association between two continuous variables. It is usually interpreted via its square as percentage of variance of one variable predicted by the other in a linear regression model. It can be generalized for multiple regression via the coefficient of determination, which is not straightforward to interpret in terms of prediction accuracy. In this paper, we propose to assess the prediction accuracy of a linear model via the prediction interval reduction (PIR) by comparing the width of the prediction interval derived from this model with the width of the prediction interval obtained without this model. At the population level, PIR is one-to-one related to the correlation and the coefficient of determination. In particular, a correlation of 0.5 corresponds to a PIR of only 13%. It is also the one's complement of the coefficient of alienation introduced at the beginning of last century. We argue that PIR is easily interpretable and useful to keep in mind how difficult it is to make accurate individual predictions, an important message in the era of precision medicine and artificial intelligence. Different estimates of PIR are compared in the context of a linear model and an extension of the PIR concept to non-linear models is outlined.

Methodology
Pearson's correlation under the scope: Assessment of the efficiency of Pearson's correlation to select predictor variables for linear models

Mustafa Attallah

DOI: https://doi.org/10.48550/arXiv.2409.01295

2024-09-07

Abstract:This article examines the limitations of Pearson's correlation in selecting predictor variables for linear models. Using mtcars and iris datasets from R, this paper demonstrates the limitation of this correlation measure when selecting a proper independent variable to model miles per gallon (mpg) from mtcars data and the petal length from the iris data. This paper exhibits the findings by reporting Pearson's correlation values for two potential predictor variables for each response variable, then builds a linear model to predict the response variable using each predictor variable. The error metrics for each model are then reported to evaluate how reliable Pearson's correlation is in selecting the best predictor variable. The results show that Pearson's correlation can be deceiving if used to select the predictor variable to build a linear model for a dependent variable.

Methodology
On Clustering Time Series Using Euclidean Distance and Pearson Correlation

Michael R. Berthold,Frank Höppner

DOI: https://doi.org/10.48550/arXiv.1601.02213

2016-01-10

Abstract:For time series comparisons, it has often been observed that z-score normalized Euclidean distances far outperform the unnormalized variant. In this paper we show that a z-score normalized, squared Euclidean Distance is, in fact, equal to a distance based on Pearson Correlation. This has profound impact on many distance-based classification or clustering methods. In addition to this theoretically sound result we also show that the often used k-Means algorithm formally needs a mod ification to keep the interpretation as Pearson correlation strictly valid. Experimental results demonstrate that in many cases the standard k-Means algorithm generally produces the same results.

Machine Learning,Artificial Intelligence
The Evolution of Pearson's Correlation Coefficient

Gary Kader,Christine Franklin

DOI: https://doi.org/10.5951/mt.102.4.0292

2008-11-01

The Mathematics Teacher

Abstract:Studying the relationship between two quantitative variables is a standard topic in statistics. In high school and introductory college-level statistics, Pearson's correlation coefficient, r, is typically included as a measure of the direction and strength of the linear relationship between two quantitative variables. This article describes an activity that aids an intuitive development of the formula for r and its interpretation. Exploring scatter plots allows students to develop an intermediate measure of association called the quadrant count ratio (QCR), investigate properties of the QCR, and develop Pearson's r to address some of the QCR's shortcomings.
Pearson correlations on complex networks

Michele Coscia

DOI: https://doi.org/10.1093/comnet/cnab036

IF: 1.492

2021-10-20

Journal of Complex Networks

Abstract:Abstract Complex networks are useful tools to understand propagation events like epidemics, word-of-mouth, adoption of habits and innovations. Estimating the correlation between two processes happening on the same network is therefore an important problem with a number of applications. However, at present there is no way to do so: current methods either correlate a network with itself, a single process with the network structure or calculate a network distance between two processes. In this article, we propose to extend the Pearson correlation coefficient to work on complex networks. Given two vectors, we define a function that uses the topology of the network to return a correlation coefficient. We show that our formulation is intuitive and returns the expected values in a number of scenarios. We also demonstrate how the classical the Pearson correlation coefficient is unable to do so. We conclude the article with two case studies, showcasing how our network correlation can facilitate tasks in social network analysis and economics. We provide examples of how we could use our network correlation to infer user characteristics from their activities on social media; and relationships between industrial products, under some assumptions as to what should make two exporting countries similar.

mathematics, interdisciplinary applications
The extension of Pearson correlation coefficient, measuring noise, and selecting features

Reza Salimi,Kamran Pakizeh

2024-02-01

Abstract:Not a matter of serious contention, Pearson's correlation coefficient is still the most important statistical association measure. Restricted to just two variables, this measure sometimes doesn't live up to users' needs and expectations. Specifically, a multivariable version of the correlation coefficient can greatly contribute to better assessment of the risk in a multi-asset investment portfolio. Needless to say, the correlation coefficient is derived from another concept: covariance. Even though covariance can be extended naturally by its mathematical formula, such an extension is to no use. Making matters worse, the correlation coefficient can never be extended based on its mathematical definition. In this article, we briefly explore random matrix theory to extend the notion of Pearson's correlation coefficient to an arbitrary number of variables. Then, we show that how useful this measure is at gauging noise, thereby selecting features particularly in classification.

Mathematical Finance
Pearson codes

Jos H. Weber,Kees A. Schouhamer Immink,Simon R. Blackburn

DOI: https://doi.org/10.1109/TIT.2015.2490219

2015-09-29

Abstract:The Pearson distance has been advocated for improving the error performance of noisy channels with unknown gain and offset. The Pearson distance can only fruitfully be used for sets of $q$-ary codewords, called Pearson codes, that satisfy specific properties. We will analyze constructions and properties of optimal Pearson codes. We will compare the redundancy of optimal Pearson codes with the redundancy of prior art $T$-constrained codes, which consist of $q$-ary sequences in which $T$ pre-determined reference symbols appear at least once. In particular, it will be shown that for $q\le 3$ the $2$-constrained codes are optimal Pearson codes, while for $q\ge 4$ these codes are not optimal.

Information Theory

On relationships between the Pearson and the distance correlation coefficients

Pearson Correlations on Networks: Corrigendum

The relation between Pearson's correlation coefficient r and Salton's cosine measure

The Earth Mover's Correlation

Pearson's correlation coefficient in the theory of networks: A comment

A Multi-Way Correlation Coefficient

On Conditional Correlations

The affinely invariant distance correlation

Measuring Linear Correlation Between Random Vectors

Is Distance Correlation Robust?

Partial Distance Correlation with Methods for Dissimilarities

Improved distance correlation estimation

On Correlation Coefficients

A new correlation coefficient between categorical, ordinal and interval variables with Pearson characteristics

On Correlation and Prediction Interval Reduction

Pearson's correlation under the scope: Assessment of the efficiency of Pearson's correlation to select predictor variables for linear models

On Clustering Time Series Using Euclidean Distance and Pearson Correlation

The Evolution of Pearson's Correlation Coefficient

Pearson correlations on complex networks

The extension of Pearson correlation coefficient, measuring noise, and selecting features

Pearson codes