Alternatives to Pearson's and Spearman's Correlation Coefficients

Florentin Smarandache

DOI: https://doi.org/10.2139/ssrn.2725499

2016-01-01

SSRN Electronic Journal

Abstract:This article presents several alternatives to Pearson’s correlation coefficient and many examples. In the samples where the rank in a discrete variable counts more than the variable values, the mixture of Pearson’s and Spearman’s gives a better result.

English Else

What problem does this paper attempt to address?

Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data

Jan Hauke,Tomasz Kossowski

DOI: https://doi.org/10.2478/v10117-011-0021-1

2011-06-01

quageo

Abstract:Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data Spearman's rank correlation coefficient is a nonparametric (distribution-free) rank statistic proposed by Charles Spearman as a measure of the strength of an association between two variables. It is a measure of a monotone association that is used when the distribution of data makes Pearson's correlation coefficient undesirable or misleading. Spearman's coefficient is not a measure of the linear relationship between two variables, as some "statisticians" declare. It assesses how well an arbitrary monotonic function can describe a relationship between two variables, without making any assumptions about the frequency distribution of the variables. Unlike Pearson's product-moment correlation coefficient, it does not require the assumption that the relationship between the variables is linear, nor does it require the variables to be measured on interval scales; it can be used for variables measured at the ordinal level. The idea of the paper is to compare the values of Pearson's product-moment correlation coefficient and Spearman's rank correlation coefficient as well as their statistical significance for different sets of data (original - for Pearson's coefficient, and ranked data for Spearman's coefficient) describing regional indices of socio-economic development.
On Correlation Coefficients

Alexei Stepanov

2024-05-26

Abstract:In the present paper, we discuss the Pearson, Spearman, Kendall correlation coefficients and their statistical analogues. We propose a new correlation coefficient r and its statistical analogue. The coefficient r is based on Kendal's and Spearman's correlation coefficients. A new extension of the Pearson correlation coefficient is also discussed. We conduct simulation experiments and study the behavior of the above correlation coefficients. We observe that the behavior of Pearson's sample correlation coefficient can be very different from the behavior of the rank correlation coefficients, which, in turn, behave in a similar way. The question arises: which correlation coefficient better measures the dependence rate? We try to answer this question in the final conclusion.

Statistics Theory
A Comparison of the Pearson, Spearman Rank and Kendall Tau Correlation Coefficients Using Quantitative Variables

Essam F. El-Hashash,Rega Hassan Ali Shiekh

DOI: https://doi.org/10.9734/ajpas/2022/v20i3425

2022-10-18

Asian Journal of Probability and Statistics

Abstract:In all fields and branches of sciences especially statistics, the correlation coefficient is one of the most often used statistical measures. This study has been carried out for comparing the performances of the Pearson (), Spearman's Rank (), and Kendall’s Tau () correlation coefficients under three sample sizes based on the data of quantitative variables of cotton. Descriptive statistics showed the presence of genetic variability for the cotton studied traits in this study. The quantity, significance, and direction of the correlation calculated by differed in some cases from the other methods under the three sample sizes, opposite is true for and . The highest number of positive correlations among studied traits were by under N = 30 observations, and by and under N = 20 observations. The studied correlation methods performances by Root Mean Square Error (RMSE) revealed that and appear to be a good estimator of correlation because they have the lowest values of RMSE. The highest values of RMSE were observed by and under N=10 and N=20, and by under N=30. The results of PCA could be useful and appropriate in this study, in which the PCA1 had highly positively correlated with the three studied methods for N=10 observations, and with and for N=20 observations.
Relative Synergy Coefficient: A Novel Way to Detect Variable Interaction in Large Dataset

Yanrui Li,Kaiyou Fu,Yuchen Zhao,Chunjie Yang

DOI: https://doi.org/10.1016/j.knosys.2023.111112

IF: 8.139

2023-01-01

Knowledge-Based Systems

Abstract:Feature interaction, also referred to as feature synergy, denotes the phenomenon wherein interactive features collectively convey more information than their individual contributions, thereby holding paramount significance in the realms of feature engineering and data mining. Many prevailing techniques designed to detect these interactions primarily rely on model-based methods to compute absolute synergy. However, such approaches often prove ill-suited for extensive datasets and overlook variables with comparatively minor primary effects. In response, we introduce a groundbreaking metric known as the Relative Synergy Coefficient (RSC). This novel metric facilitates swift identification and quantification of relative synergy’s potency within large datasets. The proposed indicator is a non-parametric metric based on information entropy, and its computation involves the utilization of discretization and normalization techniques. The generality, equitability and robustness of metric is proved on the simulated data. Besides, the indicator is proved to be effective and can cross-validate with domain knowledge on two real world datasets.
Nonparametric statistics. Part 3. Correlation coefficients

M. A. Nikitina,I. M. Chernukha

DOI: https://doi.org/10.21323/2414-438x-2023-8-3-237-251

2023-10-10

Theory and practice of meat processing

Abstract:A measure of correlation or strength of association between random variables is the correlation coefficient. In scientific research, correlation analysis is most often carried out using various correlation coefficients without explaining why this particular coefficient was chosen and what the resulting value of this coefficient means. The article discusses Spearman correlation coefficient, Kendall correlation coefficient, phi (Yule) correlation coefficient, Cramér’s correlation coefficient, Matthews correlation coefficient, Fechner correlation coefficient, Tschuprow correlation coefficient, rank-biserial correlation coefficient, point-biserial correlation coefficient, as well as association coefficient and contingency coefficient. The criteria for applying each of the coefficients are given. It is shown how to establish the significance (insignificance) of the resulting correlation coefficient. The scales in which the correlated variables should be located for the coefficients under consideration are presented. Spearman rank correlation coefficient and other nonparametric indicators are independent of the distribution law, and that is why they are very useful. They make it possible to measure the contingency between such attributes that cannot be directly measured, but can be expressed by points or other conventional units that allow ranking the sample. The benefit of rank correlation coefficient also lies in the fact that it allows to quickly assess the relationship between attributes regardless of the distribution law. Examples are given and step-by-step application of each coefficient is described. When analyzing scientific research and evaluating the results obtained, the strength of association is most commonly assessed by the correlation coefficient. In this regard, a number of scales are given (Chaddock scale, Cohen scale, Rosenthal scale, Hinkle scale, Evans scale) grading the strength of association for correlation coefficient, both widely recognized and not so well known.
A Short Note on Spearman Correlation: Impact of Tied Observations

Yang Liu

DOI: https://doi.org/10.2139/ssrn.2933193

2017-01-01

SSRN Electronic Journal

Abstract:The Spearman Correlation is a well known approach to assess the rank correlation of two data sets. One of the advantages choosing Spearman over other correlation coefficients such as the Pearson is that the difference in original value series is less important while the relative rank of the value is what matters most in this coefficient. The Spearman correlation coefficient is often used to assess and validate the performance of models that require less accuracy in absolute value estimate, e.g. the loss prediction models or exposure models. Although other measures such as the Kendall’s τ and Somer’s D are used to measure rank ordering with tied observations, the Spearman’s ρ is often calculated as an initial step of correlation analysis. In this short note we look into the tied observations in the target data set and investigate the impact on the Spearman Correlation coefficient in three different scenarios: single value ties, random multi-value ties, and bounded random ties.
Comparison of correlation-based measures of concordance in terms of asymptotic variance

Takaaki Koike,Marius Hofert

DOI: https://doi.org/10.48550/arXiv.2006.13975

2023-03-06

Abstract:We compare measures of concordance that arise as Pearson's linear correlation coefficient between two random variables transformed so that they follow the so-called concordance-inducing distributions. The class of such transformed rank correlations includes Spearman's rho, Blomqvist's beta and van der Waerden's coefficient. When only the standard axioms of measures of concordance are required, it is not always clear which transformed rank correlation is most suitable to use. To address this question, we compare measures of concordance in terms of their best and worst asymptotic variances of some canonical estimators over a certain set of dependence structures. A simple criterion derived from this approach is that concordance-inducing distributions with smaller fourth moment are more preferable. In particular, we show that Blomqvist's beta is the optimal transformed rank correlation in this sense, and Spearman's rho outperforms van der Waerden's coefficient. Moreover, we find that Kendall's tau, although it is not a transformed rank correlation of that nature, shares a certain optimal structure with Blomqvist's beta.

Statistics Theory
Correlation Coefficients and Semantic Textual Similarity

Vitalii Zhelezniak,Aleksandar Savkov,April Shen,Nils Y. Hammerla

DOI: https://doi.org/10.48550/arXiv.1905.07790

2019-05-19

Computation and Language

Abstract:A large body of research into semantic textual similarity has focused on constructing state-of-the-art embeddings using sophisticated modelling, careful choice of learning signals and many clever tricks. By contrast, little attention has been devoted to similarity measures between these embeddings, with cosine similarity being used unquestionably in the majority of cases. In this work, we illustrate that for all common word vectors, cosine similarity is essentially equivalent to the Pearson correlation coefficient, which provides some justification for its use. We thoroughly characterise cases where Pearson correlation (and thus cosine similarity) is unfit as similarity measure. Importantly, we show that Pearson correlation is appropriate for some word vectors but not others. When it is not appropriate, we illustrate how common non-parametric rank correlation coefficients can be used instead to significantly improve performance. We support our analysis with a series of evaluations on word-level and sentence-level semantic textual similarity benchmarks. On the latter, we show that even the simplest averaged word vectors compared by rank correlation easily rival the strongest deep representations compared by cosine similarity.
Comparing Correlated but Nonoverlapping Correlations.

TE Raghunathan,R Rosenthal,DB Rubin

DOI: https://doi.org/10.1037//1082-989x.1.2.178

IF: 10.929

1996-01-01

Psychological Methods

Abstract:A common situation in psychological research involves the comparison of two correlations on the same sample of subjects, in which the correlations are nonoverlapping in the sense of having a variable in common (e.g., r(14) and r(23) rather than r(13) and r(12)). The classic statistic for this situation is the Pearson-Filon statistic, (PF) which is based on the difference of rs. A much more accurate statistic is the version of this statistic based on the difference of Fisher r-to-Z transformed rs, (ZPF). Both PF and ZPF involve an easily computed but visually unattractive expression for the large-N sampling correlation between the correlations and thus may not be especially easy to motivate or teach. We develop a simple approximation that is simple to calculate and teach and therefore has pedagogical value. We also provide simulation evidence to support the superiority of ZPF of PF with respect to both alpha level and power.
Measuring mixing patterns in complex networks by Spearman rank correlation coefficient

Wen-Yao Zhang,Zong-Wen Wei,Bing-Hong Wang,Xiao-Pu Han

DOI: https://doi.org/10.1016/j.physa.2016.01.056

2016-01-01

Abstract:In this paper, we utilize Spearman rank correlation coefficient to measure mixing patterns in complex networks. Compared with the widely used Pearson coefficient, Spearman coefficient is rank-based, nonparametric, and size-independent. Thus it is more effective to assess linking patterns of diverse networks, especially for large-size networks. We demonstrate this point by testing a variety of empirical and artificial networks. Moreover, we show that normalized Spearman ranks of stubs are subject to an interesting linear rule where the correlation coefficient is just the Spearman coefficient. This compelling linear relationship allows us to directly produce networks with any prescribed Spearman coefficient. Our method apparently has an edge over the well known uncorrelated configuration model.
A New Correlation Coefficient for Aggregating Non-strict and Incomplete Rankings

Yeawon Yoo,Adolfo R. Escobedo,J. Kyle Skolfield

DOI: https://doi.org/10.48550/arXiv.1801.07793

2019-02-17

Abstract:We introduce a correlation coefficient that is designed to deal with a variety of ranking formats including those containing non-strict (i.e., with-ties) and incomplete (i.e., unknown) preferences. The correlation coefficient is designed to enforce a neutral treatment of incompleteness whereby no assumptions are made about individual preferences involving unranked objects. The new measure, which can be regarded as a generalization of the seminal Kendall tau correlation coefficient, is proven to satisfy a set of metric-like axioms and to be equivalent to a recently developed ranking distance function associated with Kemeny aggregation. In an effort to further unify and enhance both robust ranking methodologies, this work proves the equivalence of an additional distance and correlation-coefficient pairing in the space of non-strict incomplete rankings. These connections induce new exact optimization methodologies: a specialized branch and bound algorithm and an exact integer programming formulation. Moreover, the bridging of these complementary theories reinforces the singular suitability of the featured correlation coefficient to solve the general consensus ranking problem. The latter premise is bolstered by an accompanying set of experiments on random instances, which are generated via a herein developed sampling technique connected with the classic Mallows distribution of ranking data. Associated experiments with the branch and bound algorithm demonstrate that, as data becomes noisier, the featured correlation coefficient yields relatively fewer alternative optimal solutions and that the aggregate rankings tend to be closer to an underlying ground truth shared by a majority.

Applications,Combinatorics,Optimization and Control,Methodology,Other Statistics
Quotient correlation: A sample based alternative to Pearson's correlation

Zhengjun Zhang

DOI: https://doi.org/10.1214/009053607000000866

2008-04-07

Abstract:The quotient correlation is defined here as an alternative to Pearson's correlation that is more intuitive and flexible in cases where the tail behavior of data is important. It measures nonlinear dependence where the regular correlation coefficient is generally not applicable. One of its most useful features is a test statistic that has high power when testing nonlinear dependence in cases where the Fisher's $Z$-transformation test may fail to reach a right conclusion. Unlike most asymptotic test statistics, which are either normal or $\chi^2$, this test statistic has a limiting gamma distribution (henceforth, the gamma test statistic). More than the common usages of correlation, the quotient correlation can easily and intuitively be adjusted to values at tails. This adjustment generates two new concepts--the tail quotient correlation and the tail independence test statistics, which are also gamma statistics. Due to the fact that there is no analogue of the correlation coefficient in extreme value theory, and there does not exist an efficient tail independence test statistic, these two new concepts may open up a new field of study. In addition, an alternative to Spearman's rank correlation, a rank based quotient correlation, is also defined. The advantages of using these new concepts are illustrated with simulated data and a real data analysis of internet traffic.

Statistics Theory
Comparing the Pearson and Spearman Correlation Coefficients Across Distributions and Sample Sizes: A Tutorial Using Simulations and Empirical Data

J. C. F. de Winter,S. D. Gosling,J. Potter

DOI: https://doi.org/10.1037/met0000079

2024-08-29

Abstract:The Pearson product-moment correlation coefficient (rp) and the Spearman rank correlation coefficient (rs) are widely used in psychological research. We compare rp and rs on 3 criteria: variability, bias with respect to the population value, and robustness to an outlier. Using simulations across low (N = 5) to high (N = 1,000) sample sizes we show that, for normally distributed variables, rp and rs have similar expected values but rs is more variable, especially when the correlation is strong. However, when the variables have high kurtosis, rp is more variable than rs. Next, we conducted a sampling study of a psychometric dataset featuring symmetrically distributed data with light tails, and of 2 Likert-type survey datasets, 1 with light-tailed and the other with heavy-tailed distributions. Consistent with the simulations, rp had lower variability than rs in the psychometric dataset. In the survey datasets with heavy-tailed variables in particular, rs had lower variability than rp, and often corresponded more accurately to the population Pearson correlation coefficient (Rp) than rp did. The simulations and the sampling studies showed that variability in terms of standard deviations can be reduced by about 20% by choosing rs instead of rp. In comparison, increasing the sample size by a factor of 2 results in a 41% reduction of the standard deviations of rs and rp. In conclusion, rp is suitable for light-tailed distributions, whereas rs is preferable when variables feature heavy-tailed distributions or when outliers are present, as is often the case in psychological research.

Methodology
A new coefficient of correlation

Sourav Chatterjee

DOI: https://doi.org/10.48550/arXiv.1909.10140

2020-04-29

Abstract:Is it possible to define a coefficient of correlation which is (a) as simple as the classical coefficients like Pearson's correlation or Spearman's correlation, and yet (b) consistently estimates some simple and interpretable measure of the degree of dependence between the variables, which is 0 if and only if the variables are independent and 1 if and only if one is a measurable function of the other, and (c) has a simple asymptotic theory under the hypothesis of independence, like the classical coefficients? This article answers this question in the affirmative, by producing such a coefficient. No assumptions are needed on the distributions of the variables. There are several coefficients in the literature that converge to 0 if and only if the variables are independent, but none that satisfy any of the other properties mentioned above.

Statistics Theory,Probability
Different coefficients for studying dependence

Oona Rainio

DOI: https://doi.org/10.1007/s13571-022-00295-0

2023-01-09

Abstract:Through computer simulations, we research several different measures of dependence, including Pearson's and Spearman's correlation coefficients, the maximal correlation, the distance correlation, a function of the mutual information called the information coefficient of correlation, and the maximal information coefficient (MIC). We compare how well these coefficients fulfill the criteria of generality, power, and equitability. Furthermore, we consider how the exact type of dependence, the amount of noise and the number of observations affect their performance.

Methodology
A new correlation coefficient between categorical, ordinal and interval variables with Pearson characteristics

M. Baak,R. Koopman,H. Snoek,S. Klous

DOI: https://doi.org/10.1016/j.csda.2020.107043

2020-12-01

Abstract:A prescription is presented for a new and practical correlation coefficient, <math>ϕK</math>, based on several refinements to Pearson's hypothesis test of independence of two variables. The combined features of <math>ϕK</math> form an advantage over existing coefficients. Primarily, it works consistently between categorical, ordinal and interval variables, in essence by treating each variable as categorical, and can therefore be used to calculate correlations between variables of mixed type. Second, it captures nonlinear dependency. The strength of <math>ϕK</math> is similar to Pearson's correlation coefficient, and is equivalent in case of a bivariate normal input distribution. These are useful properties when studying the correlations between variables with mixed types, where some are categorical. Two more innovations are presented: to the proper evaluation of statistical significance of correlations, and to the interpretation of variable relationships in a contingency table, in particular in case of sparse or low statistics samples and significant dependencies. Two practical applications are discussed. The presented algorithms are easy to use and available through a public Python library.<a class="workspace-trigger" href="#fn1">1</a> 

statistics & probability,computer science, interdisciplinary applications
Correlation Coefficients: Appropriate Use and Interpretation

Patrick Schober,Christa Boer,Lothar A. Schwarte,Boer, Christa,Schwarte, Lothar A.,Schober, Patrick

DOI: https://doi.org/10.1213/ANE.0000000000002864

2019-10-03

Abstract:Correlation in the broadest sense is a measure of an association between variables. In correlated data, the change in the magnitude of 1 variable is associated with a change in the magnitude of another variable, either in the same (positive correlation) or in the opposite (negative correlation) direction. Most often, the term correlation is used in the context of a linear relationship between 2 continuous variables and expressed as Pearson product-moment correlation. The Pearson correlation coefficient is typically used for jointly normally distributed data (data that follow a bivariate normal distribution). For nonnormally distributed continuous data, for ordinal data, or for data with relevant outliers, a Spearman rank correlation can be used as a measure of a monotonic association. Both correlation coefficients are scaled such that they range from –1 to +1, where 0 indicates that there is no linear or monotonic association, and the relationship gets stronger and ultimately approaches a straight line (Pearson correlation) or a constantly increasing or decreasing curve (Spearman correlation) as the coefficient approaches an absolute value of 1. Hypothesis tests and confidence intervals can be used to address the statistical significance of the results and to estimate the strength of the relationship in the population from which the data were sampled. The aim of this tutorial is to guide researchers and clinicians in the appropriate use and interpretation of correlation coefficients.

anesthesiology
Between- and Within-Cluster Spearman Rank Correlations

Shengxin Tu,Chun Li,Bryan E. Shepherd

DOI: https://doi.org/10.48550/arXiv.2402.11341

2024-02-18

Abstract:Clustered data are common in practice. Clustering arises when subjects are measured repeatedly, or subjects are nested in groups (e.g., households, schools). It is often of interest to evaluate the correlation between two variables with clustered data. There are three commonly used Pearson correlation coefficients (total, between-, and within-cluster), which together provide an enriched perspective of the correlation. However, these Pearson correlation coefficients are sensitive to extreme values and skewed distributions. They also depend on the scale of the data and are not applicable to ordered categorical data. Current non-parametric measures for clustered data are only for the total correlation. Here we define population parameters for the between- and within-cluster Spearman rank correlations. The definitions are natural extensions of the Pearson between- and within-cluster correlations to the rank scale. We show that the total Spearman rank correlation approximates a weighted sum of the between- and within-cluster Spearman rank correlations, where the weights are functions of rank intraclass correlations of the two random variables. We also discuss the equivalence between the within-cluster Spearman rank correlation and the covariate-adjusted partial Spearman rank correlation. Furthermore, we describe estimation and inference for the three Spearman rank correlations, conduct simulations to evaluate the performance of our estimators, and illustrate their use with data from a longitudinal biomarker study and a clustered randomized trial.

Methodology
Compatible Matrices of Spearman's Rank Correlation

Bin Wang,Ruodu Wang,Yuming Wang

DOI: https://doi.org/10.48550/arXiv.1810.03477

2019-04-04

Abstract:In this paper, we provide a negative answer to a long-standing open problem on the compatibility of Spearman's rho matrices. Following an equivalence of Spearman's rho matrices and linear correlation matrices for dimensions up to 9 in the literature, we show non-equivalence for dimensions 12 or higher. In particular, we connect this problem with the existence of a random vector under some linear projection restrictions in two characterization results.

Statistics Theory,Applications
Power Comparisons in 2x2 Contingency Tables: Odds Ratio versus Pearson Correlation versus Canonical Correlation

Mohammad Alfrad Nobel Bhuiyan,Michael J Wathen,M Bhaskara Rao

DOI: https://doi.org/10.48550/arXiv.1912.11466

2019-12-24

Methodology

Abstract:It is an important inferential problem to test no association between two binary variables based on data. Tests based on the sample odds ratio are commonly used. We bring in a competing test based on the Pearson correlation coefficient. In particular, the Odds ratio does not extend to higher order contingency tables, whereas Pearson correlation does. It is important to understand how Pearson correlation stacks against the odds ratio in 2x2 tables. Another measure of association is the canonical correlation. In this paper, we examine how competitive Pearson correlation is vis-\`a-vis odds ratio in terms of power in the binary context, contrasting further with both the Wald Z and Rao Score tests. We generated an extensive collection of joint distributions of the binary variables and estimated the power of the tests under each joint alternative distribution based on random samples. The consensus is that none of the tests dominates the other.

Alternatives to Pearson's and Spearman's Correlation Coefficients

Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data

On Correlation Coefficients

A Comparison of the Pearson, Spearman Rank and Kendall Tau Correlation Coefficients Using Quantitative Variables

Relative Synergy Coefficient: A Novel Way to Detect Variable Interaction in Large Dataset

Nonparametric statistics. Part 3. Correlation coefficients

A Short Note on Spearman Correlation: Impact of Tied Observations

Comparison of correlation-based measures of concordance in terms of asymptotic variance

Correlation Coefficients and Semantic Textual Similarity

Comparing Correlated but Nonoverlapping Correlations.

Measuring mixing patterns in complex networks by Spearman rank correlation coefficient

A New Correlation Coefficient for Aggregating Non-strict and Incomplete Rankings

Quotient correlation: A sample based alternative to Pearson's correlation

Comparing the Pearson and Spearman Correlation Coefficients Across Distributions and Sample Sizes: A Tutorial Using Simulations and Empirical Data

A new coefficient of correlation

Different coefficients for studying dependence

A new correlation coefficient between categorical, ordinal and interval variables with Pearson characteristics

Correlation Coefficients: Appropriate Use and Interpretation

Between- and Within-Cluster Spearman Rank Correlations

Compatible Matrices of Spearman's Rank Correlation

Power Comparisons in 2x2 Contingency Tables: Odds Ratio versus Pearson Correlation versus Canonical Correlation