Discussion of 'Multivariate Fisher's independence test for multivariate dependence'

Thomas B Berrett

DOI: https://doi.org/10.48550/arXiv.2205.00992

2022-05-02

Statistics Theory

Abstract:Invited discussion for Biometrika of 'Multivariate Fisher's independence test for multivariate dependence' by Gorsky and Ma (2022).

What problem does this paper attempt to address?

A hypothesis test for independence of sets of variates in high dimensions

Zhengyan Lin,Yanbiao Xiang

DOI: https://doi.org/10.1016/j.spl.2008.05.003

IF: 0.718

2008-01-01

Statistics & Probability Letters

Abstract:Srivastava [Srivastava, M.S., 2005. Some tests concerning the covariance matrix in high dimensional data. J. Japan Statist. Soc. 35, 251–272] has proposed a test statistic for testing the hypothesis that the covariance matrix of the normal population is a diagonal matrix when the sample size is smaller than the dimensionality of the data. We extend his results to the hypothesis testing problem for independence of sets of variates in high dimensions. A test statistic is proposed and its asymptotic null distribution is also given, as both the sample size and the number of variables go to infinity. Consequently, this test can be used when the number of variables is not small relative to the sample size, in particular, even when the number of variables exceeds the sample size. Simulations are performed to see the accuracy of the asymptotic null distribution.
Testing multivariate normality by testing independence

Povilas Daniušis

2023-12-23

Abstract:We propose a simple multivariate normality test based on Kac-Bernstein's characterization, which can be conducted by utilising existing statistical independence tests for sums and differences of data samples. We also perform its empirical investigation, which reveals that for high-dimensional data, the proposed approach may be more efficient than the alternative ones. The accompanying code repository is provided at \url{<a class="link-external link-https" href="https://shorturl.at/rtuy5" rel="external noopener nofollow">this https URL</a>}.

Methodology,Machine Learning
A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Wen-Xin Zhou,Koushiki Bose,Jianqing Fan,Han Liu

DOI: https://doi.org/10.1214/17-AOS1606

Abstract:Heavy-tailed errors impair the accuracy of the least squares estimate, which can be spoiled by a single grossly outlying observation. As argued in the seminal work of Peter Huber in 1973 [Ann. Statist.1 (1973) 799-821], robust alternatives to the method of least squares are sorely needed. To achieve robustness against heavy-tailed sampling distributions, we revisit the Huber estimator from a new perspective by letting the tuning parameter involved diverge with the sample size. In this paper, we develop nonasymptotic concentration results for such an adaptive Huber estimator, namely, the Huber estimator with the tuning parameter adapted to sample size, dimension, and the variance of the noise. Specifically, we obtain a sub-Gaussian-type deviation inequality and a nonasymptotic Bahadur representation when noise variables only have finite second moments. The nonasymptotic results further yield two conventional normal approximation results that are of independent interest, the Berry-Esseen inequality and Cramér-type moderate deviation. As an important application to large-scale simultaneous inference, we apply these robust normal approximation results to analyze a dependence-adjusted multiple testing procedure for moderately heavy-tailed data. It is shown that the robust dependence-adjusted procedure asymptotically controls the overall false discovery proportion at the nominal level under mild moment conditions. Thorough numerical results on both simulated and real datasets are also provided to back up our theory.
Distribution-free tests of multivariate independence based on center-outward quadrant, Spearman, Kendall, and van der Waerden statistics

Hongjian Shi,Mathias Drton,Marc Hallin,Fang Han

2024-09-10

Abstract:Due to the lack of a canonical ordering in ${\mathbb R}^d$ for $d>1$, defining multivariate generalizations of the classical univariate ranks has been a long-standing open problem in statistics. Optimal transport has been shown to offer a solution in which multivariate ranks are obtained by transporting data points to a grid that approximates a uniform reference measure (Chernozhukov et al., 2017; Hallin, 2017; Hallin et al., 2021), thereby inducing ranks, signs, and a data-driven ordering of ${\mathbb R}^d$. We take up this new perspective to define and study multivariate analogues of the sign covariance/quadrant statistic, Spearman's rho, Kendall's tau, and van der Waerden covariances. The resulting tests of multivariate independence are fully distribution-free, hence uniformly valid irrespective of the actual (absolutely continuous) distribution of the observations. Our results provide the asymptotic distribution theory for these new test statistics, with asymptotic approximations to critical values to be used for testing independence between random vectors, as well as a power analysis of the resulting tests in an extension of the so-called (bivariate) Konijn model. This power analysis includes a multivariate Chernoff--Savage property guaranteeing that, under elliptical generalized Konijn models, the asymptotic relative efficiency of our van der Waerden tests with respect to Wilks' classical (pseudo-)Gaussian procedure is strictly larger than or equal to one, where equality is achieved under Gaussian distributions only. We similarly provide a lower bound for the asymptotic relative efficiency of our Spearman procedure with respect to Wilks' test, thus extending the classical result by Hodges and Lehmann on the asymptotic relative efficiency, in univariate location models, of Wilcoxon tests with respect to the Student ones.

Statistics Theory
BET on Independence

Kai Zhang

DOI: https://doi.org/10.1080/01621459.2018.1537921

IF: 4.369

2019-04-24

Journal of the American Statistical Association

Abstract:We study the problem of nonparametric dependence detection. Many existing methods may suffer severe power loss due to nonuniform consistency, which we illustrate with a paradox. To avoid such power loss, we approach the nonparametric test of independence through the new framework of binary expansion statistics (BEStat) and binary expansion testing (BET), which examine dependence through a novel binary expansion filtration approximation of the copula. Through a Hadamard transform, we find that the symmetry statistics in the filtration are complete sufficient statistics for dependence. These statistics are also uncorrelated under the null. By using symmetry statistics, the BET avoids the problem of nonuniform consistency and improves upon a wide class of commonly used methods (a) by achieving the minimax rate in sample size requirement for reliable power and (b) by providing clear interpretations of global relationships upon rejection of independence. The binary expansion approach also connects the symmetry statistics with the current computing system to facilitate efficient bitwise implementation. We illustrate the BET with a study of the distribution of stars in the night sky and with an exploratory data analysis of the TCGA breast cancer data. Supplementary materials for this article are available online.

statistics & probability
Graphical tests of independence for general distributions

Jiří Dvořák,Tomáš Mrkvička

DOI: https://doi.org/10.1007/s00180-021-01134-y

2020-08-14

Abstract:We propose two model-free, permutation-based tests of independence between a pair of random variables. The tests can be applied to samples from any bivariate distribution: continuous, discrete or mixture of those, with light tails or heavy tails, \ldots The tests take advantage of the recent development of the global envelope tests in the context of spatial statistics. Apart from the broad applicability of the tests, their main benefit lies in the graphical interpretation of the test outcome: in case of rejection of the null hypothesis of independence, the combinations of quantiles in the two marginals are indicated for which the deviation from independence is significant. This information can be used to gain more insight into the properties of the observed data and as a guidance for proposing more complicated models and hypotheses. We assess the performance of the proposed tests in a simulation study and compare them to several well-established tests of independence. Furthermore, we illustrate the use of the tests and the interpretation of the test outcome in two real datasets consisting of meteorological reports (daily mean temperature and total daily precipitation, having an atomic component at 0 millimeters) and road accidents reports (type of road and the weather conditions, both variables having categorical distribution).

Methodology
Towards a universal representation of statistical dependence

Gery Geenens

2023-12-22

Abstract:Dependence is undoubtedly a central concept in statistics. Though, it proves difficult to locate in the literature a formal definition which goes beyond the self-evident 'dependence = non-independence'. This absence has allowed the term 'dependence' and its declination to be used vaguely and indiscriminately for qualifying a variety of disparate notions, leading to numerous incongruities. For example, the classical Pearson's, Spearman's or Kendall's correlations are widely regarded as 'dependence measures' of major interest, in spite of returning 0 in some cases of deterministic relationships between the variables at play, evidently not measuring dependence at all. Arguing that research on such a fundamental topic would benefit from a slightly more rigid framework, this paper suggests a general definition of the dependence between two random variables defined on the same probability space. Natural enough for aligning with intuition, that definition is still sufficiently precise for allowing unequivocal identification of a 'universal' representation of the dependence structure of any bivariate distribution. Links between this representation and familiar concepts are highlighted, and ultimately, the idea of a dependence measure based on that universal representation is explored and shown to satisfy Renyi's postulates.

Statistics Theory,Methodology
Testing independence in high dimensions with sums of rank correlations

Dennis Leung,Mathias Drton

DOI: https://doi.org/10.48550/arXiv.1501.01732

2016-12-02

Abstract:We treat the problem of testing independence between m continuous variables when m can be larger than the available sample size n. We consider three types of test statistics that are constructed as sums or sums of squares of pairwise rank correlations. In the asymptotic regime where both m and n tend to infinity, a martingale central limit theorem is applied to show that the null distributions of these statistics converge to Gaussian limits, which are valid with no specific distributional or moment assumptions on the data. Using the framework of U-statistics, our result covers a variety of rank correlations including Kendall's tau and a dominating term of Spearman's rank correlation coefficient (rho), but also degenerate U-statistics such as Hoeffding's $D$, or the $\tau^*$ of Bergsma and Dassios (2014). As in the classical theory for U-statistics, the test statistics need to be scaled differently when the rank correlations used to construct them are degenerate U-statistics. The power of the considered tests is explored in rate-optimality theory under Gaussian equicorrelation alternatives as well as in numerical experiments for specific cases of more general alternatives.

Statistics Theory
Discussion of "A note on universal inference" by Timmy Tse and Anthony Davison

Mathias Drton,Hongjian Shi,David Strieder

2023-03-31

Abstract:Invited discussion for Stat of "A note on universal inference" by Timmy Tse and Anthony Davison (2022)

Methodology,Statistics Theory
Testing Independence with High-Dimensional Correlated Samples

Xi Chen,Weidong Liu

DOI: https://doi.org/10.1214/17-aos1571

2018-01-01

The Annals of Statistics

Abstract:Testing independence among a number of (ultra) high-dimensional random samples is a fundamental and challenging problem. By arranging $n$ identically distributed $p$-dimensional random vectors into a $p \times n$ data matrix, we investigate the problem of testing independence among columns under the matrix-variate normal modeling of data. We propose a computationally simple and tuning-free test statistic, characterize its limiting null distribution, analyze the statistical power and prove its minimax optimality. As an important by-product of the test statistic, a ratio-consistent estimator for the quadratic functional of a covariance matrix from correlated samples is developed. We further study the effect of correlation among samples to an important high-dimensional inference problem --- large-scale multiple testing of Pearson's correlation coefficients. Indeed, blindly using classical inference results based on the assumed independence of samples will lead to many false discoveries, which suggests the need for conducting independence testing before applying existing methods. To address the challenge arising from correlation among samples, we propose a "sandwich estimator" of Pearson's correlation coefficient by de-correlating the samples. Based on this approach, the resulting multiple testing procedure asymptotically controls the overall false discovery rate at the nominal level while maintaining good statistical power. Both simulated and real data experiments are carried out to demonstrate the advantages of the proposed methods.
A nonparametric Bayesian test of dependence

Yimin Kao,Brian J Reich,Howard D Bondell

DOI: https://doi.org/10.48550/arXiv.1501.07198

2015-01-29

Abstract:In this article, we propose a new method for the fundamental task of testing for dependence between two groups of variables. The response densities under the null hypothesis of independence and the alternative hypothesis of dependence are specified by nonparametric Bayesian models. Under the null hypothesis, the joint distribution is modeled by the product of two independent Dirichlet Process Mixture (DPM) priors; under the alternative, the full joint density is modeled by a multivariate DPM prior. The test is then based on the posterior probability of favoring the alternative hypothesis. The proposed test not only has good performance for testing linear dependence among other popular nonparametric tests, but is also preferred to other methods in testing many of the nonlinear dependencies we explored. In the analysis of gene expression data, we compare different methods for testing pairwise dependence between genes. The results show that the proposed test identifies some dependence structures that are not detected by other tests.

Methodology
Kernel-based joint independence tests for multivariate stationary and non-stationary time series

Zhaolu Liu,Robert L. Peach,Felix Laumann,Sara Vallejo Mengod,Mauricio Barahona

DOI: https://doi.org/10.1098/rsos.230857

IF: 3.5

2023-12-01

Royal Society Open Science

Abstract:Multivariate time-series data that capture the temporal evolution of interconnected systems are ubiquitous in diverse areas. Understanding the complex relationships and potential dependencies among co-observed variables is crucial for the accurate statistical modelling and analysis of such systems. Here, we introduce kernel-based statistical tests of joint independence in multivariate time series by extending the d -variable Hilbert–Schmidt independence criterion to encompass both stationary and non-stationary processes, thus allowing broader real-world applications. By leveraging resampling techniques tailored for both single- and multiple-realization time series, we show how the method robustly uncovers significant higher-order dependencies in synthetic examples, including frequency mixing data and logic gates, as well as real-world climate, neuroscience and socio-economic data. Our method adds to the mathematical toolbox for the analysis of multivariate time series and can aid in uncovering high-order interactions in data.

multidisciplinary sciences
Testing the equality of multivariate means when $p>n$ by combining the Hoteling and Simes tests

Tzviel Frostig,Yoav Benjamini

DOI: https://doi.org/10.48550/arXiv.1912.10472

2019-12-23

Abstract:We propose a method of testing the shift between mean vectors of two multivariate Gaussian random variables in a high-dimensional setting incorporating the possible dependency and allowing $p > n$. This method is a combination of two well-known tests: the Hotelling test and the Simes test. The tests are integrated by sampling several dimensions at each iteration, testing each using the Hotelling test, and combining their results using the Simes test. We prove that this procedure is valid asymptotically. This procedure can be extended to handle non-equal covariance matrices by plugging in the appropriate extension of the Hotelling test. Using a simulation study, we show that the proposed test is advantageous over state-of-the-art tests in many scenarios and robust to violation of the Gaussian assumption.

Methodology
Generalized Independence Test for Modern Data

Mingshuo Liu,Doudou Zhou,Hao Chen

2024-09-12

Abstract:The test of independence is a crucial component of modern data analysis. However, traditional methods often struggle with the complex dependency structures found in high-dimensional data. To overcome this challenge, we introduce a novel test statistic that captures intricate relationships using similarity and dissimilarity information derived from the data. The statistic exhibits strong power across a broad range of alternatives for high-dimensional data, as demonstrated in extensive simulation studies. Under mild conditions, we show that the new test statistic converges to the $\chi^2_4$ distribution under the permutation null distribution, ensuring straightforward type I error control. Furthermore, our research advances the moment method in proving the joint asymptotic normality of multiple double-indexed permutation statistics. We showcase the practical utility of this new test with an application to the Genotype-Tissue Expression dataset, where it effectively measures associations between human tissues.

Methodology,Statistics Theory
A robust test approach for equality of mean vectors of two independent groups under the multivariate Behrens-Fisher problem

Hasan Bulut,Gülnur Karaosman

DOI: https://doi.org/10.1080/03610918.2024.2329237

2024-03-15

Communications in Statistics - Simulation and Computation

Abstract:In multivariate statistical inference, the Hotelling T2 statistic is used to test the equality of mean vectors for two independent groups. This statistic needs the multivariate normality and homogeneous covariance matrices assumptions. However, homogeneous covariance matrices assumption may not be provided in real applications. This case is called the multivariate Behrens-Fisher problem. There are several studies to test the equality of two mean vectors for the independent groups under the multivariate Behrens-fisher problem. But these studies do not interest in outliers at data sets. In this study, we propose solving problems caused by multivariate Behrens-Fisher and outliers in the dataset. We compare our proposed approach with other approaches regarding empirical size and power at simulated data that are both uncontaminated and contaminated. Thus we show that our proposed approach can be used to test the equality of mean vectors for two independent groups under multivariate Behrens-Fisher problem without being affected by outliers in the data. Moreover, we construct an R function in the MVTests package to use our proposed approach for real data applications.

statistics & probability
MATS: Inference for potentially singular and heteroscedastic MANOVA

Sarah Friedrich,Markus Pauly

DOI: https://doi.org/10.1016/j.jmva.2017.12.008

IF: 1.387

2018-05-01

Journal of Multivariate Analysis

Abstract:In many experiments in the life sciences, several endpoints are recorded per subject. The analysis of such multivariate data is usually based on MANOVA models assuming multivariate normality and covariance homogeneity. These assumptions, however, are often not met in practice. Furthermore, test statistics should be invariant under scale transformations of the data, since the endpoints may be measured on different scales. In the context of high-dimensional data, Srivastava and Kubokawa (2013) proposed such a test statistic for a specific one-way model; however, it relies on the assumption of a common non-singular covariance matrix. We modify and extend this test statistic to factorial MANOVA designs, incorporating general heteroscedastic models. In particular, our only distributional assumption is the existence of the group-wise covariance matrices, which may even be singular. We base inference on quantiles of resampling distributions, and derive confidence regions and ellipsoids based on these quantiles. In a simulation study, we extensively analyze the behavior of these procedures. Finally, the methods are applied to a data set containing information on the 2016 presidential elections in the USA with unequal and singular empirical covariance matrices.

statistics & probability
Distance multivariance: New dependence measures for random vectors

Björn Böttcher,Martin Keller-Ressel,René L. Schilling

DOI: https://doi.org/10.1214/18-AOS1764

2018-10-17

Abstract:We introduce two new measures for the dependence of $n \ge 2$ random variables: distance multivariance and total distance multivariance. Both measures are based on the weighted $L^2$-distance of quantities related to the characteristic functions of the underlying random variables. These extend distance covariance (introduced by Székely, Rizzo and Bakirov) from pairs of random variables to $n$-tuplets of random variables. We show that total distance multivariance can be used to detect the independence of $n$ random variables and has a simple finite-sample representation in terms of distance matrices of the sample points, where distance is measured by a continuous negative definite function. Under some mild moment conditions, this leads to a test for independence of multiple random vectors which is consistent against all alternatives.

Probability,Statistics Theory
Test for independence of long-range dependent time series using distance covariance

Annika Betken,Herold Dehling

2024-01-04

Abstract:We apply the concept of distance covariance for testing independence of two long-range dependent time series. As test statistic we propose a linear combination of empirical distance cross-covariances. We derive the asymptotic distribution of the test statistic, and we show consistency against arbitrary alternatives. The asymptotic theory developed in this paper is based on a novel non-central limit theorem for stochastic processes with values in an $L^2$-Hilbert space. This limit theorem is of general theoretical interest which goes beyond the context of this article. Subject to the dependence in the data, the standardization and the limit distributions of the proposed test statistic vary. Since the limit distributions are unknown, we propose a subsampling procedure to determine the critical values for the proposed test, and we provide a proof for the validity of subsampling. In a simulation study, we investigate the finite-sample behavior of our test, and we compare its performance to tests based on the empirical cross-covariances. As an application of our results we analyze the cross-dependencies between mean monthly discharges of three rivers.

Statistics Theory
Distance Correlation in Multiple Biased Sampling Models

Yuwei Ke,Hok Kan Ling,Yanglei Song

2024-08-22

Abstract:Testing the independence between random vectors is a fundamental problem in statistics. Distance correlation, a recently popular dependence measure, is universally consistent for testing independence against all distributions with finite moments. However, when data are subject to selection bias or collected from multiple sources or schemes, spurious dependence may arise. This creates a need for methods that can effectively utilize data from different sources and correct these biases. In this paper, we study the estimation of distance covariance and distance correlation under multiple biased sampling models, which provide a natural framework for addressing these issues. Theoretical properties, including the strong consistency and asymptotic null distributions of the distance covariance and correlation estimators, and the rate at which the test statistic diverges under sequences of alternatives approaching the null, are established. A weighted permutation procedure is proposed to determine the critical value of the independence test. Simulation studies demonstrate that our approach improves both the estimation of distance correlation and the power of the test.

Methodology,Statistics Theory
Asymptotic Distribution-Free Independence Test for High Dimension Data

Zhanrui Cai,Jing Lei,Kathryn Roeder

DOI: https://doi.org/10.48550/arXiv.2110.07652

2023-06-11

Abstract:Test of independence is of fundamental importance in modern data analysis, with broad applications in variable selection, graphical models, and causal inference. When the data is high dimensional and the potential dependence signal is sparse, independence testing becomes very challenging without distributional or structural assumptions. In this paper, we propose a general framework for independence testing by first fitting a classifier that distinguishes the joint and product distributions, and then testing the significance of the fitted classifier. This framework allows us to borrow the strength of the most advanced classification algorithms developed from the modern machine learning community, making it applicable to high dimensional, complex data. By combining a sample split and a fixed permutation, our test statistic has a universal, fixed Gaussian null distribution that is independent of the underlying data distribution. Extensive simulations demonstrate the advantages of the newly proposed test compared with existing methods. We further apply the new test to a single-cell data set to test the independence between two types of single-cell sequencing measurements, whose high dimensionality and sparsity make existing methods hard to apply.

Methodology

Discussion of 'Multivariate Fisher's independence test for multivariate dependence'

A hypothesis test for independence of sets of variates in high dimensions

Testing multivariate normality by testing independence

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Distribution-free tests of multivariate independence based on center-outward quadrant, Spearman, Kendall, and van der Waerden statistics

BET on Independence

Graphical tests of independence for general distributions

Towards a universal representation of statistical dependence

Testing independence in high dimensions with sums of rank correlations

Discussion of "A note on universal inference" by Timmy Tse and Anthony Davison

Testing Independence with High-Dimensional Correlated Samples

A nonparametric Bayesian test of dependence

Kernel-based joint independence tests for multivariate stationary and non-stationary time series

Testing the equality of multivariate means when $p>n$ by combining the Hoteling and Simes tests

Generalized Independence Test for Modern Data

A robust test approach for equality of mean vectors of two independent groups under the multivariate Behrens-Fisher problem

MATS: Inference for potentially singular and heteroscedastic MANOVA

Distance multivariance: New dependence measures for random vectors

Test for independence of long-range dependent time series using distance covariance

Distance Correlation in Multiple Biased Sampling Models

Asymptotic Distribution-Free Independence Test for High Dimension Data