Abstract:In this paper, we study distance covariance, Hilbert–Schmidt covariance (aka Hilbert–Schmidt independence criterion [In Advances in Neural Information Processing Systems (2008) 585–592]) and related independence tests under the high dimensional scenario. We show that the sample distance/Hilbert–Schmidt covariance between two random vectors can be approximated by the sum of squared componentwise sample cross-covariances up to an asymptotically constant factor, which indicates that the standard distance/Hilbert–Schmidt covariance based test can only capture linear dependence in high dimension. Under the assumption that the components within each high dimensional vector are weakly dependent, the distance correlation based $t$ test developed by Székely and Rizzo (J. Multivariate Anal. 117 (2013) 193–213) for independence is shown to have trivial limiting power when the two random vectors are nonlinearly dependent but component-wisely uncorrelated. This new and surprising phenomenon, which seems to be discovered and carefully studied for the first time, is further confirmed in our simulation study. As a remedy, we propose tests based on an aggregation of marginal sample distance/Hilbert–Schmidt covariances and show their superior power behavior against their joint counterparts in simulations. We further extend the distance correlation based $t$ test to those based on Hilbert–Schmidt covariance and marginal distance/Hilbert–Schmidt covariance. A novel unified approach is developed to analyze the studentized sample distance/Hilbert–Schmidt covariance as well as the studentized sample marginal distance covariance under both null and alternative hypothesis. Our theoretical and simulation results shed light on the limitation of distance/Hilbert–Schmidt covariance when used jointly in the high dimensional setting and suggest the aggregation of marginal distance/Hilbert–Schmidt covariance as a useful alternative.

Generalized kernel distance covariance in high dimensions: non-null CLTs and power universality

ASYMPTOTIC DISTRIBUTIONS OF HIGH-DIMENSIONAL DISTANCE CORRELATION INFERENCE

A hypothesis test for independence of sets of variates in high dimensions

Distance-based and RKHS-based dependence metrics in high dimension

Eigenvalue Distribution of a High-Dimensional Distance Covariance Matrix with Application

On the Decreasing Power of Kernel and Distance Based Nonparametric Hypothesis Tests in High Dimensions

Kernel Two-Sample Tests in High Dimension: Interplay Between Moment Discrepancy and Dimension-and-Sample Orders

Sample canonical correlation coefficients of high-dimensional random vectors: local law and Tracy-Widom limit

Distance Correlation Test for High-Dimensional Independence

Detecting practically significant dependencies in infinite dimensional data via distance correlations

The Chi-Square Test of Distance Correlation

Sample canonical correlation coefficients of high-dimensional random vectors with finite rank correlations

High dimensional correlation matrices: the central limit theorem and its applications

Testing Independence with High-Dimensional Correlated Samples

Testing High-dimensional Covariance Matrices under the Elliptical Distribution and Beyond

A High-dimensional Convergence Theorem for U-statistics with Applications to Kernel-based Testing

Generalised Covariances and Correlations

Generalization of the HSIC and distance covariance using positive definite independent kernels

Distribution-free tests of multivariate independence based on center-outward quadrant, Spearman, Kendall, and van der Waerden statistics

Spectral properties of high dimensional rescaled sample correlation matrices

Notes on the dimension dependence in high-dimensional central limit theorems for hyperrectangles