Abstract:In this paper, we study distance covariance, Hilbert–Schmidt covariance (aka Hilbert–Schmidt independence criterion [In Advances in Neural Information Processing Systems (2008) 585–592]) and related independence tests under the high dimensional scenario. We show that the sample distance/Hilbert–Schmidt covariance between two random vectors can be approximated by the sum of squared componentwise sample cross-covariances up to an asymptotically constant factor, which indicates that the standard distance/Hilbert–Schmidt covariance based test can only capture linear dependence in high dimension. Under the assumption that the components within each high dimensional vector are weakly dependent, the distance correlation based $t$ test developed by Székely and Rizzo (J. Multivariate Anal. 117 (2013) 193–213) for independence is shown to have trivial limiting power when the two random vectors are nonlinearly dependent but component-wisely uncorrelated. This new and surprising phenomenon, which seems to be discovered and carefully studied for the first time, is further confirmed in our simulation study. As a remedy, we propose tests based on an aggregation of marginal sample distance/Hilbert–Schmidt covariances and show their superior power behavior against their joint counterparts in simulations. We further extend the distance correlation based $t$ test to those based on Hilbert–Schmidt covariance and marginal distance/Hilbert–Schmidt covariance. A novel unified approach is developed to analyze the studentized sample distance/Hilbert–Schmidt covariance as well as the studentized sample marginal distance covariance under both null and alternative hypothesis. Our theoretical and simulation results shed light on the limitation of distance/Hilbert–Schmidt covariance when used jointly in the high dimensional setting and suggest the aggregation of marginal distance/Hilbert–Schmidt covariance as a useful alternative.

The Impossibility of Testing for Dependence Using Kendall's $τ$ Under Missing Data of Unknown Form

Kendall's Tau for Functional Data Analysis

Tail Dependence Measure for Examining Financial Extreme Co-Movements

An adaptive test of the independence of high-dimensional data based on Kendall rank correlation coefficient

Testing for Changes in Kendall's Tau

Asymptotic Distribution Theory for Nonparametric Entropy Measures of Serial Dependence

On kernel-based estimation of conditional Kendall's tau: finite-distance bounds and asymptotic behavior

Asymptotic Uncertainty of False Discovery Proportion for Dependent $t$-Tests

Interval Estimation for a Measure of Tail Dependence

Randomization Tests for Equality in Dependence Structure

Ordinal pattern dependence as a multivariate dependence measure

Detecting practically significant dependencies in infinite dimensional data via distance correlations

Testing for Pairwise Serial Independence Via the Empirical Distribution Function

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Independence Testing for Temporal Data

Rearranged dependence measures

Testing independence in high dimensions with sums of rank correlations

Distance-based and RKHS-based dependence metrics in high dimension

Universally Consistent K-Sample Tests via Dependence Measures

Upper Bound for the Expected Minimum of Dependent Random Variables with Known Kendall's Tau

Missing at Random or Not: A Semiparametric Testing Approach