Abstract:In this paper, we study distance covariance, Hilbert–Schmidt covariance (aka Hilbert–Schmidt independence criterion [In Advances in Neural Information Processing Systems (2008) 585–592]) and related independence tests under the high dimensional scenario. We show that the sample distance/Hilbert–Schmidt covariance between two random vectors can be approximated by the sum of squared componentwise sample cross-covariances up to an asymptotically constant factor, which indicates that the standard distance/Hilbert–Schmidt covariance based test can only capture linear dependence in high dimension. Under the assumption that the components within each high dimensional vector are weakly dependent, the distance correlation based $t$ test developed by Székely and Rizzo (J. Multivariate Anal. 117 (2013) 193–213) for independence is shown to have trivial limiting power when the two random vectors are nonlinearly dependent but component-wisely uncorrelated. This new and surprising phenomenon, which seems to be discovered and carefully studied for the first time, is further confirmed in our simulation study. As a remedy, we propose tests based on an aggregation of marginal sample distance/Hilbert–Schmidt covariances and show their superior power behavior against their joint counterparts in simulations. We further extend the distance correlation based $t$ test to those based on Hilbert–Schmidt covariance and marginal distance/Hilbert–Schmidt covariance. A novel unified approach is developed to analyze the studentized sample distance/Hilbert–Schmidt covariance as well as the studentized sample marginal distance covariance under both null and alternative hypothesis. Our theoretical and simulation results shed light on the limitation of distance/Hilbert–Schmidt covariance when used jointly in the high dimensional setting and suggest the aggregation of marginal distance/Hilbert–Schmidt covariance as a useful alternative.

Universality of Estimator for High-Dimensional Linear Models with Block Dependency

Universality in block dependent linear models with applications to nonparametric regression

A hypothesis test for independence of sets of variates in high dimensions

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Robust Inference for High-dimensional Linear Models with Heavy-tailed Errors via Partial Gini Covariance

Asymptotics of Linear Regression with Linearly Dependent Data

ON BLOCKWISE AND REFERENCE PANEL-BASED ESTIMATORS FOR GENETIC DATA PREDICTION IN HIGH DIMENSIONS

Central limit theorems for high dimensional dependent data

Statistical Inference on High Dimensional Gaussian Graphical Regression Models

High-dimensional Simultaneous Inference on Non-Gaussian VAR Model via De-biased Estimator

On block-wise and reference panel-based estimators for genetic data prediction in high dimensions

High-dimensional copula-based Wasserstein dependence

High-Dimensional Single-Index Models: Link Estimation and Marginal Inference

Generalized kernel distance covariance in high dimensions: non-null CLTs and power universality

Information-theoretic evaluation of covariate distributions models

Generalized multi-view model: Adaptive density estimation under low-rank constraints

High-dimensional logistic regression with missing data: Imputation, regularization, and universality

The Asymptotic Properties of the Extreme Eigenvectors of High-dimensional Generalized Spiked Covariance Model

Distance-based and RKHS-based dependence metrics in high dimension

High-Dimensional Gaussian Graphical Regression Models with Covariates

High-dimensional analysis of variance in multivariate linear regression