Abstract:In this paper, we study distance covariance, Hilbert–Schmidt covariance (aka Hilbert–Schmidt independence criterion [In Advances in Neural Information Processing Systems (2008) 585–592]) and related independence tests under the high dimensional scenario. We show that the sample distance/Hilbert–Schmidt covariance between two random vectors can be approximated by the sum of squared componentwise sample cross-covariances up to an asymptotically constant factor, which indicates that the standard distance/Hilbert–Schmidt covariance based test can only capture linear dependence in high dimension. Under the assumption that the components within each high dimensional vector are weakly dependent, the distance correlation based $t$ test developed by Székely and Rizzo (J. Multivariate Anal. 117 (2013) 193–213) for independence is shown to have trivial limiting power when the two random vectors are nonlinearly dependent but component-wisely uncorrelated. This new and surprising phenomenon, which seems to be discovered and carefully studied for the first time, is further confirmed in our simulation study. As a remedy, we propose tests based on an aggregation of marginal sample distance/Hilbert–Schmidt covariances and show their superior power behavior against their joint counterparts in simulations. We further extend the distance correlation based $t$ test to those based on Hilbert–Schmidt covariance and marginal distance/Hilbert–Schmidt covariance. A novel unified approach is developed to analyze the studentized sample distance/Hilbert–Schmidt covariance as well as the studentized sample marginal distance covariance under both null and alternative hypothesis. Our theoretical and simulation results shed light on the limitation of distance/Hilbert–Schmidt covariance when used jointly in the high dimensional setting and suggest the aggregation of marginal distance/Hilbert–Schmidt covariance as a useful alternative.

Generalization of the HSIC and distance covariance using positive definite independent kernels

Invariant kernels on Riemannian symmetric spaces: a harmonic-analytic approach

Learning Deep Kernels for Non-Parametric Independence Testing

Conditionally positive definite kernels in Hilbert $C^*$-modules

Strictly positive definite kernels on two-point compact homogeneous spaces

Matrix valued positive definite kernels related to the generalized Aitken's integral for Gaussians

Generalized kernel distance covariance in high dimensions: non-null CLTs and power universality

Hilbert space valued Gaussian processes, their kernels, factorizations, and covariance structure

The Minimax Rate of HSIC Estimation for Translation-Invariant Kernels

New characterizations of reproducing kernel Hilbert spaces and applications to metric geometry

A new flexible class of kernel-based tests of independence

Distance-based and RKHS-based dependence metrics in high dimension

Positive definite singular kernels on two-point homogeneous spaces

Strict positive definiteness of convolutional and axially symmetric kernels on d-dimensional spheres

Invariant kernels on the space of complex covariance matrices

Invariance of Gaussian RKHSs under Koopman operators of stochastic differential equations with constant matrix coefficients

Product kernels are efficient and flexible tools for high-dimensional scattered data interpolation

Nonuniform sampling, reproducing kernels, and the associated Hilbert spaces

Strict positive definiteness on a product of compact two-point homogeneous spaces

Positive Definite Kernels, Algorithms, Frames, and Approximations

Strictly Positive Definite Kernels on a Product of Spheres II