Abstract:Xiaohui Chen, Kengo Kato. This paper studies inference for the mean vector of a high-dimensional $U$-statistic. In the era of big data, the dimension $d$ of the $U$-statistic and the sample size $n$ of the observations tend to be both large, and the computation of the $U$-statistic is prohibitively demanding. Data-dependent inferential procedures such as the empirical bootstrap for $U$-statistics is even more computationally expensive. To overcome such a computational bottleneck, incomplete $U$-statistics obtained by sampling fewer terms of the $U$-statistic are attractive alternatives. In this paper, we introduce randomized incomplete $U$-statistics with sparse weights whose computational cost can be made independent of the order of the $U$-statistic. We derive nonasymptotic Gaussian approximation error bounds for the randomized incomplete $U$-statistics in high dimensions, namely in cases where the dimension $d$ is possibly much larger than the sample size $n$, for both nondegenerate and degenerate kernels. In addition, we propose generic bootstrap methods for the incomplete $U$-statistics that are computationally much less demanding than existing bootstrap methods, and establish finite sample validity of the proposed bootstrap methods. Our methods are illustrated on the application to nonparametric testing for the pairwise independence of a high-dimensional random vector under weaker assumptions than those appearing in the literature.

Testing the Statistical Significance of an Ultra-High-Dimensional Naive Bayes Classifier

Testing Predictor Significance with Ultra High Dimensional Multivariate Responses

Penalized Independence Rule for Testing High-Dimensional Hypotheses

A Two-Sample Test of High Dimensional Means Based on Posterior Bayes Factor

Model-Free Feature Screening for Ultrahigh Dimensional Discriminant Analysis

Strong Sure Screening of Ultra-high Dimensional Categorical Data

A Normality Test for High-dimensional Data Based on the Nearest Neighbor Approach

Simulation-Based Hypothesis Testing of High Dimensional Means Under Covariance Heterogeneity

Two sample test for covariance matrices in ultra-high dimension

A Unified Framework for Testing High Dimensional Parameters: A Data-Adaptive Approach.

Model-Free Statistical Inference on High-Dimensional Data

A Unified Framework for Testing High Dimensional Parameters: A Data-Adaptive Approach

Asymptotic Distribution-Free Independence Test for High Dimension Data

Two-sample Test in High Dimensions Through Random Selection.

Testing High Dimensional Covariance Matrices Via Posterior Bayes Factor.

A Na&#x00ef;ve Bayesian Classifier in Categorical Uncertain Data Streams

Randomized incomplete $U$-statistics in high dimensions

Two-Sample Test for Sparse High Dimensional Multinomial Distributions

Testing the Mean Vector for High-Dimensional Data

High-Dimensional U-Statistics Type Hypothesis Testing via Jackknife Pseudo-Values with Multiplier Bootstrap

SURE Estimates for High Dimensional Classification