Abstract:In analyzing high-dimensional models, sparsity of the model parameter is a common but often undesirable assumption. In this paper, we study the following two-sample testing problem: given two samples generated by two high-dimensional linear models, we aim to test whether the regression coefficients of the two linear models are identical. We propose a framework named TIERS (short for TestIng Equality of Regression Slopes), which solves the two-sample testing problem without making any assumptions on the sparsity of the regression parameters. TIERS builds a new model by convolving the two samples in such a way that the original hypothesis translates into a new moment condition. A self-normalization construction is then developed to form a moment test. We provide rigorous theory for the developed framework. Under very weak conditions of the feature covariance, we show that the accuracy of the proposed test in controlling Type I errors is robust both to the lack of sparsity in the features and to the heavy tails in the error distribution, even when the sample size is much smaller than the feature dimension. Moreover, we discuss minimax optimality and efficiency properties of the proposed test. Simulation analysis demonstrates excellent finite-sample performance of our test. In deriving the test, we also develop tools that are of independent interest. The test is built upon a novel estimator, called Auto-aDaptive Dantzig Selector (ADDS), which not only automatically chooses an appropriate scale of the error term but also incorporates prior information. To effectively approximate the critical value of the test statistic, we develop a novel high-dimensional plug-in approach that complements the recent advances in Gaussian approximation theory.

TP2 DEPENDENCE OF SAMPLE SPACINGS WITH APPLICATIONS

Stochastic Comparisons And Dependence Of Spacings From Two Samples Of Exponential Random Variables

Dependence Structure of Spacings of Order Statistics

Stochastic comparisons of spacings from restricted families of distributions

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Dependence properties of order statistics☆

Stochastic Orderings Between P-Spacings of Generalized Order Statistics from Two Samples

Asymptotic Distribution Theory for Nonparametric Entropy Measures of Serial Dependence

Ordering Conditional Distributions of Spacings of Generalized Order Statistics

Some New Results On Likelihood Ratio Orderings For Spacings Of Heterogeneous Exponential Random Variables

Dependence Structure of a Class of Symmetric Distributions

Stochastic Properties of P-Spacings of Generalized Order Statistics

Multivariate Likelihood Ratio Orderings Between Spacings of Heterogeneous Exponential Random Variables

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

Stochastic comparisons of m-spacings

Two-sample testing in non-sparse high-dimensional linear models

Likelihood Ratio Order of M-Spacings for Two Samples

Negative dependence in the balls and bins experiment with applications to order statistics

Likelihood Ratio Orderings of Spacings of Heterogeneous Exponential Random Variables

Ordering p-spacings of generalized order statistics revisited

Stochastic Comparisons Of Spacings From Heterogeneous Samples