Abstract:In analyzing high-dimensional models, sparsity of the model parameter is a common but often undesirable assumption. In this paper, we study the following two-sample testing problem: given two samples generated by two high-dimensional linear models, we aim to test whether the regression coefficients of the two linear models are identical. We propose a framework named TIERS (short for TestIng Equality of Regression Slopes), which solves the two-sample testing problem without making any assumptions on the sparsity of the regression parameters. TIERS builds a new model by convolving the two samples in such a way that the original hypothesis translates into a new moment condition. A self-normalization construction is then developed to form a moment test. We provide rigorous theory for the developed framework. Under very weak conditions of the feature covariance, we show that the accuracy of the proposed test in controlling Type I errors is robust both to the lack of sparsity in the features and to the heavy tails in the error distribution, even when the sample size is much smaller than the feature dimension. Moreover, we discuss minimax optimality and efficiency properties of the proposed test. Simulation analysis demonstrates excellent finite-sample performance of our test. In deriving the test, we also develop tools that are of independent interest. The test is built upon a novel estimator, called Auto-aDaptive Dantzig Selector (ADDS), which not only automatically chooses an appropriate scale of the error term but also incorporates prior information. To effectively approximate the critical value of the test statistic, we develop a novel high-dimensional plug-in approach that complements the recent advances in Gaussian approximation theory.

Two-Stage Testing in a high dimensional setting

Two-Sample Tests for High-Dimensional Linear Regression with an Application to Detecting Interactions.

Two-stage Hypothesis Tests for Variable Interactions with FDR Control

Analysis of error control in large scale two-stage multiple hypothesis testing

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Testing covariates in high-dimensional regression

Two-Stage Penalized Regression Screening to Detect Biomarker-Treatment Interactions in Randomized Clinical Trials

Testing a Single Regression Coefficient in High Dimensional Linear Models

Testing a Single Regression Coefficient in High Dimensional Regression Model

Large-Scale Multiple Testing of Correlations

A Sequential Significance Test for Treatment by Covariate Interactions

Joint testing and false discovery rate control in high-dimensional multivariate regression.

Multiple two-sample testing under arbitrary covariance dependency with an application in imaging mass spectrometry

On Construction of Single-Arm Two-Stage Designs with Consideration of Both Response and Toxicity

Optimal exact tests for multiple binary endpoints

Robustness of multiple testing procedures against dependence

Multiple multi-sample testing under arbitrary covariance dependency

Testing Regression Coefficients in High-Dimensional and Sparse Settings

Interaction screening in high-dimensional multi-response regression via projected distance correlation

Two-sample testing in non-sparse high-dimensional linear models

Testing Psychological Hypotheses Addressing Two Independent Variables and One Dependent Variable