Abstract:In analyzing high-dimensional models, sparsity of the model parameter is a common but often undesirable assumption. In this paper, we study the following two-sample testing problem: given two samples generated by two high-dimensional linear models, we aim to test whether the regression coefficients of the two linear models are identical. We propose a framework named TIERS (short for TestIng Equality of Regression Slopes), which solves the two-sample testing problem without making any assumptions on the sparsity of the regression parameters. TIERS builds a new model by convolving the two samples in such a way that the original hypothesis translates into a new moment condition. A self-normalization construction is then developed to form a moment test. We provide rigorous theory for the developed framework. Under very weak conditions of the feature covariance, we show that the accuracy of the proposed test in controlling Type I errors is robust both to the lack of sparsity in the features and to the heavy tails in the error distribution, even when the sample size is much smaller than the feature dimension. Moreover, we discuss minimax optimality and efficiency properties of the proposed test. Simulation analysis demonstrates excellent finite-sample performance of our test. In deriving the test, we also develop tools that are of independent interest. The test is built upon a novel estimator, called Auto-aDaptive Dantzig Selector (ADDS), which not only automatically chooses an appropriate scale of the error term but also incorporates prior information. To effectively approximate the critical value of the test statistic, we develop a novel high-dimensional plug-in approach that complements the recent advances in Gaussian approximation theory.

GAP: A General Framework for Information Pooling in Two-Sample Sparse Inference

NAPA: Neighborhood-Assisted and Posterior-Adjusted Two-sample Inference

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Two-sample testing in non-sparse high-dimensional linear models

Incorporation of Sparsity Information in Large-scale Multiple Two-sample $t$ Tests

Testing Differential Networks with Applications to Detecting Gene-by-Gene Interactions.

Promoting Similarity of Sparsity Structures in Integrative Analysis With Penalization

Two-Sample Tests for High-Dimensional Linear Regression with an Application to Detecting Interactions.

Testing and Support Recovery of Multiple High-Dimensional Covariance Matrices with False Discovery Rate Control

A Regularization-Based Adaptive Test for High-Dimensional Generalized Linear Models

Scalable Inference for Massive Data

Simultaneous high-probability bounds on the false discovery proportion in structured, regression, and online settings

Two-Sample Covariance Matrix Testing and Support Recovery in High-Dimensional and Sparse Settings

On a Near-Optimal \& Efficient Algorithm for the Sparse Pooled Data Problem

Multiple Testing of Submatrices of a Precision Matrix with Applications to Identification of Between Pathway Interactions

Projection-based two-sample inference for sparsely observed multivariate functional data

Semi-Penalized Inference with Direct False Discovery Rate Control in High-Dimensions

Simultaneous Nonparametric Regression Analysis of Sparse Longitudinal Data

Pretest estimation in combining probability and non-probability samples

Is Seeing Believing? A Practitioner's Perspective on High-Dimensional Statistical Inference in Cancer Genomics Studies

When can Multi-Site Datasets be Pooled for Regression? Hypothesis Tests, $\ell_2$-consistency and Neuroscience Applications