Abstract:Testing the significance of a variable or group of variables $X$ for predicting a response $Y$, given additional covariates $Z$, is a ubiquitous task in statistics. A simple but common approach is to specify a linear model, and then test whether the regression coefficient for $X$ is non-zero. However, when the model is misspecified, the test may have poor power, for example when $X$ is involved in complex interactions, or lead to many false rejections. In this work we study the problem of testing the model-free null of conditional mean independence, i.e. that the conditional mean of $Y$ given $X$ and $Z$ does not depend on $X$. We propose a simple and general framework that can leverage flexible nonparametric or machine learning methods, such as additive models or random forests, to yield both robust error control and high power. The procedure involves using these methods to perform regressions, first to estimate a form of projection of $Y$ on $X$ and $Z$ using one half of the data, and then to estimate the expected conditional covariance between this projection and $Y$ on the remaining half of the data. While the approach is general, we show that a version of our procedure using spline regression achieves what we show is the minimax optimal rate in this nonparametric testing problem. Numerical experiments demonstrate the effectiveness of our approach both in terms of maintaining Type I error control, and power, compared to several existing approaches.

Variance-estimation-free Test of Significant Covariates in High-Dimensional Regression

Testing covariates in high-dimensional regression

A hypothesis test for independence of sets of variates in high dimensions

Testing Regression Coefficients in High-Dimensional and Sparse Settings

Score Function-Based Tests for Ultrahigh-Dimensional Linear Models

A New Nonparametric Test for High-Dimensional Regression Coefficients

Testing a Single Regression Coefficient in High Dimensional Linear Models

Testing a Single Regression Coefficient in High Dimensional Regression Model

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Testing for the Presence of Significant Covariates Through Conditional Marginal Regression

A New Test for Part of High Dimensional Regression Coefficients.

Dimension Reduction-Based Significance Testing in Nonparametric Regression

Penalized Independence Rule for Testing High-Dimensional Hypotheses

The Projected Covariance Measure for assumption-lean variable significance testing

HYPOTHESIS TESTING ON LINEAR STRUCTURES OF HIGH DIMENSIONAL COVARIANCE MATRIX.

On the Test of Covariance Between Two High-Dimensional Random Vectors

Variance Estimation Using Refitted Cross-Validation in Ultrahigh Dimensional Regression.

Tests for High-Dimensional Generalized Linear Models under General Covariance Structure

Test for high dimensional partially linear models

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

High-dimensional analysis of variance in multivariate linear regression