Abstract:Statistical inference of the high-dimensional regression coefficients is challenging because the uncertainty introduced by the model selection procedure is hard to account for. Currently, the inference of the model and the inference of the coefficients are separately sought. A critical question remains unsettled; that is, is it possible to embed the inference of the model into the simultaneous inference of the coefficients? If so, then how to properly design a simultaneous inference tool with desired properties? To this end, we propose a notion of simultaneous confidence intervals called the sparsified simultaneous confidence intervals (SSCI). Our intervals are sparse in the sense that some of the intervals' upper and lower bounds are shrunken to zero (i.e., [0, 0]), indicating the unimportance of the corresponding covariates. These covariates should be excluded from the final model. The rest of the intervals, either containing zero (e.g., or [0, 1]) or not containing zero (e.g., [2, 3]), indicate the plausible and significant covariates, respectively. The SSCI intuitively suggests a lower-bound model with significant covariates only and an upper-bound model with plausible and significant covariates. The proposed method can be coupled with various selection procedures, making it ideal for comparing their uncertainty. For the proposed method, we establish desirable asymptotic properties, develop intuitive graphical tools for visualization, and justify its superior performance through simulation and real data analysis.

Constant width simultaneous confidence bands in multiple linear regression with predictor variables constrained in intervals

EXACT SIMULTANEOUS CONFIDENCE BANDS IN MULTIPLE LINEAR REGRESSION WITH PREDICTOR VARIABLES CONSTRAINED IN INTERVALS

Optimal Simultaneous Confidence Bands in Multiple Linear Regression with Predictor Variables Constrained in an Ellipsoidal Region

Data Sharpening Method in Regression Confidence Band

A Simultaneous Confidence Band for Dense Longitudinal Regression

Adjusted Confidence Bands in Nonparametric Regression

Local Linear Multiple Regression with Variable Bandwidth in the Presence of Heteroscedasticity

A Simultaneous Confidence Band for Sparse Longitudinal Regression

Polynomial Spline Confidence Bands for Regression Curves

Fast and Fair Simultaneous Confidence Bands for Functional Parameters

Optimal Confidence Bands for Shape-restricted Regression in Multidimensions

A simple approach to construct confidence bands for a regression function with incomplete data

Simultaneous Confidence Band for Stationary Covariance Function of Dense Functional Data

Simultaneous Confidence Bands in Nonlinear Regression Models with Nonstationarity

SIMULTANEOUS CONFIDENCE BANDS FOR MEAN AND VARIANCE FUNCTIONS BASED ON DETERMINISTIC DESIGN

Confidence sets for a level set in linear regression

A Smooth Simultaneous Confidence Band for Conditional Variance Function

Spline Confidence Bands for Variance Functions

Sparsified simultaneous confidence intervals for high-dimensional linear models

Confldence Band for Additive Regression Model

Simultaneous Confidence Band for Partially Linear Panel Data Models with Fixed Effects