Abstract:Statistical inference of the high-dimensional regression coefficients is challenging because the uncertainty introduced by the model selection procedure is hard to account for. Currently, the inference of the model and the inference of the coefficients are separately sought. A critical question remains unsettled; that is, is it possible to embed the inference of the model into the simultaneous inference of the coefficients? If so, then how to properly design a simultaneous inference tool with desired properties? To this end, we propose a notion of simultaneous confidence intervals called the sparsified simultaneous confidence intervals (SSCI). Our intervals are sparse in the sense that some of the intervals' upper and lower bounds are shrunken to zero (i.e., [0, 0]), indicating the unimportance of the corresponding covariates. These covariates should be excluded from the final model. The rest of the intervals, either containing zero (e.g., or [0, 1]) or not containing zero (e.g., [2, 3]), indicate the plausible and significant covariates, respectively. The SSCI intuitively suggests a lower-bound model with significant covariates only and an upper-bound model with plausible and significant covariates. The proposed method can be coupled with various selection procedures, making it ideal for comparing their uncertainty. For the proposed method, we establish desirable asymptotic properties, develop intuitive graphical tools for visualization, and justify its superior performance through simulation and real data analysis.

Fast and reliable confidence intervals for a variance component

On asymptotically optimal confidence regions and tests for high-dimensional models

EIGENVALUE DISTRIBUTIONS OF VARIANCE COMPONENTS ESTIMATORS IN HIGH-DIMENSIONAL RANDOM EFFECTS MODELS

Sparsified simultaneous confidence intervals for high-dimensional linear models

Confidence Intervals and Hypothesis Testing for High-Dimensional Regression

Variance Component Testing in Semiparametric Mixed Models

Fast and Fair Simultaneous Confidence Bands for Functional Parameters

Spline Confidence Bands for Variance Functions

An Approximate Restricted Likelihood Ratio Test for Variance Components in Generalized Linear Mixed Models

Variance Components Genetic Association Test for Zero-inflated Count Outcomes

Confidence intervals for parameters in high-dimensional sparse vector autoregression

Simultaneous Confidence Intervals for Partially Identified Parameters

Statistical Inference for Partially Linear Varying Coefficient Quantile Models with Missing Responses

Variance component score test for time-course gene set analysis of longitudinal RNA-seq data

Hypothesis testing at the extremes: fast and robust association for high-throughput data

Confidence Intervals for the Number of Components in Factor Analysis and Principal Components Analysis via Subsampling

Strong confidence intervals for autoregression

Confidence Corridors for Multivariate Generalized Quantile Regression

A Distribution-Free Test of Independence and Its Application to Variable Selection

Guaranteed Conservative Fixed Width Confidence Intervals Via Monte Carlo Sampling

Finite sample properties of the Buckland-Burnham-Augustin confidence interval centered on a model averaged estimator