Abstract:Statistical inference of the high-dimensional regression coefficients is challenging because the uncertainty introduced by the model selection procedure is hard to account for. Currently, the inference of the model and the inference of the coefficients are separately sought. A critical question remains unsettled; that is, is it possible to embed the inference of the model into the simultaneous inference of the coefficients? If so, then how to properly design a simultaneous inference tool with desired properties? To this end, we propose a notion of simultaneous confidence intervals called the sparsified simultaneous confidence intervals (SSCI). Our intervals are sparse in the sense that some of the intervals' upper and lower bounds are shrunken to zero (i.e., [0, 0]), indicating the unimportance of the corresponding covariates. These covariates should be excluded from the final model. The rest of the intervals, either containing zero (e.g., or [0, 1]) or not containing zero (e.g., [2, 3]), indicate the plausible and significant covariates, respectively. The SSCI intuitively suggests a lower-bound model with significant covariates only and an upper-bound model with plausible and significant covariates. The proposed method can be coupled with various selection procedures, making it ideal for comparing their uncertainty. For the proposed method, we establish desirable asymptotic properties, develop intuitive graphical tools for visualization, and justify its superior performance through simulation and real data analysis.

Multimodel Inference Based on Smoothed Information Criteria

Statistical Inference for Generalized Additive Models: Simultaneous Confidence Corridors and Variable Selection

Sparsified simultaneous confidence intervals for high-dimensional linear models

A Robust Consistent Information Criterion for Model Selection Based on Empirical Likelihood

Simultaneous identification of models and parameters of scientific simulators

Simultaneous semiparametric inference for single-index models

Learning under Singularity: An Information Criterion improving WBIC and sBIC

Semi-Modular Inference: enhanced learning in multi-modular models by tempering the influence of components

Inference in Varying-Coefficient Mixed Models by Using Smoothing Spline

Bias-corrected Smoothed Score Function for Single-Index Models

Model Selection Principles in Misspecified Models

Bayesian Analysis for Semiparametric Mixed-E®ects Double Regression Models

Variable Selection Using a Smooth Information Criterion for Distributional Regression Models

Multi-Step-Adjustment Consistent Inference for Biased Sub-Model of Multidimensional Linear Regression

Model Selection for Mixtures of Factor Analyzers via Hierarchical BIC

A simple application of FIC to model selection

The Focused Information Criterion for Stochastic Model Selection Problems Using $M$-Estimators

A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike’s information criterion

Information based model selection criteria for generalized linear mixed models with unknown variance component parameters

Posterior Averaging Information Criterion

Consistent Model Selection Procedure for Random Coefficient INAR Models