Abstract:We study asymptotically normal estimation and confidence regions for low-dimensional parameters in high-dimensional sparse models. Our approach is based on the $\ell_1$-penalized M-estimator which is used for construction of a bias corrected estimator. We show that the proposed estimator is asymptotically normal, under a sparsity assumption on the high-dimensional parameter, smoothness conditions on the expected loss and an entropy condition. This leads to uniformly valid confidence regions and hypothesis testing for low-dimensional parameters. The present approach is different in that it allows for treatment of loss functions that we not sufficiently differentiable, such as quantile loss, Huber loss or hinge loss functions. We also provide new results for estimation of the inverse Fisher information matrix, which is necessary for the construction of the proposed estimator. We formulate our results for general models under high-level conditions, but investigate these conditions in detail for generalized linear models and provide mild sufficient conditions. As particular examples, we investigate the case of quantile loss and Huber loss in linear regression and demonstrate the performance of the estimators in a simulation study and on real datasets from genome-wide association studies. We further investigate the case of logistic regression and illustrate the performance of the estimator on simulated and real data.

Error Density Estimation in High-Dimensional Sparse Linear Model

Robust Error Density Estimation in Ultrahigh Dimensional Sparse Linear Model

RCV-based Error Density Estimation in the Ultrahigh Dimensional Additive Model

Sparse Semiparametric Efficient Estimation in High-Dimensional Linear Regression Models

Variance estimation for sparse ultra-high dimensional varying coefficient models

Estimation of Linear Functionals in High-Dimensional Linear Models: From Sparsity to Nonsparsity

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Large-Dimensional Positive Definite Covariance Estimation for High Frequency Data via Low-rank and Sparse Matrix Decomposition

Feature Screening and Error Variance Estimation for Ultrahigh-Dimensional Linear Model with Measurement Errors

Inference in High-Dimensional Linear Measurement Error Models

Estimation and Inference for High-Dimensional Non-Sparse Models

Sparsity Identification for High-Dimensional Partially Linear Model with Measurement Error.

Confidence regions for high-dimensional generalized linear models under sparsity

Sparse kernel density estimations and its application in variable selection based on quadratic Renyi entropy

Adaptive posterior concentration rates for sparse high-dimensional linear regression with random design and unknown error variance

Statistical Inference on Explained Variation in High-dimensional Linear Model with Dense Effects

Penalized Sparse Covariance Regression with High Dimensional Covariates

High Dimensional Robust Sparse Regression

Semiparametric efficient estimation in high‐dimensional partial linear regression models

Self-Consistent Density Estimation in the Presence of Errors-in-Variables

Estimation of Error Variance Via Ridge Regression