Abstract:We consider the problem of uncertainty assessment for low dimensional components in high dimensional models. Specifically, we propose a decorrelated score function to handle the impact of high dimensional nuisance parameters. We consider both hypothesis tests and confidence regions for generic penalized M-estimators. Unlike most existing inferential methods which are tailored for individual models, our approach provides a general framework for high dimensional inference and is applicable to a wide range of applications. From the testing perspective, we develop general theorems to characterize the limiting distributions of the decorrelated score test statistic under both null hypothesis and local alternatives. These results provide asymptotic guarantees on the type I errors and local powers of the proposed test. Furthermore, we show that the decorrelated score function can be used to construct point and confidence region estimators that are semiparametrically efficient. We also generalize this framework to broaden its applications. First, we extend it to handle high dimensional null hypothesis, where the number of parameters of interest can increase exponentially fast with the sample size. Second, we establish the theory for model misspecification. Third, we go beyond the likelihood framework, by introducing the generalized score test based on general loss functions. Thorough numerical studies are conducted to back up the developed theoretical results.

Inference in High-Dimensional Linear Measurement Error Models

The Quadratic Inference Functions in Measurement Error Model for Longitudinal Data

Double-Estimation-Friendly Inference for High Dimensional Misspecified Measurement Error Models

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Inference for High‐dimensional Linear Models with Locally Stationary Error Processes

Decorrelated Empirical Likelihood for Generalized Linear Models with High-Dimensional Longitudinal Data

Overview of High-Dimensional Measurement Error Regression Models

A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Models

Restricted Estimation and Testing of Hypothesis in Linear Measurement Errors Models

Statistical Inference on Explained Variation in High-dimensional Linear Model with Dense Effects

A Simple Correction Procedure for High-Dimensional Generalized Linear Models with Measurement Error

High-Dimensional Single-Index Models: Link Estimation and Marginal Inference

Balanced Estimation for High-Dimensional Measurement Error Models.

Statistical Inference for Linear Regression Models with Additive Distortion Measurement Errors

On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization

Inference on Multiple Correlation Coefficients with Moderately High Dimensional Data

Statistical Inference for Varying-Coefficient Models with Error-Prone Covariates

Statistical Inference and Large-scale Multiple Testing for High-dimensional Regression Models

Statistical Inference for Regression Models with Covariate Measurement Error and Auxiliary Information.

Efficient Inference on High-Dimensional Linear Models with Missing Outcomes

Group Inference of High-Dimensional Single-Index Models