Abstract:We consider the problem of uncertainty assessment for low dimensional components in high dimensional models. Specifically, we propose a decorrelated score function to handle the impact of high dimensional nuisance parameters. We consider both hypothesis tests and confidence regions for generic penalized M-estimators. Unlike most existing inferential methods which are tailored for individual models, our approach provides a general framework for high dimensional inference and is applicable to a wide range of applications. From the testing perspective, we develop general theorems to characterize the limiting distributions of the decorrelated score test statistic under both null hypothesis and local alternatives. These results provide asymptotic guarantees on the type I errors and local powers of the proposed test. Furthermore, we show that the decorrelated score function can be used to construct point and confidence region estimators that are semiparametrically efficient. We also generalize this framework to broaden its applications. First, we extend it to handle high dimensional null hypothesis, where the number of parameters of interest can increase exponentially fast with the sample size. Second, we establish the theory for model misspecification. Third, we go beyond the likelihood framework, by introducing the generalized score test based on general loss functions. Thorough numerical studies are conducted to back up the developed theoretical results.

ON CONFIDENCE REGIONS OF SEMIPARAMETRIC NONLINEAR REGRESSION MODELS (A GEOMETRIC APPROACH)

A Geometric Approach to Confidence Regions and Bands for Functional Parameters

On asymptotically optimal confidence regions and tests for high-dimensional models

A Likelihood Ratio Framework for High Dimensional Semiparametric Regression

Adaptive Confidence Intervals For Regression Functions Under Shape Constraints

A TRUST-REGION METHOD FOR NONSMOOTH NONCONVEX OPTIMIZATION

Finite Sample Confidence Regions for Linear Regression Parameters Using Arbitrary Predictors

A Confidence Corridor for Sparse Longitudinal Data Curves

Statistical inference in functional semiparametric spatial autoregressive model

Asymptotic Efficient Estimation in Semiparametric Nonlinear Regression Models

On the Construction of Confidence Regions for Uncertain Planar Displacements

From Conformal Predictions to Confidence Regions

A General Theory of Hypothesis Tests and Confidence Regions for Sparse High Dimensional Models

A Geometric Perspective on Double Robustness by Semiparametric Theory and Information Geometry

Polynomial Spline Confidence Bands for Regression Curves

Local Asymptotic Behavior of Regression Splines for Marginal Semiparametric Models with Longitudinal Data

A nonmonotone adaptive trust region method for unconstrained optimization based on conic model

A new nonmonotone trust-region method of conic model for solving unconstrained optimization

A Robust Hessian-based Trust Region Algorithm for Spherical Conformal Parameterizations

An adaptive simple model trust region algorithm based on new weak secant equations

Linear programming approach to nonparametric inference under shape restrictions: with an application to regression kink designs