Abstract:In a variety of applications, including nonparametric instrumental variable (NPIV) analysis, proximal causal inference under unmeasured confounding, and missing-not-at-random data with shadow variables, we are interested in inference on a continuous linear functional (e.g., average causal effects) of nuisance function (e.g., NPIV regression) defined by conditional moment restrictions. These nuisance functions are generally weakly identified, in that the conditional moment restrictions can be severely ill-posed as well as admit multiple solutions. This is sometimes resolved by imposing strong conditions that imply the function can be estimated at rates that make inference on the functional possible. In this paper, we study a novel condition for the functional to be strongly identified even when the nuisance function is not; that is, the functional is amenable to asymptotically-normal estimation at $\sqrt{n}$-rates. The condition implies the existence of debiasing nuisance functions, and we propose penalized minimax estimators for both the primary and debiasing nuisance functions. The proposed nuisance estimators can accommodate flexible function classes, and importantly they can converge to fixed limits determined by the penalization regardless of the identifiability of the nuisances. We use the penalized nuisance estimators to form a debiased estimator for the functional of interest and prove its asymptotic normality under generic high-level conditions, which provide for asymptotically valid confidence intervals. We also illustrate our method in a novel partially linear proximal causal inference problem and a partially linear instrumental variable regression problem.

Targeted Inference Involving High-Dimensional Data Using Nuisance Penalized Regression

Inference for possibly misspecified generalized linear models with nonpolynomial-dimensional nuisance parameters

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Estimation and Inference in Ultrahigh Dimensional Partially Linear Single-Index Models

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

Testing generalized linear models with high-dimensional nuisance parameter.

A Perturbation Method for Inference on Regularized Regression Estimates

Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis

Tests for ultrahigh-dimensional partially linear regression models

On High dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization

Inference in High-dimensional Multivariate Response Regression with Hidden Variables

Model-Free Statistical Inference on High-Dimensional Data

Inference on Strongly Identified Functionals of Weakly Identified Functions

High-Dimensional Censored Regression via the Penalized Tobit Likelihood

Inference for Partially Linear Quantile Regression Models in Ultrahigh Dimension

Inference on the Primary Parameter of Interest with the Aid of Dimension Reduction Estimation

Estimation and inference for high-dimensional nonparametric additive instrumental-variables regression

Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares

Exploring Dimension Learning Via a Penalized Probabilistic Principal Component Analysis

High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking

High-Dimensional Analysis for Generalized Nonlinear Regression: from Asymptotics to Algorithm