Abstract:We develop results for the use of Lasso and Post-Lasso methods to form first-stage predictions and estimate optimal instruments in linear instrumental variables (IV) models with many instruments, $p$. Our results apply even when $p$ is much larger than the sample size, $n$. We show that the IV estimator based on using Lasso or Post-Lasso in the first stage is root-n consistent and asymptotically normal when the first-stage is approximately sparse; i.e. when the conditional expectation of the endogenous variables given the instruments can be well-approximated by a relatively small set of variables whose identities may be unknown. We also show the estimator is semi-parametrically efficient when the structural error is homoscedastic. Notably our results allow for imperfect model selection, and do not rely upon the unrealistic "beta-min" conditions that are widely used to establish validity of inference following model selection. In simulation experiments, the Lasso-based IV estimator with a data-driven penalty performs well compared to recently advocated many-instrument-robust procedures. In an empirical example dealing with the effect of judicial eminent domain decisions on economic outcomes, the Lasso-based IV estimator outperforms an intuitive benchmark. In developing the IV results, we establish a series of new results for Lasso and Post-Lasso estimators of nonparametric conditional expectation functions which are of independent theoretical and practical interest. We construct a modification of Lasso designed to deal with non-Gaussian, heteroscedastic disturbances which uses a data-weighted $\ell_1$-penalty function. Using moderate deviation theory for self-normalized sums, we provide convergence rates for the resulting Lasso and Post-Lasso estimators that are as sharp as the corresponding rates in the homoscedastic Gaussian case under the condition that $\log p = o(n^{1/3})$.

Logit-based alternatives to two-stage least squares

Bias Reduction in Instrumental Variable Estimation through First-Stage Shrinkage

Bayesian variable selection in linear regression models with instrumental variables

Binary Outcomes, OLS, 2SLS and IV Probit

Bounded, efficient and multiply robust estimation of average treatment effects using instrumental variables

Minimax Instrumental Variable Regression and L_2 Convergence Guarantees Without Identification or Closedness

Instrumental variable analysis in the presence of unmeasured confounding

LASSO-type instrumental variable selection methods with an application to Mendelian randomization

Control Function Instrumental Variable Estimation of Nonlinear Causal Effect Models

Instrument-residual estimator for multi-valued instruments under full monotonicity

Doubly Robust Identification of Causal Effects of a Continuous Treatment using Discrete Instruments

Sequential Underspecified Instrument Selection for Cause-Effect Estimation

Two-stage least squares with a randomly right censored outcome

Estimation and inference for high-dimensional nonparametric additive instrumental-variables regression

Comparing the performance of two-stage residual inclusion methods when using physician's prescribing preference as an instrumental variable: unmeasured confounding and noncollapsibility

Estimation of average treatment effects for massively unbalanced binary outcomes

Nonparametric Instrumental Variable Regression through Stochastic Approximate Gradients

Estimating Causal Effects of Discrete and Continuous Treatments with Binary Instruments

Mostly Harmless Machine Learning: Learning Optimal Instruments in Linear IV Models

Sparse Models and Methods for Optimal Instruments with an Application to Eminent Domain

Selective Machine Learning of the Average Treatment Effect with an Invalid Instrumental Variable