Abstract:This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least squares after model selection. We show that by separating model selection and estimation, it is possible to achieve an improved rate of convergence of the L2 estimation error compared to the rate sqrt{s log p/n} achieved by simultaneous estimation and variable selection methods such as L1 penalized corrected least squares. If the correct model is selected with high probability then the L2 rate of convergence for the proposed method is indeed the oracle rate of sqrt{s/n}. Here s, p are the number of non zero parameters and the model dimension, respectively, and n is the sample size. Under very general model selection criteria, the proposed method is computationally simpler and statistically at least as efficient as the L1 penalized corrected least squares method, performs model selection without the availability of the bias correction matrix, and is able to provide estimates with only a small sub-block of the bias correction covariance matrix of order s x s in comparison to the p x p correction matrix required for computation of the L1 penalized version. Furthermore we show that the model selection requirements are met by a correlation screening type method and the L1 penalized corrected least squares method. Also, the proposed methodology when applied to the estimation of precision matrices with missing observations, is seen to perform at least as well as existing L1 penalty based methods. All results are supported empirically by a simulation study.

Estimation and Inference in Two-Step Econometric Models

Recent Developments in Inference: Practicalities for Applied Economics

On econometric inference and multiple use of the same data

Model-based Inference for Two-Stage Cluster Samples Subject to Nonignorable Item Nonresponse

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Two-Stage Maximum Score Estimator

Estimation and Inference for Linear Models with Two-Way Fixed Effects and Sparsely Matched Data

On the Use of Two-Way Fixed Effects Regression Models for Causal Inference with Panel Data

Inference for Regression with Variables Generated from Unstructured Data

Inference for Two-Stage Extremum Estimators

TWO-STEP ESTIMATION OF QUANTILE PANEL DATA MODELS WITH INTERACTIVE FIXED EFFECTS

Inference in High-Dimensional Linear Measurement Error Models

Fixed-b Estimation and Inference in Heterogenous Dynamic Cointegrated Panels

On "Imputation of Counterfactual Outcomes when the Errors are Predictable": Discussions on Misspecification and Suggestions of Sensitivity Analyses

On the Effect of Imputation on the 2SLS Variance

probitfe and logitfe: Bias corrections for probit and logit models with two-way fixed effects

Introducing Ph.D. students to asymptotic inference for two‐stage M‐estimators: Easing analytic and coding demands via the use of numerical derivatives

Inference on estimators defined by mathematical programming

Adaptive Estimation and Uniform Confidence Bands for Nonparametric Structural Functions and Elasticities

Measurement error in two-stage analyses, with application to air pollution epidemiology

Two Stage Non-penalized Corrected Least Squares for High Dimensional Linear Models with Measurement error or Missing Covariates