Abstract:This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least squares after model selection. We show that by separating model selection and estimation, it is possible to achieve an improved rate of convergence of the L2 estimation error compared to the rate sqrt{s log p/n} achieved by simultaneous estimation and variable selection methods such as L1 penalized corrected least squares. If the correct model is selected with high probability then the L2 rate of convergence for the proposed method is indeed the oracle rate of sqrt{s/n}. Here s, p are the number of non zero parameters and the model dimension, respectively, and n is the sample size. Under very general model selection criteria, the proposed method is computationally simpler and statistically at least as efficient as the L1 penalized corrected least squares method, performs model selection without the availability of the bias correction matrix, and is able to provide estimates with only a small sub-block of the bias correction covariance matrix of order s x s in comparison to the p x p correction matrix required for computation of the L1 penalized version. Furthermore we show that the model selection requirements are met by a correlation screening type method and the L1 penalized corrected least squares method. Also, the proposed methodology when applied to the estimation of precision matrices with missing observations, is seen to perform at least as well as existing L1 penalty based methods. All results are supported empirically by a simulation study.

PENALIZED SPLINE NONPARAMETRIC MIXED MODELS FOR INFERENCE ABOUT A FINITE POPULATION MEAN FROM TWO -STAGE SAMPLES

Optimized estimation for population mean using conventional and non-conventional measures under the joint influence of measurement error and non-response

PENALIZED VARIABLE SELECTION PROCEDURE FOR COX MODELS WITH SEMIPARAMETRIC RELATIVE RISK

Penalized Spline Estimation for Partially Linear Single-Index Models

A Partially Linear Regression Model for Data from an Outcome-Dependent Sampling Design

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Model-based Inference for Two-Stage Cluster Samples Subject to Nonignorable Item Nonresponse

Doubly Robust Inference with Non-probability Survey Samples

Partial Linear Inference for a 2-Stage Outcome-Dependent Sampling Design with a Continuous Outcome.

Model-assisted sensitivity analysis for treatment effects under unmeasured confounding via regularized calibrated estimation

Two-stage, model-assisted estimation using remotely sensed auxiliary data

Semiparametric adaptive estimation under informative sampling

Optimal Predictors of General Small Area Parameters Under an Informative Sample Design Using Parametric Sample Distribution Models

Two Stage Non-penalized Corrected Least Squares for High Dimensional Linear Models with Measurement error or Missing Covariates

M-ESTIMATORS IN A PARTIAL LINEAR SINGLE-INDEX MODEL

Sampling Importance Resampling Algorithm with Nonignorable Missing Response Variable Based on Smoothed Quantile Regression

A penalized likelihood approach for efficiently estimating a partially linear additive transformation model with current status data

Penalty parameter selection and asymmetry corrections to Laplace approximations in Bayesian P-splines models

Fully Bayesian estimation under informative sampling

Non-Concave Penalization in Linear Mixed-Effects Models and Regularized Selection of Fixed Effects

Sample-constrained partial identification with application to selection bias