Abstract:This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least squares after model selection. We show that by separating model selection and estimation, it is possible to achieve an improved rate of convergence of the L2 estimation error compared to the rate sqrt{s log p/n} achieved by simultaneous estimation and variable selection methods such as L1 penalized corrected least squares. If the correct model is selected with high probability then the L2 rate of convergence for the proposed method is indeed the oracle rate of sqrt{s/n}. Here s, p are the number of non zero parameters and the model dimension, respectively, and n is the sample size. Under very general model selection criteria, the proposed method is computationally simpler and statistically at least as efficient as the L1 penalized corrected least squares method, performs model selection without the availability of the bias correction matrix, and is able to provide estimates with only a small sub-block of the bias correction covariance matrix of order s x s in comparison to the p x p correction matrix required for computation of the L1 penalized version. Furthermore we show that the model selection requirements are met by a correlation screening type method and the L1 penalized corrected least squares method. Also, the proposed methodology when applied to the estimation of precision matrices with missing observations, is seen to perform at least as well as existing L1 penalty based methods. All results are supported empirically by a simulation study.

Adaptive Unified Biased Estimators of Parameters in Linear Model

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

Inference for High-Dimensional Linear Expectile Regression with De-Biasing Method

The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

The Optimal Property of Almost Unbiased Stein Ridge Type Principal Component Estimator Under Mean Square Error

Covariate-adjusted response-adaptive designs for generalized linear models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

Robust Liu Estimator Used to Combat Some Challenges in Partially Linear Regression Model by Improving LTS Algorithm Using Semidefinite Programming

The Unbiasedness Approach to Linear Regression Models

Liu-type estimator in Conway–Maxwell–Poisson regression model: theory, simulation and application

Bayes estimator for the inequality-constrained regression model*

Transformation of Rhododendron through microprojectile bombardment

Parameter Estimator Suitable For Some Bad Samples

Two Stage Non-penalized Corrected Least Squares for High Dimensional Linear Models with Measurement error or Missing Covariates

Adaptive Linear Estimating Equations

A Unified Variable Selection Approach for Varying Coefficient Models

New biased estimators for the Conway–Maxwell-Poisson Model

A Nonprobabilistic Approach for Linear Model Selection

Constrained Best Linear Unbiased Estimation

Strong Consistency of Maximum Quasi-Likelihood Estimators in Generalized Linear Models with Fixed and Adaptive Designs

Liu-type Negative Binomial Regression: A Comparison of Recent Estimators and Applications