Abstract:This paper studies the asymptotic properties of the adaptive elastic net in ultra-high dimensional sparse linear regression models and proposes a new method called SSLS (Separate Selection from Least Squares) to improve prediction accuracy. Besides, we prove that SSLS has the superior performance both in the theoretical part and empirical part. In this paper, we prove that the probability of adaptive elastic net selecting wrong variables can decays at an exponential rate with very few conditions. Irrepresentable Condition or similar constraint isn't necessary in our proof. We derive accurate bounds of bias and mean squared error (MSE) which both depend on the choice of parameters, and also show that there exists a bias of asymptotic normality of the adaptive elastic net. Furthermore, simulations and empirical part both show that the prediction accuracy of the penalized least squares requires more improvement. Therefore, we propose SSLS to improve the prediction. It selects variable first, reducing high dimension to low dimension by using the adaptive elastic net in this paper. In the second step, the coefficients are constructed based on the OLS estimation. We show that the bias of SSLS can decays at an exponential rate. Also, MSE decays to zero. Finally, we prove that the variable selection consistency of SSLS implies the asymptotic normality of SSLS. Simulations given in this paper illustrate the performance of the SSLS, adaptive elastic net and other penalized least squares. The index tracking problem in stock market is studied in the empirical part with other methods.

Robust Error Density Estimation in Ultrahigh Dimensional Sparse Linear Model

Robust Estimation and Shrinkage in Ultrahigh Dimensional Expectile Regression with Heavy Tails and Variance Heterogeneity

Error Density Estimation in High-Dimensional Sparse Linear Model

RCV-based Error Density Estimation in the Ultrahigh Dimensional Additive Model

Expectile regression for analyzing heteroscedasticity in high dimension

High Dimensional Robust Sparse Regression

Ultrahigh dimensional precision matrix estimation via refitted cross validation

SCAD-Ridge Penalized Likelihood Estimators for Ultra-high Dimensional Models

Feature Screening and Error Variance Estimation for Ultrahigh-Dimensional Linear Model with Measurement Errors

Large-Dimensional Positive Definite Covariance Estimation for High Frequency Data via Low-rank and Sparse Matrix Decomposition

Sparse Semiparametric Efficient Estimation in High-Dimensional Linear Regression Models

Variance estimation for sparse ultra-high dimensional varying coefficient models

Variance Estimation Using Refitted Cross-Validation in Ultrahigh Dimensional Regression.

Adaptive Elastic Net and Separate Selection from Least Squares for Ultra-High Dimensional Regression Models

Double-Estimation-Friendly Inference for High Dimensional Misspecified Measurement Error Models

Penalized Sparse Covariance Regression with High Dimensional Covariates

Estimation of Error Variance Via Ridge Regression

Low-Rank-Sparse Subspace Representation for Robust Regression

Marginal Empirical Likelihood Independence Screening in Sparse Ultrahigh Dimensional Additive Models

A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates

A Constructive Approach to High-dimensional Regression