Abstract:This paper studies the asymptotic properties of the adaptive elastic net in ultra-high dimensional sparse linear regression models and proposes a new method called SSLS (Separate Selection from Least Squares) to improve prediction accuracy. Besides, we prove that SSLS has the superior performance both in the theoretical part and empirical part. In this paper, we prove that the probability of adaptive elastic net selecting wrong variables can decays at an exponential rate with very few conditions. Irrepresentable Condition or similar constraint isn't necessary in our proof. We derive accurate bounds of bias and mean squared error (MSE) which both depend on the choice of parameters, and also show that there exists a bias of asymptotic normality of the adaptive elastic net. Furthermore, simulations and empirical part both show that the prediction accuracy of the penalized least squares requires more improvement. Therefore, we propose SSLS to improve the prediction. It selects variable first, reducing high dimension to low dimension by using the adaptive elastic net in this paper. In the second step, the coefficients are constructed based on the OLS estimation. We show that the bias of SSLS can decays at an exponential rate. Also, MSE decays to zero. Finally, we prove that the variable selection consistency of SSLS implies the asymptotic normality of SSLS. Simulations given in this paper illustrate the performance of the SSLS, adaptive elastic net and other penalized least squares. The index tracking problem in stock market is studied in the empirical part with other methods.

Nonnegative Elastic Net and application in index tracking

Nonnegative-lasso and application in index tracking

Nonnegative Sparse Group Lasso with an Application in Financial Index Tracking

Nonnegative Estimation and Variable Selection Via Adaptive Elastic-Net for High-Dimensional Data

A Kind of New Time-Weighted Nonnegative Lasso Index-Tracking Model and Its Application

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

Sparse Index Tracking With K-Sparsity or ε-Deviation Constraint via l0-Norm Minimization

On Model Selection Consistency of the Elastic Net when P >> N

Index Tracing Using Variable Selection Based on Adaptive Lasso

Sparse Index Tracking: Simultaneous Asset Selection and Capital Allocation via $\ell_0$-Constrained Portfolio

Adaptive Elastic Net and Separate Selection from Least Squares for Ultra-High Dimensional Regression Models

Index Tracking Based on LARS-Lasso and Its Application to Stock Index Future Arbitrage

Sparse Index Tracking : An L 1 / 2 Regularization Based Model and Solution

High-dimensional Sparse Portfolio Selection with Nonnegative Constraint.

Elastic-net Regularized High-dimensional Negative Binomial Regression: Consistency and Weak Signals Detection

Nonnegative Estimation and Variable Selection under Minimax Concave Penalty for Sparse High-Dimensional Linear Regression Models

ELASTIC-NET REGULARIZED HIGH-DIMENSIONAL NEGATIVE BINOMIAL REGRESSION: CONSISTENCY AND WEAK SIGNAL DETECTION

An Efficient Optimization Approach for a Cardinality-Constrained Index Tracking Problem

Sparse Index Tracking Based On $L_{1/2}$ Model And Algorithm

On Estimation Error Bounds of the Elastic Net when P ≫ N

Stability of the Elastic Net Estimator