Abstract:High dimensional massive data analysis is one of the hot topics in machine learning and statistics.The high correlation between the variables and the heavy tailed distribution noise is the main feature which makes the classical machine learning algorithm failing.In this paper,we propose the LAD-Elastic Net model.We study the model selection properties of LAD-Elastic Net.There are two parts,the loss function and the penalty,in the LAD-Elastic Net model.We use the absolute loss which can overcome the influence of the heavy tailed noise.And the combination of the l 1 norm and l 2 norm of the coefficients of the model utilizes the prior information with sparse and correlation of the variables.We study the model selection properties which are the main results of this paper.Firstly,we review the main results in the models selection in recent years.Secondly,we propose the LAD-Elastic Net model.In our model,we use least absolute deviation as loss function and the combination of l 1-penalty and l 2-penalty.By using the l 1-penalty the model can select the principal variable which has the similar property of the Lasso(The Least Absolute Shrinkage and Selection Operator).By using the l 2-penalty the model can decrease the influence of the correlation of <br> the variable which has the similar property of Ridge regression.Finally,we prove the model selection consistency of LAD-Elastic Net by the approximation approach.We use the weighted least square loss function which can approximate the least absolute deviation loss function.The theoretical results show that under the Elastic Irrepersentable Condition the LAD-Elastic Net can select the true model by using the appropriate tuning parameters.

Adaptive Elastic Net and Separate Selection from Least Squares for Ultra-High Dimensional Regression Models

Rates of Convergence of the Adaptive Elastic Net and the Post-Selection Procedure in Ultra-High Dimensional Sparse Models

Adaptive Lasso in high-dimensional settings

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

A Group Adaptive Elastic-Net Approach for Variable Selection in High-Dimensional Linear Regression

Nonnegative Estimation and Variable Selection Via Adaptive Elastic-Net for High-Dimensional Data

High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking

Asymptotic Properties of Lasso+mLS and Lasso+Ridge in Sparse High-Dimensional Linear Regression

Enmsp: an elastic-net multi-step screening procedure for high-dimensional regression

Model selection based on LAD-Elastic Net

Model selection via standard error adjusted adaptive lasso

SCAD-Penalized Least Absolute Deviation Regression in High-Dimensional Models

Elastic Net Procedure for Partially Linear Models

Iterative Reweighted Framework Based Algorithms for Sparse Linear Regression with Generalized Elastic Net Penalty

Post Selection Shrinkage Estimation for High Dimensional Data Analysis

An adaptive shortest-solution guided decimation approach to sparse high-dimensional linear regression

Variable selection using axis-aligned random projections for partial least-squares regression

A Robust Variable Selection Method for Sparse Online Regression Via the Elastic Net Penalty

Variable selection and model prediction based on Lasso, adaptive lasso and elastic net

Penalized least squares estimation with weakly dependent data

Multi-step Adaptive Elastic-Net: Reducing False Positives in High-Dimensional Variable Selection