Abstract:High dimensional massive data analysis is one of the hot topics in machine learning and statistics.The high correlation between the variables and the heavy tailed distribution noise is the main feature which makes the classical machine learning algorithm failing.In this paper,we propose the LAD-Elastic Net model.We study the model selection properties of LAD-Elastic Net.There are two parts,the loss function and the penalty,in the LAD-Elastic Net model.We use the absolute loss which can overcome the influence of the heavy tailed noise.And the combination of the l 1 norm and l 2 norm of the coefficients of the model utilizes the prior information with sparse and correlation of the variables.We study the model selection properties which are the main results of this paper.Firstly,we review the main results in the models selection in recent years.Secondly,we propose the LAD-Elastic Net model.In our model,we use least absolute deviation as loss function and the combination of l 1-penalty and l 2-penalty.By using the l 1-penalty the model can select the principal variable which has the similar property of the Lasso(The Least Absolute Shrinkage and Selection Operator).By using the l 2-penalty the model can decrease the influence of the correlation of <br> the variable which has the similar property of Ridge regression.Finally,we prove the model selection consistency of LAD-Elastic Net by the approximation approach.We use the weighted least square loss function which can approximate the least absolute deviation loss function.The theoretical results show that under the Elastic Irrepersentable Condition the LAD-Elastic Net can select the true model by using the appropriate tuning parameters.

Model selection via standard error adjusted adaptive lasso

Adaptive Lasso in high-dimensional settings

Variable Selection for Partially Linear Models via Adaptive LASSO

测量误差模型的自适应LASSO变量选择方法研究

Relaxed Adaptive Lasso and Its Asymptotic Results

Adaptive LASSO for measurement error models

Variable selection and model prediction based on Lasso, adaptive lasso and elastic net

Adaptive lasso variable selection for the accelerated failure models

WLAD-LASSO Method for Robust Estimation and Variable Selection in Partially Linear Models

The Adaptive Lasso and Its Oracle Properties

New Robust Variable Selection Methods for Linear Regression Models

Regularized Estimation for the Least Absolute Relative Error Models with a Diverging Number of Covariates.

Model Selection Consistency of Lasso for Empirical Data

Adaptive Elastic Net and Separate Selection from Least Squares for Ultra-High Dimensional Regression Models

Studies of the adaptive network-constrained linear regression and its application

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

Robust Variable Selection Based on Relaxed Lad Lasso

Estimation of Error Variance in Regularized Regression Models Via Adaptive Lasso

Model selection based on LAD-Elastic Net

On LASSO for predictive regression

Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model