Abstract:The elastic net penalty is frequently employed in high-dimensional statistics for parameter regression and variable selection. It is particularly beneficial compared to lasso when the number of predictors greatly surpasses the number of observations. However, empirical evidence has shown that the $\ell_q$-norm penalty (where $0 < q < 1$) often provides better regression compared to the $\ell_1$-norm penalty, demonstrating enhanced robustness in various scenarios. In this paper, we explore a generalized elastic net model that employs a $\ell_r$-norm (where $r \geq 1$) in loss function to accommodate various types of noise, and employs a $\ell_q$-norm (where $0 < q < 1$) to replace the $\ell_1$-norm in elastic net penalty. Theoretically, we establish the computable lower bounds for the nonzero entries of the generalized first-order stationary points of the proposed generalized elastic net model. For implementation, we develop two efficient algorithms based on the locally Lipschitz continuous $\epsilon$-approximation to $\ell_q$-norm. The first algorithm employs an alternating direction method of multipliers (ADMM), while the second utilizes a proximal majorization-minimization method (PMM), where the subproblems are addressed using the semismooth Newton method (SNN). We also perform extensive numerical experiments with both simulated and real data, showing that both algorithms demonstrate superior performance. Notably, the PMM-SSN is efficient than ADMM, even though the latter provides a simpler implementation.

Adaptive Elastic-Net for General Single-Index Regression Models.

Adaptive Lasso in high-dimensional settings

Regularization and variable selection for infinite variance autoregressive models

Nonnegative Elastic Net and application in index tracking

Empirical Likelihood for Single-Index Regression Models under Negatively Associated Errors

Nonlinear generalization of the monotone single index model

Iterative Reweighted Framework Based Algorithms for Sparse Linear Regression with Generalized Elastic Net Penalty

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

Asymptotics of the Adaptive Elastic Net Estimation for Conditional Heteroscedastic Time Series Models

Variable selection and model prediction based on Lasso, adaptive lasso and elastic net

On Model Selection Consistency of the Elastic Net when P >> N

Elastic Net Procedure for Partially Linear Models

Elastic Net with Adaptive Weight for Image Denoising

Robust Elastic Net Regression

Variable Selection for the Partial Linear Single-Index Model

Enmsp: an elastic-net multi-step screening procedure for high-dimensional regression

Nonnegative-lasso and application in index tracking

Adaptive $$l_p$$ $$(0<p<1)$$ Regularization: Oracle Property and Applications

ELASTIC-NET REGULARIZED HIGH-DIMENSIONAL NEGATIVE BINOMIAL REGRESSION: CONSISTENCY AND WEAK SIGNAL DETECTION

Elastic-net Regularized High-dimensional Negative Binomial Regression: Consistency and Weak Signals Detection

Adaptive Covariance Estimation with model selection