Abstract:We propose a constructive approach to estimating sparse, high-dimensional linear regression models. The approach is a computational algorithm motivated from the KKT conditions for the l 0 -penalized least squares solutions. It generates a sequence of solutions iteratively, based on support detection using primal and dual information and root finding. We refer to the algorithm as SDAR for brevity. Under a sparse Riesz condition on the design matrix and certain other conditions, we show that with high probability, the l 2 estimation error of the solution sequence decays exponentially to the minimax error bound in O (log(Rp√ J )) iterations, where J is the number of important predictors and R is the relative magnitude of the nonzero target coefficients; and under a mutual coherence condition and certain other conditions, the l ∞ estimation error decays to the optimal error bound in O(log(R)) iterations. Moreover the SDAR solution recovers the oracle least squares estimator within a finite number of iterations with high probability if the sparsity level is known. Computational complexity analysis shows that the cost of SDAR is O(np) per iteration. We also consider an adaptive version of SDAR for use in practical applications where the true sparsity level is unknown. Simulation studies demonstrate that SDAR outperforms Lasso, MCP and two greedy methods in accuracy and efficiency.

A descent algorithm for constrained LAD-Lasso estimation with applications in portfolio selection

An amendatory branch and bound algorithm for mad model with concave transaction costs and bounded assets constraints

SCAD-Penalized Least Absolute Deviation Regression in High-Dimensional Models

Cardinality Constrained Portfolio Optimization via Alternating Direction Method of Multipliers

Penalized and Constrained LAD Estimation in Fixed and High Dimension

Robust Regression Shrinkage and Consistent Variable Selection Through the LAD-Lasso

An Application of Sparse-Group Lasso Regularization to Equity Portfolio Optimization and Sector Selection.

Fused LASSO Penalized Least Absolute Deviation Estimator for High Dimensional Linear Regression

The Linearized Alternating Direction Method of Multipliers for Sparse Group LAD Model.

A new penalized least absolute deviation model for high dimensional sparse linear regression and an efficient sequential linear programming algorithm

Penalized LAD regression for single index models

Robust Variable Selection Based on Relaxed Lad Lasso

NONCONVEX L-1/2 REGULARIZATION FOR SPARSE PORTFOLIO SELECTION

Nonnegative Adaptive Lasso for Ultra-High Dimensional Regression Models and A Two-Stage Method Applied in Financial Modeling

Some Improved Sparse and Stable Portfolio Optimization Problems

Fast Alternating Direction Algorithms for Sparse Portfolio Model Via Sorted ℓ1-Norm.

LAD-LASSO: SIMULATION STUDY OF ROBUST REGRESSION IN HIGH DIMENSIONAL DATA

A constructive approach to L

Robust Minimum Variance Portfolio with L-infinity Constraints

Outlier detection and robust variable selection via the penalized weighted LAD-LASSO method

A fast ADMM algorithm for sparse precision matrix estimation using lasso penalized D-trace loss