Abstract:In this paper we present an efficient active-set method for the solution of convex quadratic programming problems with general piecewise-linear terms in the objective, with applications to sparse approximations and risk-minimization. The algorithm is derived by combining a proximal method of multipliers (PMM) with a standard semismooth Newton method (SSN), and is shown to be globally convergent under minimal assumptions. Further local linear (and potentially superlinear) convergence is shown under standard additional conditions. The major computational bottleneck of the proposed approach arises from the solution of the associated SSN linear systems. These are solved using a Krylov-subspace method, accelerated by certain novel general-purpose preconditioners which are shown to be optimal with respect to the proximal penalty parameters. The preconditioners are easy to store and invert, since they exploit the structure of the nonsmooth terms appearing in the problem's objective to significantly reduce their memory requirements. We showcase the efficiency, robustness, and scalability of the proposed solver on a variety of problems arising in risk-averse portfolio selection, $L^1$-regularized partial differential equation constrained optimization, quantile regression, and binary classification via linear support vector machines. We provide computational evidence, on real-world datasets, to demonstrate the ability of the solver to efficiently and competitively handle a diverse set of medium- and large-scale optimization instances.

On Partly Smoothness, Activity Identification and Faster Algorithms of L 1 over L 2 Minimization

On Partial Smoothness, Activity Identification and Faster Algorithms of L1 over L2 Minimization

On Partly Smoothness, Activity Identification and Faster Algorithms of $L_1$ over $L_2$ Minimization

Smoothed sparse recovery via locally competitive algorithm and forward Euler discretization method.

On the Convergence of an Active-Set Method for ℓ1 Minimization

A Unified Study on $L_1$ over $L_2$ Minimization

Study on L_1 over L_2 Minimization for Nonnegative Signal Recovery

Study on <i>L</i><sub>1</sub> over <i>L</i><sub>2</sub> Minimization for Nonnegative Signal Recovery

Unified Analysis on L1 over L2 Minimization for Signal Recovery

Nonlinear Eigen-approach ADMM for Sparse Optimization on Stiefel Manifold

An efficient active-set method with applications to sparse approximations and risk minimization

A Learned Proximal Alternating Minimization Algorithm and Its Induced Network for a Class of Two-block Nonconvex and Nonsmooth Optimization

An over-relaxed ADMM for separable convex programming and its applications to statistical learning

A Riemannian ADMM

ADMM for Nonconvex Optimization under Minimal Continuity Assumption

A Bregman-Style Improved ADMM and its Linearized Version in the Nonconvex Setting: Convergence and Rate Analyses

Smoothed Proximal Lagrangian Method for Nonlinear Constrained Programs

ADMM Algorithmic Regularization Paths for Sparse Statistical Machine Learning

Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation

Minimizing L 1 over L 2 norms on the gradient

Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation.