Abstract:This paper introduces new solvers for efficiently computing solutions to large-scale inverse problems with group sparsity regularization, including both non- overlapping and overlapping groups. Group sparsity regularization refers to a type of structured sparsity regularization, where the goal is to impose additional structure in the regularization process by assigning variables to predefined groups that may represent graph or network structures. Special cases of group sparsity regularization include l1 and isotropic total variation regularization. In this work, we develop hybrid projection methods based on flexible Krylov subspaces, where we first recast the group sparsity regularization term as a sequence of 2-norm penalization terms using adaptive regularization matrices in an iterative reweighted norm fashion. Then, we exploit flexible preconditioning techniques to efficiently incorporate the weight updates. The main advantages of these methods are that they are computationally efficient (leveraging the advantages of flexible methods), they are general (and therefore very easily adaptable to new regularization term choices), and they are able to select the regularization parameters automatically and adaptively (exploiting the advantages of hybrid methods). Extensions to multiple regularization terms and solution decomposition frameworks (e.g., for anomaly detection) are described, and a variety of numerical examples demonstrate both the efficiency and accuracy of the proposed approaches compared to existing solvers.

A Fast Algorithm for Group Square-Root Lasso Based Group-Sparse Regression

A Dual Semismooth Newton Based Augmented Lagrangian Method for Large-Scale Linearly Constrained Sparse Group Square-Root Lasso Problems

A Fast and Scalable Pathwise-Solver for Group Lasso and Elastic Net Penalized Regression via Block-Coordinate Descent

An efficient Hessian based algorithm for solving large-scale sparse group Lasso problems

A Fast GP Regression Method Using Banded Sparsification of Inverse Covariance

Smoothing composite proximal gradient algorithm for sparse group Lasso problems with nonsmooth loss functions

Generalized Newton–Raphson Algorithm for High Dimensional LASSO Regression

Group Sparse Recovery Via Group Square-Root Elastic Net and the Iterative Multivariate Thresholding-Based Algorithm

A Fast Method for Lasso and Logistic Lasso

Group Sparse Recovery Via the $\ell ^0(\ell ^2)$ Penalty: Theory and Algorithm

Efficient Low Rank Matrix Recovery With Flexible Group Sparse Regularization

An Efficient and Globally Convergent Algorithm for $\ell_{p,q} - \ell_r$ Model in Group Sparse Optimization

GSDAR: a Fast Newton Algorithm for ℓ _0 Regularized Generalized Linear Models with Statistical Guarantee

Flexible Krylov Methods for Group Sparsity Regularization

Subspace Newton method for sparse group optimization problem

An Efficient and Globally Convergent Algorithm for `p,q-`r Model in Group Sparse Optimization

GEP-MSCRA for computing the group zero-norm regularized least squares estimator.

A Sparse-Group Lasso

Efficient Inexact Proximal Gradient Algorithms for Structured Sparsity-Inducing Norm.

Supervised Group Sparse Representation via Intra-class Low-Rank Constraint.