Abstract:Taking advantage of the natural grouping structure inside data, group sparse optimization can effectively improve the efficiency and stability of high-dimensional data analysis, and it has wide applications in a variety of fields such as machine learning, signal processing, and bioinformatics. Although there has been a lot of progress, it is still a challenge to construct a group sparse-inducing function with good properties and to identify significant groups. This article aims to address the group-sparsity-constrained minimization problem. We convert the problem to an equivalent weighted lp,q -norm ( , ) constrained optimization model, instead of its relaxation or approximation problem. Then, by applying the proximal gradient method, a solution method with theoretical convergence analysis is developed. Moreover, based on the properties proved in the Lagrangian dual framework, the homotopy technique is employed to cope with the parameter tuning task and to ensure that the output of the proposed homotopy algorithm is an L -stationary point of the original problem. The proposed weighted framework, with the central idea of identifying important groups, is compatible with a wide range of support set identification strategies, which can better meet the needs of different applications and improve the robustness of the model in practice. Both simulated and real data experiments demonstrate the superiority of the proposed method in terms of group feature selection accuracy and computational efficiency. Extensive experimental results in application areas such as compressed sensing, image recognition, and classifier design show that our method has great potential in a wide range of applications. Our codes will be available at https://github.com/jianglanfan/HIWT-GSC.

The benefit of group sparsity

Average case analysis of Lasso under ultra-sparse conditions

A Sparse-Group Lasso

A note on the group lasso and a sparse group lasso

Adaptive Lasso in high-dimensional settings

Error Bounds for Generalized Group Sparsity

Group Sparse Recovery Via the $\ell ^0(\ell ^2)$ Penalty: Theory and Algorithm

ℓ _1/2,1 group sparse regularization for compressive sensing

An efficient Hessian based algorithm for solving large-scale sparse group Lasso problems

Selective Inference for Group-Sparse Linear Models

Group sparse optimization via l

Globally Sparse and Locally Dense Signal Recovery for Compressed Sensing

Regularization for Compressive Sensing

The ℓ2, Regularized Group Sparse Optimization: Lower Bound Theory, Recovery Bound and Algorithms

Exclusive Feature Learning on Arbitrary Structures via l(1,2)-norm

Improved Support Recovery Guarantees for the Group Lasso With Applications to Structural Health Monitoring

Sparsity and smoothness via the fused lasso

Sharp minimax optimality of LASSO and SLOPE under double sparsity assumption

Sparsity via Sparse Group $k$-max Regularization

Exclusive Group Lasso for Structured Variable Selection

Iterative-Weighted Thresholding Method for Group-Sparsity-Constrained Optimization With Applications