Abstract:Taking advantage of the natural grouping structure inside data, group sparse optimization can effectively improve the efficiency and stability of high-dimensional data analysis, and it has wide applications in a variety of fields such as machine learning, signal processing, and bioinformatics. Although there has been a lot of progress, it is still a challenge to construct a group sparse-inducing function with good properties and to identify significant groups. This article aims to address the group-sparsity-constrained minimization problem. We convert the problem to an equivalent weighted lp,q -norm ( , ) constrained optimization model, instead of its relaxation or approximation problem. Then, by applying the proximal gradient method, a solution method with theoretical convergence analysis is developed. Moreover, based on the properties proved in the Lagrangian dual framework, the homotopy technique is employed to cope with the parameter tuning task and to ensure that the output of the proposed homotopy algorithm is an L -stationary point of the original problem. The proposed weighted framework, with the central idea of identifying important groups, is compatible with a wide range of support set identification strategies, which can better meet the needs of different applications and improve the robustness of the model in practice. Both simulated and real data experiments demonstrate the superiority of the proposed method in terms of group feature selection accuracy and computational efficiency. Extensive experimental results in application areas such as compressed sensing, image recognition, and classifier design show that our method has great potential in a wide range of applications. Our codes will be available at https://github.com/jianglanfan/HIWT-GSC.

Matrix Optimization Problem Involving Group Sparsity and Nonnegativity Constraints

Adaptive Iterative Hard Thresholding for Least Absolute Deviation Problems with Sparsity Constraints

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

Matrix Function Optimization Problems under Orthonormal Constraint

Optimal $k$-thresholding algorithms for sparse optimization problems

A New Nonmonotone Spectral Projected Gradient Algorithm for Box-Constrained Optimization Problems in M×n Real Matrix Space with Application in Image Clustering.

Subspace Newton method for sparse group optimization problem

Scaled Proximal Gradient Methods for Sparse Optimization Problems

Iterative-Weighted Thresholding Method for Group-Sparsity-Constrained Optimization With Applications

Stochastic Iterative Hard Thresholding for Graph-structured Sparsity Optimization

A New Linear Convergence Result for the Iterative Soft Thresholding Algorithm

New Inexact Explicit Thresholding/shrinkage Formulas for Inverse Problems with Overlapping Group Sparsity.

Sparse Polynomial Matrix Optimization

Constrained Mix Sparse Optimization via Hard Thresholding Pursuit

Exclusive Sparsity Norm Minimization with Random Groups Via Cone Projection

A minimax optimal approach to high-dimensional double sparse linear regression

A General Iterative Shrinkage and Thresholding Algorithm for Non-convex Regularized Optimization Problems

Minimization Over the Nonconvex Sparsity Constraint Using A Hybrid First-order method

General Constrained Matrix Optimization

Sparsity via Sparse Group $k$-max Regularization

Sparse Convex Optimization via Adaptively Regularized Hard Thresholding