Abstract:Taking advantage of the natural grouping structure inside data, group sparse optimization can effectively improve the efficiency and stability of high-dimensional data analysis, and it has wide applications in a variety of fields such as machine learning, signal processing, and bioinformatics. Although there has been a lot of progress, it is still a challenge to construct a group sparse-inducing function with good properties and to identify significant groups. This article aims to address the group-sparsity-constrained minimization problem. We convert the problem to an equivalent weighted lp,q -norm ( , ) constrained optimization model, instead of its relaxation or approximation problem. Then, by applying the proximal gradient method, a solution method with theoretical convergence analysis is developed. Moreover, based on the properties proved in the Lagrangian dual framework, the homotopy technique is employed to cope with the parameter tuning task and to ensure that the output of the proposed homotopy algorithm is an L -stationary point of the original problem. The proposed weighted framework, with the central idea of identifying important groups, is compatible with a wide range of support set identification strategies, which can better meet the needs of different applications and improve the robustness of the model in practice. Both simulated and real data experiments demonstrate the superiority of the proposed method in terms of group feature selection accuracy and computational efficiency. Extensive experimental results in application areas such as compressed sensing, image recognition, and classifier design show that our method has great potential in a wide range of applications. Our codes will be available at https://github.com/jianglanfan/HIWT-GSC.

Constrained Mix Sparse Optimization via Hard Thresholding Pursuit

Adaptive Iterative Hard Thresholding for Least Absolute Deviation Problems with Sparsity Constraints

Gradient Hard Thresholding Pursuit for Sparsity-Constrained Optimization.

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

One-Bit Compressive Sensing with Projected Subgradient Method under Sparsity Constraints

A New Linear Convergence Result for the Iterative Soft Thresholding Algorithm

Sparse Convex Optimization via Adaptively Regularized Hard Thresholding

Adaptive $textit{L}_{bf 1/2}$ Sparsity-Constrained NMF With Half-Thresholding Algorithm for Hyperspectral Unmixing

Iterative-Weighted Thresholding Method for Group-Sparsity-Constrained Optimization With Applications

Hyperspectral Sparse Unmixing Via Nonconvex Shrinkage Penalties

Nonlinear Hyperspectral Unmixing Based on Sparse Non-Negative Matrix Factorization

Dual Iterative Hard Thresholding: from Non-convex Sparse Minimization to Non-smooth Concave Maximization.

L1/2 Sparsity Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing

Matrix Optimization Problem Involving Group Sparsity and Nonnegativity Constraints

Hyperspectral Unmixing Via L-1/2 Sparsity-Constrained Nonnegative Matrix Factorization

Correntropy-Based Spatial-Spectral Robust Sparsity-Regularized Hyperspectral Unmixing

Multiple Choice Hard Thresholding Pursuit (MCHTP) for simultaneous sparse recovery and sparsity order estimation

Iterative Orthogonal Matching Pursuit and Sparse Solution

A minimax optimal approach to high-dimensional double sparse linear regression

Exact Recovery of Hard Thresholding Pursuit.

Scaled Proximal Gradient Methods for Sparse Optimization Problems