Abstract:One-bit compressive sensing theory shows that the sparse signals can be almost exactly reconstructed from a small number of one-bit quantized linear measurements. This paper presents the convergence analysis of the binary iterative hard thresholding (BIHT) algorithm which is a state-of-the-art recovery algorithm in one-bit compressive sensing. The basic idea of the convergence analysis is to view BIHT as a kind of projected subgradient method under sparsity constrains. To the best of our knowledge, this is the first convergence analysis of BIHT. We first consider a general convex function subject to sparsity constraints and connect it with the non-convex model in one-bit compressive sensing literatures. A projected subgradient method is proposed to solve the general model and some convergence results are established. A stronger convergence theorem for alpha-strongly convex functions without assumption on differentiable condition is also established. Furthermore, the corresponding stochastic projected subgradient method is provided with convergence guarantee. In our settings, BIHT is a special case of the projected subgradient method. Therefore, the convergence analysis can be applied to BIHT naturally. Then, we apply the projected subgradient method to some related non-convex optimization models arising in compressive sensing with l(1)-constraint, sparse support vector machines, and rectifier linear units regression. Finally, some numerical examples are presented to show the validity of our convergence analysis. The numerical experiments also show that the proposed projected subgradient method is very simple to implement, robust to sparse noise, and effective for sparse recovery problems.

Two-level ℓ1 Minimization for Compressed Sensing

On the Null Space Property of L Q-Minimization for 0 < Q ≤ 1 in Compressed Sensing

Minimization of Transformed $L_1$ Penalty: Theory, Difference of Convex Function Algorithm, and Robust Application in Compressed Sensing

Weighted LASSO for Sparse Recovery with Statistical Prior Support Information

One-Bit Compressive Sensing with Projected Subgradient Method under Sparsity Constraints

Nonconvex Sorted ℓ _1 Minimization for Sparse Approximation

Sparse Estimation Via Lower-Order Penalty Optimization Methods in High-Dimensional Linear Regression.

Analysis of the Ratio of ℓ1 and ℓ2 Norms in Compressed Sensing

L1−2 Minimization for Exact and Stable Seismic Attenuation Compensation

Nonconvex penalties with analytical solutions for one-bit compressive sensing

A Comparison of Typical ℓ Minimization Algorithms

A new inexact iterative hard thresholding algorithm for compressed sensing

Image Compressive Sensing Recovery Using Group Sparse Coding Via Non-convex Weighted Lp Minimization.

The variant of the iterative shrinkage-thresholding algorithm for minimization of the l 1 over l ∞ norms

Nonconvex Sorted $$\ell _1$$ ℓ 1 Minimization for Sparse Approximation

Iterative thresholding algorithm based on non-convex method for modified lp-norm regularization minimization

Introduction to Compressive Sensing and Sparse Optimization

Sparse Signal Reconstruction Via Concave Continuous Piecewise Linear Programming

A Barzilai-Borwein $l_1$-Regularized Least Squares Algorithm for Compressed Sensing

GIST: General Iterative Shrinkage and Thresholding for Non-convex Sparse Learning

Compressed sensing with l0-norm: statistical physics analysis and algorithms for signal recovery