Abstract:One-bit compressive sensing theory shows that the sparse signals can be almost exactly reconstructed from a small number of one-bit quantized linear measurements. This paper presents the convergence analysis of the binary iterative hard thresholding (BIHT) algorithm which is a state-of-the-art recovery algorithm in one-bit compressive sensing. The basic idea of the convergence analysis is to view BIHT as a kind of projected subgradient method under sparsity constrains. To the best of our knowledge, this is the first convergence analysis of BIHT. We first consider a general convex function subject to sparsity constraints and connect it with the non-convex model in one-bit compressive sensing literatures. A projected subgradient method is proposed to solve the general model and some convergence results are established. A stronger convergence theorem for alpha-strongly convex functions without assumption on differentiable condition is also established. Furthermore, the corresponding stochastic projected subgradient method is provided with convergence guarantee. In our settings, BIHT is a special case of the projected subgradient method. Therefore, the convergence analysis can be applied to BIHT naturally. Then, we apply the projected subgradient method to some related non-convex optimization models arising in compressive sensing with l(1)-constraint, sparse support vector machines, and rectifier linear units regression. Finally, some numerical examples are presented to show the validity of our convergence analysis. The numerical experiments also show that the proposed projected subgradient method is very simple to implement, robust to sparse noise, and effective for sparse recovery problems.

A Modified Spectral PRP Conjugate Gradient Projection Method for Solving Large-Scale Monotone Equations and Its Application in Compressed Sensing

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing

A Low-rank Projected Proximal Gradient Method for Spectral Compressed Sensing

A Modified Spectral Conjugate Gradient Projection Method for Signal Recovery.

One-Bit Compressive Sensing with Projected Subgradient Method under Sparsity Constraints

A Two-Step Spectral Gradient Projection Method for System of Nonlinear Monotone Equations and Image Deblurring Problems

Spectral Compressed Sensing Via Projected Gradient Descent

A diagonal PRP-type projection method for convex constrained nonlinear monotone equations

Successive Projection for Solving Systems of Nonlinear Equations/Inequalities

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

Projected Gradient Descent for Spectral Compressed Sensing via Symmetric Hankel Factorization

A New Three-Term Spectral Conjugate Gradient Algorithm with Higher Numerical Performance for Solving Large Scale Optimization Problems Based on Quasi-Newton Equation.

An Efficient Modified Residual-Based Algorithm for Large Scale Symmetric Nonlinear Equations by Approximating Successive Iterated Gradients

Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing

An Efficient Method for Compressed Sensing

Optimized Projections for Compressed Sensing Via Direct Mutual Coherence Minimization

A New Spectral Conjugate Subgradient Method with Application in Computed Tomography Image Reconstruction

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

Constrained Optimization with Compressed Gradients: A Dynamical Systems Perspective

Subspace projection matrix recovery from incomplete information