Abstract:One-bit compressive sensing theory shows that the sparse signals can be almost exactly reconstructed from a small number of one-bit quantized linear measurements. This paper presents the convergence analysis of the binary iterative hard thresholding (BIHT) algorithm which is a state-of-the-art recovery algorithm in one-bit compressive sensing. The basic idea of the convergence analysis is to view BIHT as a kind of projected subgradient method under sparsity constrains. To the best of our knowledge, this is the first convergence analysis of BIHT. We first consider a general convex function subject to sparsity constraints and connect it with the non-convex model in one-bit compressive sensing literatures. A projected subgradient method is proposed to solve the general model and some convergence results are established. A stronger convergence theorem for alpha-strongly convex functions without assumption on differentiable condition is also established. Furthermore, the corresponding stochastic projected subgradient method is provided with convergence guarantee. In our settings, BIHT is a special case of the projected subgradient method. Therefore, the convergence analysis can be applied to BIHT naturally. Then, we apply the projected subgradient method to some related non-convex optimization models arising in compressive sensing with l(1)-constraint, sparse support vector machines, and rectifier linear units regression. Finally, some numerical examples are presented to show the validity of our convergence analysis. The numerical experiments also show that the proposed projected subgradient method is very simple to implement, robust to sparse noise, and effective for sparse recovery problems.

Proof of Convergence and Performance Analysis for Sparse Recovery via Zero-Point Attracting Projection

Dynamic Zero-Point Attracting Projection for Time-Varying Sparse Signal Recovery

Efficient Recovery of Block Sparse Signals Via Zero-Point Attracting Projection.

One-Bit Compressive Sensing with Projected Subgradient Method under Sparsity Constraints

I T ] 8 S ep 2 01 3 Sparse Recovery with Coherent Tight Frames via Analysis Dantzig Selector and Analysis LASSO ∗

Sparse Recovery with Coherent Tight Frame via Analysis Dantzig Selector and Analysis LASSO

Convergence of projected Landweber iteration for matrix rank minimization

Analysis Non-Sparse Recovery for Relaxed ALASSO

CONVERGENCE AND STABILITY OF ITERATIVELY REWEIGHTED LEAST SQUARES FOR LOW-RANK MATRIXRECOVERY

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

Zero-point attracting projection algorithm for sequential compressive sensing

Improving the Reconstruction Accuracy of Mr Imaging Using Zero-Point Attracting Projection

From Least Squares to Sparse: A Non-Convex Approach with Guarantee

Robust Sparse Recovery Via Non-Convex Optimization

Fast Sparse Recovery Via Non-Convex Optimization

Fast and Robust Spectrally Sparse Signal Recovery: A Provable Non-Convex Approach via Robust Low-Rank Hankel Matrix Reconstruction

Weakly Convex Regularized Robust Sparse Recovery Methods with Theoretical Guarantees

Learning Proximal Operator Methods for Nonconvex Sparse Recovery with Theoretical Guarantee.

Unified Analysis on L1 over L2 Minimization for Signal Recovery

A Robust Recovery Algorithm with Smoothing Strategies.