Abstract:One-bit compressive sensing theory shows that the sparse signals can be almost exactly reconstructed from a small number of one-bit quantized linear measurements. This paper presents the convergence analysis of the binary iterative hard thresholding (BIHT) algorithm which is a state-of-the-art recovery algorithm in one-bit compressive sensing. The basic idea of the convergence analysis is to view BIHT as a kind of projected subgradient method under sparsity constrains. To the best of our knowledge, this is the first convergence analysis of BIHT. We first consider a general convex function subject to sparsity constraints and connect it with the non-convex model in one-bit compressive sensing literatures. A projected subgradient method is proposed to solve the general model and some convergence results are established. A stronger convergence theorem for alpha-strongly convex functions without assumption on differentiable condition is also established. Furthermore, the corresponding stochastic projected subgradient method is provided with convergence guarantee. In our settings, BIHT is a special case of the projected subgradient method. Therefore, the convergence analysis can be applied to BIHT naturally. Then, we apply the projected subgradient method to some related non-convex optimization models arising in compressive sensing with l(1)-constraint, sparse support vector machines, and rectifier linear units regression. Finally, some numerical examples are presented to show the validity of our convergence analysis. The numerical experiments also show that the proposed projected subgradient method is very simple to implement, robust to sparse noise, and effective for sparse recovery problems.

Stochastic IHT With Stochastic Polyak Step-Size for Sparse Signal Recovery

Adaptive Iterative Hard Thresholding for Least Absolute Deviation Problems with Sparsity Constraints

One-Bit Compressive Sensing with Projected Subgradient Method under Sparsity Constraints

I T ] 8 S ep 2 01 3 Sparse Recovery with Coherent Tight Frames via Analysis Dantzig Selector and Analysis LASSO ∗

Newton-Step-Based Hard Thresholding Algorithms for Sparse Signal Recovery

Stochastic Natural Thresholding Algorithms

Heavy-Ball-Based Hard Thresholding Algorithms for Sparse Signal Recovery

Conjugate Gradient Hard Thresholding Pursuit Algorithm For Sparse Signal Recovery

Stepwise Suboptimal Iterative Hard Thresholding Algorithm for Compressive Sensing

Stability and Risk Bounds of Iterative Hard Thresholding

A Modified Iterative Hard Thresholding Algorithm

Iterative Soft / Hard Thresholding Homotopy Algorithm for Sparse Recovery

Randomized Iterative Hard Thresholding for Sparse Approximations

Stochastic Iterative Hard Thresholding for Low-Tucker-Rank Tensor Recovery

Iterative Soft/Hard Thresholding With Homotopy Continuation for Sparse Recovery

Efficient Recovery of Block Sparse Signals by an Improved Algorithm of Block-StOMP

Stochastic Recovery Of Sparse Signals From Random Measurements

Fast and Provable Algorithms for Spectrally Sparse Signal Reconstruction Via Low-Rank Hankel Matrix Completion

A Stochastic Alternating Minimizing Method for Sparse Phase Retrieval

Stochastic Greedy Algorithms For Multiple Measurement Vectors

Iterative Difference Hard-Thresholding Algorithm for Sparse Signal Recovery.