Compressed Sensing Via Iterative Support Detection

Yilun Wang,Wotao Yin

2009-01-01

Abstract:We present a new compressive sensing reconstruction method “ISD”, aiming to achieve fast reconstruction and a reduced requirement on the number of measurements compared to the classical `1 minimization approach. ISD addresses failed cases of `1–based construction due to insufficient measurements, in which the returned signals are not equal or even close to the true signals. ISD will learn from such signals and solve new minimization problems that return a perfect or a better signal. Specifically, given an incorrect signal, ISD detects an index set I that includes components most likely to be true nonzeros and solves min{ ∑ i 6∈I |xi| : Ax = b} for a new signal x, and it iterates these two steps alternatively using latest x and I from one another until convergence. ISD differs from the orthogonal matching pursuit (OMP) method, as well as its variants, in two aspects. First, although both methods generate index sets iteratively, the index set I in ISD is not necessarily nested or increasing over the iterations. Second, the OMP–family methods at each of their iterations fix xi, i ∈ I, and update the remaining components of x, but the ISD minimization problem above updates all the components of x. To analyze the performance of ISD, we generalize the Null Space Property to Truncated Null Space Property and present our analysis on the latter. We introduce an efficient implementation of ISD, called threshold–ISD, for recovering signals with fast decaying distributions of nonzeros from compressive measurements. Numerical experiments show that threshold–ISD has significant overall advantages over the classical `1 minimization approach, as well as two other state–of–the–art algorithms such as the iterative reweighted `1 minimization algorithm (IRL1) and the iterative reweighted least–squares algorithm (IRLS). MATLAB code is available for download from http://www.caam.rice.edu/~optimization/L1/ISD/.