Abstract:We study the minimization problem of a non-convex sparsity promoting penalty function, the transformed $l_1$ (TL1), and its application in compressed sensing (CS). The TL1 penalty interpolates $l_0$ and $l_1$ norms through a nonnegative parameter $a \in (0,+\infty)$, similar to $l_p$ with $p \in (0,1]$, and is known to satisfy unbiasedness, sparsity and Lipschitz continuity properties. We first consider the constrained minimization problem and discuss the exact recovery of $l_0$ norm minimal solution based on the null space property (NSP). We then prove the stable recovery of $l_0$ norm minimal solution if the sensing matrix $A$ satisfies a restricted isometry property (RIP). Next, we present difference of convex algorithms for TL1 (DCATL1) in computing TL1-regularized constrained and unconstrained problems in CS. The inner loop concerns an $l_1$ minimization problem on which we employ the Alternating Direction Method of Multipliers (ADMM). For the unconstrained problem, we prove convergence of DCATL1 to a stationary point satisfying the first order optimality condition. In numerical experiments, we identify the optimal value $a=1$, and compare DCATL1 with other CS algorithms on two classes of sensing matrices: Gaussian random matrices and over-sampled discrete cosine transform matrices (DCT). We find that for both classes of sensing matrices, the performance of DCATL1 algorithm (initiated with $l_1$ minimization) always ranks near the top (if not the top), and is the most robust choice insensitive to the conditioning of the sensing matrix $A$. DCATL1 is also competitive in comparison with DCA on other non-convex penalty functions commonly used in statistics with two hyperparameters.

Exact Reconstruction Analysis of Log-Sum Minimization for Compressed Sensing

On the Null Space Property of L Q-Minimization for 0 < Q ≤ 1 in Compressed Sensing

Recovery analysis of log-sum minimization under mutual incoherence property

Sparsity optimized compressed sensing image recovery

Two-level ℓ1 Minimization for Compressed Sensing

A piecewise linear programming algorithm for sparse signal reconstruction

Sparse Signal Recovery by Minimization Under Restricted Isometry Property

Sparse Signal Reconstruction Via Concave Continuous Piecewise Linear Programming

Minimization of Fraction Function Penalty in Compressed Sensing

The Essential Ability of Sparse Reconstruction of Different Compressive Sensing Strategies

Sparse Signal Recovery By L(Q) Minimization Under Restricted Isometry Property

Minimization of Transformed $L_1$ Penalty: Theory, Difference of Convex Function Algorithm, and Robust Application in Compressed Sensing

One-bit compressive sensing and source localization in wireless sensor networks

Compressed Sensing Image Reconstruction Algorithm Based on Rank Minimization

An Iterative Threshold Algorithm of Log-sum Regularization for Sparse Problem

Globally Sparse and Locally Dense Signal Recovery for Compressed Sensing

Sparse Signals Recovered by Non-Convex Penalty in Quasi-Linear Systems.

Compressive Sensing Via Nonlocal Low-Rank Regularization

Gradient Projection with Approximate L0 Norm Minimization for Sparse Reconstruction in Compressed Sensing

On Recovery of Block-Sparse Signals Via Mixed L2/lq(0 < Q ≤ 1) Norm Minimization

Compressive Sensing Via Nonlocal Smoothed Rank Function.