Abstract:We study the minimization problem of a non-convex sparsity promoting penalty function, the transformed $l_1$ (TL1), and its application in compressed sensing (CS). The TL1 penalty interpolates $l_0$ and $l_1$ norms through a nonnegative parameter $a \in (0,+\infty)$, similar to $l_p$ with $p \in (0,1]$, and is known to satisfy unbiasedness, sparsity and Lipschitz continuity properties. We first consider the constrained minimization problem and discuss the exact recovery of $l_0$ norm minimal solution based on the null space property (NSP). We then prove the stable recovery of $l_0$ norm minimal solution if the sensing matrix $A$ satisfies a restricted isometry property (RIP). Next, we present difference of convex algorithms for TL1 (DCATL1) in computing TL1-regularized constrained and unconstrained problems in CS. The inner loop concerns an $l_1$ minimization problem on which we employ the Alternating Direction Method of Multipliers (ADMM). For the unconstrained problem, we prove convergence of DCATL1 to a stationary point satisfying the first order optimality condition. In numerical experiments, we identify the optimal value $a=1$, and compare DCATL1 with other CS algorithms on two classes of sensing matrices: Gaussian random matrices and over-sampled discrete cosine transform matrices (DCT). We find that for both classes of sensing matrices, the performance of DCATL1 algorithm (initiated with $l_1$ minimization) always ranks near the top (if not the top), and is the most robust choice insensitive to the conditioning of the sensing matrix $A$. DCATL1 is also competitive in comparison with DCA on other non-convex penalty functions commonly used in statistics with two hyperparameters.

Primal and Dual Alternating Direction Algorithms for ℓ 1 - ℓ 1 -Norm Minimization Problems in Compressive Sensing

Primal and dual alternating direction algorithms for l1-l1-norm minimization problems in compressive sensing

Alternating Direction Algorithms for $\Ell_1$-Problems in Compressive Sensing

Linearized Alternating Directions Method for ℓ1-Norm Inequality Constrained ℓ1-Norm Minimization

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

An Alternative Lagrange-Dual Based Algorithm for Sparse Signal Reconstruction

A Primal Dual Active Set Algorithm with Continuation for Compressed Sensing

A Primal Douglas–Rachford Splitting Method for the Constrained Minimization Problem in Compressive Sensing

Alternating direction algorithms for $\ell_0$ regularization in compressed sensing.

A Primal Dual Active Set with Continuation Algorithm for the ℓ^0-Regularized Optimization Problem

Gradient Projection with Approximate L0 Norm Minimization for Sparse Reconstruction in Compressed Sensing

Analysis of the Ratio of ℓ1 and ℓ2 Norms in Compressed Sensing

Study on L_1 over L_2 Minimization for Nonnegative Signal Recovery

The variant of the iterative shrinkage-thresholding algorithm for minimization of the l 1 over l ∞ norms

Unified Analysis on L1 over L2 Minimization for Signal Recovery

Two-level ℓ1 Minimization for Compressed Sensing

Study on <i>L</i><sub>1</sub> over <i>L</i><sub>2</sub> Minimization for Nonnegative Signal Recovery

Minimization of Transformed $L_1$ Penalty: Theory, Difference of Convex Function Algorithm, and Robust Application in Compressed Sensing

A Unified Primal Dual Active Set Algorithm for Nonconvex Sparse Recovery

Nonconvex Optimization with Alternating Direction Method of Multipliers for Tensor-Based Compressed Sensing with Group Sparsity

Prior Information Constrained Alternating Direction Method of Multipliers for Longitudinal Compressive Sensing MR Imaging