Abstract:We study the minimization problem of a non-convex sparsity promoting penalty function, the transformed $l_1$ (TL1), and its application in compressed sensing (CS). The TL1 penalty interpolates $l_0$ and $l_1$ norms through a nonnegative parameter $a \in (0,+\infty)$, similar to $l_p$ with $p \in (0,1]$, and is known to satisfy unbiasedness, sparsity and Lipschitz continuity properties. We first consider the constrained minimization problem and discuss the exact recovery of $l_0$ norm minimal solution based on the null space property (NSP). We then prove the stable recovery of $l_0$ norm minimal solution if the sensing matrix $A$ satisfies a restricted isometry property (RIP). Next, we present difference of convex algorithms for TL1 (DCATL1) in computing TL1-regularized constrained and unconstrained problems in CS. The inner loop concerns an $l_1$ minimization problem on which we employ the Alternating Direction Method of Multipliers (ADMM). For the unconstrained problem, we prove convergence of DCATL1 to a stationary point satisfying the first order optimality condition. In numerical experiments, we identify the optimal value $a=1$, and compare DCATL1 with other CS algorithms on two classes of sensing matrices: Gaussian random matrices and over-sampled discrete cosine transform matrices (DCT). We find that for both classes of sensing matrices, the performance of DCATL1 algorithm (initiated with $l_1$ minimization) always ranks near the top (if not the top), and is the most robust choice insensitive to the conditioning of the sensing matrix $A$. DCATL1 is also competitive in comparison with DCA on other non-convex penalty functions commonly used in statistics with two hyperparameters.

On Partly Smoothness, Activity Identification and Faster Algorithms of $L_1$ over $L_2$ Minimization

On Partly Smoothness, Activity Identification and Faster Algorithms of L 1 over L 2 Minimization

On Partial Smoothness, Activity Identification and Faster Algorithms of L1 over L2 Minimization

On NP-Hardness of $L_1/L_2$ Minimization and Bound Theory of Nonzero Entries in Solutions

Lp quasi-norm minimization: algorithm and applications

On the Convergence of an Active-Set Method for ℓ1 Minimization

On the Hardness of the $L_1-L_2$ Regularization Problem

Weak Sharp Minima on Riemannian Manifolds

Smoothed sparse recovery via locally competitive algorithm and forward Euler discretization method.

A differential equations approach to $l_1$-minimization with applications to array imaging

A Unified Study on $L_1$ over $L_2$ Minimization

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

A Comparison of Typical ℓp Minimization Algorithms

Minimizing L 1 over L 2 norms on the gradient

On the smoothing of the norm objective penalty function for two-cardinality sparse constrained optimization problems

Sharp minimax optimality of LASSO and SLOPE under double sparsity assumption

Minimization of Transformed $L_1$ Penalty: Theory, Difference of Convex Function Algorithm, and Robust Application in Compressed Sensing

Smooth Approximation of L_infinity-Norm for Multi-view Geometry

Weak Sharp Minima for Convex Infinite Optimization Problems in Normed Linear Spaces

Sampling numbers of smoothness classes via $\ell^1$-minimization

Solving the L1 regularized least square problem via a box-constrained smooth minimization