Abstract:The \(\ell _1\) norm is the tight convex relaxation for the \(\ell _0\) norm and has been successfully applied for recovering sparse signals. However, for problems with fewer samples than required for accurate \(\ell _1\) recovery, one needs to apply nonconvex penalties such as \(\ell _p\) norm. As one method for solving \(\ell _p\) minimization problems, iteratively reweighted \(\ell _1\) minimization updates the weight for each component based on the value of the same component at the previous iteration. It assigns large weights on small components in magnitude and small weights on large components in magnitude. The set of the weights is not fixed, and it makes the analysis of this method difficult. In this paper, we consider a weighted \(\ell _1\) penalty with the set of the weights fixed, and the weights are assigned based on the sort of all the components in magnitude. The smallest weight is assigned to the largest component in magnitude. This new penalty is called nonconvex sorted \(\ell _1\). Then we propose two methods for solving nonconvex sorted \(\ell _1\) minimization problems: iteratively reweighted \(\ell _1\) minimization and iterative sorted thresholding, and prove that both methods will converge to a local minimizer of the nonconvex sorted \(\ell _1\) minimization problems. We also show that both methods are generalizations of iterative support detection and iterative hard thresholding, respectively. The numerical experiments demonstrate the better performance of assigning weights by sort compared to assigning by value.

Sorted Minimization for Sparse Signal Recovery

Sorted L1/L2 Minimization for Sparse Signal Recovery

Subspace Weighted L(2,1) Minimization For Sparse Signal Recovery

Block Sparse Recovery Via Mixed L 2 / L 1 Minimization

Subspace weighted ℓ 2,1 minimization for sparse signal recovery

Weighted LASSO for Sparse Recovery with Statistical Prior Support Information

Non-signal Components Minimization for Sparse Signal Recovery

Nonconvex Sorted ℓ _1 Minimization for Sparse Approximation

Analyzing Weighted $\ell_1$ Minimization for Sparse Recovery with Nonuniform Sparse Models\footnote{The results of this paper were presented in part at the International Symposium on Information Theory, ISIT 2009}

An Iteratively Reweighted Method For Recovery Of Block-Sparse Signal With Unknown Block Partition

Sparse Signal Recovery Via Minimax-Concave Penalty and ℓ 1 -Norm Loss Function.

Fast Sparse Recovery Via Non-Convex Optimization

A Truncated Approximate Difference Algorithm for Sparse Signal Recovery

On Recovery of Block-Sparse Signals Via Mixed L2/lq(0 < Q ≤ 1) Norm Minimization

Sparse Signal Recovery Based on Simulated Annealing

On recovery of sparse signals via l1 minimization

Nonconvex Sorted $$\ell _1$$ ℓ 1 Minimization for Sparse Approximation

Joint Sparse Recovery for Signals of Spark-Level Sparsity and MMV Tail-$\ell _{2,1}$ Minimization

Sparse Signal Recovery by Minimization Under Restricted Isometry Property

Robust Recovery of Jointly-Sparse Signals Using Minimax Concave Loss Function

Noisy Signal Recovery via Iterative Reweighted L1-Minimization