Abstract:The \(\ell _1\) norm is the tight convex relaxation for the \(\ell _0\) norm and has been successfully applied for recovering sparse signals. However, for problems with fewer samples than required for accurate \(\ell _1\) recovery, one needs to apply nonconvex penalties such as \(\ell _p\) norm. As one method for solving \(\ell _p\) minimization problems, iteratively reweighted \(\ell _1\) minimization updates the weight for each component based on the value of the same component at the previous iteration. It assigns large weights on small components in magnitude and small weights on large components in magnitude. The set of the weights is not fixed, and it makes the analysis of this method difficult. In this paper, we consider a weighted \(\ell _1\) penalty with the set of the weights fixed, and the weights are assigned based on the sort of all the components in magnitude. The smallest weight is assigned to the largest component in magnitude. This new penalty is called nonconvex sorted \(\ell _1\). Then we propose two methods for solving nonconvex sorted \(\ell _1\) minimization problems: iteratively reweighted \(\ell _1\) minimization and iterative sorted thresholding, and prove that both methods will converge to a local minimizer of the nonconvex sorted \(\ell _1\) minimization problems. We also show that both methods are generalizations of iterative support detection and iterative hard thresholding, respectively. The numerical experiments demonstrate the better performance of assigning weights by sort compared to assigning by value.

An Infimal Convolution Based Penalty for Sparse Signal Recovery

Block Sparse Recovery Via Mixed L 2 / L 1 Minimization

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

Robust Sparse Recovery Via Non-Convex Optimization

A Sparse MLE Approach for Joint Interference Mitigation and Data Recovery

Sparse Bayesian Learning Approach for Discrete Signal Reconstruction

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

Nonconvex Sorted ℓ _1 Minimization for Sparse Approximation

Fast Sparse Recovery Via Non-Convex Optimization

Group Sparse Recovery Via the $\ell ^0(\ell ^2)$ Penalty: Theory and Algorithm

From Least Squares to Sparse: A Non-Convex Approach with Guarantee

A Fast Convex Conjugated Algorithm for Sparse Recovery

Nonconvex Regularization Based Sparse Recovery and Demixing with Application to Color Image Inpainting

A Unified Primal Dual Active Set Algorithm for Nonconvex Sparse Recovery

Sparse Signal Estimation by Maximally Sparse Convex Optimization

Non-signal Components Minimization for Sparse Signal Recovery

Nonconvex Sorted $$\ell _1$$ ℓ 1 Minimization for Sparse Approximation

Computational approaches to non-convex, sparsity-inducing multi-penalty regularization

Improving Spiking Sparse Recovery via Non-Convex Penalties

An Efficient Semismooth Newton Method for Adaptive Sparse Signal Recovery Problems