Abstract:In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now the non-convex algorithms lack convergence guarantee from the initial solution to the global optimum. This paper aims to provide theoretical guarantee for sparse recovery via non-convex optimization. The concept of weak convexity is incorporated into a class of sparsity-inducing penalties to characterize their non-convexity. It is shown that in a neighborhood of the sparse signal (with radius in inverse proportion to the non-convexity), any local optimum can be regarded as a stable solution. It is further proved that if the non-convexity of the penalty function is below a threshold, the initial solution also belongs to this neighborhood. In addition, The idea of projected (sub)gradient method is generalized to solve this non-convex optimization problem. A uniform approximate projection can also be applied in the projection step to make the algorithm computationally tractable for large scale problems. The theoretical convergence analysis of these methods is provided in the noisy scenario. The result reveals that if the non-convexity is below a threshold, these methods would converge from the initial solution, and the recovered solution is with recovery error linear in both the noise term and the step size. Numerical simulations are performed to test the performance of the proposed approach and verify the theoretical analysis.

New iterative methods for nonlinear operators as concerns convex programming applicable in differential problems, image deblurring, and signal recovering problems

Iterative methods for solving monotone variational inclusions without prior knowledge of the Lipschitz constant of the single-valued operator

Strong convergence of new iterative projection methods with regularization for solving monotone variational inequalities in Hilbert spaces

Local Convergence of Inexact Methods under the Hölder Condition

An Uni ed Convergence Theory for Newton's Type Methods for Zeros of Nonlinear Operators in Banach spaces

On relaxed inertial projection and contraction algorithms for solving monotone inclusion problems

Convergence of projection and contraction algorithms with outer perturbations and their applications to sparse signals recovery

Modified accelerated Bregman projection methods for solving quasi-monotone variational inequalities

Non-Euclidean Monotone Operator Theory and Applications

Plug‐and‐play algorithms for convex non‐convex regularization: Convergence analysis and applications

Incremental Methods for Weakly Convex Optimization

On the Bregman-proximal iterative algorithm for the monotone inclusion problem in Banach spaces

Non-monotonic and self-adaptive strongly convergent iterative methods for efficiently solving variational inequalities with pseudomonotone operators

Linear Convergence of Stochastic Iterative Greedy Algorithms With Sparse Constraints

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Learning truly monotone operators with applications to nonlinear inverse problems

Weak and strong convergence results for solving monotone variational inequalities in reflexive Banach spaces

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

A class modified projection algorithms for nonmonotone variational inequalities with continuity

An extended study of two multistep higher order convergent methods for solving nonlinear equations

An Extended Primal-Dual Algorithm Framework for Nonconvex Problems with Application to Nonlinear Imaging