Abstract:In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now the non-convex algorithms lack convergence guarantee from the initial solution to the global optimum. This paper aims to provide theoretical guarantee for sparse recovery via non-convex optimization. The concept of weak convexity is incorporated into a class of sparsity-inducing penalties to characterize their non-convexity. It is shown that in a neighborhood of the sparse signal (with radius in inverse proportion to the non-convexity), any local optimum can be regarded as a stable solution. It is further proved that if the non-convexity of the penalty function is below a threshold, the initial solution also belongs to this neighborhood. In addition, The idea of projected (sub)gradient method is generalized to solve this non-convex optimization problem. A uniform approximate projection can also be applied in the projection step to make the algorithm computationally tractable for large scale problems. The theoretical convergence analysis of these methods is provided in the noisy scenario. The result reveals that if the non-convexity is below a threshold, these methods would converge from the initial solution, and the recovered solution is with recovery error linear in both the noise term and the step size. Numerical simulations are performed to test the performance of the proposed approach and verify the theoretical analysis.

Convergence of projection and contraction algorithms with outer perturbations and their applications to sparse signals recovery

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

Inertial hybrid and shrinking projection algorithms for solving variational inequality problems

Convergence Analysis of Projection Method for Variational Inequalities

Modified Inertial Projection and Contraction Algorithms with Non-Monotonic Step Sizes for Solving Variational Inequalities and Their Applications

Inertial Projection and Contraction Methods for Pseudomonotone Variational Inequalities with Non-Lipschitz Operators and Applications

On relaxed inertial projection and contraction algorithms for solving monotone inclusion problems

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

A class modified projection algorithms for nonmonotone variational inequalities with continuity

Strongly convergent inertial projection and contraction methods for split variational inequality problem

Modified projection method and strong convergence theorem for solving variational inequality problems with non-Lipschitz operators

A Projection-Based Algorithm for Solving Stochastic Inverse Variational Inequality Problems

Linear Convergence Results for Inertial Type Projection Algorithm for Quasi-Variational Inequalities

Strong and linear convergence of projection-type method with an inertial term for finding minimum-norm solutions of pseudomonotone variational inequalities in Hilbert spaces

The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery.

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

Inertial Halpern-type methods for variational inequality with application to medical image recovery

Projection and contraction method with double inertial steps for quasi-monotone variational inequalities

Strong Convergence of a Projection-Type Method for Mixed Variational Inequalities in Hilbert Spaces

Relaxed Projection Methods with Self-Adaptive Step Size for Solving Variational Inequality and Fixed Point Problems for an Infinite Family of Multivalued Relatively Nonexpansive Mappings in Banach Spaces