Abstract:In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now the non-convex algorithms lack convergence guarantee from the initial solution to the global optimum. This paper aims to provide theoretical guarantee for sparse recovery via non-convex optimization. The concept of weak convexity is incorporated into a class of sparsity-inducing penalties to characterize their non-convexity. It is shown that in a neighborhood of the sparse signal (with radius in inverse proportion to the non-convexity), any local optimum can be regarded as a stable solution. It is further proved that if the non-convexity of the penalty function is below a threshold, the initial solution also belongs to this neighborhood. In addition, The idea of projected (sub)gradient method is generalized to solve this non-convex optimization problem. A uniform approximate projection can also be applied in the projection step to make the algorithm computationally tractable for large scale problems. The theoretical convergence analysis of these methods is provided in the noisy scenario. The result reveals that if the non-convexity is below a threshold, these methods would converge from the initial solution, and the recovered solution is with recovery error linear in both the noise term and the step size. Numerical simulations are performed to test the performance of the proposed approach and verify the theoretical analysis.

Sparse Signal Recovery Based on Simulated Annealing

A simulated annealing algorithm for sparse recovery by l0 minimization

A Sparse Recovery Algorithm Based on Particle Swarm Optimization

A Sparse Recovery Algorithm Based on Arithmetic Optimization

Asymptotically Optimized Subspace Pursuit for sparse signal recovery

An Optimization-Oriented Algorithm for Sparse Signal Reconstruction.

A Novel Sparse Signal Reconstruction Algorithm Based on $l_{0}$ Minimization

Fast Recursive Greedy Methods for Sparse Signal Recovery

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

On A Class of Greedy Sparse Recovery Algorithms -- A High Dimensional Approach

Extreme Sparse-Array Synthesis Via Iterative Convex Optimization and Simulated-Annealing Expanded Array

Fast Sparse Recovery Via Non-Convex Optimization

Robust Sparse Recovery Via Non-Convex Optimization

Sparse Signal Recovery Via Generalized Gaussian Function

Sorted L1/L2 Minimization for Sparse Signal Recovery

Sparse Signal Reconstruction Via Expanded Subspace Pursuit

Large Sparse Signal Recovery by Conjugate Gradient Algorithm Based on Smoothing Technique

Sorted Minimization for Sparse Signal Recovery

Dynamical Sparse Signal Recovery with Fixed-Time Convergence

A comparison of typical sparse optimization for 1D signal recovery

Adaptive matching pursuit for sparse signal recovery