Abstract:In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now the non-convex algorithms lack convergence guarantee from the initial solution to the global optimum. This paper aims to provide theoretical guarantee for sparse recovery via non-convex optimization. The concept of weak convexity is incorporated into a class of sparsity-inducing penalties to characterize their non-convexity. It is shown that in a neighborhood of the sparse signal (with radius in inverse proportion to the non-convexity), any local optimum can be regarded as a stable solution. It is further proved that if the non-convexity of the penalty function is below a threshold, the initial solution also belongs to this neighborhood. In addition, The idea of projected (sub)gradient method is generalized to solve this non-convex optimization problem. A uniform approximate projection can also be applied in the projection step to make the algorithm computationally tractable for large scale problems. The theoretical convergence analysis of these methods is provided in the noisy scenario. The result reveals that if the non-convexity is below a threshold, these methods would converge from the initial solution, and the recovered solution is with recovery error linear in both the noise term and the step size. Numerical simulations are performed to test the performance of the proposed approach and verify the theoretical analysis.

Robust Sparse Recovery Via Weakly Convex Optimization in Impulsive Noise

Robust Sparse Recovery in Impulsive Noise Via M-Estimator and Non-Convex Regularization

Robust Sparse Recovery in Impulsive Noise via p-1 Optimization

Robust Sparse Recovery in Impulsive Noise Via $\ell _p$ -$\Ell _1$ Optimization

Robust Sparse Recovery in Impulsive Noise via lp-l1 Optimization

A Robust Recovery Algorithm with Smoothing Strategies.

Stability and robustness of the l2/lq-minimization for block sparse recovery.

Robust Sparse Recovery via Weakly Convex Regularization

Weakly Convex Regularized Robust Sparse Recovery Methods with Theoretical Guarantees

Robust Sparse Recovery for Compressive Sensing in Impulsive Noise Using ℓp-Norm Model Fitting.

Robust Sparse Recovery Via Non-Convex Optimization

Nonconvex Penalized Regularization for Robust Sparse Recovery in the Presence of $s\alpha S$ Noise

Sparse Recovery of Multiple Measurement Vectors in Impulsive Noise: A Smooth Block Successive Minimization Algorithm

Iteratively Reweighted Sparse Reconstruction in Impulsive Noise

A Non-convex Approach for Sparse Recovery with Convergence Guarantee

Group Sparse Recovery in Impulsive Noise Via Alternating Direction Method of Multipliers

Fast Sparse Recovery Via Non-Convex Optimization

Robust Tensor Recovery in Impulsive Noise Based on Correntropy and Hybrid Tensor Sparsity

Efficient and Robust Recovery of Sparse Signal and Image Using Generalized Nonconvex Regularization

A $ Q$ -Gaussian Maximum Correntropy Adaptive Filtering Algorithm for Robust Sparse Recovery in Impulsive Noise

Stable Outlier-Robust Signal Recovery Over Networks: A Convex Analytic Approach Using Minimax Concave Loss