Abstract:In recent studies on sparse modeling, nonconvex penalties have received considerable attentions due to their superiorities on sparsity-inducing over the convex counterparts. In this paper, we study the convergence of a nonconvex iterative thresholding algorithm for solving a class of sparse regularized optimization problems, where the corresponding thresholding functions of the penalties are discontinuous with jump discontinuities. Therefore, we call the algorithm the iterative jumping thresholding (IJT) algorithm. The finite support and sign convergence of IJT algorithm is first verified via taking advantage of such jump discontinuity. Together with the introduced restricted Kurdyka-Łojasiewicz property, then the global convergence1 of the entire sequence can be further proved. Furthermore, we can show that the IJT algorithm converges to a strictly local minimizer at an eventual linear rate2 under some additional conditions. Moreover, we derive a posteriori computable error estimate, which can be used to design an efficient terminate rule. It should be pointed out that the ℓq quasinorm (0 <; q <; 1) is an important subclass of the nonconvex penalties studied in this paper. In particular, when applied to the ℓq regularization, IJT algorithm can converge to a local minimizer with an eventual linear rate under certain concentration conditions. We also apply the proposed algorithm to sparse signal recovery and synthetic aperture radar imaging problems. The experiment results show the effectiveness of the proposed algorithm.

Multi-parameter Tikhonov regularization with the ` sparsity constraint: ` convergence

Multi-parameter Tikhonov Regularization with the ℓ 0 Sparsity Constraint

Tikhonov Regularization with L^0-Term Complementing a Convex Penalty: L^1 Convergence under Sparsity Constraints

Multi-parameter Regularization and Its Numerical Realization

Multi-Parameter Tikhonov Regularization for Linear Ill-Posed Operator Equations

Convergence of Chebyshev Type Regularization Method under Morozov Discrepancy Principle.

Sparsity reconstruction by the standard Tikhonov method

A Global Minimization Algorithm for Tikhonov Functionals with Sparsity Constraints

A new approach to nonlinear constrained Tikhonov regularization

A dual based semismooth Newton-type algorithm for solving large-scale sparse Tikhonov regularization problems

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Beyond convergence rates: Exact recovery with Tikhonov regularization with sparsity constraints

High-dimensional Inference Via Lipschitz Sparsity-Yielding Regularizers.

Discrepancy Curves for Multi-Parameter Regularization

Asymptotics for estimating a diverging number of parameters - with and without sparsity

Sparse Parameter Identification for Stochastic Systems Based on [math] Regularization

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Sparse Reconstruction by Means of the Standard Tikhonov Regularization

Tikhonov regularized exterior penalty dynamics for constrained variational inequalities

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

Sparse Regularization: Convergence of Iterative Jumping Thresholding Algorithm