Abstract:The ℓ _p regularization problem with 0< p< 1 has been widely studied for finding sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. The proximal gradient algorithm is one of the most popular algorithms for solving the ℓ _p regularisation problem. In the present paper, we investigate the linear convergence issue of one inexact descent method and two inexact proximal gradient algorithms (PGA). For this purpose, an optimality condition theorem is explored to provide the equivalences among a local minimum, second-order optimality condition and second-order growth property of the ℓ _p regularization problem. By virtue of the second-order optimality condition and second-order growth property, we establish the linear convergence properties of the inexact descent method and inexact PGAs under some simple assumptions. Both linear convergence to a local minimal value and linear convergence to a local minimum are provided. Finally, the linear convergence results of these methods are extended to the infinite-dimensional Hilbert spaces. Our results cannot be established under the framework of Kurdyka–Łojasiewicz theory.

Convergence analysis of gauss-type proximal point method for metrically regular mappings

Convergence Analysis of the Gauss–Newton-Type Method for Lipschitz-Like Mappings

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

Convergence Behavior of Gauss-Newton's Method and Extensions of the Smale Point Estimate Theory.

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Majorizing Functions and Convergence of the Gauss-Newton Method for Convex Composite Optimization

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

Convergence and Uniqueness Properties of Gauss-Newton's Method

Convergence Analysis of a Method for Variational Inclusions

Monotone vector fields and the proximal point algorithm on Hadamard manifolds

Gauss–Newton Method for Convex Composite Optimizations on Riemannian Manifolds

Strong Convergence Theorems for Relatively Nonexpansive Mappings and Variational Inclusions in Banach Spaces

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Local Conditions for Global Convergence of Gradient Flows and Proximal Point Sequences in Metric Spaces

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

Explicit Convergence Rate of The Proximal Point Algorithm under R-Continuity