Abstract:The ℓ _p regularization problem with 0< p< 1 has been widely studied for finding sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. The proximal gradient algorithm is one of the most popular algorithms for solving the ℓ _p regularisation problem. In the present paper, we investigate the linear convergence issue of one inexact descent method and two inexact proximal gradient algorithms (PGA). For this purpose, an optimality condition theorem is explored to provide the equivalences among a local minimum, second-order optimality condition and second-order growth property of the ℓ _p regularization problem. By virtue of the second-order optimality condition and second-order growth property, we establish the linear convergence properties of the inexact descent method and inexact PGAs under some simple assumptions. Both linear convergence to a local minimal value and linear convergence to a local minimum are provided. Finally, the linear convergence results of these methods are extended to the infinite-dimensional Hilbert spaces. Our results cannot be established under the framework of Kurdyka–Łojasiewicz theory.

Convergence Rate of Descent Method with New Inexact Line-Search on Riemannian Manifolds

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Inexact Riemannian Gradient Descent Method for Nonconvex Optimization

Convergence analysis of the DFP algorithm for unconstrained optimization problems on Riemannian manifolds

Linear Convergence of Subgradient Algorithm for Convex Feasibility on Riemannian Manifolds

A descent method for nonsmooth multiobjective optimization problems on Riemannian manifolds

On the linear convergence rate of Riemannian proximal gradient method

Global convergence of a conjugate descent algorithm

Gauss–Newton Method for Convex Composite Optimizations on Riemannian Manifolds

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

AN INEXACT DESCENT ALGORITHM FOR MULTICRITERIA OPTIMIZATIONS ON GENERAL RIEMANNIAN MANIFOLDS

Riemannian Interior Point Methods for Constrained Optimization on Manifolds

Convergence and worst-case complexity of adaptive Riemannian trust-region methods for optimization on manifolds

A new convergence rate of the steepest descent regarding the Euclidean norm

Global convergence of Riemannian line search methods with a Zhang-Hager-type condition

Convergence analysis of incremental quasi-subgradient method on Riemannian manifolds with lower bounded curvature

Two efficient nonlinear conjugate gradient methods for Riemannian manifolds