Abstract:This paper considers the problem of minimizing the summation of a differentiable function and a nonsmooth function on a Riemannian manifold. In recent years, proximal gradient method and its invariants have been generalized to the Riemannian setting for solving such problems. Different approaches to generalize the proximal mapping to the Riemannian setting lead versions of Riemannian proximal gradient methods. However, their convergence analyses all rely on solving their Riemannian proximal mapping exactly, which is either too expensive or impracticable. In this paper, we study the convergence of an inexact Riemannian proximal gradient method. It is proven that if the proximal mapping is solved sufficiently accurately, then the global convergence and local convergence rate based on the Riemannian Kurdyka-Łojasiewicz property can be guaranteed. Moreover, practical conditions on the accuracy for solving the Riemannian proximal mapping are provided. As a byproduct, the proximal gradient method on the Stiefel manifold proposed in~[CMSZ2020] can be viewed as the inexact Riemannian proximal gradient method provided the proximal mapping is solved to certain accuracy. Finally, numerical experiments on sparse principal component analysis are conducted to test the proposed practical conditions.

On the linear convergence rate of Riemannian proximal gradient method

An Inexact Riemannian Proximal Gradient Method

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Linear Convergence of Subgradient Algorithm for Convex Feasibility on Riemannian Manifolds

Riemannian proximal gradient methods

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

A Riemannian Proximal Newton Method

Riemannian Proximal Gradient Methods (extended Version)

The Proximal Gradient Method for Composite Optimization Problems on Riemannian Manifolds

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Convergence Rate of Descent Method with New Inexact Line-Search on Riemannian Manifolds

On the Linear Convergence of a Proximal Gradient Method for a Class of Nonsmooth Convex Minimization Problems

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Linear Convergence of the Proximal Gradient Method for Composite Optimization Under the Polyak-Łojasiewicz Inequality and Its Variant

Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties

A Decentralized Proximal Gradient Tracking Algorithm for Composite Optimization on Riemannian Manifolds