Abstract:This paper considers the problem of minimizing the summation of a differentiable function and a nonsmooth function on a Riemannian manifold. In recent years, proximal gradient method and its invariants have been generalized to the Riemannian setting for solving such problems. Different approaches to generalize the proximal mapping to the Riemannian setting lead versions of Riemannian proximal gradient methods. However, their convergence analyses all rely on solving their Riemannian proximal mapping exactly, which is either too expensive or impracticable. In this paper, we study the convergence of an inexact Riemannian proximal gradient method. It is proven that if the proximal mapping is solved sufficiently accurately, then the global convergence and local convergence rate based on the Riemannian Kurdyka-Łojasiewicz property can be guaranteed. Moreover, practical conditions on the accuracy for solving the Riemannian proximal mapping are provided. As a byproduct, the proximal gradient method on the Stiefel manifold proposed in~[CMSZ2020] can be viewed as the inexact Riemannian proximal gradient method provided the proximal mapping is solved to certain accuracy. Finally, numerical experiments on sparse principal component analysis are conducted to test the proposed practical conditions.

Proximal calculus on Riemannian manifolds, with applications to fixed point theory

Equilibrium Problems on Riemannian Manifolds with Applications

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Monotone vector fields and the proximal point algorithm on Hadamard manifolds

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

Newton's Method for Sections on Riemannian Manifolds: Generalized Covariant Α-Theory

A Riemannian Proximal Newton Method

Subgradient Projection Algorithms for Convex Feasibility on Riemannian Manifolds with Lower Bounded Curvatures

Gauss–Newton Method for Convex Composite Optimizations on Riemannian Manifolds

Newton's Method on Riemannian Manifolds: Smale's Point Estimate Theory under the Γ-Condition

An Inexact Riemannian Proximal Gradient Method

Proximal methods for structured nonsmooth optimization over Riemannian submanifolds

Local proximal algorithms in Riemannian manifolds: Application to the behavioral traveler's problem

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Linear Convergence of Subgradient Algorithm for Convex Feasibility on Riemannian Manifolds

Finite Termination of Inexact Proximal Point Algorithms in Hilbert Spaces

Weak Sharp Minima and Finite Termination of the Proximal Point Method for Convex Functions on Hadamard Manifolds

On Differential and Riemannian Calculus on Wasserstein Spaces

Level proximal subdifferential, variational convexity, and pointwise Lipschitz smoothness