Abstract:The Bregman proximal gradient method (BPGM), which uses the Bregman distance as a proximity measure in the iterative scheme, has recently been re-developed for minimizing convex composite problems without the global Lipschitz gradient continuity assumption. This makes the BPGM appealing for a wide range of applications, and hence it has received growing attention in recent years. However, most existing convergence results are only obtained under the assumption that the involved subproblems are solved exactly, which is unrealistic in many applications and limits the applicability of the BPGM. To make the BPGM implementable and practical, in this paper, we develop inexact versions of the BPGM (denoted by iBPGM) by employing either an absolute-type stopping criterion or a partial relative-type stopping criterion for solving the subproblems. The $\mathcal{O}(1/k)$ convergence rate and the convergence of the sequence are also established for our iBPGM under some conditions. Moreover, we develop an inertial variant of our iBPGM (denoted by v-iBPGM) and establish the $\mathcal{O}(1/k^{\gamma})$ convergence rate, where $\gamma\geq1$ is a restricted relative smoothness exponent depending on the smooth function in the objective and the kernel function. Specially, when the smooth function in the objective has a Lipschitz continuous gradient and the kernel function is strongly convex, we have $\gamma=2$ and thus the v-iBPGM improves the convergence rate of the iBPGM from $\mathcal{O}(1/k)$ to $\mathcal{O}(1/k^2)$, in accordance with the existing results on the exact accelerated BPGM. Finally, some preliminary numerical experiments for solving the discrete quadratic regularized optimal transport problem are conducted to illustrate the convergence behaviors of our iBPGM and v-iBPGM under different inexactness settings.

Convergence rates analysis of Interior Bregman Gradient Method for Vector Optimization Problems

Convergence Analysis of Gradient Algorithms on Riemannian Manifolds Without Curvature Constraints and Application to Riemannian Mass

Linear Convergence of Subgradient Algorithm for Convex Feasibility on Riemannian Manifolds

Variational Analysis Perspective on Linear Convergence of Some First Order Methods for Nonsmooth Convex Optimization Problems

Convergence of Inexact Steepest Descent Algorithm for Multiobjective Optimizations on Riemannian Manifolds Without Curvature Constraints

Descent Methods for Vector Optimization Problems: A Majorization-Minimization Perspective

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Convergence Analysis of a Method for Variational Inclusions

Convergence analysis of the Gauss–Newton method for convex inclusion and convex-composite optimization problems

Accelerated Bregman Proximal Gradient Methods for Relatively Smooth Convex Optimization

Convex and Non-convex Optimization Under Generalized Smoothness

Linear convergence of first order methods for non-strongly convex optimization

On the linear convergence rate of Riemannian proximal gradient method

Convergence analysis of approximate primal solutions in dual first-order methods

Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization

Barzilai-Borwein Proximal Gradient Methods for Multiobjective Composite Optimization Problems with Improved Linear Convergence

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

On quasi-inertial double extragradient-type iterations for variational inequalities and Bregman relatively asymptotically nonexpansive mapping

On the Extension of Dai-Liao Conjugate Gradient Method for Vector Optimization

Inexact Bregman Proximal Gradient Method and its Inertial Variant with Absolute and Partial Relative Stopping Criteria

Linear Convergence of the Proximal Gradient Method for Composite Optimization Under the Polyak-Łojasiewicz Inequality and Its Variant