Abstract:The Bregman proximal gradient method (BPGM), which uses the Bregman distance as a proximity measure in the iterative scheme, has recently been re-developed for minimizing convex composite problems without the global Lipschitz gradient continuity assumption. This makes the BPGM appealing for a wide range of applications, and hence it has received growing attention in recent years. However, most existing convergence results are only obtained under the assumption that the involved subproblems are solved exactly, which is unrealistic in many applications and limits the applicability of the BPGM. To make the BPGM implementable and practical, in this paper, we develop inexact versions of the BPGM (denoted by iBPGM) by employing either an absolute-type stopping criterion or a partial relative-type stopping criterion for solving the subproblems. The $\mathcal{O}(1/k)$ convergence rate and the convergence of the sequence are also established for our iBPGM under some conditions. Moreover, we develop an inertial variant of our iBPGM (denoted by v-iBPGM) and establish the $\mathcal{O}(1/k^{\gamma})$ convergence rate, where $\gamma\geq1$ is a restricted relative smoothness exponent depending on the smooth function in the objective and the kernel function. Specially, when the smooth function in the objective has a Lipschitz continuous gradient and the kernel function is strongly convex, we have $\gamma=2$ and thus the v-iBPGM improves the convergence rate of the iBPGM from $\mathcal{O}(1/k)$ to $\mathcal{O}(1/k^2)$, in accordance with the existing results on the exact accelerated BPGM. Finally, some preliminary numerical experiments for solving the discrete quadratic regularized optimal transport problem are conducted to illustrate the convergence behaviors of our iBPGM and v-iBPGM under different inexactness settings.

Efficient Inexact Proximal Gradient Algorithm for Nonconvex Problems.

More Efficient Accelerated Proximal Algorithm for Nonconvex Problems

Accelerated Proximal Gradient Methods for Nonconvex Programming

Inexact Proximal Gradient Methods for Non-convex and Non-smooth Optimization

A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems

A unified single-loop alternating gradient projection algorithm for nonconvex–concave and convex–nonconcave minimax problems

Accelerated Quasi-Newton Proximal Extragradient: Faster Rate for Smooth Convex Optimization

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Accelerated Proximal Coordinate Gradient Methods

Approximate Bregman Proximal Gradient Algorithm for Relatively Smooth Nonconvex Optimization

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

A nonmonotone accelerated proximal gradient method with variable stepsize strategy for nonsmooth and nonconvex minimization problems

Distributed Accelerated Proximal Coordinate Gradient Methods

Smoothing Accelerated Proximal Gradient Method with Fast Convergence Rate for Nonsmooth Convex Optimization Beyond Differentiability

Inexact Bregman Proximal Gradient Method and its Inertial Variant with Absolute and Partial Relative Stopping Criteria

A Relative Inexact Proximal Gradient Method With an Explicit Linesearch

A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization.

A New Inexact Gradient Descent Method with Applications to Nonsmooth Convex Optimization

A Bregman Proximal Stochastic Gradient Method with Extrapolation for Nonconvex Nonsmooth Problems

Inexact Riemannian Gradient Descent Method for Nonconvex Optimization

Nonconvex Stochastic Bregman Proximal Gradient Method for Nonconvex Composite Problems