Abstract:In this paper, based a novel primal-dual dynamical model with adaptive scaling parameters and Bregman divergences, we propose new accelerated primal-dual proximal gradient splitting methods for solving bilinear saddle-point problems with provable optimal nonergodic convergence rates. For the first, using the spectral analysis, we show that a naive extension of acceleration model for unconstrained optimization problems to a quadratic game is unstable. Motivated by this, we present an accelerated primal-dual hybrid gradient (APDHG) flow which combines acceleration with careful velocity correction. To work with non-Euclidean distances, we also equip our APDHG model with general Bregman divergences and prove the exponential decay of a Lyapunov function. Then, new primal-dual splitting methods are developed based on proper semi-implicit Euler schemes of the continuous model, and the theoretical convergence rates are nonergodic and optimal with respect to the matrix norms,\, Lipschitz constants and convexity parameters. Thanks to the primal and dual scaling parameters, both the algorithm designing and convergence analysis cover automatically the convex and (partially) strongly convex objectives. Moreover, the use of Bregman divergences not only unifies the standard Euclidean distances and general cases in an elegant way, but also makes our methods more flexible and adaptive to problem-dependent metrics.

Transformed Primal-Dual Methods For Nonlinear Saddle Point Systems

Transformed Primal-Dual Methods with Variable-Preconditioners

A primal-dual flow for affine constrained convex optimization

A Generalized Primal-Dual Correction Method for Saddle-Point Problems with the Nonlinear Coupling Operator

A Second Order Primal–Dual Dynamical System for a Convex–Concave Bilinear Saddle Point Problem

Optimal Primal-Dual Methods for a Class of Saddle Point Problems

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems

Inertial primal-dual dynamics with Hessian-driven damping and Tikhonov regularization for convex-concave bilinear saddle point problems

Convergence to a second-order critical point by a primal-dual interior point trust-region method for nonlinear semidefinite programming

Nonlinear preconditioned primal-dual method for a class of structured minimax problems

Two Modified Schemes for the Primal Dual Fixed Point Method

Robust Accelerated Primal-Dual Methods for Computing Saddle Points

An efficient symmetric primal-dual algorithmic framework for saddle point problems

An Enhanced Numerical Discretization Method for Transient Stability Constrained Optimal Power Flow

A continuous perspective on the inertial corrected primal-dual proximal splitting

Tikhonov regularized mixed-order primal-dual dynamical system for convex optimization problems with linear equality constraints

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

Tikhonov regularized second-order plus first-order primal-dual dynamical systems with asymptotically vanishing damping for linear equality constrained convex optimization problems

Tikhonov regularization of second-order plus first-order primal-dual dynamical systems for separable convex optimization