Abstract:We propose two approximate versions of the first-order primaldual algorithm (PDA) to solve a class of convex-concave saddle point problems. The introduced approximate criteria are easy to implement in the sense that they only involve the subgradient of a certain function at the current iterate. The first approximate PDA solves both subproblems inexactly and adopts the absolute error criteria, which are based on non-negative summable sequences. Assuming that one of the PDA subproblems can be solved exactly, the second approximate PDA solves the other subproblem approximately and adopts a relative error criterion. The relative error criterion only involves a single parameter in the range of [0, 1), which makes the method more applicable. For both versions, we establish the global convergence and O(1/N) convergence rate measured by the iteration complexity, where N counts the number of iterations. For the inexact PDA with absolute error criteria, we show the accelerated O(1/N-2) and linear convergence rate under the assumptions that a part of the underlying functions and both underlying functions are strongly convex, respectively. Then, we prove that these inexact criteria can also be extended to solve a class of more general problems. Finally, we perform some numerical experiments on sparse recovery and image processing problems. The results demonstrate the feasibility and superiority of the proposed methods.

Approximate First-Order Primal-Dual Algorithms for Saddle Point Problems.

Optimal Primal-Dual Methods for a Class of Saddle Point Problems

Randomized First-Order Methods for Saddle Point Optimization

An efficient symmetric primal-dual algorithmic framework for saddle point problems

Convergence analysis of approximate primal solutions in dual first-order methods

An inexact golden ratio primal-dual algorithm with linesearch step for a saddle point problem

An Inexact Primal-Dual Smoothing Framework for Large-Scale Non-Bilinear Saddle Point Problems

Robust Accelerated Primal-Dual Methods for Computing Saddle Points

Primal-Dual Sequential Subspace Optimization for Saddle-point Problems

Approximate Primal-Dual Fixed-Point based Langevin Algorithms for Non-smooth Convex Potentials

A Second Order Primal–Dual Dynamical System for a Convex–Concave Bilinear Saddle Point Problem

A splitting primal-dual proximity algorithm for solving composite optimization problems

Faster Accelerated First-order Methods for Convex Optimization with Strongly Convex Function Constraints

A Fast Single-Loop Primal-Dual Algorithm for Non-Convex Functional Constrained Optimization

A convex combination based primal-dual algorithm with linesearch for general convex-concave saddle point problems

A nonsmooth primal-dual method with interwoven PDE constraint solver

Comparison of Proximal First-Order Primal and Primal-Dual algorithms via Performance Estimation

A first-order computational algorithm for reaction-diffusion type equations via primal-dual hybrid gradient method

A Generalized Primal-Dual Correction Method for Saddle-Point Problems with the Nonlinear Coupling Operator