Abstract:Both the popular primal-dual algorithms of Chambolle-Pock and Chang-Yang are full-splitting and efficient for solving bilinear saddle point problem. However, their step sizes depend on the spectral norm of the linear transform or are estimated by using linesearch, which are usually overconservative from the spectral norm or require extra computing from linesearch. By using sequence interpolation and extrapolation, a novel primal-dual algorithm with larger stepsizes is proposed. Moreover for this scheme, we introduce a splitting preconditioned strategy by solving matrix inversion problem for the dual variable, where the preconditioning is separable from the evaluations of proximal operators and then avoids the difficulty of computing complicated preconditioned proximal operator in the existing methods. The preconditioned primal-dual algorithm not only does not require the spectral norm of the linear transform or linesearch to estimate stepsizes, but also holds cheap computation on the matrix inversion problem for the cases with primal or dual variable being modest, as the matrix decomposition is involved only once. Global iterative convergence and ergodic convergence rate results measured by the function value residual and constraint violation are established, where N denotes the iteration counter. Finally, we demonstrate the performance of the proposed primal-dual algorithm and preconditioning strategy via preliminary numerical experiments.

An Inexact Primal-Dual Smoothing Framework for Large-Scale Non-Bilinear Saddle Point Problems

A Primal-Dual Smoothing Framework for Max-Structured Non-Convex Optimization

A Smooth Primal-Dual Optimization Framework for Nonsmooth Composite Convex Minimization

An efficient symmetric primal-dual algorithmic framework for saddle point problems

Randomized First-Order Methods for Saddle Point Optimization

Primal-Dual Sequential Subspace Optimization for Saddle-point Problems

A nonsmooth primal-dual method with interwoven PDE constraint solver

DIPPA: An improved Method for Bilinear Saddle Point Problems

Nonlinear preconditioned primal-dual method for a class of structured minimax problems

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems

A Second Order Primal–Dual Dynamical System for a Convex–Concave Bilinear Saddle Point Problem

A splitting primal-dual proximity algorithm for solving composite optimization problems

An Inexact Primal-Dual Algorithm for Semi-Infinite Programming

A splitting preconditioned primal-dual algorithm with interpolation and extrapolation for bilinear saddle point problem

A Nonlinear Bregman Primal-Dual Framework for Optimizing Nonconvex Infimal Convolutions

A Unified Primal-Dual Algorithm Framework for Inequality Constrained Problems

On the Differentiability of the Primal-Dual Interior-Point Method

A convex combination based primal-dual algorithm with linesearch for general convex-concave saddle point problems

Primal-dual Accelerated Mirror-Descent Method for Constrained Bilinear Saddle-Point Problems

A Randomized Block-Coordinate Primal-Dual Method for Large-scale Stochastic Saddle Point Problems