Abstract:We propose and analyze a golden ratio primal-dual algorithm for solving structured optimization problems involving the sum of three convex terms - a smooth function with Lipschitzian gradient and two nonsmooth proximal-friendly functions, one of which is composed with a linear mapping. The proposed algorithm is of primal-dual and full-splitting type as it solves the primal and the dual problems simultaneously and does not rely on solving any subproblems or linear system of equations iteratively, the smooth function is handled by gradient evaluation, and the nonsmooth functions are handled by their proximity operators. Several well-known algorithms are closely related, e.g., the classical Arrow-Hurwicz method and the primal-dual algorithm of Chambolle and Pock. In particular, it extends the golden ratio primal-dual algorithm recently proposed by Chang and Yang by including an extra smooth term with Lipschitzian gradient. The convergence rates O(1/N) and O(1/N-2) are established for convex and strongly convex cases, respectively, which differentiate themselves from existing results in terms of the adopted optimality measures. Specifically, to measure optimality, most existing results adopt the primal-dual gap function, a major flaw of which is that it could vanish at nonstationary points. In comparison, we adopt function value residual and feasibility violation as optimality measures, which are conventional for 'constrained optimization. Finally, preliminary numerical results on image reconstruction and elastic net regularization problems are presented to demonstrate the efficiency of the proposed algorithm.

Nonlinear preconditioned primal-dual method for a class of structured minimax problems

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A Primal-Dual Smoothing Framework for Max-Structured Non-Convex Optimization

A Primal-Dual Algorithm Framework for Convex Saddle-Point Optimization

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

Accelerated Primal-dual Scheme for a Class of Stochastic Nonconvex-concave Saddle Point Problems

A splitting primal-dual proximity algorithm for solving composite optimization problems

A splitting preconditioned primal-dual algorithm with interpolation and extrapolation for bilinear saddle point problem

A Proximal Point Analysis of the Preconditioned Alternating Direction Method of Multipliers.

A convex combination based primal-dual algorithm with linesearch for general convex-concave saddle point problems

A preconditioned alternating minimization framework for nonconvex and half quadratic regularization

An efficient symmetric primal-dual algorithmic framework for saddle point problems

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems

A Preconditioned Alternating Minimization Framework for Nonconvex and Half Quadratic Optimization.

A new primal-dual algorithm for structured convex optimization involving a lipschitzian term

Primal Dual Alternating Proximal Gradient Algorithms for Nonsmooth Nonconvex Minimax Problems with Coupled Linear Constraints

A Modified Primal-Dual Algorithm for Structured Convex Optimization with a Lipschitzian Term

Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problems

Primal-dual Interior Point QP-free Algorithm for Nonlinear Constrained Optimization

Primal-Dual Sequential Subspace Optimization for Saddle-point Problems

Local Linear Convergence Analysis of Primal–Dual Splitting Methods