Abstract:We propose and analyze a golden ratio primal-dual algorithm for solving structured optimization problems involving the sum of three convex terms - a smooth function with Lipschitzian gradient and two nonsmooth proximal-friendly functions, one of which is composed with a linear mapping. The proposed algorithm is of primal-dual and full-splitting type as it solves the primal and the dual problems simultaneously and does not rely on solving any subproblems or linear system of equations iteratively, the smooth function is handled by gradient evaluation, and the nonsmooth functions are handled by their proximity operators. Several well-known algorithms are closely related, e.g., the classical Arrow-Hurwicz method and the primal-dual algorithm of Chambolle and Pock. In particular, it extends the golden ratio primal-dual algorithm recently proposed by Chang and Yang by including an extra smooth term with Lipschitzian gradient. The convergence rates O(1/N) and O(1/N-2) are established for convex and strongly convex cases, respectively, which differentiate themselves from existing results in terms of the adopted optimality measures. Specifically, to measure optimality, most existing results adopt the primal-dual gap function, a major flaw of which is that it could vanish at nonstationary points. In comparison, we adopt function value residual and feasibility violation as optimality measures, which are conventional for 'constrained optimization. Finally, preliminary numerical results on image reconstruction and elastic net regularization problems are presented to demonstrate the efficiency of the proposed algorithm.

Convergence analysis of a primal–dual optimization-by-continuation algorithm

Convergence analysis of a primal-dual optimization-by-continuation algorithm

Convergence analysis of approximate primal solutions in dual first-order methods

Parametrization and convergence of a primal-dual block-coordinate approach to linearly-constrained nonsmooth optimization

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

A Nonlinear Bregman Primal-Dual Framework for Optimizing Nonconvex Infimal Convolutions

A splitting primal-dual proximity algorithm for solving composite optimization problems

A New Primal-Dual Algorithm for a Class of Nonlinear Compositional Convex Optimization Problems

A new primal-dual algorithm for structured convex optimization involving a lipschitzian term

A Smooth Primal-Dual Optimization Framework for Nonsmooth Composite Convex Minimization

Some Primal-Dual Theory for Subgradient Methods for Strongly Convex Optimization

Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints

A Fast Single-Loop Primal-Dual Algorithm for Non-Convex Functional Constrained Optimization

A nested primal–dual iterated Tikhonov method for regularized convex optimization

Linear Convergence of Primal-Dual Gradient Methods and their Performance in Distributed Optimization

Analysis of Primal-Dual Langevin Algorithms

On the convergence of proximal gradient methods for convex simple bilevel optimization

Primal-dual proximal bundle and conditional gradient methods for convex problems

A fast primal-dual algorithm via dynamical system with variable mass for linearly constrained convex optimization

Automated Lyapunov Analysis of Primal-Dual Optimization Algorithms: An Interpolation Approach

Convergence of Nonmonotone Proximal Gradient Methods under the Kurdyka-Lojasiewicz Property without a Global Lipschitz Assumption