Abstract:In this article, we study two methods for solving monotone inclusions in real Hilbert spaces involving the sum of a maximally monotone operator, a monotone-Lipschitzian operator, a cocoercive operator, and a normal cone to a vector subspace. Our algorithms split and exploits the intrinsic properties of each operator involved in the inclusion. We derive our methods by combining partial inverse techniques with the forward-half-reflected-backward algorithm and with the forward-shadow-Douglas–Rachford (FSDR) algorithm, respectively. Our methods inherit the advantages of those methods, requiring only one activation of the Lipschitzian operator, one activation of the cocoercive operator, two projections onto the closed vector subspace, and one calculation of the resolvent of the maximally monotone operator. Additionally, to allow larger step-sizes in one of the proposed methods, we revisit FSDR by extending its convergence for larger step-sizes. Furthermore, we provide methods for solving monotone inclusions involving a sum of maximally monotone operatores and for solving a system of primal-dual inclusions involving a mixture of sums, linear compositions, parallel sums, Lipschitzian operators, cocoercive operators, and normal cones. We apply our methods to constrained composite convex optimization problems as a specific example. Finally, in order to compare our methods with existing methods in the literature, we provide numerical experiments on constrained total variation least-squares optimization problems and computed tomography inverse problems. We obtain promising numerical results.

Forward Primal-Dual Half-Forward Algorithm for Splitting Four Operators

Three-operator reflected forward-backward splitting algorithm with double inertial effects

An adaptive splitting algorithm for the sum of three operators

A splitting primal-dual proximity algorithm for solving composite optimization problems

The splitting algorithms by Ryu, by Malitsky-Tam, and by Campoy applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

An outer reflected forward-backward splitting algorithm for solving monotone inclusions

A Forward-Backward Bregman Splitting Scheme for Regularized Distributed Optimization Problems

Forward-backward algorithms devised by graphs

The splitting algorithms by Ryu and by Malitsky-Tam applied to normal cones of linear subspaces converge strongly to the projection onto the intersection

A four-operator splitting algorithm for nonconvex and nonsmooth optimization

Frugal Splitting Operators: Representation, Minimal Lifting, and Convergence

Forward-Reflected-Backward and Shadow-Douglas--Rachford with partial inverse for Solving Monotone Inclusions

Stochastic Primal-Dual Three Operator Splitting Algorithm with Extension to Equivariant Regularization-by-Denoising

Forward-backward-half forward splitting algorithm with deviations

Three-Operator Splitting Method with Two-Step Inertial Extrapolation

A new splitting method for solving composite monotone inclusions involving parallel-sum operators

Forward-reflected-backward and shadow-Douglas–Rachford with partial inverse for solving monotone inclusions

Stochastic forward-backward-half forward splitting algorithm with variance reduction

Algorithm 1 : Non-stationary Forward – Douglas – Rachford splitting

Forward–Reflected–Backward Splitting Algorithms with Momentum: Weak, Linear and Strong Convergence Results

Convergence Rates of Forward–Douglas–Rachford Splitting Method