Abstract:During the last decade, the state-of-the-art alternating direction method of multipliers (ADMM) has successfully been used to solve many two-block separable convex minimization problems arising from several applied areas such as signal/image processing and statistical and machine learning. It however remains an interesting problem of how to implement ADMM to three-block separable convex minimization problems as required by the situation where many objective functions in the above-mentioned areas are actually more conveniently decomposed to the sum of three convex functions, due also to the observation that the straightforward extension of ADMM from the two-block case to the three-block case is apparently not convergent. In this paper, we shall introduce a new algorithm that is called a partially isochronous splitting algorithm (PISA) in order to implement ADMM for the three-block separable model. The main idea of our algorithm is to incorporate only one proximal term into the last subproblem of the extended ADMM so that the resulting algorithm maximally inherits the promising properties of ADMM. A remarkable superiority over the extended ADMM is that we can simultaneously solve two of the subproblems, thereby taking advantages of the separable structure and parallel architectures. Theoretically, we will establish the global convergence of our algorithm under standard conditions, and also the O (1/ t ) rate of convergence in both ergodic and nonergodic senses, where t is the iteration counter. The computational competitiveness of our algorithm is shown by numerical experiments on an application to the well-tested robust principal component analysis model.

A Customized Douglas–Rachford Splitting Algorithm for Separable Convex Minimization with Linear Constraints

A Distributed Douglas-Rachford Splitting Method for Multi-Block Convex Minimization Problems

An ADM-based Splitting Method for Separable Convex Programming

A distributed Douglas-Rachford splitting method for solving linear constrained multi-block weakly convex problems

A Modified Strictly Contractive Peaceman-Rachford Splitting Method for Multi-Block Separable Convex Programming

A Partially Inertial Customized Douglas–Rachford Splitting Method for a Class of Structured Optimization Problems

Convergence Analysis of Douglas--Rachford Splitting Method for “strongly + Weakly” Convex Programming

A Note on the Douglas–Rachford Splitting Method for Optimization Problems Involving Hypoconvex Functions

Convergence Study on Strictly Contractive Peaceman–Rachford Splitting Method for Nonseparable Convex Minimization Models with Quadratic Coupling Terms

A Proximal Peaceman-Rachford Splitting Method for Solving the Multi-Block Separable Convex Minimization Problems.

A parameterized Douglas-Rachford Splitting algorithm for nonconvex optimization

An Inertial Parametric Douglas–Rachford Splitting Method for Nonconvex Problems

Customized Douglas-Rachford Splitting Methods for Structured Inverse Variational Inequality Problems

A Primal Douglas–Rachford Splitting Method for the Constrained Minimization Problem in Compressive Sensing

A Proximal Parallel Splitting Method for Minimizing Sum of Convex Functions with Linear Constraints.

A Partially Isochronous Splitting Algorithm for Three-Block Separable Convex Minimization Problems

A Strictly Contractive Peaceman-Rachford Splitting Method with Logarithmic-Quadratic Proximal Regularization for Convex Programming

An Augmented Lagrangian Based Parallel Splitting Method for Separable Convex Minimization with Applications to Image Processing

A Three-Operator Splitting Scheme Derived from Three-Block ADMM

A Continuous Dynamical Splitting Method for Solving ‘strongly+weakly’ Convex Programming Problems

Operator Splitting for Convex Constrained Markov Decision Processes