Abstract:For the primal -dual monotone inclusion problem, the split-Douglas-Rachford (SDR) algorithm is a well-known first -order splitting method. Similar to other first -order algorithms, the efficiency of SDR is greatly influenced by its step parameters. Therefore, expanding the range of stepsizes may lead to improved numerical performance. In this paper, we prove that the stepsize range of SDR can be expanded based on a series of properties of the product Hilbert space. Moreover, we present a concise counterexample to illustrate that the newly proposed stepsize range cannot be further enhanced. Furthermore, to bridge the theoretical gap in the convergence rate of SDR, we analyze the descent of SDR's fixed point residuals and provide the first proof of a sublinear convergence rate for the fixed point residuals. As an application, we utilize SDR to solve separable convex optimization problems with linear equality constraints and develop a novel preconditioned alternating direction method of multipliers (NP-ADMM). This method can handle scenarios where two linear operators are not identity operators. We propose strict convergence conditions and convergence rates for the preconditioned primal -dual split (P-PDS) method and NP-ADMM by demonstrating the relationship between SDR, P-PDS, and NP-ADMM. Finally, we conduct four numerical experiments to verify the computational efficiency of these algorithms and demonstrate that the performance of these algorithms has been significantly improved with the improved conditions.

Convergence Rate Analysis of Several Splitting Schemes

Convergence Rates of Forward–Douglas–Rachford Splitting Method

On the Convergence Rates of Proximal Splitting Algorithms

Convergence Rates of Inertial Splitting Schemes for Nonconvex Composite Optimization

Linear Convergence Rate of Splitting Algorithms for Multi-Block Constrained Convex Minimizations

Convergence analysis of the Peaceman-Rachford splitting method for nonsmooth convex optimization

Convergence Analyses of Davis-Yin Splitting via Scaled Relative Graphs

A Three-Operator Splitting Scheme and Its Optimization Applications

Splitting Methods in Communication, Imaging, Science, and Engineering Introduction

Accelerated Gradient and Skew-Symmetric Splitting Methods for a Class of Monotone Operator Equations

Convergence Analysis of a Variable Metric Forward–backward Splitting Algorithm with Applications

A randomized operator splitting scheme inspired by stochastic optimization methods

Local Linear Convergence Analysis of Primal–Dual Splitting Methods

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Convergence Analysis of Split-Douglas-Rachford Algorithm and a Novel Preconditioned ADMM with an Improved Condition

Convergence of the Preconditioned Proximal Point Method and Douglas-Rachford Splitting in the Absence of Monotonicity

Convergence Analysis of an Inexact Three-Operator Splitting Algorithm.

Convergence Study on Strictly Contractive Peaceman–Rachford Splitting Method for Nonseparable Convex Minimization Models with Quadratic Coupling Terms

Convergence of the Peaceman-Rachford Splitting Method for a Class of Nonconvex Programs

Three-Operator Splitting Method with Two-Step Inertial Extrapolation