Abstract:This paper introduces a parallel and distributed extension to the alternating direction method of multipliers (ADMM) for solving convex problem: minimize $\sum_{i=1}^N f_i(x_i)$ subject to $\sum_{i=1}^N A_i x_i=c, x_i\in \mathcal{X}_i$. The algorithm decomposes the original problem into N smaller subproblems and solves them in parallel at each iteration. This Jacobian-type algorithm is well suited for distributed computing and is particularly attractive for solving certain large-scale problems. This paper introduces a few novel results. Firstly, it shows that extending ADMM straightforwardly from the classic Gauss-Seidel setting to the Jacobian setting, from 2 blocks to N blocks, will preserve convergence if matrices $A_i$ are mutually near-orthogonal and have full column-rank. Secondly, for general matrices $A_i$, this paper proposes to add proximal terms of different kinds to the N subproblems so that the subproblems can be solved in flexible and efficient ways and the algorithm converges globally at a rate of o(1/k). Thirdly, a simple technique is introduced to improve some existing convergence rates from O(1/k) to o(1/k). In practice, some conditions in our convergence theorems are conservative. Therefore, we introduce a strategy for dynamically tuning the parameters in the algorithm, leading to substantial acceleration of the convergence in practice. Numerical results are presented to demonstrate the efficiency of the proposed method in comparison with several existing parallel algorithms. We implemented our algorithm on Amazon EC2, an on-demand public computing cloud, and report its performance on very large-scale basis pursuit problems with distributed data.

A CUDA-based Parallel Adaptive Dynamic Programming Algorithm

Online Sparse Kernel Learning-Based Adaptive Dynamic Programming

Two-Phase Iteration for Value Function Approximation and Hyperparameter Optimization in Gaussian-Kernel-Based Adaptive Critic Design

Research of a Parallel Learning Adaptive Dynamic Programming Based on Genetic Algorithms

A Parallel Framework of Adaptive Dynamic Programming Algorithm with Off-Policy Learning.

A Parallel Dynamic Programming algorithm based on GPU-acceleration

Adaptive Critic Design with Local Gaussian Process Models

A Performance Analysis of Parallel Differential Dynamic Programming on a GPU

pdlADMM: An ADMM-based framework for parallel deep learning training with efficiency

A Parallel Dynamic Programming Algorithm on a Multi-Core Architecture

An Incremental Iterative Acceleration Architecture in Distributed Heterogeneous Environments With GPUs for Deep Learning

On the O(1/k) Convergence and Parallelization of the Alternating Direction Method of Multipliers

BLAD: Adaptive Load Balanced Scheduling and Operator Overlap Pipeline for Accelerating the Dynamic GNN Training

Gaussian-kernel-based Adaptive Critic Design Using Two-Phase Value Iteration.

Twin Deterministic Policy Gradient Adaptive Dynamic Programming for Optimal Control of Affine Nonlinear Discrete-time Systems

A Summary on Some Typical Adaptive Dynamic Programming Schemes

Adaptive dynamic programming: an introduction

Optimization Of Parallel Algorithm For Kalman Filter On Cpu-Gpu Heterogeneous System

Neural-network-based Learning Algorithms for Cooperative Games of Discrete-Time Multi-Player Systems with Control Constraints Via Adaptive Dynamic Programming

PiPAD: Pipelined and Parallel Dynamic GNN Training on GPUs

GPGPU-Based Parallel Algorithms for Scheduling Against Due Date.