Abstract:By enabling the nodes or agents to solve small-sized subproblems to achieve coordination, distributed algorithms are favored by many networked systems for efficient and scalable computation. While for convex problems, substantial distributed algorithms are available, the results for the more broad nonconvex counterparts are extremely lacking. This paper develops a distributed algorithm for a class of nonconvex and nonsmooth problems featured by i) a nonconvex objective formed by both separate and composite objective components regarding the decision components of interconnected agents, ii) local bounded convex constraints, and iii) coupled linear constraints. This problem is directly originated from smart buildings and is also broad in other domains. To provide a distributed algorithm with convergence guarantee, we revise the powerful tool of alternating direction method of multiplier (ADMM) and proposed a proximal ADMM. Specifically, noting that the main difficulty to establish the convergence for the nonconvex and nonsmooth optimization within the ADMM framework is to assume the boundness of dual updates, we propose to update the dual variables in a discounted manner. This leads to the establishment of a so-called sufficiently decreasing and lower bounded Lyapunov function, which is critical to establish the convergence. We prove that the method converges to some approximate stationary points. We besides showcase the efficacy and performance of the method by a numerical example and the concrete application to multi-zone heating, ventilation, and air-conditioning (HVAC) control in smart buildings.

Sublinear and Linear Convergence of Modified ADMM for Distributed Nonconvex Optimization

On the Linear Convergence of the ADMM in Decentralized Consensus Optimization

On Distributed Nonconvex Optimisation Via Modified ADMM

Distributed ADMM with linear updates over directed networks

Linear Convergence of First- and Zeroth-Order Primal-Dual Algorithms for Distributed Nonconvex Optimization

Linearized ADMM for Nonconvex Nonsmooth Optimization with Convergence Analysis

Linear Convergence of the Alternating Direction Method of Multipliers for a Class of Convex Optimization Problems

Proximal ADMM for Nonconvex and Nonsmooth Optimization

A Bregman-Style Improved ADMM and its Linearized Version in the Nonconvex Setting: Convergence and Rate Analyses

Linearly Convergent Decentralized Consensus Optimization with the Alternating Direction Method of Multipliers

Distributed Adaptive Newton Methods with Globally Superlinear Convergence

A Convergence Analysis of Nonlinearly Constrained ADMM in Deep Learning

Distributed Constrained Optimization with Linear Convergence Rate

Distributed Optimization on Directed Graphs Based on Inexact ADMM with Partial Participation

BFGS-ADMM for Large-Scale Distributed Optimization

Asynchronous Distributed Optimization via ADMM with Efficient Communication

Distributed ADMM for Time-Varying Communication Networks

Linearly Convergent Second-Order Distributed Optimization Algorithms

DN-ADMM: Distributed Newton ADMM for Multi-agent Optimization

Explicit Convergence Rate of a Distributed Alternating Direction Method of Multipliers

Achieving Globally Superlinear Convergence for Distributed Optimization with Adaptive Newton Method