Abstract:By enabling the nodes or agents to solve small-sized subproblems to achieve coordination, distributed algorithms are favored by many networked systems for efficient and scalable computation. While for convex problems, substantial distributed algorithms are available, the results for the more broad nonconvex counterparts are extremely lacking. This paper develops a distributed algorithm for a class of nonconvex and nonsmooth problems featured by i) a nonconvex objective formed by both separate and composite objective components regarding the decision components of interconnected agents, ii) local bounded convex constraints, and iii) coupled linear constraints. This problem is directly originated from smart buildings and is also broad in other domains. To provide a distributed algorithm with convergence guarantee, we revise the powerful tool of alternating direction method of multiplier (ADMM) and proposed a proximal ADMM. Specifically, noting that the main difficulty to establish the convergence for the nonconvex and nonsmooth optimization within the ADMM framework is to assume the boundness of dual updates, we propose to update the dual variables in a discounted manner. This leads to the establishment of a so-called sufficiently decreasing and lower bounded Lyapunov function, which is critical to establish the convergence. We prove that the method converges to some approximate stationary points. We besides showcase the efficacy and performance of the method by a numerical example and the concrete application to multi-zone heating, ventilation, and air-conditioning (HVAC) control in smart buildings.

A Gradient-free Penalty ADMM for Solving Distributed Convex Optimization Problems with Feasible Set Constraints.

A Penalty Alternating Direction Method of Multipliers for Convex Composite Optimization over Decentralized Networks

A Penalty Alternating Direction Method of Multipliers for Decentralized Composite Optimization.

An Adaptive Penalty-like Continuous-Time Algorithm to Constrained Distributed Convex Optimization

Distributed Learning with Convex SUM-of -Non-convex Objective

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Adaptive Exact Penalty Design for Constrained Distributed Optimization

Proximal ADMM for Nonconvex and Nonsmooth Optimization

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Network Optimization via Smooth Exact Penalty Functions Enabled by Distributed Gradient Computation

Decentralized Accelerated Gradient Methods with Increasing Penalty Parameters.

Distributed Nonsmooth Optimization with Different Local Constraints Via Exact Penalty

BFGS-ADMM for Large-Scale Distributed Optimization

Golden Ratio Proximal Gradient ADMM for Distributed Composite Convex Optimization

A Penalty-Like Neurodynamic Approach to Constrained Nonsmooth Distributed Convex Optimization

DN-ADMM: Distributed Newton ADMM for Multi-agent Optimization

On Distributed Nonconvex Optimisation Via Modified ADMM

A Distributed Proximal Alternating Direction Multiplier Method for Multiblock Nonsmooth Composite Optimization

Distributed and Parallel ADMM for Structured Nonconvex Optimization Problem.

Distributed algorithms for solving the convex feasibility problems

An Exact Penalty Method for Constrained Distributed Optimization