Decentralized ADMM with compressed and event-triggered communication

Zhen Zhang,Shaofu Yang,Wenying Xu
DOI: https://doi.org/10.1016/j.neunet.2023.06.001
IF: 7.8
2023-06-10
Neural Networks
Abstract:This paper considers the decentralized optimization problem, where agents in a network cooperate to minimize the sum of their local objective functions by communication and local computation. We propose a decentralized second-order communication-efficient algorithm called communication-censored and communication-compressed quadratically approximated alternating direction method of multipliers (ADMM), termed as CC-DQM, by combining event-triggered communication with compressed communication. In CC-DQM, agents are allowed to transmit the compressed message only when the current primal variables have changed greatly compared to its last estimate. Moreover, to relieve the computation cost, the update of Hessian is also scheduled by the trigger condition. Theoretical analysis shows that the proposed algorithm can still maintain an exact linear convergence, despite the existence of compression error and intermittent communication, if the local objective functions are strongly convex and smooth. Finally, numerical experiments demonstrate its satisfactory communication efficiency.
computer science, artificial intelligence,neurosciences
What problem does this paper attempt to address?