Abstract:This paper considers solving a class of optimization problems which are modeled as the sum of all agents' convex cost functions and each agent is only accessible to its individual function. Communication between agents in multiagent networks is assumed to be limited: each agent can only interact information with its neighbors by using time-varying communication channels with limited capacities. A technique which overcomes the limitation is to implement a quantization process to the interacted information. The quantized information is first encoded as a binary sequence at the side of each agent before sending. After the binary sequence is received by the neighboring agent, corresponding decoding scheme is utilized to resume the original information with a certain degree of error which is caused by the quantization process. With the availability of each agent's encoding states (associated with its out-channels) and decoding states (associated with its in-channels), we devise a set of distributed optimization algorithms that generate two iterative sequences, one of which converges to the optimal solution and the other of which reaches to the optimal value. We prove that if the parameters satisfy some mild conditions, the quantization errors are bounded and the consensus optimization can be achieved. How to minimize the number of quantization level of each connected communication channel in fixed networks is also explored thoroughly. It is found that, by properly choosing system parameters, one bit information exchange suffices to ensure consensus optimization. Finally, we present two numerical simulation experiments to illustrate the efficacy of the algorithms as well as to validate the theoretical findings.

Quantizer-based Distributed Mirror Descent for Multi-Agent Convex Optimization

Distributed Stochastic Mirror Descent Algorithm over Time-varying Network

Optimal Distributed Stochastic Mirror Descent for Strongly Convex Optimization

Distributed Mirror Descent for Online Composite Optimization

Distributed constrained optimization with periodic dynamic quantization

Distributed Constrained Optimization With Delayed Subgradient Information Over Time-Varying Network Under Adaptive Quantization

Distributed online convex optimization with a bandit primal-dual mirror descent push-sum algorithm

Gossip-based distributed stochastic mirror descent for constrained optimization

Distributed Quasi-Newton Method for Multi-Agent Optimization

Quantized Subgradient Algorithm with Limited Bandwidth Communications for Solving Distributed Optimization over General Directed Multi-Agent Networks.

Distributed Time-Varying Convex Optimization with Dynamic Quantization

Distributed Mirror Descent Algorithm with Bregman Damping for Nonsmooth Constrained Optimization

Distributed Consensus Optimization in Multiagent Networks with Time-Varying Directed Topologies and Quantized Communication.

Stabilized Distributed Online Mirror Descent for Multi-Agent Optimization

Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks

Distributed Optimization with Quantized Gradient Descent

Distributed Online Optimization Under Dynamic Adaptive Quantization

Distributed Consensus-Based Multi-Agent Convex Optimization Via Gradient Tracking Technique

Distributed Stochastic Block Coordinate Descent for Time-Varying Multi-Agent Optimization

Stochastic Mirror Descent for Convex Optimization with Consensus Constraints

Zeroth-Order Non-Convex Optimization for Cooperative Multi-Agent Systems with Diminishing Step Size and Smoothing Radius