Abstract:In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors. Additionally, in our problem, the communication channels among the nodes have limited bandwidth. In order to alleviate this limitation, quantized messages should be exchanged among the nodes. For solving this distributed optimization problem, we combine a gradient descent method with a distributed quantized consensus algorithm (which requires the nodes to exchange quantized messages and converges in a finite number of steps). Specifically, at every optimization step, each node (i) performs a gradient descent step (i.e., subtracts the scaled gradient from its current estimate), and (ii) performs a finite-time calculation of the quantized average of every node's estimate in the network. As a consequence, this algorithm approximately mimics the centralized gradient descent algorithm. We show that our algorithm asymptotically converges to a neighborhood of the optimal solution with linear convergence rate. The performance of the proposed algorithm is demonstrated via simple illustrative examples.

What problem does this paper attempt to address?

### Problems Addressed by the Paper The paper primarily aims to address the bandwidth limitation issue in distributed optimization and proposes a gradient descent algorithm combined with quantized communication (Quantized Averaged Gradient Descent, QuAGD). Specifically: 1. **Distributed Optimization Problem**: The paper considers an unconstrained distributed optimization problem where information exchange in the network is described by a directed graph topology, and nodes can only communicate with their neighbors. Additionally, the communication channels between nodes have limited bandwidth. 2. **Quantized Communication**: To alleviate the bandwidth limitation issue, nodes need to exchange quantized messages. The paper proposes a new quantized averaging algorithm (FAQuA), enabling each node to compute the quantized average of other nodes' estimates within a finite time. 3. **Algorithm Design**: The paper combines the gradient descent method with a distributed quantized consensus algorithm, allowing each node to (i) perform a gradient descent step in each optimization iteration, and (ii) compute the quantized average of all nodes' estimates in the network. In this way, the algorithm can approximately simulate the centralized gradient descent iterative process. 4. **Convergence Analysis**: The paper proves that the proposed algorithm can asymptotically converge to a neighborhood of the optimal solution with a linear convergence rate. The size of this neighborhood depends on the quantization level ∆. In summary, the main contribution of the paper is the proposal of a distributed optimization algorithm suitable for bandwidth-constrained network environments. This algorithm can achieve quantized averaging of node estimates within a finite time and exhibits good convergence performance.

Distributed Optimization with Quantized Gradient Descent

Distributed Optimization via Gradient Descent with Event-Triggered Zooming over Quantized Communication

Quantized Gradient-Descent Algorithm for Distributed Resource Allocation

Quantized Distributed Gradient Tracking Algorithm with Linear Convergence in Directed Networks

Quantized Subgradient Algorithm with Limited Bandwidth Communications for Solving Distributed Optimization over General Directed Multi-Agent Networks.

Quantized Subgradient Algorithm and Data-Rate Analysis for Distributed Optimization

Distributed Online Optimization Under Dynamic Adaptive Quantization

Distributed subgradient method for multi-agent optimization with quantized communication: J. LIET AL

Distributed Constrained Optimization With Delayed Subgradient Information Over Time-Varying Network Under Adaptive Quantization

Distributed Subgradient Method for Multi‐agent Optimization with Quantized Communication

Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

Quantized Zeroth-Order Gradient Tracking Algorithm for Distributed Nonconvex Optimization under Polyak–${\L}$ojasiewicz Condition

Quantized Distributed Nonconvex Optimization with Linear Convergence

Distributed Quantized Mirror Descent for Strongly Convex Optimization over Time-Varying Directed Graph

Distributed Quantized Gradient-Free Algorithm for Multi-Agent Convex Optimization

Distributed Consensus Optimization in Multiagent Networks with Time-Varying Directed Topologies and Quantized Communication.

Quantization Avoids Saddle Points in Distributed Optimization

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

Log-Scale Quantization in Distributed First-Order Methods: Gradient-based Learning from Distributed Data