Abstract:In this paper, we study unconstrained distributed optimization strongly convex problems, in which the exchange of information in the network is captured by a directed graph topology over digital channels that have limited capacity (and hence information should be quantized). Distributed methods in which nodes use quantized communication yield a solution at the proximity of the optimal solution, hence reaching an error floor that depends on the quantization level used; the finer the quantization the lower the error floor. However, it is not possible to determine in advance the optimal quantization level that ensures specific performance guarantees (such as achieving an error floor below a predefined threshold). Choosing a very small quantization level that would guarantee the desired performance, requires {information} packets of very large size, which is not desirable (could increase the probability of packet losses, increase delays, etc) and often not feasible due to the limited capacity of the channels available. In order to obtain a communication-efficient distributed solution and a sufficiently close proximity to the optimal solution, we propose a quantized distributed optimization algorithm that converges in a finite number of steps and is able to adjust the quantization level accordingly. The proposed solution uses a finite-time distributed optimization protocol to find a solution to the problem for a given quantization level in a finite number of steps and keeps refining the quantization level until the difference in the solution between two successive solutions with different quantization levels is below a certain pre-specified threshold.

Quantized Distributed Nonconvex Optimization with Linear Convergence

Quantized Distributed Nonconvex Optimization Algorithms with Linear Convergence under the Polyak--$Ł$ojasiewicz Condition

An Initialization-Free Continuous-Time Distributed Algorithm for Convex Optimization Problem

Linear Convergence of First- and Zeroth-Order Primal-Dual Algorithms for Distributed Nonconvex Optimization

Distributed Optimization with Quantized Gradient Descent

Communication Compression for Distributed Nonconvex Optimization

Quantization Avoids Saddle Points in Distributed Optimization

Distributed Constrained Optimization With Delayed Subgradient Information Over Time-Varying Network Under Adaptive Quantization

Distributed constrained optimization with periodic dynamic quantization

Quantized Distributed Gradient Tracking Algorithm with Linear Convergence in Directed Networks

Linearly Convergent Distributed Optimization Methods with Compressed Innovation

Finite-Bit Quantization for Distributed Algorithms With Linear Convergence

Distributed Stochastic Algorithm for Global Optimization in Networked System

Distributed Optimization via Gradient Descent with Event-Triggered Zooming over Quantized Communication

Distributed Optimization with Finite Bit Adaptive Quantization for Efficient Communication and Precision Enhancement

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Differentially Private Distributed Nonconvex Stochastic Optimization with Quantized Communication

Distributed Zeroth-Order Optimization: Convergence Rates That Match Centralized Counterpart

Sublinear and Linear Convergence of Modified ADMM for Distributed Nonconvex Optimization

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Distributed Vector Quantization Based On Kullback-Leibler Divergence