Abstract:We investigate decentralized online convex optimization (D-OCO), in which a set of local learners are required to minimize a sequence of global loss functions using only local computations and communications. Previous studies have established $O(n^{5/4}\rho^{-1/2}\sqrt{T})$ and ${O}(n^{3/2}\rho^{-1}\log T)$ regret bounds for convex and strongly convex functions respectively, where $n$ is the number of local learners, $\rho<1$ is the spectral gap of the communication matrix, and $T$ is the time horizon. However, there exist large gaps from the existing lower bounds, i.e., $\Omega(n\sqrt{T})$ for convex functions and $\Omega(n)$ for strongly convex functions. To fill these gaps, in this paper, we first develop a novel D-OCO algorithm that can respectively reduce the regret bounds for convex and strongly convex functions to $\tilde{O}(n\rho^{-1/4}\sqrt{T})$ and $\tilde{O}(n\rho^{-1/2}\log T)$. The primary technique is to design an online accelerated gossip strategy that enjoys a faster average consensus among local learners. Furthermore, by carefully exploiting spectral properties of a specific network topology, we enhance the lower bounds for convex and strongly convex functions to $\Omega(n\rho^{-1/4}\sqrt{T})$ and $\Omega(n\rho^{-1/2}\log T)$, respectively. These results suggest that the regret of our algorithm is nearly optimal in terms of $T$, $n$, and $\rho$ for both convex and strongly convex functions. Finally, we propose a projection-free variant of our algorithm to efficiently handle practical applications with complex constraints. Our analysis reveals that the projection-free variant can achieve ${O}(nT^{3/4})$ and ${O}(nT^{2/3}(\log T)^{1/3})$ regret bounds for convex and strongly convex functions with nearly optimal $\tilde{O}(\rho^{-1/2}\sqrt{T})$ and $\tilde{O}(\rho^{-1/2}T^{1/3}(\log T)^{2/3})$ communication rounds, respectively.

Online Convex Optimization with Switching Costs: Algorithms and Performance

Smoothed Online Decision Making in Communication: Algorithms and Applications

Online Convex Optimization with Continuous Switching Constraint

Lazy OCO: Online Convex Optimization on a Switching Budget

Optimal Dynamic Regret for Online Convex Optimization with Squared L2 Norm Switching Cost

Understand Dynamic Regret with Switching Cost for Online Decision Making

Smoothed Online Convex Optimization Based on Discounted-Normal-Predictor

Online Convex Optimization with Switching Cost and Delayed Gradients

Simultaneously Achieving Sublinear Regret and Constraint Violations for Online Convex Optimization with Time-varying Constraints

Optimal and Efficient Algorithms for Decentralized Online Convex Optimization

Best of Both Worlds Guarantees for Smoothed Online Quadratic Optimization

Online Convex Optimisation: The Optimal Switching Regret for all Segmentations Simultaneously

Optimistic Safety for Online Convex Optimization with Unknown Linear Constraints

Universal Online Convex Optimization with Minimax Optimal Second-Order Dynamic Regret

Dynamic Regret of Convex and Smooth Functions

Communication-Efficient Regret-Optimal Distributed Online Convex Optimization

Nearly Optimal Regret for Decentralized Online Convex Optimization

Online Convex Optimization for Dynamic Network Resource Allocation

Online Sequential Decision-Making with Unknown Delays

Adaptivity and Optimality: A Universal Algorithm for Online Convex Optimization

Communication Efficient Decentralization for Smoothed Online Convex Optimization