Abstract:Distributed stochastic non-convex optimization problems have recently received attention due to the growing interest of signal processing, computer vision, and natural language processing communities in applications deployed over distributed learning systems (e.g., federated learning). We study the setting where the data is distributed across the nodes of a time-varying directed network, a topology suitable for modeling dynamic networks experiencing communication delays and straggler effects. The network nodes, which can access only their local objectives and query a stochastic first-order oracle to obtain gradient estimates, collaborate to minimize a global objective function by exchanging messages with their neighbors. We propose an algorithm, novel to this setting, that leverages stochastic gradient descent with momentum and gradient tracking to solve distributed non-convex optimization problems over time-varying networks. To analyze the algorithm, we tackle the challenges that arise when analyzing dynamic network systems which communicate gradient acceleration components. We prove that the algorithm's oracle complexity is $\mathcal{O}(1/\epsilon^{1.5})$, and that under Polyak-$Ł$ojasiewicz condition the algorithm converges linearly to a steady error state. The proposed scheme is tested on several learning tasks: a non-convex logistic regression experiment on the MNIST dataset, an image classification task on the CIFAR-10 dataset, and an NLP classification test on the IMDB dataset. We further present numerical simulations with an objective that satisfies the PL condition. The results demonstrate superior performance of the proposed framework compared to the existing related methods.

Two-timescale recurrent neural networks for distributed minimax optimization

A Neural Network Model for General Minimax Problem

A collaborative neurodynamic approach with two-timescale projection neural networks designed via majorization-minimization for global optimization and distributed global optimization

A Two-Timescale Duplex Neurodynamic Approach to Mixed-Integer Optimization

Two-timescale projection neural networks in collaborative neurodynamic approaches to global optimization and distributed optimization

A discrete-time neural network for optimization problems with hybrid constraints.

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

A nonautonomous-differential-inclusion neurodynamic approach for nonsmooth distributed optimization on multi-agent systems

Neurodynamic approaches for multi-agent distributed optimization

Clifford-Valued Distributed Optimization Based on Recurrent Neural Networks

Distributed Stochastic Optimization With Unbounded Subgradients Over Randomly Time-Varying Networks

Accelerated Distributed Stochastic Non-Convex Optimization over Time-Varying Directed Networks

A Collaborative Neurodynamic Optimization Approach to Distributed Nash-Equilibrium Seeking in Multicluster Games With Nonconvex Functions

Distributed Nonsmooth Convex Optimization over Markovian Switching Random Networks with Two Step-Sizes

Min-max optimization over slowly time-varying graphs

Distributed Time-Varying Convex Optimization for a Class of Nonlinear Multiagent Systems

Inverse-free distributed neurodynamic optimization algorithms for sparse reconstruction

Distributed finite-time optimization algorithms with a modified Newton–Raphson method

Cardinality-constrained portfolio selection via two-timescale duplex neurodynamic optimization

Distributed Continuous-Time Algorithms for Time-Varying Constrained Convex Optimization