Abstract:In this paper, we consider the decentralized, stochastic nonconvex strongly-concave (NCSC) minimax problem with nonsmooth regularization terms on both primal and dual variables, wherein a network of $m$ computing agents collaborate via peer-to-peer communications. We consider when the coupling function is in expectation or finite-sum form and the double regularizers are convex functions, applied separately to the primal and dual variables. Our algorithmic framework introduces a Lagrangian multiplier to eliminate the consensus constraint on the dual variable. Coupling this with variance-reduction (VR) techniques, our proposed method, entitled VRLM, by a single neighbor communication per iteration, is able to achieve an $\mathcal{O}(\kappa^3\varepsilon^{-3})$ sample complexity under the general stochastic setting, with either a big-batch or small-batch VR option, where $\kappa$ is the condition number of the problem and $\varepsilon$ is the desired solution accuracy. With a big-batch VR, we can additionally achieve $\mathcal{O}(\kappa^2\varepsilon^{-2})$ communication complexity. Under the special finite-sum setting, our method with a big-batch VR can achieve an $\mathcal{O}(n + \sqrt{n} \kappa^2\varepsilon^{-2})$ sample complexity and $\mathcal{O}(\kappa^2\varepsilon^{-2})$ communication complexity, where $n$ is the number of components in the finite sum. All complexity results match the best-known results achieved by a few existing methods for solving special cases of the problem we consider. To the best of our knowledge, this is the first work which provides convergence guarantees for NCSC minimax problems with general convex nonsmooth regularizers applied to both the primal and dual variables in the decentralized stochastic setting. Numerical experiments are conducted on two machine learning problems. Our code is downloadable from <a class="link-external link-https" href="https://github.com/RPI-OPT/VRLM" rel="external noopener nofollow">this https URL</a>.

A variance-reduced stochastic gradient tracking algorithm for decentralized optimization with orthogonality constraints

Distributed Stochastic Gradient Tracking Algorithm with Variance Reduction for Non-Convex Optimization

Parallel Stochastic Optimization Framework for Large-Scale Non-Convex Stochastic Problems

Variance-Reduced Decentralized Stochastic Optimization with Gradient Tracking -- Part II: GT-SVRG

Gradient tracking and variance reduction for decentralized optimization and machine learning

Variance-reduced Reshuffling Gradient Descent for Nonconvex Optimization: Centralized and Distributed Algorithms

A Communication-efficient Linearly Convergent Algorithm with Variance Reduction for Distributed Stochastic Optimization

Optimal Gradient Tracking for Decentralized Optimization

Stochastic Sub-Sampled Newton Method with Variance Reduction

Stochastic Successive Convex Approximation for Non-Convex Constrained Stochastic Optimization

A Flexible Gradient Tracking Algorithmic Framework for Decentralized Optimization

Global Optimization with Orthogonality Constraints Via Stochastic Diffusion on Manifold

Parallel Asynchronous Stochastic Variance Reduction for Nonconvex Optimization

Byzantine-Robust Loopless Stochastic Variance-Reduced Gradient

Variance-reduced accelerated methods for decentralized stochastic double-regularized nonconvex strongly-concave minimax problems

Linear Convergence of Variance-Reduced Stochastic Gradient without Strong Convexity

Stochastic Constrained Decentralized Optimization for Machine Learning with Fewer Data Oracles: a Gradient Sliding Approach

Stochastic Nested Variance Reduction for Nonconvex Optimization

A Compressed Gradient Tracking Method for Decentralized Optimization With Linear Convergence

Balancing Communication and Computation in Gradient Tracking Algorithms for Decentralized Optimization

Decentralized Stochastic Gradient Tracking for Non-convex Empirical Risk Minimization