Abstract:We consider a class of nonsmooth aggregative games over networks in stochastic regimes, where each player is characterized by a composite cost function $f_i+r_i$, $f_i$ is a smooth expectation-valued function dependent on its own strategy and an aggregate function of rival strategies, and $r_i$ is a nonsmooth convex function of its strategy with an efficient prox-evaluation. We design a fully distributed iterative proximal stochastic gradient method overlaid by a Tikhonov regularization, where each player may independently choose its steplengths and regularization parameters while meeting some coordination requirements. Under a monotonicity assumption on the pseudo-gradient mapping, we prove the almost sure convergence to the least-norm Nash equilibrium. In addition, when each $r_i$ is an indicator function of a compact convex set, we establish the convergence rate associated with the expected gap function at the time-averaged sequence. We further establish high probability bounds for the gap function via both Markov's inequality as well as a more refined argument that leverages Azuma's inequality. Furthermore, we consider the extension to the private hierarchical regime where each player is a leader with respect to a collection of private followers competing in a strongly monotone game, parametrized by leader decisions. By leveraging a convolution-smoothing framework, we present amongst the first fully distributed schemes for computing a Nash equilibrium of a game complicated by such a hierarchical structure. Based on this framework, we extend the rate statements to accommodate the computation of a hierarchical stochastic Nash equilibrium by using a Fitzpatrick gap function. Finally, we validate the proposed methods on a networked Nash-Cournot equilibrium problem and a hierarchical generalization, observing that regularization has a beneficial impact on empirical behavior.

Numerical methods for distributed stochastic compositional optimization problems with aggregative structure

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Distributed Stochastic Algorithm for Global Optimization in Networked System

A Unified Algorithmic Framework for Distributed Composite Optimization.

A Unified Contraction Analysis of a Class of Distributed Algorithms for Composite Optimization

Asynchronous Proximal Stochastic Gradient Algorithm for Composition Optimization Problems

Accelerated Distributed Aggregative Optimization

Distributed Aggregative Optimization via Finite-time Dynamic Average Consensus

Achieving Linear Speedup in Decentralized Stochastic Compositional Minimax Optimization

Augmented Distributed Gradient Methods for Multi-Agent Optimization under Uncoordinated Constant Stepsizes

Decentralized Multi-Level Compositional Optimization Algorithms with Level-Independent Convergence Rate

A Push-Pull Gradient Method for Distributed Optimization in Networks.

Convergence in High Probability of Distributed Stochastic Gradient Descent Algorithms

A Communication-Efficient Stochastic Gradient Descent Algorithm for Distributed Nonconvex Optimization

Compressed Gradient Tracking Algorithm for Distributed Aggregative Optimization

Distributed Heterogeneous Multi-Agent Optimization with Stochastic Sub-Gradient

Asynchronous Stochastic Composition Optimization with Variance Reduction

A Distributed Iterative Tikhonov Method for Networked Monotone Aggregative Hierarchical Stochastic Games

Distributed Online Convex Optimization with an Aggregative Variable

Stochastic Compositional Minimax Optimization with Provable Convergence Guarantees

Distributed Stochastic Optimization under a General Variance Condition