Abstract:We consider a class of nonsmooth aggregative games over networks in stochastic regimes, where each player is characterized by a composite cost function $f_i+r_i$, $f_i$ is a smooth expectation-valued function dependent on its own strategy and an aggregate function of rival strategies, and $r_i$ is a nonsmooth convex function of its strategy with an efficient prox-evaluation. We design a fully distributed iterative proximal stochastic gradient method overlaid by a Tikhonov regularization, where each player may independently choose its steplengths and regularization parameters while meeting some coordination requirements. Under a monotonicity assumption on the pseudo-gradient mapping, we prove the almost sure convergence to the least-norm Nash equilibrium. In addition, when each $r_i$ is an indicator function of a compact convex set, we establish the convergence rate associated with the expected gap function at the time-averaged sequence. We further establish high probability bounds for the gap function via both Markov's inequality as well as a more refined argument that leverages Azuma's inequality. Furthermore, we consider the extension to the private hierarchical regime where each player is a leader with respect to a collection of private followers competing in a strongly monotone game, parametrized by leader decisions. By leveraging a convolution-smoothing framework, we present amongst the first fully distributed schemes for computing a Nash equilibrium of a game complicated by such a hierarchical structure. Based on this framework, we extend the rate statements to accommodate the computation of a hierarchical stochastic Nash equilibrium by using a Fitzpatrick gap function. Finally, we validate the proposed methods on a networked Nash-Cournot equilibrium problem and a hierarchical generalization, observing that regularization has a beneficial impact on empirical behavior.

Game-Theoretic Distributed Empirical Risk Minimization With Strategic Network Design

Distributed Machine Learning with Strategic Network Design: A Game-Theoretic Perspective

Generalized Nash Equilibrium Seeking for Networked Noncooperative games with a Dynamic Event-Triggered Mechanism

Distributed event-triggered Nash equilibrium seeking for non-cooperative games on unbalanced digraphs

General sum stochastic games with networked information flows

An Efficient Distributed Nash Equilibrium Seeking with Compressed and Event-triggered Communication

Adaptive approaches for fully distributed Nash equilibrium seeking in networked games

Social Optimum Equilibrium Selection for Distributed Multi-Agent Optimization

Efficient Distributed Learning in Stochastic Non-cooperative Games without Information Exchange.

Networked Communication for Mean-Field Games with Function Approximation and Empirical Mean-Field Estimation

Distributed Nash Equilibrium Seeking over Time-Varying Directed Communication Networks

Differentially private Nash equilibrium seeking for networked aggregative games

Distributed Nash Equilibrium Seeking in Games With Partial Decision Information: A Survey

Distributed Nash equilibrium seeking with stochastic event-triggered mechanism

Network games with dynamic players: Stabilization and output convergence to Nash equilibrium

Distributed Nash equilibrium seeking in noncooperative game with partial decision information of neighbors

Dynamic Chinese Restaurant Game: Theory and Application to Cognitive Radio Networks

Distributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View

A Distributed Iterative Tikhonov Method for Networked Monotone Aggregative Hierarchical Stochastic Games