Abstract:We consider a class of nonsmooth aggregative games over networks in stochastic regimes, where each player is characterized by a composite cost function $f_i+r_i$, $f_i$ is a smooth expectation-valued function dependent on its own strategy and an aggregate function of rival strategies, and $r_i$ is a nonsmooth convex function of its strategy with an efficient prox-evaluation. We design a fully distributed iterative proximal stochastic gradient method overlaid by a Tikhonov regularization, where each player may independently choose its steplengths and regularization parameters while meeting some coordination requirements. Under a monotonicity assumption on the pseudo-gradient mapping, we prove the almost sure convergence to the least-norm Nash equilibrium. In addition, when each $r_i$ is an indicator function of a compact convex set, we establish the convergence rate associated with the expected gap function at the time-averaged sequence. We further establish high probability bounds for the gap function via both Markov's inequality as well as a more refined argument that leverages Azuma's inequality. Furthermore, we consider the extension to the private hierarchical regime where each player is a leader with respect to a collection of private followers competing in a strongly monotone game, parametrized by leader decisions. By leveraging a convolution-smoothing framework, we present amongst the first fully distributed schemes for computing a Nash equilibrium of a game complicated by such a hierarchical structure. Based on this framework, we extend the rate statements to accommodate the computation of a hierarchical stochastic Nash equilibrium by using a Fitzpatrick gap function. Finally, we validate the proposed methods on a networked Nash-Cournot equilibrium problem and a hierarchical generalization, observing that regularization has a beneficial impact on empirical behavior.

Decomposition of convex high dimensional aggregative stochasticcontrol problems

Decomposed resolution of finite-state aggregative optimal control problems

A Multilevel Approach for Stochastic Nonlinear Optimal Control

Domain decomposition for integer optimal control with total variation regularization

Numerical methods for distributed stochastic compositional optimization problems with aggregative structure

Distributed Online Convex Optimization with an Aggregative Variable

Scenario-decomposition Solution Framework for Nonseparable Stochastic Control Problems

An essentially decentralized interior point method for control

Discrete-Time Hybrid Control Processes with Unbounded Costs

Particle Methods For Stochastic Optimal Control Problems

Large-scale nonconvex optimization: randomization, gap estimation, and numerical resolution

An Optimal Stochastic Algorithm for Decentralized Nonconvex Finite-sum Optimization

On Convex Data-Driven Inverse Optimal Control for Nonlinear, Non-stationary and Stochastic Systems

A stochastic hybrid optimal control with regime switching and recursive cost functional

Convex duality for stochastic singular control problems

A Distributed Iterative Tikhonov Method for Networked Monotone Aggregative Hierarchical Stochastic Games

Stabilization and Optimal Control of Interconnected SDE - Scalar PDE System

On Minimum-Dispersion Control of Nonlinear Diffusion Processes

Deep Graphic FBSDEs for Opinion Dynamics Stochastic Control

Distributed Aggregative Optimization via Finite-time Dynamic Average Consensus

On a Probabilistic Approach for Inverse Data-Driven Optimal Control