Abstract:Consider $N$ players each with a $d$-dimensional action set. Each of the players' utility functions includes their reward function and a linear term for each dimension, with coefficients that are controlled by the manager. We assume that the game is strongly monotone, so if each player runs gradient descent, the dynamics converge to a unique Nash equilibrium (NE). The NE is typically inefficient in terms of global performance. The resulting global performance of the system can be improved by imposing $K$-dimensional linear constraints on the NE. We therefore want the manager to pick the controlled coefficients that impose the desired constraint on the NE. However, this requires knowing the players' reward functions and their action sets. Obtaining this game structure information is infeasible in a large-scale network and violates the users' privacy. To overcome this, we propose a simple algorithm that learns to shift the NE of the game to meet the linear constraints by adjusting the controlled coefficients online. Our algorithm only requires the linear constraints violation as feedback and does not need to know the reward functions or the action sets. We prove that our algorithm, which is based on two time-scale stochastic approximation, guarantees convergence with probability 1 to the set of NE that meet target linear constraints. We then provide a mean square convergence rate of $O(t^{-1/4})$ for our algorithm. This is the first such bound for two time-scale stochastic approximation where the slower time-scale is a fixed point iteration with a non-expansive mapping. We demonstrate how our scheme can be applied to optimizing a global quadratic cost at NE and load balancing in resource allocation games. We provide simulations of our algorithm for these scenarios.

Controlling network coordination games

Generalized Nash Equilibrium Seeking for Networked Noncooperative games with a Dynamic Event-Triggered Mechanism

Who Controls the Network?

Coordination on Networks

Rationality and connectivity in stochastic learning for networked coordination games

Equilibrium analysis and incentive-based control of the anticoordinating networked game dynamics

Controlling network ensembles

Control of Asynchronous Imitation Dynamics on Networks

Distributed Formation Control with Open-Loop Nash Strategy

Optimizing the Controllability of Arbitrary Networks with Genetic Algorithm

Analysis and Control of Networked Game Dynamics Via A Microscopic Deterministic Approach.

Networked Anti-Coordination Games Meet Graphical Dynamical Systems: Equilibria and Convergence

Average Submodularity of Maximizing Anticoordination in Network Games

Network games with dynamic players: Stabilization and output convergence to Nash equilibrium

Control of states based on evolutionary games in multi-agent systems

Leader-follower and leaderless bipartite formation-consensus over undirected coopetition networks and under proximity and collision-avoidance constraints

Control Efficacy of Complex Networks

Adaptive approaches for fully distributed Nash equilibrium seeking in networked games

Learning to Control Unknown Strongly Monotone Games

Controllability of Networks with Multivariable Agents

Robust Distributed Nash Equilibrium Seeking Subject to Communication Constraints