Abstract:Consider $N$ players each with a $d$-dimensional action set. Each of the players' utility functions includes their reward function and a linear term for each dimension, with coefficients that are controlled by the manager. We assume that the game is strongly monotone, so if each player runs gradient descent, the dynamics converge to a unique Nash equilibrium (NE). The NE is typically inefficient in terms of global performance. The resulting global performance of the system can be improved by imposing $K$-dimensional linear constraints on the NE. We therefore want the manager to pick the controlled coefficients that impose the desired constraint on the NE. However, this requires knowing the players' reward functions and their action sets. Obtaining this game structure information is infeasible in a large-scale network and violates the users' privacy. To overcome this, we propose a simple algorithm that learns to shift the NE of the game to meet the linear constraints by adjusting the controlled coefficients online. Our algorithm only requires the linear constraints violation as feedback and does not need to know the reward functions or the action sets. We prove that our algorithm, which is based on two time-scale stochastic approximation, guarantees convergence with probability 1 to the set of NE that meet target linear constraints. We then provide a mean square convergence rate of $O(t^{-1/4})$ for our algorithm. This is the first such bound for two time-scale stochastic approximation where the slower time-scale is a fixed point iteration with a non-expansive mapping. We demonstrate how our scheme can be applied to optimizing a global quadratic cost at NE and load balancing in resource allocation games. We provide simulations of our algorithm for these scenarios.

Dynamic Interventions With Limited Knowledge in Network Games

Data-driven Dynamic Intervention Design in Network Games

Generalized Nash Equilibrium Seeking for Networked Noncooperative games with a Dynamic Event-Triggered Mechanism

Differentially Private Nash Equilibrium Seeking in Quadratic Network Games

Inducing Social Optimality in Games via Adaptive Incentive Design

Intervention Mechanism Design for Networks With Selfish Users

Network games with dynamic players: Stabilization and output convergence to Nash equilibrium

Network Learning in Quadratic Games from Best-Response Dynamics

Repeated Games With Intervention: Theory and Applications in Communications

Adaptive Incentive Design with Learning Agents

Partial Interventions in Networks

Learning to Control Unknown Strongly Monotone Games

Distributed Nash Equilibrium Seeking for Games in Systems with Unknown Control Directions

Information Preferences of Individual Agents in Linear-Quadratic-Gaussian Network Games

Indian Buffet Game with Negative Network Externality and Non-Bayesian Social Learning.

Relationship Design for Socially-Aware Behavior in Static Games

Optimal Pricing for Linear-Quadratic Games with Nonlinear Interaction Between Agents

Tackling Stackelberg Network Interdiction against a Boundedly Rational Adversary

Games on Endogenous Networks

Equilibrium analysis and incentive-based control of the anticoordinating networked game dynamics

Nash Equilibrium Seeking for Noncooperative Duopoly Games via Event-Triggered Control