Abstract:Except for special classes of games, there is no systematic framework for analyzing the dynamical properties of multi-agent strategic interactions. Potential games are one such special but restrictive class of games that allow for tractable dynamic analysis. Intuitively, games that are "close" to a potential game should share similar properties. In this paper, we formalize and develop this idea by quantifying to what extent the dynamic features of potential games extend to "near-potential" games. We study convergence of three commonly studied classes of adaptive dynamics: discrete-time better/best response, logit response, and discrete-time fictitious play dynamics. For better/best response dynamics, we focus on the evolution of the sequence of pure strategy profiles and show that this sequence converges to a (pure) approximate equilibrium set, whose size is a function of the "distance" from a close potential game. We then study logit response dynamics and provide a characterization of the stationary distribution of this update rule in terms of the distance of the game from a close potential game and the corresponding potential function. We further show that the stochastically stable strategy profiles are pure approximate equilibria. Finally, we turn attention to fictitious play, and establish that the sequence of empirical frequencies of player actions converges to a neighborhood of (mixed) equilibria of the game, where the size of the neighborhood increases with distance of the game to a potential game. Thus, our results suggest that games that are close to a potential game inherit the dynamical properties of potential games. Since a close potential game to a given game can be found by solving a convex optimization problem, our approach also provides a systematic framework for studying convergence behavior of adaptive learning dynamics in arbitrary finite strategic form games.

On the Rate of Convergence of Continuous-Time Game Dynamics in N-Player Potential Games

CONTINUOUS-TIME CONVERGENCE RATES IN POTENTIAL AND MONOTONE GAMES

Convergence Dynamics of Graphical Congestion Games.

On Best-Response Dynamics in Potential Games

Best-response dynamics, playing sequences, and convergence to equilibrium in random games

Finite-time convergence to an $ε$-efficient Nash equilibrium in potential games

Dynamics in Near-Potential Games

On Convergence Rates of Robust Adaptive Game Theoretic Learning Algorithms

On convergence rates of game theoretic reinforcement learning algorithms

Equilibrium convergence in large games

Global Nash Equilibrium in Non-convex Multi-player Game: Theory and Algorithms

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Evolutionary Games on Infinite Strategy Sets: Convergence to Nash Equilibria via Dissipativity

Convergence Rate of Payoff-based Generalized Nash Equilibrium Learning

Towards An Analytical Framework for Dynamic Potential Games

Approaching the Global Nash Equilibrium of Non-convex Multi-player Games

Game-theoretical control with continuous action sets

Convergence Rate of Learning a Strongly Variationally Stable Equilibrium

On Passivity, Reinforcement Learning and Higher-Order Learning in Multi-Agent Finite Games

Linear convergence in time-varying generalized Nash equilibrium problems

Finding Mixed Strategy Nash Equilibrium for Continuous Games through Deep Learning