Abstract:In 1950, Nash proposed a natural equilibrium solution concept for games hence called Nash equilibrium, and proved that all finite games have at least one. The proof is through a simple yet ingenious application of Brouwer’s (or, in another version Kakutani’s) fixed point theorem, the most sophisticated result in his era’s topology—in fact, recent algorithmic work has established that Nash equilibria are computationally equivalent to fixed points. In this paper, we propose a new class of universal non-equilibrium solution concepts arising from an important theorem in the topology of dynamical systems that was unavailable to Nash. This approach starts with both a game and a learning dynamics, defined over mixed strategies. The Nash equilibria are fixpoints of the dynamics, but the system behavior is captured by an object far more general than the Nash equilibrium that is known in dynamical systems theory as chain recurrent set. Informally, once we focus on this solution concept—this notion of “the outcome of the game”—every game behaves like a potential game with the dynamics converging to these states. In other words, unlike Nash equilibria, this solution concept is algorithmic in the sense that it has a constructive proof of existence. We characterize this solution for simple benchmark games under replicator dynamics, arguably the best known evolutionary dynamics in game theory. For (weighted) potential games, the new concept coincides with the fixpoints/equilibria of the dynamics. However, in (variants of) zero-sum games with fully mixed (i.e., interior) Nash equilibria, it covers the whole state space, as the dynamics satisfy specific information theoretic constants of motion. We discuss numerous novel computational, as well as structural, combinatorial questions raised by this chain recurrence conception of games.

Equilibrium convergence in large games

Convergence Dynamics of Graphical Congestion Games.

Distributed event-triggered Nash equilibrium seeking for non-cooperative games on unbalanced digraphs

The equilibrium properties of obvious strategy profiles in games with many players

Best-response dynamics, playing sequences, and convergence to equilibrium in random games

On the Rate of Convergence of Continuous-Time Game Dynamics in N-Player Potential Games

A general structure theorem for the Nash equilibrium correspondence

From the master equation to mean field game limit theory: Large deviations and concentration of measure

Convergence of Bayesian Nash Equilibrium in Infinite Bayesian Games under Discretization

N-person noncooperative game with infinite strategic space

From Nash Equilibria to Chain Recurrent Sets: An Algorithmic Solution Concept for Game Theory

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

From winning strategy to Nash equilibrium

Learning Graphon Mean Field Games and Approximate Nash Equilibria

Nash Equilibrium Existence without Convexity

Finite-Agent Stochastic Differential Games on Large Graphs: I. The Linear-Quadratic Case

On the Existence of Nash Equilibriums for Infinite Matrix Games

Swim till You Sink: Computing the Limit of a Game

Large population games with interactions through controls and common noise: convergence results and equivalence between $open$--$loop$ and $closed$--$loop$ controls

Classifying Convergence Complexity of Nash Equilibria in Graphical Games Using Distributed Computing Theory

Finding pure Nash equilibria in large random games