Abstract:In 1950, Nash proposed a natural equilibrium solution concept for games hence called Nash equilibrium, and proved that all finite games have at least one. The proof is through a simple yet ingenious application of Brouwer’s (or, in another version Kakutani’s) fixed point theorem, the most sophisticated result in his era’s topology—in fact, recent algorithmic work has established that Nash equilibria are computationally equivalent to fixed points. In this paper, we propose a new class of universal non-equilibrium solution concepts arising from an important theorem in the topology of dynamical systems that was unavailable to Nash. This approach starts with both a game and a learning dynamics, defined over mixed strategies. The Nash equilibria are fixpoints of the dynamics, but the system behavior is captured by an object far more general than the Nash equilibrium that is known in dynamical systems theory as chain recurrent set. Informally, once we focus on this solution concept—this notion of “the outcome of the game”—every game behaves like a potential game with the dynamics converging to these states. In other words, unlike Nash equilibria, this solution concept is algorithmic in the sense that it has a constructive proof of existence. We characterize this solution for simple benchmark games under replicator dynamics, arguably the best known evolutionary dynamics in game theory. For (weighted) potential games, the new concept coincides with the fixpoints/equilibria of the dynamics. However, in (variants of) zero-sum games with fully mixed (i.e., interior) Nash equilibria, it covers the whole state space, as the dynamics satisfy specific information theoretic constants of motion. We discuss numerous novel computational, as well as structural, combinatorial questions raised by this chain recurrence conception of games.

The Existence of Equilibria in Games with Arbitrary Strategy Spaces and Payoffs: A Full Characterization

Distributed Generalized Nash Equilibrium Seeking: An Operator-Theoretic Perspective

Nash Equilibrium Existence without Convexity

A general structure theorem for the Nash equilibrium correspondence

A New Proof of Existence of Equilibria in Infinite Normal Form Games

Generalized Bayesian Nash Equilibrium with Continuous Type and Action Spaces

N-person noncooperative game with infinite strategic space

From Nash Equilibria to Chain Recurrent Sets: An Algorithmic Solution Concept for Game Theory

A Robust Characterization of Nash Equilibrium

Generalized Nash Equilibrium Problems with Mixed-Integer Variables

Existence of open-loop equilibria in differential games with impulsive effects suffered by logic choice

On the Existence of Nash Equilibriums for Infinite Matrix Games

Myopic equilibria, the spanning property, and subgame bundles

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

On the tractability of Nash equilibrium

Finding Mixed Strategy Nash Equilibrium for Continuous Games through Deep Learning

From winning strategy to Nash equilibrium

Nash Equilibria for Total Expected Reward Absorbing Markov Games: The Constrained and Unconstrained Cases

Geometric Structure and Polynomial-time Algorithm of Game Equilibria

On Existence of Berk-Nash Equilibria in Misspecified Markov Decision Processes with Infinite Spaces

Safe Equilibrium