Abstract:In 1950, Nash proposed a natural equilibrium solution concept for games hence called Nash equilibrium, and proved that all finite games have at least one. The proof is through a simple yet ingenious application of Brouwer’s (or, in another version Kakutani’s) fixed point theorem, the most sophisticated result in his era’s topology—in fact, recent algorithmic work has established that Nash equilibria are computationally equivalent to fixed points. In this paper, we propose a new class of universal non-equilibrium solution concepts arising from an important theorem in the topology of dynamical systems that was unavailable to Nash. This approach starts with both a game and a learning dynamics, defined over mixed strategies. The Nash equilibria are fixpoints of the dynamics, but the system behavior is captured by an object far more general than the Nash equilibrium that is known in dynamical systems theory as chain recurrent set. Informally, once we focus on this solution concept—this notion of “the outcome of the game”—every game behaves like a potential game with the dynamics converging to these states. In other words, unlike Nash equilibria, this solution concept is algorithmic in the sense that it has a constructive proof of existence. We characterize this solution for simple benchmark games under replicator dynamics, arguably the best known evolutionary dynamics in game theory. For (weighted) potential games, the new concept coincides with the fixpoints/equilibria of the dynamics. However, in (variants of) zero-sum games with fully mixed (i.e., interior) Nash equilibria, it covers the whole state space, as the dynamics satisfy specific information theoretic constants of motion. We discuss numerous novel computational, as well as structural, combinatorial questions raised by this chain recurrence conception of games.

Nonzero-sum games of optimal stopping and generalised Nash equilibrium

Distributed Generalized Nash Equilibrium Seeking: An Operator-Theoretic Perspective

Non-zero-sum stopping games in discrete time

Generalized Nash Equilibrium Seeking for Networked Noncooperative games with a Dynamic Event-Triggered Mechanism

Non-linear non-zero-sum Dynkin games with Bermudan strategies

Non-zero-sum stopping games in continuous time

A tutorial on Zero-sum Stochastic Games

The Multi-player Nonzero-sum Dynkin Game in Continuous Time

Nonzero-sum Discrete-time Stochastic Games with Risk-sensitive Ergodic Cost Criterion

Discounted nonzero-sum optimal stopping games under Poisson random intervention times

From Nash Equilibria to Chain Recurrent Sets: An Algorithmic Solution Concept for Game Theory

The Continuous Time Nonzero-sum Dynkin Game Problem and Application in Game Options

A Generalization of von Neumann's Reduction from the Assignment Problem to Zero-Sum Games

Zero-sum Dynkin games under common and independent Poisson constraints

Exponential Convergence of Gradient Methods in Concave Network Zero-sum Games

Multi-player stopping games in continuous time

Nash, Conley, and Computation: Impossibility and Incompleteness in Game Dynamics

Zero-Sum Non-stationary Stochastic Games with the Long-Run Average Criterion

Zero-Sum Games and Linear Programming Duality

Zero-Sum Games involving Teams against Teams: Existence of Equilibria, and Comparison and Regularity in Information

Generalized Nash Equilibrium Problems with Mixed-Integer Variables