Abstract:In 1950, Nash proposed a natural equilibrium solution concept for games hence called Nash equilibrium, and proved that all finite games have at least one. The proof is through a simple yet ingenious application of Brouwer’s (or, in another version Kakutani’s) fixed point theorem, the most sophisticated result in his era’s topology—in fact, recent algorithmic work has established that Nash equilibria are computationally equivalent to fixed points. In this paper, we propose a new class of universal non-equilibrium solution concepts arising from an important theorem in the topology of dynamical systems that was unavailable to Nash. This approach starts with both a game and a learning dynamics, defined over mixed strategies. The Nash equilibria are fixpoints of the dynamics, but the system behavior is captured by an object far more general than the Nash equilibrium that is known in dynamical systems theory as chain recurrent set. Informally, once we focus on this solution concept—this notion of “the outcome of the game”—every game behaves like a potential game with the dynamics converging to these states. In other words, unlike Nash equilibria, this solution concept is algorithmic in the sense that it has a constructive proof of existence. We characterize this solution for simple benchmark games under replicator dynamics, arguably the best known evolutionary dynamics in game theory. For (weighted) potential games, the new concept coincides with the fixpoints/equilibria of the dynamics. However, in (variants of) zero-sum games with fully mixed (i.e., interior) Nash equilibria, it covers the whole state space, as the dynamics satisfy specific information theoretic constants of motion. We discuss numerous novel computational, as well as structural, combinatorial questions raised by this chain recurrence conception of games.

A Learning Framework for Distribution-Based Game-Theoretic Solution Concepts

A game theoretical formulation for distributed optimization problems

Towards a theory of out-of-distribution learning

Computing Optimal Equilibria and Mechanisms via Learning in Zero-Sum Extensive-Form Games

A unified stochastic approximation framework for learning in games

Solving Decision-Dependent Games by Learning from Feedback

Learning Cooperative Games

A Scalable Game Theoretic Approach for Coordination of Multiple Dynamic Systems

Indian Buffet Game with Negative Network Externality and Non-Bayesian Social Learning.

Distributed Machine Learning with Strategic Network Design: A Game-Theoretic Perspective

From Nash Equilibria to Chain Recurrent Sets: An Algorithmic Solution Concept for Game Theory

The Confluence of Networks, Games and Learning

A Robust Utility Learning Framework via Inverse Optimization

Distributed Non-Bayesian Learning for Games with Incomplete Information

Optimality and Stability in Federated Learning: A Game-theoretic Approach

Learning Equilibria of Simulation-Based Games

Indian Buffet Game with non-Bayesian social learning.

Learning in Games: a Systematic Review

Energy-Based Learning for Cooperative Games, with Applications to Valuation Problems in Machine Learning

Decentralized and Uncoordinated Learning of Stable Matchings: A Game-Theoretic Approach

Modelling Behavioural Diversity for Learning in Open-Ended Games