Abstract:Whether a PTAS (polynomial-time approximation scheme) exists for game equilibria has been an open question, and its absence has indications and consequences in three fields: the practicality of methods in algorithmic game theory, non-stationarity and curse of multiagency in MARL (multi-agent reinforcement learning), and the tractability of PPAD in computational complexity theory. In this paper, we introduce a geometric object called equilibrium bundle, regarding which, first, we formalize perfect equilibria of dynamic games as the zero points of its canonical section, second, we formalize a hybrid iteration of dynamic programming and interior point method as a line search on it, third, we give the existence and oddness theorems of it as an extension of those of Nash equilibria. The line search leads to any perfect equilibrium of any dynamic game, it achieves a weak approximation (approximating to an $\epsilon$-equilibrium) in fully polynomial time, and it achieves a strong approximation (approximating to an $\epsilon$-neighborhood of an actual equilibrium) with dependent time complexity. Our method is an FPTAS (fully PTAS) for the PPAD-complete weak approximation problem of game equilibria, implying PPAD=FP. As intermediate results, we introduce two concepts called unbiased barrier problem and unbiased KKT conditions to make the interior point method to approximate Nash equilibria, and introduce a concept called policy cone to give the sufficient and necessary condition for dynamic programming to converge to perfect equilibria. In experiment, the line search process is animated, and the method is tested on 2000 randomly generated dynamic games where it converges to a perfect equilibrium in every single case.

An Approximation Theorem and Generic Uniqueness of Weakly Pareto-Nash Equilibrium for Multiobjective Population Games

Well-Posedness of Weakly Cooperative Equilibria for Multi-objective Population Games

Multiple-Population Discrete-Time Mean Field Games with Discounted and Total Payoffs: Approximation of Games with Finite Populations

On the Approximation of Nash Equilibria in Sparse Win-Lose Multi-player Games

Existence and Stability of Fuzzy Slightly Altruistic Equilibrium for a Class of Generalized Multiobjective Fuzzy Games

Approaching the Global Nash Equilibrium of Non-convex Multi-player Games

On Equilibrium Existence in Generalized Multi-Prize Nested Lottery Contests.

Best Approximate Solution for Generalized Nash Games and Quasi-optimization Problems

Approximating the set of Nash equilibria for convex games

A new class of generalized Nash-population games via variational inequalities and fixed points

Open-loop Pareto-Nash equilibria in multi-objective interval differential games

Geometric Structure and Polynomial-time Algorithm of Game Equilibria

Computing Approximate Nash Equilibria for Integer Programming Games

Joint-perturbation simultaneous pseudo-gradient

Approximating multiobjective optimization problems: How exact can you be?

A note on the Finite intersection property in "Existence of Nash equilibria for generalized multiobjective games through the vector extension of Weierstrass and Berge maximum theorems"

Global Nash Equilibrium in Non-convex Multi-player Game: Theory and Algorithms

Inapproximability of NP-Complete Variants of Nash Equilibrium

Hierarchical Nash Equilibrium over Variational Equilibria via Fixed-point Set Expression of Quasi-nonexpansive Operator

Unique determination of cost functions in a multipopulation mean field game model

Multiple-Population Discrete-Time Mean Field Games with Discounted and Total Payoffs: The Existence of Equilibria