Abstract:Despite the many recent practical and theoretical breakthroughs in computational game theory, equilibrium finding in extensive-form team games remains a significant challenge. While NP-hard in the worst case, there are provably efficient algorithms for certain families of team game. In particular, if the game has common external information, also known as A-loss recall -- informally, actions played by non-team members (i.e., the opposing team or nature) are either unknown to the entire team, or common knowledge within the team -- then polynomial-time algorithms exist (Kaneko & Kline 1995). In this paper, we devise a completely new algorithm for solving team games. It uses a tree decomposition of the constraint system representing each team's strategy to reduce the number and degree of constraints required for correctness (tightness of the mathematical program). Our approach has the bags of the tree decomposition correspond to team-public states. Our algorithm reduces the problem of solving team games to a linear program with at most $O(NW^{w+1})$ nonzero entries in the constraint matrix, where $N$ is the size of the game tree, $w$ is a parameter that depends on the amount of uncommon external information, and $W$ is the treewidth of the tree decomposition. In public-action games, our program size is bounded by the tighter $2^{O(nt)}N$ for teams of $n$ players with $t$ types each. Our algorithm is based on a new way to write a custom, concise tree decomposition, and its fast run time does not assume that the decomposition has small treewidth. Since our algorithm describes the polytope of correlated strategies directly, we get equilibrium finding in correlated strategies for free -- instead of, say, having to run a double oracle algorithm. We show via experiments on a standard suite of games that our algorithm achieves state-of-the-art performance on all benchmark game classes except one.

A Fast Strategy-Solving Method for Adversarial Team Games Utilizing Warm Starting

Enhanced Equilibria-Solving via Private Information Pre-Branch Structure in Adversarial Team Games

A Generic Multi-Player Transformation Algorithm for Solving Large-Scale Zero-Sum Extensive-Form Adversarial Team Games

Ancillary Mechanism for Autonomous Decision-Making Process in Asymmetric Confrontation: a View from Gomoku

Computing Ex Ante Coordinated Team-Maxmin Equilibria in Zero-Sum Multiplayer Extensive-Form Games

Team-PSRO for Learning Approximate TMECor in Large Team Games Via Cooperative Reinforcement Learning

Team Belief DAG: Generalizing the Sequence Form to Team Games for Fast Computation of Correlated Team Max-Min Equilibria via Regret Minimization

Team Correlated Equilibria in Zero-Sum Extensive-Form Games via Tree Decompositions

RM-FSP: Regret Minimization Optimizes Neural Fictitious Self-Play

Faster Game Solving via Hyperparameter Schedules

Faster Algorithms for Optimal Ex-Ante Coordinated Collusive Strategies in Extensive-Form Zero-Sum Games

Accelerating Nash Equilibrium Convergence in Monte Carlo Settings Through Counterfactual Value Based Fictitious Play

Regret Minimization in Non-Zero-Sum Games with Applications to Building Champion Multiplayer Computer Poker Agents

Adaptive Warm-Start MCTS in AlphaZero-like Deep Reinforcement Learning

Exploration Analysis in Finite-Horizon Turn-based Stochastic Games.

Towards Solving 2-TBSG Efficiently

Scalable sub-game solving for imperfect-information games

Leveraging Team Correlation for Approximating Equilibrium in Two-Team Zero-Sum Games

Learning Equilibria in Adversarial Team Markov Games: A Nonconvex-Hidden-Concave Min-Max Optimization Problem

Efficient Last-iterate Convergence Algorithms in Solving Games

Extensive-Form Game Solving via Blackwell Approachability on Treeplexes