Abstract:We focus on the problem of finding an optimal strategy for a team of two players that faces an opponent in an imperfect-information zero-sum extensive-form game. Team members are not allowed to communicate during play but can coordinate before the game. In that setting, it is known that the best the team can do is sample a profile of potentially randomized strategies (one per player) from a joint (a.k.a. correlated) probability distribution at the beginning of the game. In this paper, we first provide new modeling results about computing such an optimal distribution by drawing a connection to a different literature on extensive-form correlation. Second, we provide an algorithm that computes such an optimal distribution by only using profiles where only one of the team members gets to randomize in each profile. We can also cap the number of such profiles we allow in the solution. This begets an anytime algorithm by increasing the cap. We find that often a handful of well-chosen such profiles suffices to reach optimal utility for the team. This enables team members to reach coordination through a relatively simple and understandable plan. Finally, inspired by this observation and leveraging theoretical concepts that we introduce, we develop an efficient column-generation algorithm for finding an optimal distribution for the team. We evaluate it on a suite of common benchmark games. It is three orders of magnitude faster than the prior state of the art on games that the latter can solve and it can also solve several games that were previously unsolvable.

A set optimization approach to zero-sum matrix games with multi-dimensional payoffs

PN Equilibrium Strategy for Matrix Games with Fuzzy Payoffs

Linear algebraic structure of zero-determinant strategies in repeated games

Zero-determinant strategies of multi-player multi-action repeated games with multiple memories

State-Constrained Zero-Sum Differential Games with One-Sided Information

A maximin based, linear programming approach to worst-case scenario control

Strategy investments in zero-sum games

Simple Strategies for Large Zero-Sum Games with Applications to Complexity Theory

A Generalization of von Neumann's Reduction from the Assignment Problem to Zero-Sum Games

Zero-Sum Games and Linear Programming Duality

Zero-determinant strategies in iterated multi-strategy games

Faster Algorithms for Optimal Ex-Ante Coordinated Collusive Strategies in Extensive-Form Zero-Sum Games

Two Person zero-sum fuzzy matrix games and extensions

Ambitropical geometry, hyperconvexity and zero-sum games

Computing Ex Ante Coordinated Team-Maxmin Equilibria in Zero-Sum Multiplayer Extensive-Form Games

Two-Player Zero-Sum Hybrid Games

Minimax theorem and Nash equilibrium of symmetric multi-players zero-sum game with two strategic variables

Zero-Determinant Strategies in the Iterated Public Goods Game

$ε$-Optimally Solving Zero-Sum POSGs

Instance-dependent Sample Complexity Bounds for Zero-sum Matrix Games

Near-Optimal Last-iterate Convergence of Policy Optimization in Zero-sum Polymatrix Markov Games