Abstract:We study zero-sum differential games with state constraints and one-sided information, where the informed player (Player 1) has a categorical payoff type unknown to the uninformed player (Player 2). The goal of Player 1 is to minimize his payoff without violating the constraints, while that of Player 2 is to violate the state constraints if possible, or to maximize the payoff otherwise. One example of the game is a man-to-man matchup in football. Without state constraints, Cardaliaguet (2007) showed that the value of such a game exists and is convex to the common belief of players. Our theoretical contribution is an extension of this result to games with state constraints and the derivation of the primal and dual subdynamic principles necessary for computing behavioral strategies. Different from existing works that are concerned about the scalability of no-regret learning in games with discrete dynamics, our study reveals the underlying structure of strategies for belief manipulation resulting from information asymmetry and state constraints. This structure will be necessary for scalable learning on games with continuous actions and long time windows. We use a simplified football game to demonstrate the utility of this work, where we reveal player positions and belief states in which the attacker should (or should not) play specific random deceptive moves to take advantage of information asymmetry, and compute how the defender should respond.

What problem does this paper attempt to address?

The paper primarily addresses the zero-sum differential game problem with state constraints and unilateral information. Specifically, the paper studies the game between two players (Player 1 and Player 2), where Player 1 has private information about the type of game payoff (i.e., type), while Player 2 is unaware of this information. Player 1's goal is to minimize the payoff without violating state constraints, while Player 2's goal is to violate the state constraints as much as possible, or if that is not possible, to maximize the payoff. The main contributions of the paper include: 1. **Theoretical Extension**: Proving the existence of the value of zero-sum differential games with state constraints and unilateral information, and deriving the primal-dual sub-dynamic principle required to compute behavioral strategies. 2. **Derivation of Behavioral Strategies**: Illustrating through detailed examples how to derive behavioral strategies from the sub-dynamic principle, especially in cases where one player can control information release to manipulate common beliefs. 3. **Development of Numerical Tools**: Proposing numerical tools to mitigate the "curse of dimensionality" in value approximation and using them to infer behavioral strategies from the value function. The paper uses a simplified soccer game as a case study, revealing how the attacker (Player 1) should utilize information asymmetry to take random deceptive actions in specific positions and belief states, and how the defender (Player 2) should respond in such an information-lacking scenario. In summary, this paper aims to address the value existence problem in zero-sum differential games with state constraints and unilateral information and proposes a method to compute the behavioral strategies that players should adopt in different situations.

State-Constrained Zero-Sum Differential Games with One-Sided Information

Zero-sum and nonzero-sum differential games without Isaacs condition

State Information in Bayesian Games

Non-zero sum differential games of forward-backward stochastic differential delayed equations under partial information and application

Zero-Sum Differential Games on the Wasserstein Space

State Constrained Two Player Differential Games with Decoupled Dynamics

A zero-sum hybrid stochastic differential game with impulse controls

Linear-Quadratic Non-Zero Sum Backward Stochastic Differential Game With Overlapping Information

Information spillover in multiple zero-sum games

Optimal Mixed Strategies to the Zero-sum Linear Differential Game

Zero-Sum Games for piecewise deterministic Markov decision processes with risk-sensitive finite-horizon cost criterion

Linear-quadratic zero-sum mean-field type games: Optimality conditions and policy optimization

Zero-determinant Strategy: an Underway Revolution in Game Theory

A tutorial on Zero-sum Stochastic Games

Convex-Concave Zero-sum Markov Stackelberg Games

Risk-Minimizing Two-Player Zero-Sum Stochastic Differential Game via Path Integral Control

Stochastic Perron's Method and Elementary Strategies for Zero-Sum Differential Games

Learning Algorithms For Differential Games Of Continuous-Time Systems

Evolutionary dynamics of zero-determinant strategies in repeated multiplayer games

Solving Large Extensive-Form Games with Strategy Constraints

Linear-quadratic two-person differential game: Nash game versus Stackelberg game, local information versus global information