Abstract:We consider the behaviour of $\lambda$-discounted zero-sum games as the discount factor $\lambda$ approaches 0 (that is, the players are more and more patient), in the context of games with stage duration. In stochastic games with stage duration h, players act at times 0, h, 2h, and so on. The payoff and leaving probabilities are proportional to h. When h tends to 0, such discrete-time games approximate games played in continuous time. The asymptotic behavior of the values (when both $\lambda$ and h tend to 0) was already studied in the case of stochastic games with perfect observation of the state and in the state-blind case.We consider the same question for the case of stochastic games with imperfect observation of the state. More precisely, we consider a particular case of such games, stochastic games with public signals, in which players are given at each stage a public signal that depends only on the current state. Our main result states that there exists a stochastic game with public signals, with no limit value (as the discount factor $\lambda$ goes to 0) if stage duration is 1, but with a limit value when stage duration h and discount factor $\lambda$ both tend to 0. Informally speaking, it means that the limit value in discrete time does not exist, but the limit value in continuous time (i.e. when h approaches 0) exists. Such a situation is impossible in the case of stochastic games with perfect observation of the state.

Constant Payoff Property in Zero-Sum Stochastic Games with a Finite Horizon

Long-Time Behavior of Zero-Sum Linear-Quadratic Stochastic Differential Games

A Zero-Sum Stochastic Game with Compact Action Sets and no Asymptotic Value

Zero-sum Risk-Sensitive Stochastic Games with Unbounded Payoff Functions and Varying Discount Factors

Zero-Sum Games for piecewise deterministic Markov decision processes with risk-sensitive finite-horizon cost criterion

A tutorial on Zero-sum Stochastic Games

Non-zero-sum stopping games in discrete time

A zero-sum hybrid stochastic differential game with switching controls

A zero-sum hybrid stochastic differential game with impulse controls

Zero-Sum Non-stationary Stochastic Games with the Long-Run Average Criterion

Marginal Values of a Stochastic Game

Discounted nonzero-sum optimal stopping games under Poisson random intervention times

Stochastic Perron's Method and Elementary Strategies for Zero-Sum Differential Games

Zero-sum Risk-sensitive Stochastic Games for Continuous Time Markov Chains

Last-Iterate Convergence of Payoff-Based Independent Learning in Zero-Sum Stochastic Games

Switching Games Of Stochastic Differential Systems

A Zero-Sum Differential Game with Exit Time

Zero-Sum Stochastic Games with Vanishing Stage Duration and Public Signals

Playing Against Fair Adversaries in Stochastic Games with Total Rewards

Limit Value in Zero-Sum Stochastic Games with Vanishing Stage Duration and Public Signals

Numerical approximations of the value of zero-sum stochastic differential impulse controls game in finite horizon