Abstract:We consider finite-state concurrent stochastic games, played by k>=2 players for an infinite number of rounds, where in every round, each player simultaneously and independently of the other players chooses an action, whereafter the successor state is determined by a probability distribution given by the current state and the chosen actions. We consider reachability objectives that given a target set of states require that some state in the target is visited, and the dual safety objectives that given a target set require that only states in the target set are visited. We are interested in the complexity of stationary strategies measured by their patience, which is defined as the inverse of the smallest nonzero probability employed. Our main results are as follows: We show that in two-player zero-sum concurrent stochastic games (with reachability objective for one player and the complementary safety objective for the other player): (i) the optimal bound on the patience of optimal and epsilon-optimal strategies, for both players is doubly exponential; and (ii) even in games with a single nonabsorbing state exponential (in the number of actions) patience is necessary. In general we study the class of non-zero-sum games admitting stationary epsilon-Nash equilibria. We show that if there is at least one player with reachability objective, then doubly-exponential patience may be needed for epsilon-Nash equilibrium strategies, whereas in contrast if all players have safety objectives, the optimal bound on patience for epsilon-Nash equilibrium strategies is only exponential.

On Equilibria in Quantitative Games with Reachability/Safety Objectives

On (Subgame Perfect) Secure Equilibrium in Quantitative Reachability Games

Weak Subgame Perfect Equilibria and their Application to Quantitative Reachability

On Subgame Perfect Equilibria in Turn-Based Reachability Timed Games

Stackelberg-Pareto Synthesis with Quantitative Reachability Objectives

Permissive Equilibria in Multiplayer Reachability Games

Multi-weighted Reachability Games and Their Application to Permissiveness

Strategy Improvement for Concurrent Reachability and Safety Games

Playing Safe, Ten Years Later

Games on Graphs: A Time-Efficient Algorithm for Solving Finite Reachability and Safety Games

Arena-independent Memory Bounds for Nash Equilibria in Reachability Games

Rational verification and checking for Nash and subgame-perfect equilibria in graph games

Strategy Complexity of Concurrent Stochastic Games with Safety and Reachability Objectives

Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons

Strategy Complexity of Reachability in Countable Stochastic 2-Player Games

Beyond Winning Strategies: Admissible and Admissible Winning Strategies for Quantitative Reachability Games

Memoryless Strategies in Stochastic Reachability Games

Quantitative reductions and vertex-ranked infinite games

Tractable Equilibrium Computation in Markov Games through Risk Aversion