Abstract:We consider finite-state concurrent stochastic games, played by k>=2 players for an infinite number of rounds, where in every round, each player simultaneously and independently of the other players chooses an action, whereafter the successor state is determined by a probability distribution given by the current state and the chosen actions. We consider reachability objectives that given a target set of states require that some state in the target is visited, and the dual safety objectives that given a target set require that only states in the target set are visited. We are interested in the complexity of stationary strategies measured by their patience, which is defined as the inverse of the smallest nonzero probability employed. Our main results are as follows: We show that in two-player zero-sum concurrent stochastic games (with reachability objective for one player and the complementary safety objective for the other player): (i) the optimal bound on the patience of optimal and epsilon-optimal strategies, for both players is doubly exponential; and (ii) even in games with a single nonabsorbing state exponential (in the number of actions) patience is necessary. In general we study the class of non-zero-sum games admitting stationary epsilon-Nash equilibria. We show that if there is at least one player with reachability objective, then doubly-exponential patience may be needed for epsilon-Nash equilibrium strategies, whereas in contrast if all players have safety objectives, the optimal bound on patience for epsilon-Nash equilibrium strategies is only exponential.

Reachability and Safety Games under TSO Semantics (Extended Version)

TSO Games -- On the decidability of safety games under the total store order semantics

Verification under TSO with an infinite Data Domain

Strategy Improvement for Concurrent Reachability and Safety Games

Analysis for Real-time Intransitive Information Flow Security Properties

Memoryless Strategies in Stochastic Reachability Games

On Equilibria in Quantitative Games with Reachability/Safety Objectives

Strategy Complexity of Concurrent Stochastic Games with Safety and Reachability Objectives

Satisfiability Modulo Ordering Consistency Theory for SC, TSO, and PSO Memory Models.

Parity Games on Temporal Graphs

Stubborn Set Reduction for Two-Player Reachability Games

Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

Playing Safe, Ten Years Later

Weak Subgame Perfect Equilibria and their Application to Quantitative Reachability

Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons

Strategy Complexity of Reachability in Countable Stochastic 2-Player Games

From Local To Global Optimality in Concurrent Parity Games

Games on Graphs: A Time-Efficient Algorithm for Solving Finite Reachability and Safety Games

How to Win First-Order Safety Games