Abstract:The possible interactions between a controller and its environment can naturally be modelled as the arena of a two-player game, and adding an appropriate winning condition permits to specify desirable behavior. The classical model here is the positional game, where both players can (fully or partially) observe the current position in the game graph, which in turn is indicative of their mutual current states. In practice, neither sensing and actuating the environment through physical devices nor data forwarding to and from the controller and signal processing in the controller are instantaneous. The resultant delays force the controller to draw decisions before being aware of the recent history of a play and to submit these decisions well before they can take effect asynchronously. It is known that existence of a winning strategy for the controller in games with such delays is decidable over finite game graphs and with respect to ω -regular objectives. The underlying reduction, however, is impractical for non-trivial delays as it incurs a blow-up of the game graph which is exponential in the magnitude of the delay. For safety objectives, we propose a more practical incremental algorithm successively synthesizing a series of controllers handling increasing delays and reducing the game-graph size in between. It is demonstrated using benchmark examples that even a simplistic explicit-state implementation of this algorithm outperforms state-of-the-art symbolic synthesis algorithms as soon as non-trivial delays have to be handled. We furthermore address the practically relevant cases of non-order-preserving delays and bounded message loss, as arising in actual networked control, thereby considerably extending the scope of regular game theory under delay.

Strategies Resilient to Delay: Games under Delayed Control vs. Delay Games

On the Existence of Reactive Strategies Resilient to Delay

Indecision and Delays Are the Parents of Failure - Taming Them Algorithmically by Synthesizing Delay-Resilient Control.

What's to Come is Still Unsure - Synthesizing Controllers Resilient to Delayed Interaction.

Concurrent games and semi-random determinacy

Different Strokes in Randomised Strategies: Revisiting Kuhn's Theorem under Finite-Memory Assumptions

Strategy Improvement for Concurrent Reachability and Safety Games

Translating Asynchronous Games for Distributed Synthesis (Full Version)

Beyond Winning Strategies: Admissible and Admissible Winning Strategies for Quantitative Reachability Games

Synthesizing Dominant Strategies for Liveness (Full Version)

Degrees of Lookahead in Regular Infinite Games

Switching Costs in Frequently Repeated Games

Memoryless Strategies in Stochastic Reachability Games

From Local To Global Optimality in Concurrent Parity Games

Control in Stochastic Environment with Delays: A Model-based Reinforcement Learning Approach

From local to global determinacy in concurrent graph games

Continual Depth-limited Responses for Computing Counter-strategies in Sequential Games

Reactive Synthesis Without Regret

Maximum Principle for Nonzero-Sum Stochastic Differential Game with Delays.

Playing Against Fair Adversaries in Stochastic Games with Total Rewards

Pareto optimality of stochastic cooperative differential game with general delays in finite horizon