Abstract:Designing controllers to satisfy temporal requirements has proven to be challenging for dynamical systems that are affected by uncertainty. This is mainly due to the states evolving in a continuous uncountable space, the stochastic evolution of the states, and infinite-horizon temporal requirements on the system evolution, all of which makes closed-form solutions generally inaccessible. A promising approach for designing provably correct controllers on such systems is to utilize the concept of abstraction, which is based on building simplified abstract models that can be used to approximate optimal controllers with provable closeness guarantees. The available abstraction-based methods are further divided into discretization-based approaches that build a finite abstract model by discretizing the continuous space of the system, and discretization-free approaches that work directly on the continuous state space without the need for building a finite space. To reduce the conservatism in the sub-optimality of the designed controller originating from the abstraction step, this paper develops an approach that naturally has the flexibility to combine different abstraction techniques from the aforementioned classes and to combine the same abstraction technique with different parameters. First, we develop a multi-layered discretization-based approach with variable precision by combining abstraction layers with different precision parameters. Then, we exploit the advantages of both classes of abstraction-based methods by extending this multi-layered approach guided by the specification to combinations of layers with respectively discretization-based and discretization-free abstractions. We achieve an efficient implementation that is less conservative and improves the computation time and memory usage. We illustrate the benefits of the proposed multi-layered approach on several case studies.

A Stability-Based Abstraction Framework for Reach-Avoid Control of Stochastic Dynamical Systems with Unknown Noise Distributions

Correct-by-Construction Control for Stochastic and Uncertain Dynamical Models via Formal Abstractions

Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions

Scalable control synthesis for stochastic systems via structural IMDP abstractions

Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertainty

Data-driven Interval MDP for Robust Control Synthesis

Correct-by-construction reach-avoid control of partially observable linear stochastic systems

Data-driven abstraction-based control synthesis

Unifying Safety Approaches for Stochastic Systems: From Barrier Functions to Uncertain Abstractions via Dynamic Programming

Formal Controller Synthesis for Markov Jump Linear Systems with Uncertain Dynamics

Abstraction-based Control of Unknown Continuous-Space Models with Just Two Trajectories

Data-Driven Abstractions for Control Systems via Random Exploration

Abstraction-based Synthesis for Stochastic Systems with Omega-Regular Objectives

An Iterative Abstraction Algorithm for Reactive Correct-by-construction Controller Synthesis

Specification-guided temporal logic control for stochastic systems: a multi-layered approach

Compositional Abstractions of Interconnected Discrete-Time Stochastic Control Systems

Robust Abstractions for Control Synthesis: Robustness Equals Realizability for Linear-Time Properties

Robust Dynamic Programming for Temporal Logic Control of Stochastic Systems

P-stable abstractions of hybrid systems

Probabilistic Reachability Analysis of Stochastic Control Systems

Robust Data-Driven Safe Control using Density Functions