Abstract:Abstraction-based techniques are an attractive approach for synthesizing correct-by-construction controllers to satisfy high-level temporal requirements. A main bottleneck for successful application of these techniques is the memory requirement, both during controller synthesis and in controller deployment. We propose memory-efficient methods for mitigating the high memory demands of the abstraction-based techniques using neural network representations. To perform synthesis for reach-avoid specifications, we propose an on-the-fly algorithm that relies on compressed neural network representations of the forward and backward dynamics of the system. In contrast to usual applications of neural representations, our technique maintains soundness of the end-to-end process. To ensure this, we correct the output of the trained neural network such that the corrected output representations are sound with respect to the finite abstraction. For deployment, we provide a novel training algorithm to find a neural network representation of the synthesized controller and experimentally show that the controller can be correctly represented as a combination of a neural network and a look-up table that requires a substantially smaller memory. We demonstrate experimentally that our approach significantly reduces the memory requirements of abstraction-based methods. For the selected benchmarks, our approach reduces the memory requirements respectively for the synthesis and deployment by a factor of $1.31\times 10^5$ and $7.13\times 10^3$ on average, and up to $7.54\times 10^5$ and $3.18\times 10^4$. Although this reduction is at the cost of increased off-line computations to train the neural networks, all the steps of our approach are parallelizable and can be implemented on machines with higher number of processing units to reduce the required computational time.

dtControl: Decision Tree Learning Algorithms for Controller Representation

dtControl 2.0: Explainable Strategy Representation via Decision Tree Learning Steered by Experts

Exact and Cost-Effective Automated Transformation of Neural Network Controllers to Decision Tree Controllers

Learning Safety Constraints From Demonstration Using One-Class Decision Trees

Strategy Representation by Decision Trees in Reactive Synthesis

A New Method for Learning Decision Tree Classifier

Learning-Based Synthesis of Safety Controllers

Decision Tree Variations and Online Tuning for Real-Time Control of a Building in a Two-Stage Management Strategy

Decision Transformer as a Foundation Model for Partially Observable Continuous Control

Learning accurate and interpretable decision trees

Learning Behavior Trees by Evolution-Inspired Approaches.

Reconfigurable Behavior Trees: Towards an Executive Framework Meeting High-level Decision Making and Control Layer Features

Interactive Decision Tree Creation and Enhancement with Complete Visualization for Explainable Modeling

In Search of Trees: Decision-Tree Policy Synthesis for Black-Box Systems via Search

An Iterative Abstraction Algorithm for Reactive Correct-by-construction Controller Synthesis

Limits of Actor-Critic Algorithms for Decision Tree Policies Learning in IBMDPs

Interpretable Decision Tree Search as a Markov Decision Process

Interval Temporal Logic Decision Tree Learning

Representation of Supervisory Controls Using State Tree Structures, Binary Decision Diagrams, Automata, and Supervisor Reduction

An Extended Convergence Result for Behaviour Tree Controllers

Neural Abstraction-Based Controller Synthesis and Deployment