Abstract:Abstraction-based techniques are an attractive approach for synthesizing correct-by-construction controllers to satisfy high-level temporal requirements. A main bottleneck for successful application of these techniques is the memory requirement, both during controller synthesis and in controller deployment. We propose memory-efficient methods for mitigating the high memory demands of the abstraction-based techniques using neural network representations. To perform synthesis for reach-avoid specifications, we propose an on-the-fly algorithm that relies on compressed neural network representations of the forward and backward dynamics of the system. In contrast to usual applications of neural representations, our technique maintains soundness of the end-to-end process. To ensure this, we correct the output of the trained neural network such that the corrected output representations are sound with respect to the finite abstraction. For deployment, we provide a novel training algorithm to find a neural network representation of the synthesized controller and experimentally show that the controller can be correctly represented as a combination of a neural network and a look-up table that requires a substantially smaller memory. We demonstrate experimentally that our approach significantly reduces the memory requirements of abstraction-based methods. For the selected benchmarks, our approach reduces the memory requirements respectively for the synthesis and deployment by a factor of $1.31\times 10^5$ and $7.13\times 10^3$ on average, and up to $7.54\times 10^5$ and $3.18\times 10^4$. Although this reduction is at the cost of increased off-line computations to train the neural networks, all the steps of our approach are parallelizable and can be implemented on machines with higher number of processing units to reduce the required computational time.

Dynamic Hierarchical Reactive Controller Synthesis

Constraint Function Based Hierarchical Control of Discrete Event Systems

Synthesis of Hierarchical Controllers Based on Deep Reinforcement Learning Policies

Learning-Based Synthesis of Safety Controllers

An Iterative Abstraction Algorithm for Reactive Correct-by-construction Controller Synthesis

Sampling-based Reactive Synthesis for Nondeterministic Hybrid Systems

Synthesising Robust Controllers for Robot Collectives with Recurrent Tasks: A Case Study

Context-triggered Abstraction-based Control Design

Tunable Reactive Synthesis for Lipschitz-Bounded Systems with Temporal Logic Specifications

Data-driven abstraction-based control synthesis

Iterative Controller Synthesis for Multirobot System

Hierarchical Policy Blending as Inference for Reactive Robot Control

Formal controller synthesis for hybrid systems using genetic programming

Controller Synthesis for Linear Time-varying Systems with Adversaries

Neural Abstraction-Based Controller Synthesis and Deployment

Indecision and Delays Are the Parents of Failure - Taming Them Algorithmically by Synthesizing Delay-Resilient Control.

Reactive high-level behavior synthesis for an Atlas humanoid robot

Hybrid Recurrent Models Support Emergent Descriptions for Hierarchical Planning and Control

Reactive Task and Motion Planning for Robust Whole-Body Dynamic Locomotion in Constrained Environments

What's to Come is Still Unsure - Synthesizing Controllers Resilient to Delayed Interaction.

Discrete-Event Controller Synthesis for Autonomous Systems with Deep-Learning Perception Components