Abstract:Several methods have been proposed recently to learn neural network (NN) controllers for autonomous agents, with unknown and stochastic dynamics, tasked with complex missions captured by Linear Temporal Logic (LTL). Due to the sample-inefficiency of the majority of these works, compositional learning methods have been proposed decomposing the LTL specification into smaller sub-tasks. Then, separate controllers are learned and composed to satisfy the original task. A key challenge within these approaches is that they often lack safety guarantees or the provided guarantees are impractical. This paper aims to address this challenge. Particularly, we consider autonomous systems with unknown and stochastic dynamics and LTL-encoded tasks. We assume that the system is equipped with a finite set of base skills modeled by trained NN feedback controllers. Our goal is to check if there exists a temporal composition of the trained NN controllers - and if so, to compute it - that will yield a composite system behavior that satisfies the assigned LTL task with probability one. We propose a new approach that relies on a novel integration of automata theory and data-driven reachability analysis tools for NN-controlled stochastic systems. The resulting neuro-symbolic controller allows the agent to generate safe behaviors for unseen complex temporal logic tasks in a zero-shot fashion by leveraging its base skills. We show correctness of the proposed method and we provide conditions under which it is complete. To the best of our knowledge, this is the first work that designs verified temporal compositions of NN controllers for unknown and stochastic systems. Finally, we provide extensive numerical simulations and hardware experiments on robot navigation tasks to demonstrate the proposed method.

Cocktail: Learn a Better Neural Network Controller from Multiple Experts via Adaptive Mixing and Robust Distillation

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

Design Of Model Predictive Controller Based On Neural Systems

Energy-Efficient Control Adaptation with Safety Guarantees for Learning-Enabled Cyber-Physical Systems

Online Reinforcement Learning-based Neural Network Controller Design for Affine Nonlinear Discrete-time Systems.

Learning-Based Neural Dynamic Surface Predictive Control for MMC

Cocktail: Mixing Multi-Modality Controls for Text-Conditional Image Generation

Safety Filter Design for Neural Network Systems via Convex Optimization

Convex Temporal Convolutional Network-Based Distributed Cooperative Learning Control for Multiagent Systems

Cocktail: Mixing Multi-Modality Control for Text-Conditional Image Generation

Learning-based Distributed Model Predictive Control with State-dependent Uncertainty Using Neural Network

Towards Design Automation of Microfluidic Mixers: Leveraging Reinforcement Learning and Artificial Neural Networks

A novel approach on control simulation using neural network ensemble

An Intelligent Social Learning-based Optimization Strategy for Black-box Robotic Control with Reinforcement Learning

Model-Based Control with Sparse Neural Dynamics

Distributionally Robust Policy and Lyapunov-Certificate Learning

Model-Assisted Probabilistic Safe Adaptive Control With Meta-Bayesian Learning

Verified Compositional Neuro-Symbolic Control for Stochastic Systems with Temporal Logic Tasks

Resilient neural network-based control of nonlinear heterogeneous multi-agent systems: a cyber-physical system approach

Lyapunov-stable neural-network control

Dynamic neural network control through fuzzy Q-learning algorithms