Abstract:While neural networks (NNs) have potential as autonomous controllers for Cyber-Physical Systems, verifying the safety of NN based control systems (NNCSs) poses significant challenges for the practical use of NNs, especially when safety is needed for unbounded time horizons. One reason is the intractability of analyzing NNs, ODEs and hybrid systems. To this end, we introduce VerSAILLE (Verifiably Safe AI via Logically Linked Envelopes): The first general approach that allows reusing control theory results for NNCS verification. By joining forces, we exploit the efficiency of NN verification tools while retaining the rigor of differential dynamic logic (dL). Based on provably safe control envelopes in dL, we derive specifications for the NN which is proven via NN verification. We show that a proof of the NN adhering to the specification is mirrored by a dL proof on the infinite-time safety of the NNCS. The NN verification properties resulting from hybrid systems typically contain nonlinear arithmetic and arbitrary logical structures while efficient NN verification merely supports linear constraints. To overcome this divide, we present Mosaic: An efficient, sound and complete verification approach for polynomial real arithmetic properties on piece-wise linear NNs. Mosaic partitions complex verification queries into simple queries and lifts off-the-shelf linear constraint tools to the nonlinear setting in a completeness-preserving manner by combining approximation with exact reasoning for counterexample regions. Our evaluation demonstrates the versatility of VerSAILLE and Mosaic: We prove infinite-time safety on the classical Vertical Airborne Collision Avoidance NNCS verification benchmark for two scenarios while (exhaustively) enumerating counterexample regions in unsafe scenarios. We also show that our approach significantly outperforms State-of-the-Art tools in closed-loop NNV.

Verified Compositional Neuro-Symbolic Control for Stochastic Systems with Temporal Logic Tasks

Verified Compositions of Neural Network Controllers for Temporal Logic Control Objectives

Compositional Neural Certificates for Networked Dynamical Systems

Composite Learning Fuzzy Control of Stochastic Nonlinear Strict-Feedback Systems

Compositional Policy Learning in Stochastic Control Systems with Formal Guarantees

A Neurosymbolic Approach to the Verification of Temporal Logic Properties of Learning enabled Control Systems

Compositional Verification for Autonomous Systems with Deep Learning Components

Composite Neural Learning Based Appointed-Time Safe Approach Control under Full-State Constraints

Mission-driven Exploration for Accelerated Deep Reinforcement Learning with Temporal Logic Task Specifications

Compositional Construction of Safety Controllers for Networks of Continuous-Space POMDPs

Correct-by-Construction Control for Stochastic and Uncertain Dynamical Models via Formal Abstractions

A Unified Approach to Multi-task Legged Navigation: Temporal Logic Meets Reinforcement Learning

Compositional Controller Synthesis for Interconnected Stochastic Systems with Markovian Switching

Safety-Aware Task Composition for Discrete and Continuous Reinforcement Learning

Provably Safe Neural Network Controllers via Differential Dynamic Logic

Safe Model-based Control from Signal Temporal Logic Specifications Using Recurrent Neural Networks

Learning Compositional Koopman Operators for Model-Based Control

Development of Compositionality and Generalization through Interactive Learning of Language and Action of Robots

Verifiable RNN-Based Policies for POMDPs Under Temporal Logic Constraints

Synthesis of Controllers for Co-Safe Linear Temporal Logic Specifications Using Reinforcement Learning