Verification of Neural Network Control Systems in Continuous Time

Ali ArjomandBigdeli,Andrew Mata,Stanley Bak

2024-06-01

Abstract:Neural network controllers are currently being proposed for use in many safety-critical tasks. Most analysis methods for neural network control systems assume a fixed control period. In control theory, higher frequency usually improves performance. However, for current analysis methods, increasing the frequency complicates verification. In the limit, when actuation is performed continuously, no existing neural network control systems verification methods are able to analyze the system. In this work, we develop the first verification method for continuously-actuated neural network control systems. We accomplish this by adding a level of abstraction to model the neural network controller. The abstraction is a piecewise linear model with added noise to account for local linearization error. The soundness of the abstraction can be checked using open-loop neural network verification tools, although we demonstrate bottlenecks in existing tools when handling the required specifications. We demonstrate the approach's efficacy by applying it to a vision-based autonomous airplane taxiing system and compare with a fixed frequency analysis baseline.

Systems and Control,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address the verification problem of neural network control systems, particularly in the context of infinite frequency control scenarios in continuous time. Specifically, most current analysis methods assume that the controller has a fixed control period, whereas in control theory, higher frequencies typically yield better performance. However, for existing analysis methods, increasing the control frequency complicates the verification process, especially in continuous time, where no ready-made methods can handle such systems. To solve this problem, the authors propose a new verification method by introducing an abstraction layer to model the neural network controller. The specific approach includes approximating the neural network controller as a piecewise linear model with noise to account for local linearization errors. This method allows the use of traditional reachability analysis tools for verification, and experiments on the Autonomous Aircraft Taxiing System (AATS) demonstrate the effectiveness of this method. Additionally, the authors discuss the limitations of existing tools in handling high-frequency controllers and propose a framework that can handle infinite frequency controllers. In this way, the paper addresses the verification problem of infinite frequency neural network control systems in continuous time for the first time.

Verification of Neural Network Control Systems in Continuous Time

Interval Reachability of Nonlinear Dynamical Systems with Neural Network Controllers

Model-Free Verification for Neural Network Controlled Systems

Safety verification of Neural-Network-based controllers: a set invariance approach

Reachability Analysis and Safety Verification for Neural Network Control Systems

Neural Network-Based Lyapunov Stability Verification for Continuous-Time Nonlinear Systems Via Mixed Integer Linear Programming

Efficient Verification of Control Systems with Neural Network Controllers.

Simultaneous Synthesis and Verification of Neural Control Barrier Functions through Branch-and-Bound Verification-in-the-loop Training

Validation of Neural Network Controllers for Uncertain Systems Through Keep-Close Approach: Robustness Analysis and Safety Verification

Provably Safe Neural Network Controllers via Differential Dynamic Logic

Safety Verification of Nonlinear Systems with Bayesian Neural Network Controllers

Verification of Neural Network Compression of ACAS Xu Lookup Tables with Star Set Reachability

Runtime Monitoring and Fault Detection for Neural Network-Controlled Systems

Verifying Neural Network Controlled Systems Using Neural Networks

NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systems

Verifying Controllers with Convolutional Neural Network-based Perception: A Case for Intelligible, Safe, and Precise Abstractions

Analysis on Existence of Compact Set in Neural Network Control for Nonlinear Systems

Learning a Formally Verified Control Barrier Function in Stochastic Environment

Function-dependent Neural-Network-driven State Feedback Control and Self-Verification Stability for Discrete-Time Nonlinear System

Learning safe neural network controllers with barrier certificates