Abstract:Autonomous cyber-physical systems (CPS) rely on the correct operation of numerous components, with state-of-the-art methods relying on machine learning (ML) and artificial intelligence (AI) components in various stages of sensing and control. This paper develops methods for estimating the reachable set and verifying safety properties of dynamical systems under control of neural network-based controllers that may be implemented in embedded software. The neural network controllers we consider are feedforward neural networks called multilayer perceptrons (MLP) with general activation functions. As such feedforward networks are memoryless, they may be abstractly represented as mathematical functions, and the reachability analysis of the network amounts to range (image) estimation of this function provided a set of inputs. By discretizing the input set of the MLP into a finite number of hyper-rectangular cells, our approach develops a linear programming (LP) based algorithm for over-approximating the output set of the MLP with its input set as a union of hyper-rectangular cells. Combining the over-approximation for the output set of an MLP based controller and reachable set computation routines for ordinary difference/differential equation (ODE) models, an algorithm is developed to estimate the reachable set of the closed-loop system. Finally, safety verification for neural network control systems can be performed by checking the existence of intersections between the estimated reachable set and unsafe regions. The approach is implemented in a computational software prototype and evaluated on numerical examples.

Towards Verification-Aware Knowledge Distillation for Neural-Network Controlled Systems: Invited Paper.

Harmonizing knowledge Transfer in Neural Network with Unified Distillation

Lipschitz Continuity Guided Knowledge Distillation

Model-Free Verification for Neural Network Controlled Systems

Verifying Neural Network Controlled Systems Using Neural Networks

Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher

Online Verification of Deep Neural Networks under Domain Shift or Network Updates

ReachNN: Reachability Analysis of Neural-Network Controlled Systems.

NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systems

A Novel Multi-Knowledge Distillation Approach.

A Selective Survey on Versatile Knowledge Distillation Paradigm for Neural Network Models

Unifying Qualitative and Quantitative Safety Verification of DNN-Controlled Systems

Variational Information Distillation for Knowledge Transfer

ReachNN*: A Tool for Reachability Analysis of Neural-Network Controlled Systems

A Dual Approach to Scalable Verification of Deep Networks

A Neurosymbolic Approach to the Verification of Temporal Logic Properties of Learning enabled Control Systems

Reachability Analysis and Safety Verification for Neural Network Control Systems

Towards a Unified View of Affinity-Based Knowledge Distillation

Neuro-Symbolic Verification of Deep Neural Networks

Revisiting Knowledge Distillation: an Inheritance and Exploration Framework

Verification and Design of Robust and Safe Neural Network-enabled Autonomous Systems