Abstract:The wide availability of data coupled with the computational advances in artificial intelligence and machine learning promise to enable many future technologies such as autonomous driving. While there has been a variety of successful demonstrations of these technologies, critical system failures have repeatedly been reported. Even if rare, such system failures pose a serious barrier to adoption without a rigorous risk assessment. This paper presents a framework for the systematic and rigorous risk verification of systems. We consider a wide range of system specifications formulated in signal temporal logic (STL) and model the system as a stochastic process, permitting discrete-time and continuous-time stochastic processes. We then define the STL robustness risk as the risk of lacking robustness against failure. This definition is motivated as system failures are often caused by missing robustness to modeling errors, system disturbances, and distribution shifts in the underlying data generating process. Within the definition, we permit general classes of risk measures and focus on tail risk measures such as the value-at-risk and the conditional value-at-risk. While the STL robustness risk is in general hard to compute, we propose the approximate STL robustness risk as a more tractable notion that upper bounds the STL robustness risk. We show how the approximate STL robustness risk can accurately be estimated from system trajectory data. For discrete-time stochastic processes, we show under which conditions the approximate STL robustness risk can even be computed exactly. We illustrate our verification algorithm in the autonomous driving simulator CARLA and show how a least risky controller can be selected among four neural network lane keeping controllers for five meaningful system specifications.

Optimization with Temporal and Logical Specifications via Generalized Mean-based Smooth Robustness Measures

Smooth Robustness Measures for Symbolic Control Via Signal Temporal Logic

STLCCP: An Efficient Convex Optimization-based Framework for Signal Temporal Logic Specifications

Signal Temporal Logic Meets Convex-Concave Programming: A Structure-Exploiting SQP Algorithm for STL Specifications

Control from Signal Temporal Logic Specifications with Smooth Cumulative Quantitative Semantics

Signal Temporal Logic Planning with Time-Varying Robustness

Combined Left and Right Temporal Robustness for Control under STL Specifications

Temporal Robustness of Temporal Logic Specifications: Analysis and Control Design

Signal Temporal Logic-Guided Model Predictive Control for Robust Bipedal Locomotion Resilient to Runtime External Perturbations

Temporally Robust Multi-Agent STL Motion Planning in Continuous Time

Lipschitz Continuity of Signal Temporal Logic Robustness Measures: Synthesizing Control Barrier Functions from One Expert Demonstration

Time-Robust Path Planning with Piece-Wise Linear Trajectory for Signal Temporal Logic Specifications

STL Robustness Risk over Discrete-Time Stochastic Processes

Motion Planning for Automata-based Objectives using Efficient Gradient-based Methods

Safety Verification and Navigation for Autonomous Vehicles based on Signal Temporal Logic Constraints

MAPS$^2$: Multi-Robot Autonomous Motion Planning under Signal Temporal Logic Specifications

Optimization-Based Model Checking and Trace Synthesis for Complex STL Specifications

Control Design for Risk-Based Signal Temporal Logic Specifications

Robust Counterexample-guided Optimization for Planning from Differentiable Temporal Logic

Robust Dynamic Programming for Temporal Logic Control of Stochastic Systems

Risk of Stochastic Systems for Temporal Logic Specifications