Abstract:Cyber-Physical Systems (CPSs), comprising both software and physical components, arise in many industry-relevant domains and are often mission- or safety-critical. System-Level Verification (SLV) of CPSs aims at certifying that given (e.g., safety or liveness) specifications are met, or at estimating the value of some KPIs, when the system runs in its operational environment, i.e., in presence of inputs (from users or other systems) and/or of additional, uncontrolled disturbances. To enable SLV of complex systems from the early design phases, the currently most adopted approach envisions the simulation of a system model under the (time bounded) operational scenarios of interest. Simulation-based SLV can be computationally prohibitive (years of sequential simulation), since model simulation is computationally intensive and the set of scenarios of interest can huge. We present a technique that, given a collection of scenarios of interest (extracted from mass-storage databases or from symbolic structures, e.g., constraint-based scenario generators), computes parallel shortest simulation campaigns, which drive a possibly large number of system model simulators running in parallel in a HPC infrastructure through all (and only) those scenarios in the user-defined (possibly random) order, by wisely avoiding multiple simulations of repeated trajectories, thus minimising the overall completion time, compatibly with the available simulator memory capacity. Our experiments on Modelica/FMU and Simulink case study models with up to ~200 million scenarios show that our optimisation yields speedups as high as 8x. This, together with the enabled massive parallelisation, makes practically viable (a few weeks in a HPC infrastructure) verification tasks (both statistical and exhaustive, with respect to the given set of scenarios) which would otherwise take inconceivably long time.

Anytime System Level Verification via Random Exhaustive Hardware in the Loop Simulation

Automatically ‘verifying’ Discrete-Time Complex Systems Through Learning, Abstraction and Refinement

Experiences from Large-Scale Model Checking: Verification of a Vehicle Control System

Optimising Highly-Parallel Simulation-Based Verification of Cyber-Physical Systems

Increasing dependability by means of model-based acceptance test inside RTOS

Online Model Checking for Dependable Real-Time Systems

Modeling, Simulation and Automatic Verification of Hybrid Systems under Matlab Environment

Fully-Automated Verification of Linear Systems Using Inner- and Outer-Approximations of Reachable Sets

Verifying Non-friendly Formal Verification Designs: Can We Start Earlier?

Formal verification and simulation for platform screen doors and collision avoidance in subway control systems

An efficient statistical model checker for nondeterminism and rare events

Verifying OSEK/VDX Automotive Applications: A Spin‐based Model Checking Approach

Toward Online Hybrid Systems Model Checking of Cyber-Physical Systems' Time-Bounded Short-Run Behavior

Algorithmic Verification of Continuous and Hybrid Systems

Safety-Critical Controller Verification via Sim2Real Gap Quantification

Simulation Modeling of a Large-Scale Formal Verification Process

Functional verification of complete sequential behaviors: A formal treatment of discrepancies between system-level and RTL descriptions

Collaborative Verification-Driven Engineering of Hybrid Systems

Verified Runtime Validation for Partially Observable Hybrid Systems

Methods to Model-Check Parallel Systems Software

Quantitative Verification with Adaptive Uncertainty Reduction