Abstract:Cyber-Physical Systems (CPS) intrinsically combine hardware and physical systems with software and network, which are together creating complex and correlated interactions. CPS applications often experience uncertainty in interacting with environment through unreliable sensors. They can be faulty and exhibit runtime errors if developers have not considered environmental interaction uncertainty adequately. Existing work in verifying CPS applications ignores interaction uncertainty and thus may overlook uncertainty-related faults. To improve verification accuracy, in this article we propose a novel approach to verifying CPS applications with explicit modeling of uncertainty arisen in the interaction between them and the environment. Our approach builds an Interactive State Machine network for a CPS application and models interaction uncertainty by error ranges and distributions. Then it encodes both the application and uncertainty models to Satisfiability Modulo Theories (SMT) formula to leverage SMT solvers searching for counterexamples that represent application failures. The precision of uncertainty model can affect the verification results. However, it may be difficult to model interaction uncertainty precisely enough at the beginning, because of the uncontrollable noise of sensors and insufficient data sample size. To further improve the accuracy of the verification results, we propose an approach to identifying and calibrating imprecise uncertainty models. We exploit the inconsistency between the counterexamples’ estimate and actual occurrence probabilities to identify possible imprecision in uncertainty models, and the calibration of imprecise models is to minimize the inconsistency, which is reduced to a Search-Based Software Engineering problem. We experimentally evaluated our verification and calibration approaches with real-world CPS applications, and the experimental results confirmed their effectiveness and efficiency.

Model Checking the Uncertainties in Software Systems Introduced by Intelligent Components

Should We Learn Probabilistic Models for Model Checking? A New Approach and An Empirical Study.

Combining Model Checking and Testing with an Application to Reliability Prediction and Distribution

The role of model checking in software engineering

Improving Verification Accuracy of CPS by Modeling and Calibrating Interaction Uncertainty

Model Checking Applied to Quantum Physics

Intelligent quantitative safety monitoring approach for ATP system by neural computing and probabilistic model checking

Modeling the Uncertainty in Complex Engineering Systems

Automatic Verification of Transition Systems with Unspecified Components

A Statistical Model Checker for Nondeterminism and Rare Events

An efficient statistical model checker for nondeterminism and rare events

Checking Component-Based Designs for Scenario-Based Specifications

Neural Model Checking

Easy Modelling and Verification of Unpredictable and Preemptive Interrupt-Driven Systems

Model-driven Safety Dependence Verification for Component-based Airborne Software Supporting Airworthiness Certification

A Survey of Statistical Model Checking

Verifying Self-Adaptive Applications Suffering Uncertainty

A Fault Propagation Modeling and Analysis Method Based on Model Checking

Verifying Stochastic Behaviors of Decentralized Self-Adaptive Systems: A Formal Modeling and Simulation Based Approach

Verification and Design of Robust and Safe Neural Network-enabled Autonomous Systems

Uncertainty Quantification in Case of Imperfect Models: A Review