Abstract:Uncertainty is intrinsic in Cyber-Physical Systems (CPSs) due to novel interactions of embedded systems, networking equipment, cloud infrastructures and humans. Our daily life has been increasing dependent on CPS applications in safety/mission critical domains such as healthcare, aerospace, oil/gas and maritime. For example, the National Institute of Standards and Technology (NIST) reported that direct CPS applications account for more than $32.3 trillions and expect to grow $82 trillions by 2025 (about half of the world economy). Expecting enormous dependence of our lives on CPSs in the future, dealing with uncertainty at an acceptable cost is vital to avoid posing undue threats to its users and environment. To ensure correct delivery of their functions at an acceptable cost even in the presence of uncertainty, CPSs must be reliable, robust, efficient, safe, and secure. All these properties are facets of a more general property often known as dependability. Improving system dependability first and foremost relies on the ability to verify and validate CPSs in a cost-effective manner and one way of achieving this is via systematic and automated Model-Based Testing (MBT): automated derivation of test cases from a behavioral model of a system. MBT supports rigorous, systematic, and automated testing, which eventually reduces the number of faults in the delivered systems and thus improves their quality. The goal of the U-Test project (a recently funded project under the EU Horizon2020 program (http://ec.europa.eu/programmes/horizon2020/) is to improve the dependability of CPSs, via cost-effective, model-based and search-based testing of CPSs under unknown risky uncertainty. Unknown uncertainty is the state of a CPS that can only be determined at the runtime as opposed to known uncertainty that is known at the design time and outcome from risky uncertainty is undesirable. To achieve our goal, we will advance the current state-of-art of testing CPSs by developing a novel- solution based on sound theoretical foundation for uncertainty testing in the following steps: 1) Developing a light-weight modelling solution with rich formalism to support minimal modelling of known uncertainty with risk information; 2) Intelligently evolving known uncertainty models towards realistic and risky unknown uncertainty models (evolved models) using search algorithms (e.g., genetic algorithms mimicking natural selection); and 3) Automatically generating test cases from the evolved models to test a CPS under unknown uncertainty to ensure that the CPS continues to operate properly and possibly at a reduced quality of operation, rather than failing completely.

Testing Self-Healing Cyber-Physical Systems under Uncertainty: a Fragility-Oriented Approach

Fragility-Oriented Testing with Model Execution and Reinforcement Learning.

Testing self-healing cyber-physical systems under uncertainty with reinforcement learning: an empirical study

Modeling Foundations for Executable Model-Based Testing of Self-Healing Cyber-Physical Systems

An Improved Test Selection Optimization Model Based on Fault Ambiguity Group Isolation and Chaotic Discrete PSO.

Robustness Improvement for Cyber Physical System Based on an Optimization Model of Interdependent Constraints

U-Test: Evolving, Modelling and Testing Realistic Uncertain Behaviours of Cyber-Physical Systems

Chapter Two - Uncertainty-Wise Testing of Cyber-Physical Systems.

Preprint Version Uncertainty-wise Testing of Cyber-Physical Systems

Constructing Cyber-Physical System Testing Suites Using Active Sensor Fuzzing

Uncertainty-wise Test Case Generation and Minimization for Cyber-Physical Systems.

Uncertainty-Wise Cyber-Physical System Test Modeling

Probabilistic Inference of Fault Condition of Cyber-Physical Systems under Uncertainty

A Model Driven Approach for Self-Healing Computing System

Modeling Coupling Impacts of Self-Healing Mechanisms and Dynamic Environments on Systems Subject to Dependent Failure Processes

Stress Testing Control Loops in Cyber-Physical Systems

Uncertainty-Aware Test Prioritization: Approaches and Empirical Evaluation

Uncertainty Theory Based Reliability-Centric Cyber-Physical System Design

Investigating Robustness in Cyber-Physical Systems: Specification-Centric Analysis in the face of System Deviations

A Survey of Algorithms for Black-Box Safety Validation of Cyber-Physical Systems

Understanding Uncertainty in Cyber-Physical Systems: A Conceptual Model