Abstract:Self-adaptive systems have to implement adaptation policies described by sets of rules that express how the components are reconfigured within the system, the priority of a given reconfiguration to happen, when a given (sequence of) event(s) occurs, and when specific conditions on the system state are satisfied. However, when this priority is given by a fuzzy value (e.g., high, medium, low) depending on external and internal events, it has to be implemented inside the software with particular implementation choices made. This paper is dedicated to the validation of adaptation policies, using a model-based testing approach and a verdict establishment that is based on both the runtime verification of temporal properties, and the detection of inconsistencies between the adaptation policy and the reconfigurations implemented in the self-adaptive system. We propose means to establish a test verdict based on the respect of the adaptation policy by the implementation, along with coverage measures of the rules. This provides interesting feedback on the adaptation policy rules, allowing to detect reconfigurations that should not have occurred, high-priority reconfigurations that are never triggered, or low-priority reconfigurations that are too frequently executed, potential inconsistencies in the rules, or wrong interpretation of priorities. The test verdict is made based on the analysis of the execution traces of the system, which is stimulated using a usage model that describes the probabilities of external events to occur. An experiment, performed on a vehicular ad-hoc network of autonomous vehicles, illustrates the interest of the approach.

Politiques de Tests Partiels \& Systèmes de Sécurité

Combining Model Checking and Testing with an Application to Reliability Prediction and Distribution

Les POMDP font de meilleurs hackers: Tenir compte de l'incertitude dans les tests de penetration

Average probability of a dangerous failure on demand: Different modelling methods, similar results

Testing adaptation policies for software components

Stochastic Formal Methods for Hybrid Systems

A PSA-based approach for the evaluation of plant level testing strategies

The Unnecessity of Assuming Statistically Independent Tests in Bayesian Software Reliability Assessments

Differences between semi-quantitative and quantitative approaches for probabilistic assessment of technological risks

A BAYESIAN HYPOTHESIS TESTING APPROACH FOR FINDING UPPER BOUNDS FOR PROBABILITIES THAT PAIRS OF SOFTWARE COMPONENTS FAIL SIMULTANEOUSLY

Model-Based Design of Resilient Systems Using Quantitative Risk Assessment

Can Search-Based Testing with Pareto Optimization Effectively Cover Failure-Revealing Test Inputs?

Defining and Measuring Policy Coverage in Testing Access Control Policies.

Cryptographically secure multiparty evaluation of system reliability

Uncertainty-wise Test Case Generation and Minimization for Cyber-Physical Systems.

A Note on Probability Quantification for Protective System Efficacy Analysis: Stochastic Dynamics, Information Flow, and Initiating Event Arrival Times

Selection of Regression System Tests for Security Policy Evolution

PAPS: A Scalable Framework for Prioritization and Partial Selection of Security Requirements

Augmenting system tests with component tests for reliability assurance

Testing Self-Healing Cyber-Physical Systems under Uncertainty: a Fragility-Oriented Approach

Adaptive importance sampling based on fault tree analysis for piecewise deterministic Markov process