Rare Events for Statistical Model Checking an Overview

Axel Legay,Sean Sedwards,Louis-Marie Traonouez

DOI: https://doi.org/10.1007/978-3-319-45994-3_2

2016-01-01

Abstract:This invited paper surveys several simulation-based approa-ches to compute the probability of rare bugs in complex systems. The paper also describes how those techniques can be implemented in the professional toolset Plasma.

What problem does this paper attempt to address?

Importance Sampling of Interval Markov Chains

Cyrille Jegourel,Jingyi Wang,Jun Sun

DOI: https://doi.org/10.1109/dsn.2018.00040

2018-01-01

Abstract:In real-world systems, rare events often characterize critical situations like the probability that a system fails within some time bound and they are used to model some potentially harmful scenarios in dependability of safety-critical systems. Probabilistic Model Checking has been used to verify dependability properties in various types of systems but is limited by the state space explosion problem. An alternative is the recourse to Statistical Model Checking (SMC) that relies on Monte Carlo simulations and provides estimates within predefined error and confidence bounds. However, rare properties require a large number of simulations before occurring at least once. To tackle the problem, Importance Sampling, a rare event simulation technique, has been proposed in SMC for different types of probabilistic systems. Importance Sampling requires the full knowledge of probabilistic measure of the system, e.g. Markov chains. In practice, however, we often have models with some uncertainty, e.g., Interval Markov Chains. In this work, we propose a method to apply importance sampling to Interval Markov Chains. We show promising results in applying our method to multiple case studies.
Should We Learn Probabilistic Models for Model Checking? A New Approach and An Empirical Study.

Jingyi Wang,Jun Sun,Qixia Yuan,Jun Pang

DOI: https://doi.org/10.1007/978-3-662-54494-5_1

2017-01-01

Abstract:Many automated system analysis techniques e.g., model checking, model-based testing rely on first obtaining a model of the system under analysis. System modeling is often done manually, which is often considered as a hindrance to adopt model-based system analysis and development techniques. To overcome this problem, researchers have proposed to automatically \"learn\" models based on sample system executions and shown that the learned models can be useful sometimes. There are however many questions to be answered. For instance, how much shall we generalize from the observed samples and how fast would learning converge? Or, would the analysis result based on the learned model be more accurate than the estimation we could have obtained by sampling many system executions within the same amount of time? In this work, we investigate existing algorithms for learning probabilistic models for model checking, propose an evolution-based approach for better controlling the degree of generalization and conduct an empirical study in order to answer the questions. One of our findings is that the effectiveness of learning may sometimes be limited.
Learning Probabilistic Models for Model Checking: an Evolutionary Approach and an Empirical Study

Jingyi Wang,Jun Sun,Qixia Yuan,Jun Pang

DOI: https://doi.org/10.1007/s10009-018-0492-7

2018-01-01

International Journal on Software Tools for Technology Transfer

Abstract:Many automated system analysis techniques (e.g., model checking, model-based testing) rely on first obtaining a model of the system under analysis. System modeling is often done manually, which is often considered as a hindrance to adopt model-based system analysis and development techniques. To overcome this problem, researchers have proposed to automatically “learn” models based on sample system executions and shown that the learned models can be useful sometimes. There are however many questions to be answered. For instance, how much shall we generalize from the observed samples and how fast would learning converge? Or, would the analysis result based on the learned model be more accurate than the estimation we could have obtained by sampling many system executions within the same amount of time? Moreover, how well does learning scale to real-world applications? If the answer is negative, what are the potential methods to improve the efficiency of learning? In this work, we first investigate existing algorithms for learning probabilistic models for model checking and propose an evolution-based approach for better controlling the degree of generalization. Then, we present existing approaches to learn abstract models to improve the efficiency of learning for scalability reasons. Lastly, we conduct an empirical study in order to answer the above questions. Our findings include that the effectiveness of learning may sometimes be limited and it is worth investigating how abstraction should be done properly in order to learn abstract models.
An efficient statistical model checker for nondeterminism and rare events

Carlos E. Budde,Pedro R. D’Argenio,Arnd Hartmanns,Sean Sedwards

DOI: https://doi.org/10.1007/s10009-020-00563-2

2020-05-28

International Journal on Software Tools for Technology Transfer

Abstract:Abstract Statistical model checking avoids the state space explosion problem in verification and naturally supports complex non-Markovian formalisms. Yet as a simulation-based approach, its runtime becomes excessive in the presence of rare events, and it cannot soundly analyse nondeterministic models. In this article, we present : a statistical model checker that combines fully automated importance splitting to estimate the probabilities of rare events with smart lightweight scheduler sampling to approximate optimal schedulers in nondeterministic models. As part of the Modest Toolset , it supports a variety of input formalisms natively and via the Jani exchange format. A modular software architecture allows its various features to be flexibly combined. We highlight its capabilities using experiments across multi-core and distributed setups on three case studies and report on an extensive performance comparison with three current statistical model checkers.

computer science, software engineering
Combining Model Checking and Testing with an Application to Reliability Prediction and Distribution

Lin Gui,Jun Sun,Yang Liu,Yuanjie Si,Jin Song Dong,Xinyu Wang

DOI: https://doi.org/10.1145/2483760.2483779

2013-01-01

Abstract:Testing provides a probabilistic assurance of system correctness. In general, testing relies on the assumptions that the system under test is deterministic so that test cases can be sampled. However, a challenge arises when a system under test behaves non-deterministiclly in a dynamic operating environment because it will be unknown how to sample test cases. In this work, we propose a method combining hypothesis testing and probabilistic model checking so as to provide the ``assurance" and quantify the error bounds. The idea is to apply hypothesis testing to deterministic system components and use probabilistic model checking techniques to lift the results through non-determinism. Furthermore, if a requirement on the level of ``assurance" is given, we apply probabilistic model checking techniques to push down the requirement through non-determinism to individual components so that they can be verified using hypothesis testing. We motivate and demonstrate our method through an application of system reliability prediction and distribution. Our approach has been realized in a toolkit named RaPiD, which has been applied to investigate two real-world systems.
A Statistical Model Checker for Nondeterminism and Rare Events

Carlos E. Budde,Pedro R. D’Argenio,Arnd Hartmanns,Sean Sedwards

DOI: https://doi.org/10.1007/978-3-319-89963-3_20

2018-01-01

Abstract:Statistical model checking avoids the state space explosion problem in verification and naturally supports complex non-Markovian formalisms. Yet as a simulation-based approach, its runtime becomes excessive in the presence of rare events, and it cannot soundly analyse nondeterministic models. In this tool paper, we present modes: a statistical model checker that combines fully automated importance splitting to efficiently estimate the probabilities of rare events with smart lightweight scheduler sampling to approximate optimal schedulers in nondeterministic models. As part of the Modest Toolset, it supports a variety of input formalisms natively and via the Jani exchange format. A modular software architecture allows its various features to be flexibly combined. We highlight its capabilities with an experimental evaluation across multi-core and distributed setups on three exemplary case studies.
A Survey of Statistical Model Checking

Gul Agha,Karl Palmskog

DOI: https://doi.org/10.1145/3158668

IF: 0.851

2018-01-31

ACM Transactions on Modeling and Computer Simulation

Abstract:Interactive, distributed, and embedded systems often behave stochastically, for example, when inputs, message delays, or failures conform to a probability distribution. However, reasoning analytically about the behavior of complex stochastic systems is generally infeasible. While simulations of systems are commonly used in engineering practice, they have not traditionally been used to reason about formal specifications. Statistical model checking (SMC) addresses this weakness by using a simulation-based approach to reason about precise properties specified in a stochastic temporal logic. A specification for a communication system may state that within some time bound, the probability that the number of messages in a queue will be greater than 5 must be less than 0.01. Using SMC, executions of a stochastic system are first sampled, after which statistical techniques are applied to determine whether such a property holds. While the output of sample-based methods are not always correct, statistical inference can quantify the confidence in the result produced. In effect, SMC provides a more widely applicable and scalable alternative to analysis of properties of stochastic systems using numerical and symbolic methods. SMC techniques have been successfully applied to analyze systems with large state spaces in areas such as computer networking, security, and systems biology. In this article, we survey SMC algorithms, techniques, and tools, while emphasizing current limitations and tradeoffs between precision and scalability.

computer science, interdisciplinary applications,mathematics, applied
Statistical Model Checking with Change Detection

Axel Legay,Louis-Marie Traonouez

DOI: https://doi.org/10.1007/978-3-319-46508-1_9

2016-01-01

Abstract:Statistical Model Checking (SMC) is a powerful and widely used approach that consists in estimating the probability for a system to satisfy a temporal property. This is done by monitoring a finite number of executions of the system, and then extrapolating the result by using statistics. The answer is correct up to some confidence that can be parameterized by the user. It is known that SMC mitigates the state-space explosion problem and allows to approximate undecidable queries. The approach has been implemented in several toolsets such as Plasma Lab, and successfully applied in a wide range of diverse areas such as systems biology, robotic, or automotive. In this paper, we add two new modest contributions to the cathedral of results on SMC. The first contribution is an algorithm that can be used to monitor changes in the probability distribution to satisfy a bounded-time property at runtime. Concretely, the algorithm constantly monitors the execution of the deployed system, and raises a flag when it observes that the probability has changed significantly. This is done by extending the applicability of the CUSUM algorithm used in signal processing into the formal validation setting. Our second contribution is to show how the programming interface of Plasma Lab can be exploited in order to make SMC technology directly available in toolsets used by designers. This integration is done by exploiting simulation facilities of design tools. Our approach thus differs from the one adopted by other SMC/formal verification toolsets which assume the existence of formal semantics for the design language, as well as a compiling chain to the rather academic one used by validation tool. The concept results in the integration of Plasma Lab as a library of the Simulink toolset. The contributions are illustrated by using Plasma Lab to verify a Simulink case study modelling a pig shed temperature controller.
What Are the Odds? Improving the foundations of Statistical Model Checking

Tobias Meggendorfer,Maximilian Weininger,Patrick Wienhöft

2024-04-08

Abstract:Markov decision processes (MDPs) are a fundamental model for decision making under uncertainty. They exhibit non-deterministic choice as well as probabilistic uncertainty. Traditionally, verification algorithms assume exact knowledge of the probabilities that govern the behaviour of an MDP. As this assumption is often unrealistic in practice, statistical model checking (SMC) was developed in the past two decades. It allows to analyse MDPs with unknown transition probabilities and provide probably approximately correct (PAC) guarantees on the result. Model-based SMC algorithms sample the MDP and build a model of it by estimating all transition probabilities, essentially for every transition answering the question: ``What are the odds?'' However, so far the statistical methods employed by the state of the art SMC algorithms are quite naive. Our contribution are several fundamental improvements to those methods: On the one hand, we survey statistics literature for better concentration inequalities; on the other hand, we propose specialised approaches that exploit our knowledge of the MDP. Our improvements are generally applicable to many kinds of problem statements because they are largely independent of the setting. Moreover, our experimental evaluation shows that they lead to significant gains, reducing the number of samples that the SMC algorithm has to collect by up to two orders of magnitude.

Artificial Intelligence,Machine Learning,Systems and Control
Sound Statistical Model Checking for Probabilities and Expected Rewards

Carlos E. Budde,Arnd Hartmanns,Tobias Meggendorfer,Maximilian Weininger,Patrick Wienhöft

2024-11-01

Abstract:Statistical model checking estimates probabilities and expectations of interest in probabilistic system models by using random simulations. Its results come with statistical guarantees. However, many tools use unsound statistical methods that produce incorrect results more often than they claim. In this paper, we provide a comprehensive overview of tools and their correctness, as well as of sound methods available for estimating probabilities from the literature. For expected rewards, we investigate how to bound the path reward distribution to apply sound statistical methods for bounded distributions, of which we recommend the Dvoretzky-Kiefer-Wolfowitz inequality that has not been used in SMC so far. We prove that even reachability rewards can be bounded in theory, and formalise the concept of limit-PAC procedures for a practical solution. The 'modes' SMC tool implements our methods and recommendations, which we use to experimentally confirm our results.

Logic in Computer Science
Towards a Statistical Model Checking Method for Safety-Critical Cyber-Physical System Verification

Jian Xie,Wenan Tan,Bingwu Fang,Zhiqiu Huang

DOI: https://doi.org/10.1155/2021/5536722

IF: 1.968

2021-05-17

Security and Communication Networks

Abstract:Safety-Critical Cyber-Physical System (SCCPS) refers to the system that if the system fails or its key functions fail, it will cause casualties, property damage, environmental damage, and other catastrophic consequences. Therefore, it is vital to verify the safety of safety critical systems. In the community, the SCCPS safety verification mainly relies on the statistical model checking methodology, but for SCCPS with extremely high safety requirements, the statistical model checking method is difficult/infeasible to sample the extremely small probability event since the probability of the system violating the safety is very low (rare property). In response to this problem, we propose a new method of statistical model checking for high-safety SCCPS. Firstly, with the CTMC-approximated SCCPS path probability space model, it leverages the maximum likelihood estimation method to learn the parameters of CTMC. Then, the embedded DTMC can be derived from CTMC, and a cross-entropy optimization model based on DTMC can be constructed. Finally, we propose an algorithm of iteratively learning the optimal importance sampling distribution on the discrete path space and an algorithm to check the statistical model of verifying the rare attribute. Eventually, experimental results show that the method proposed in this paper can effectively verify the rare attributes of SCCPS. Under the same sample size, comparing with the heuristic importance sampling methods, the estimated value of this method can be better distributed around the mean value, and the related standard deviation and relative error are reduced by more than an order of magnitude.

computer science, information systems,telecommunications
Formal Verification of Probabilistic SystemC Models with Statistical Model Checking

Van Chan Ngo,Axel Legay

DOI: https://doi.org/10.1002/smr.1890

2017-12-05

Abstract:Transaction-level modeling with SystemC has been very successful in describing the behavior of embedded systems by providing high-level executable models, in which many of them have inherent probabilistic behaviors, e.g., random data and unreliable components. It thus is crucial to have both quantitative and qualitative analysis of the probabilities of system properties. Such analysis can be conducted by constructing a formal model of the system under verification and using Probabilistic Model Checking (PMC). However, this method is infeasible for large systems, due to the state space explosion. In this article, we demonstrate the successful use of Statistical Model Checking (SMC) to carry out such analysis directly from large SystemC models and allow designers to express a wide range of useful properties. The first contribution of this work is a framework to verify properties expressed in Bounded Linear Temporal Logic (BLTL) for SystemC models with both timed and probabilistic characteristics. Second, the framework allows users to expose a rich set of user-code primitives as atomic propositions in BLTL. Moreover, users can define their own fine-grained time resolution rather than the boundary of clock cycles in the SystemC simulation. The third contribution is an implementation of a statistical model checker. It contains an automatic monitor generation for producing execution traces of the model-under-verification (MUV), the mechanism for automatically instrumenting the MUV, and the interaction with statistical model checking algorithms.

Software Engineering
Variational Bayesian Monte Carlo simulation for rare event assessment

Jingzhe Lei,Chunyan Ling,Min Xie,Way Kuo

DOI: https://doi.org/10.1177/1748006x241284054

2024-10-30

Proceedings of the Institution of Mechanical Engineers Part O Journal of Risk and Reliability

Abstract:Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, Ahead of Print. Estimating rare events in structural engineering demands intensive computational resources, and the complexity of the performance function poses challenges to accurate probability estimation. To efficiently conduct the structural reliability analysis on rare events, we propose a novel variational Bayesian Monte Carlo (VBMC)-based subset simulation (SS) method. The proposed approach can be divided into two aspects: the Monte Carlo simulation (MCS) is first applied to estimate the first-layer unconditional failure probability, then VBMC is employed to estimate subsequent conditional failure probabilities. Finally, the original small failure probability is obtained by the product of the first-layer unconditional failure probability and a series of conditional failure probabilities. The proposed approach inherits the merits of SS as well as VBMC, which converts the tricky rare event estimation into a series of high-frequency event estimations and leverages VBMC instead of the canonical Markov chain to produce the independent and informative next-generation failure-conditional samples. Four case studies, including high-dimensional and discrete state space scenarios, are performed to illustrate the feasibility and generality of the proposed method.

engineering, industrial, multidisciplinary,operations research & management science
Analysis and Simulation of Extremes and Rare Events in Complex Systems

Meagan Carney,Holger Kantz,Matthew Nicol

DOI: https://doi.org/10.48550/arXiv.2005.07573

2020-05-12

Abstract:Rare weather and climate events, such as heat waves and floods, can bring tremendous social costs. Climate data is often limited in duration and spatial coverage, and climate forecasting has often turned to simulations of climate models to make better predictions of rare weather events. However very long simulations of complex models, in order to obtain accurate probability estimates, may be prohibitively slow. It is an important scientific problem to develop probabilistic and dynamical techniques to estimate the probabilities of rare events accurately from limited data. In this paper we compare four modern methods of estimating the probability of rare events: the generalized extreme value (GEV) method from classical extreme value theory; two importance sampling techniques, genealogical particle analysis (GPA) and the Giardina-Kurchan-Lecomte-Tailleur (GKLT) algorithm; as well as brute force Monte Carlo (MC). With these techniques we estimate the probabilities of rare events in three dynamical models: the Ornstein-Uhlenbeck process, the Lorenz '96 system and PlaSim (a climate model). We keep the computational effort constant and see how well the rare event probability estimation of each technique compares to a gold standard afforded by a very long run control. Somewhat surprisingly we find that classical extreme value theory methods outperform GPA, GKLT and MC at estimating rare events.

Methodology
Bounding rare event probabilities in computer experiments

Yves Auffray,Pierre Barbillon,Jean-Michel Marin

DOI: https://doi.org/10.48550/arXiv.1105.0871

2012-03-20

Abstract:We are interested in bounding probabilities of rare events in the context of computer experiments. These rare events depend on the output of a physical model with random input variables. Since the model is only known through an expensive black box function, standard efficient Monte Carlo methods designed for rare events cannot be used. We then propose a strategy to deal with this difficulty based on importance sampling methods. This proposal relies on Kriging metamodeling and is able to achieve sharp upper confidence bounds on the rare event probabilities. The variability due to the Kriging metamodeling step is properly taken into account. The proposed methodology is applied to a toy example and compared to more standard Bayesian bounds. Finally, a challenging real case study is analyzed. It consists of finding an upper bound of the probability that the trajectory of an airborne load will collide with the aircraft that has released it.

Computation
Everything everywhere all at once, a probability-based enhanced sampling approach to rare events

Enrico Trizio,Peilin Kang,Michele Parrinello

2024-10-25

Abstract:The problem of studying rare events is central to many areas of computer simulations. In a recent paper [Kang, P., et al., Nat. Comput. Sci. 4, 451-460, 2024], we have shown that a powerful way of solving this problem passes through the computation of the committor function, and we have demonstrated how the committor can be iteratively computed in a variational way and the transition state ensemble efficiently sampled. Here, we greatly ameliorate this procedure by combining it with a metadynamics-like enhanced sampling approach in which a logarithmic function of the committor is used as a collective variable. This integrated procedure leads to an accurate and balanced sampling of the free energy surface in which transition states and metastable basins are studied with the same thoroughness. We also show that our approach can be used in cases in which competing reactive paths are possible and intermediate metastable are encountered. In addition, we demonstrate how physical insights can be obtained from the optimized committor model and the sampled data, thus providing a full characterization of the rare event under study. We ascribe the success of this approach to the use of a probability-based description of rare events.

Computational Physics,Statistical Mechanics
Monte Carlo Based Statistical Model Checking of Cyber-Physical Systems: A Review

Angela Pappagallo,Annalisa Massini,Enrico Tronci

DOI: https://doi.org/10.3390/info11120588

2020-12-21

Information

Abstract:The ever-increasing deployment of autonomous Cyber-Physical Systems (CPSs) (e.g., autonomous cars, UAV) exacerbates the need for efficient formal verification methods. In this setting, the main obstacle to overcome is the huge number of scenarios to be evaluated. Statistical Model Checking (SMC) is a simulation-based approach that holds the promise to overcome such an obstacle by using statistical methods in order to sample the set of scenarios. Many SMC tools exist, and they have been reviewed in several works. In this paper, we will overview Monte Carlo-based SMC tools in order to provide selection criteria based on Key Performance Indicators (KPIs) for the verification activity (e.g., minimize verification time or cost) as well as on the environment features, the kind of system model, the language used to define the requirements to be verified, the statistical inference approach used, and the algorithm implementing it. Furthermore, we will identify open research challenges in the field of (SMC) tools.
Survey for Stochastic Model Checking

Yang LIU,Xuan-Dong LI,Yan MA,Lin-Zhang WANG

DOI: https://doi.org/10.11897/SP.J.1016.2015.02145

2015-01-01

Abstract:Stochastic model checking is extension and generalization of the theory of model checking,which can verify and analyze system model quantitatively and qualitatively,and has been applied in the areas of verification of randomized distributed algorithms,performance analysis of communication protocols,and even the cross-disciplinary fields such as systems biology.Since the late 1990s,stochastic model checking has received widespread concern in the formal verification filed,and has made great progress.In this paper,we retrospect the origin of stochastic model checking,and discuss the basic principle of stochastic model checking systematically including the PCTL,LTL with probability bounds,PCTL* and CSL model checking algorithm.Then we summarize the main research direction and progress of stochastic model checking in recent years, analyze the verification process and advantages/disadvantages of stochastic model checking deeply, classify and list tools for stochastic model checking.Finally,we introduce the application areas of stochastic model checking and point out its future challenge.

Rare Events for Statistical Model Checking an Overview

Importance Sampling of Interval Markov Chains

Should We Learn Probabilistic Models for Model Checking? A New Approach and An Empirical Study.

Learning Probabilistic Models for Model Checking: an Evolutionary Approach and an Empirical Study

An efficient statistical model checker for nondeterminism and rare events

Combining Model Checking and Testing with an Application to Reliability Prediction and Distribution

A Statistical Model Checker for Nondeterminism and Rare Events

A Survey of Statistical Model Checking

Statistical Model Checking with Change Detection

What Are the Odds? Improving the foundations of Statistical Model Checking

Sound Statistical Model Checking for Probabilities and Expected Rewards

Towards a Statistical Model Checking Method for Safety-Critical Cyber-Physical System Verification

Formal Verification of Probabilistic SystemC Models with Statistical Model Checking

Variational Bayesian Monte Carlo simulation for rare event assessment

Analysis and Simulation of Extremes and Rare Events in Complex Systems

Bounding rare event probabilities in computer experiments

Everything everywhere all at once, a probability-based enhanced sampling approach to rare events

Monte Carlo Based Statistical Model Checking of Cyber-Physical Systems: A Review

Survey for Stochastic Model Checking