Abstract:We consider probabilistic model checking for continuous-time Markov chains (CTMCs) induced from Stochastic Reaction Networks (SRNs) against a fragment of Continuous Stochastic Logic (CSL) extended with reward operators. Classical numerical algorithms for CSL model checking based on uniformisation are limited to finite CTMCs and suffer from the state sapce explosion problem. On the other hand, approximate techniques such as mean-field approximations and simulations combined with statistical inference are more scalable, but can be time consuming and do not support the full expressiveness of CSL. In this paper we employ a continuous-space approximation of the CTMC in terms of a Gaussian process based on the Central Limit Approximation (CLA), also known as the Linear Noise Approximation (LNA), whose solution requires solving a number of differential equations that is quadratic in the number of species and independent of the population size. We then develop efficient and scalable approximate model checking algorithms on the resulting Gaussian process, where we restrict the target regions for probabilistic reachability to convex polytopes. This allows us to derive an abstraction in terms of a time-inhomogeneous discrete-time Markov chain (DTMC), whose dimension is independent of the number of species, on which model checking is performed. Using results from probability theory, we prove the convergence in distribution of our algorithms to the corresponding measures on the original CTMC. We implement the techniques and, on a set of examples, demonstrate that they allow us to overcome the state space explosion problem, while still correctly characterizing the stochastic behaviour of the system. Our methods can be used for formal analysis of a wide range of distributed stochastic systems, including biochemical systems, sensor networks and population protocols.

Bayesian Inference by Symbolic Model Checking

Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

Symbolic and Structural Model-Checking

Beyond Decisiveness of Infinite Markov Chains

Weighted Positive Binary Decision Diagrams for Exact Probabilistic Inference

The Quantified Boolean Bayesian Network: Theory and Experiments with a Logical Graphical Model

Symbolic Assume-Guarantee Reasoning Through BDD Learning

Bounded Model Checking for Branching-Time Temporal Logic

Exploiting Structure in Weighted Model Counting Approaches to Probabilistic Inference

Bayesian Statistical Model Checking for Multi-agent Systems using HyperPCTL*

A SAT-based approach to rigorous verification of Bayesian networks

A Channel-based Exact Inference Algorithm for Bayesian Networks

Faster Statistical Model Checking for Unbounded Temporal Properties

Visualizing the Consequences of Evidence in Bayesian Networks

Bayesian inference of Stochastic reaction networks using Multifidelity Sequential Tempered Markov Chain Monte Carlo

Efficient inference in persistent Dynamic Bayesian Networks

Distributed Markov Chains

Model Checking Markov Chains as Distribution Transformers

A Variational Approach to Bayesian Phylogenetic Inference

Central Limit Model Checking

Inference And Modeling Of Multiply Sectioned Bayesian Networks