Abstract:We consider probabilistic model checking for continuous-time Markov chains (CTMCs) induced from Stochastic Reaction Networks (SRNs) against a fragment of Continuous Stochastic Logic (CSL) extended with reward operators. Classical numerical algorithms for CSL model checking based on uniformisation are limited to finite CTMCs and suffer from the state sapce explosion problem. On the other hand, approximate techniques such as mean-field approximations and simulations combined with statistical inference are more scalable, but can be time consuming and do not support the full expressiveness of CSL. In this paper we employ a continuous-space approximation of the CTMC in terms of a Gaussian process based on the Central Limit Approximation (CLA), also known as the Linear Noise Approximation (LNA), whose solution requires solving a number of differential equations that is quadratic in the number of species and independent of the population size. We then develop efficient and scalable approximate model checking algorithms on the resulting Gaussian process, where we restrict the target regions for probabilistic reachability to convex polytopes. This allows us to derive an abstraction in terms of a time-inhomogeneous discrete-time Markov chain (DTMC), whose dimension is independent of the number of species, on which model checking is performed. Using results from probability theory, we prove the convergence in distribution of our algorithms to the corresponding measures on the original CTMC. We implement the techniques and, on a set of examples, demonstrate that they allow us to overcome the state space explosion problem, while still correctly characterizing the stochastic behaviour of the system. Our methods can be used for formal analysis of a wide range of distributed stochastic systems, including biochemical systems, sensor networks and population protocols.

Distributed Markov Chains

Importance Sampling of Interval Markov Chains

Distributed Bounded Model Checking

Verification of Linear Duration Properties over Continuous-Time Markov Chains

Beyond Decisiveness of Infinite Markov Chains

Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

Decisive Markov Chains

Model Checking Markov Chains as Distribution Transformers

What Are the Odds? Improving the foundations of Statistical Model Checking

Central Limit Model Checking

Probabilistic Model Checking Multi-agent Behaviors in Dispersion Games Using Counter Abstraction.

Runtime verification of partially-synchronous distributed system

Certified Policy Verification and Synthesis for MDPs under Distributional Reach-avoidance Properties

Model Checking of Continuous-Time Markov Chains Against Timed Automata Specifications

Interleaving Model and Verification of Distributed Probabilistic Real-time Systems

Reversible Mcmc on Markov Equivalence Classes of Sparse Directed Acyclic Graphs

Verification of deep probabilistic models

A Survey of Statistical Model Checking

On Distributed Model Checking of MSO on Graphs

Distributed Parametric and Statistical Model Checking

On the Total Variation Distance of Semi-Markov Chains.