Model Checking Markov Chains Against Unambiguous Buchi Automata

Michael Benedikt,Rastislav Lenhardt,James Worrell

DOI: https://doi.org/10.48550/arXiv.1405.4560

2014-05-18

Logic in Computer Science

Abstract:We give a polynomial-time algorithm for model checking finite Markov chains against omega-regular specifications given as unambiguous Buchi automata.

What problem does this paper attempt to address?

Model Checking Omega-regular Properties for Quantum Markov Chains .

Yuan Feng,Ernst Moritz Hahn,Andrea Turrini,Shenggang Ying

DOI: https://doi.org/10.4230/lipics.concur.2017.35

2017-01-01

Abstract:Quantum Markov chains are an extension of classical Markov chains which are labelled with super-operators rather than probabilities. They allow to faithfully represent quantum programs and quantum protocols. In this paper, we investigate model checking ω-regular properties, a very general class of properties (including, e.g., LTL properties) of interest, against this model. For classical Markov chains, such properties are usually checked by building the product of the model with a language automaton. Subsequent analysis is then performed on this product. When doing so, one takes into account its graph structure, and for instance performs different analyses per bottom strongly connected component (BSCC). Unfortunately, for quantum Markov chains such an approach does not work directly, because super-operators behave differently from probabilities. To overcome this problem, we transform the product quantum Markov chain into a single super-operator, which induces a decomposition of the state space (the tensor product of classical state space and the quantum one) into a family of BSCC subspaces. Interestingly, we show that this BSCC decomposition provides a solution to the issue of model checking ω-regular properties for quantum Markov chains. 1998 ACM Subject Classification D.2.4 Software/Program Verification
Model Checking of Continuous-Time Markov Chains Against Timed Automata Specifications

Taolue Chen,Tingting Han,Joost-Pieter Katoen,Alexandru Mereacre

DOI: https://doi.org/10.2168/lmcs-7(1:12)2011

2011-01-01

Logical Methods in Computer Science

Abstract:We study the verification of a finite continuous-time Markov chain (CTMC) C against a linear real-time specification given as a deterministic timed automaton (DTA) A with finite or Muller acceptance conditions. The central question that we address is: what is the probability of the set of paths of C that are accepted by A, i.e., the likelihood that C satisfies A? It is shown that under finite acceptance criteria this equals the reachability probability in a finite piecewise deterministic Markov process (PDP), whereas for Muller acceptance criteria it coincides with the reachability probability of terminal strongly connected components in such a PDP. Qualitative verification is shown to amount to a graph analysis of the PDP. Reachability probabilities in our PDPs are then characterized as the least solution of a system of Volterra integral equations of the second type and are shown to be approximated by the solution of a system of partial differential equations. For single-clock DTA, this integral equation system can be transformed into a system of linear equations where the coefficients are solutions of ordinary differential equations. As the coefficients are in fact transient probabilities in CTMCs, this result implies that standard algorithms for CTMC analysis suffice to verify single-clock DTA specifications.
More anti-chain based refinement checking

Ting Wang,Songzheng Song,Jun Sun,Yang Liu,Jin Song Dong,Xinyu Wang,Shanping Li

DOI: https://doi.org/10.1007/978-3-642-34281-3_26

2012-01-01

Abstract:Refinement checking plays an important role in system verification. It establishes properties of an implementation by showing a refinement relationship between the implementation and a specification. Recently, it has been shown that anti-chain based approaches increase the efficiency of trace refinement checking significantly. In this work, we study the problem of adopting anti-chain for stable failures refinement checking, failures-divergence refinement checking and probabilistic refine checking (i.e., a probabilistic implementation against a non-probabilistic specification). We show that the first two problems can be significantly improved, because the state space of the product model may be reduced dramatically. Though applying anti-chain for probabilistic refinement checking is more complicated, we manage to show improvements in some cases. We have integrated these techniques into the PAT model checking framework. Experiments are conducted to demonstrate the efficiency of our approach.
Model Checking Quantum Markov Chains

Yuan Feng,Nengkun Yu,Mingsheng Ying

DOI: https://doi.org/10.1016/j.jcss.2013.04.002

IF: 1.043

2013-01-01

Journal of Computer and System Sciences

Abstract:Although security of quantum cryptography is provable based on principles of quantum mechanics, it can be compromised by flaws in the design of quantum protocols. So, it is indispensable to develop techniques for verifying and debugging quantum cryptographic systems. Model-checking has proved to be effective in the verification of classical cryptographic protocols, but an essential difficulty arises when it is applied to quantum systems: the state space of a quantum system is always a continuum even when its dimension is finite. To overcome this difficulty, we introduce a novel notion of quantum Markov chain, especially suited for modelling quantum cryptographic protocols, in which quantum effects are encoded as super-operators labelling transitions, leaving the location information (nodes) being classical. Then we define a quantum extension of probabilistic computation tree logic (PCTL) and develop a model-checking algorithm for quantum Markov chains.
LTL Model Checking of Time-Inhomogeneous Markov Chains

Taolue Chen,Tingting Han,Joost-Pieter Katoen,Alexandru Mereacre

DOI: https://doi.org/10.1007/978-3-642-04761-9_10

2009-01-01

Abstract:We investigate the problem of verifying linear-time properties against inhomogeneous continuous-time Markov chains (ICTMCs). A fundamental question we address is how to compute reachability probabilities. We consider two variants: time-bounded and unbounded reachability. It turns out that both can be characterized as the least solution of a system of integral equations. We show that for the time-bounded case, the obtained integral equations can be transformed into a system of ordinary differential equations; for the time-unbounded case, we identify two sufficient conditions, namely the eventually periodic assumption and the eventually uniform assumption , under which the problem can be reduced to solving a time-bounded reachability problem for the ICTMCs and a reachability problem for a DTMC. These results provide the basis for a model checking algorithm for LTL. Under the eventually stable assumption , we show how to compute the probability of a set of ICTMC paths which satisfy a given LTL formula. By an automata-based approach, we reduce this problem to the previous established results for reachability problems.
Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

Dimitrios Milios,Guido Sanguinetti,David Schnoerr

DOI: https://doi.org/10.48550/arXiv.1711.01863

2018-06-11

Abstract:Probabilistic model checking for systems with large or unbounded state space is a challenging computational problem in formal modelling and its applications. Numerical algorithms require an explicit representation of the state space, while statistical approaches require a large number of samples to estimate the desired properties with high confidence. Here, we show how model checking of time-bounded path properties can be recast exactly as a Bayesian inference problem. In this novel formulation the problem can be efficiently approximated using techniques from machine learning. Our approach is inspired by a recent result in statistical physics which derived closed form differential equations for the first-passage time distribution of stochastic processes. We show on a number of non-trivial case studies that our method achieves both high accuracy and significant computational gains compared to statistical model checking.

Logic in Computer Science
Model Checking Markov Chains as Distribution Transformers

Rajab Aghamov,Christel Baier,Toghrul Karimov,Joris Nieuwveld,Joël Ouaknine,Jakob Piribauer,Mihir Vahanwala

2024-06-21

Abstract:The conventional perspective on Markov chains considers decision problems concerning the probabilities of temporal properties being satisfied by traces of visited states. However, consider the following query made of a stochastic system modelling the weather: given the conditions today, will there be a day with less than 50\% chance of rain? The conventional perspective is ill-equipped to decide such problems regarding the evolution of the initial distribution. The alternate perspective we consider views Markov chains as distribution transformers: the focus is on the sequence of distributions on states at each step, where the evolution is driven by the underlying stochastic transition matrix. More precisely, given an initial distribution vector $\mu$, a stochastic update transition matrix $M$, we ask whether the ensuing sequence of distributions $(\mu, M\mu, M^2\mu, \dots)$ satisfies a given temporal property. This is a special case of the model-checking problem for linear dynamical systems, which is not known to be decidable in full generality. The goal of this article is to delineate the classes of instances for which this problem can be solved, under the assumption that the dynamics is governed by stochastic matrices.

Logic in Computer Science
Smoothed Model Checking for Uncertain Continuous Time Markov Chains

Luca Bortolussi,Dimitrios Milios,Guido Sanguinetti

DOI: https://doi.org/10.48550/arXiv.1402.1450

2014-10-22

Abstract:We consider the problem of computing the satisfaction probability of a formula for stochastic models with parametric uncertainty. We show that this satisfaction probability is a smooth function of the model parameters. This enables us to devise a novel Bayesian statistical algorithm which performs statistical model checking simultaneously for all values of the model parameters from observations of truth values of the formula over individual runs of the model at isolated parameter values. This is achieved by exploiting the smoothness of the satisfaction function: by modelling explicitly correlations through a prior distribution over a space of smooth functions (a Gaussian Process), we can condition on observations at individual parameter values to construct an analytical approximation of the function itself. Extensive experiments on non-trivial case studies show that the approach is accurate and several orders of magnitude faster than naive parameter exploration with standard statistical model checking methods.

Logic in Computer Science,Systems and Control
Model-Checking Linear-Time Properties of Quantum Systems

Mingsheng Ying,Yangjia Li,Nengkun Yu,Yuan Feng

DOI: https://doi.org/10.1145/2629680

2014-07-08

ACM Transactions on Computational Logic

Abstract:We define a formal framework for reasoning about linear-time properties of quantum systems in which quantum automata are employed in the modeling of systems and certain (closed) subspaces of state Hilbert spaces are used as the atomic propositions about the behavior of systems. We provide an algorithm for verifying invariants of quantum automata. Then, an automata-based model-checking technique is generalized for the verification of safety properties recognizable by reversible automata and ω--properties recognizable by reversible Büchi automata.

computer science, theory & methods,logic
Efficient Analysis of Unambiguous Automata Using Matrix Semigroup Techniques

Stefan Kiefer,Cas Widdershoven

2024-09-17

Abstract:We introduce a novel technique to analyse unambiguous Büchi automata quantitatively, and apply this to the model checking problem. It is based on linear-algebra arguments that originate from the analysis of matrix semigroups with constant spectral radius. This method can replace a combinatorial procedure that dominates the computational complexity of the existing procedure by Baier et al. We analyse the complexity in detail, showing that, in terms of the set $Q$ of states of the automaton, the new algorithm runs in time $O(|Q|^4)$, improving on an efficient implementation of the combinatorial algorithm by a factor of $|Q|$.

Formal Languages and Automata Theory
Model Checking Quantum Automata

Mingsheng Ying,Yuan Feng

DOI: https://doi.org/10.1017/9781108613323.006

2021-01-01

Abstract:Quantum systems are modelled as different mathematical structures, depending on their nature and complexity. This chapter considers one of the simplest (discrete-time) models of quantum systems, namely quantum automata. It introduces a way of describing linear-time (dynamic) properties of quantum systems and presents several algorithms for checking certain linear-time properties of quantum automata, for example, invariants and reachability.
Faster Statistical Model Checking for Unbounded Temporal Properties

Przemysław Daca,Thomas A. Henzinger,Jan Křetínský,Tatjana Petrov

DOI: https://doi.org/10.48550/arXiv.1504.05739

2016-03-03

Abstract:We present a new algorithm for the statistical model checking of Markov chains with respect to unbounded temporal properties, such as reachability and full linear temporal logic. The main idea is that we monitor each simulation run on the fly, in order to detect quickly if a bottom strongly connected component is entered with high probability, in which case the simulation run can be terminated early. As a result, our simulation runs are often much shorter than required by termination bounds that are computed a priori for a desired level of confidence and size of the state space. In comparison to previous algorithms for statistical model checking, for a given level of confidence, our method is not only faster in many cases but also requires less information about the system, namely, only the minimum transition probability that occurs in the Markov chain, thus enabling almost complete black-box verification. In addition, our method can be generalised to unbounded quantitative properties such as mean-payoff bounds.

Logic in Computer Science
Beyond Decisiveness of Infinite Markov Chains

Benoît Barbot,Patricia Bouyer,Serge Haddad

2024-09-27

Abstract:Verification of infinite-state Markov chains is still a challenge despite several fruitful numerical or statistical approaches. For decisive Markov chains, there is a simple numerical algorithm that frames the reachability probability as accurately as required (however with an unknown complexity). On the other hand when applicable, statistical model checking is in most of the cases very efficient. Here we study the relation between these two approaches showing first that decisiveness is a necessary and sufficient condition for almost sure termination of statistical model checking. Afterwards we develop an approach with application to both methods that substitutes to a non decisive Markov chain a decisive Markov chain with the same reachability probability. This approach combines two key ingredients: abstraction and importance sampling (a technique that was formerly used for efficiency). We develop this approach on a generic formalism called layered Markov chain (LMC). Afterwards we perform an empirical study on probabilistic pushdown automata (an instance of LMC) to understand the complexity factors of the statistical and numerical algorithms. To the best of our knowledge, this prototype is the first implementation of the deterministic algorithm for decisive Markov chains and required us to solve several qualitative and numerical issues.

Logic in Computer Science,Formal Languages and Automata Theory
Model Checking Super-Operator-Valued Markov Chains

Mingsheng Ying,Yuan Feng

2021-01-01

Abstract:This chapter is devoted to studying a class of even more complex quantum systems modelled as so-called super-operator-valued Markov chains (SVMCs). This new model is particularly useful in modelling the high-level structure of quantum programs and quantum communication protocols. Several algorithms for checking SVMCs are presented in this chapter.
Checking Continuous Stochastic Logic against Quantum Continuous-Time Markov Chains

Jingyi Mei,Ming Xu,Ji Guan,Yuxin Deng,Nengkun Yu

2023-06-30

Abstract:Verifying quantum systems has attracted a lot of interest in the last decades. In this paper, we study the quantitative model-checking of quantum continuous-time Markov chains (quantum CTMCs). The branching-time properties of quantum CTMCs are specified by continuous stochastic logic (CSL), which is famous for verifying real-time systems, including classical CTMCs. The core of checking the CSL formulas lies in tackling multiphase until formulas. We develop an algebraic method using proper projection, matrix exponentiation, and definite integration to symbolically calculate the probability measures of path formulas. Thus the decidability of CSL is established. To be efficient, numerical methods are incorporated to guarantee that the time complexity is polynomial in the encoding size of the input model and linear in the size of the input formula. A running example of Apollonian networks is further provided to demonstrate our method.

Logic in Computer Science
Compositional Model-Checking for Real-Time Systems

Jianmin Hou,Xuandong Li,Xiaocong Fan,Guoliang Zheng

DOI: https://doi.org/10.1145/272263.272359

1998-01-01

Abstract:A major problem in applying model checking to finite–state systems is the potential combinatorial explosion of the state space arising from parallel composition. Solutions of this problem have been attempted for practical applications using a variety of techniques. Recent work by Andersen [And95] proposes a very promising compositional model checking technique, which has experimentally been shown to improve results obtained using Binary Decision Diagrams. In this paper we make Andersen’s technique applicable to systems described by networks of timed automata. We present a quotient construction, which allows timed automata components to be gradually moved from the network expression into the specification. The intermediate specifications are kept small using minimization heuristics suggested by Andersen. The potential of the combined technique is demonstrated using a prototype implemented in CAML. ∗This work has been supported by the European Communities under CONCUR2, BRA 7166 †Basic Research in Computer Science, Centre of the Danish National Research Foundation. ‡Dept. of Computer Science, Aalborg University, Fredrik Bajers Vej 7-E, DK-9220 Aalborg, Denmark, (email: {fl,kgl}@iesd.auc.dk) fax: (45) 98.15.81.29
Model Checking Applied to Quantum Physics

Ji Guan,Yuan Feng,Andrea Turrini,Mingsheng Ying

DOI: https://doi.org/10.48550/arXiv.1902.03218

2019-02-09

Abstract:Model checking has been successfully applied to verification of computer hardware and software, communication systems and even biological systems. In this paper, we further push the boundary of its applications and show that it can be adapted for applications in quantum physics. More explicitly, we show how quantum statistical and many-body systems can be modeled as quantum Markov chains, and some of their properties that interest physicists can be specified in linear-time temporal logics. Then we present an efficient algorithm to check these properties. A few case studies are given to demonstrate the use of our algorithm to actual quantum physical problems.

Quantum Physics,Logic in Computer Science
On the complexity of model checking interval-valued discrete time Markov chains

Taolue Chen,Tingting Han,Marta Kwiatkowska

DOI: https://doi.org/10.1016/j.ipl.2013.01.004

IF: 0.851

2013-01-01

Information Processing Letters

Abstract:We investigate the complexity of model checking (finite) interval-valued discrete time Markov chains, that is, discrete time Markov chains where each transition is associated with an interval in which the actual transition probability must lie. Two semantics are considered, the uncertain Markov chain (UMC) semantics and the interval Markov decision process (IMDP) semantics. We show that, for reachability, these two semantics coincide and the problem is P-complete. This entails that PCTL model checking problem under the IMDP semantics is also P-complete. We also show that model checking PCTL under the UMC semantics is Square-Root-Sum hard, meaning that one can reduce the Square-Root-Sum problem to it.
The Bouquet Algorithm for Model Checking Unbounded Until

Shiraj Arora,M. V. Panduranga Rao

DOI: https://doi.org/10.48550/arXiv.1911.10478

2019-11-24

Abstract:The problem of verifying the "Unbounded Until" fragment in temporal logic formulas has been studied extensively in the past, especially in the context of statistical model checking. Statistical model checking, a computationally inexpensive sampling based alternative to the more expensive numerical model checking technique, presents the following decision dilemma -- what length of the sample is enough in general? In this paper, we discuss an algorithm for this problem that combines ideas from graph theory, statistical model checking and numerical model checking. We analyze the algorithm and show through experiments that this approach outperforms the standard statistical model checking algorithm for verifying unbounded until for low density Discrete Time Markov Chains.

Logic in Computer Science,Formal Languages and Automata Theory
Quantum Markov chains: Description of hybrid systems, decidability of equivalence, and model checking linear-time properties

Lvzhou Li,Yuan Feng

DOI: https://doi.org/10.1016/j.ic.2015.07.001

IF: 1.24

2015-01-01

Information and Computation

Abstract:In this paper, we study a model of quantum Markov chains that is a quantum analogue of Markov chains and is obtained by replacing probabilities in transition matrices with quantum operations. We show that this model is very suited to describe hybrid systems that consist of a quantum component and a classical one. Indeed, hybrid systems are often encountered in quantum information processing. Thus, we further propose a model called hybrid quantum automata (HQA) that can be used to describe the hybrid systems receiving inputs (actions) from the outer world. We show the language equivalence problem of HQA is decidable in polynomial time. Furthermore, we apply this result to the trace equivalence problem of quantum Markov chains, and thus it is also decidable in polynomial time. Finally, we discuss model checking linear-time properties of quantum Markov chains, and show the quantitative analysis of regular safety properties can be addressed successfully.

Model Checking Markov Chains Against Unambiguous Buchi Automata

Model Checking Omega-regular Properties for Quantum Markov Chains .

Model Checking of Continuous-Time Markov Chains Against Timed Automata Specifications

More anti-chain based refinement checking

Model Checking Quantum Markov Chains

LTL Model Checking of Time-Inhomogeneous Markov Chains

Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

Model Checking Markov Chains as Distribution Transformers

Smoothed Model Checking for Uncertain Continuous Time Markov Chains

Model-Checking Linear-Time Properties of Quantum Systems

Efficient Analysis of Unambiguous Automata Using Matrix Semigroup Techniques

Model Checking Quantum Automata

Faster Statistical Model Checking for Unbounded Temporal Properties

Beyond Decisiveness of Infinite Markov Chains

Model Checking Super-Operator-Valued Markov Chains

Checking Continuous Stochastic Logic against Quantum Continuous-Time Markov Chains

Compositional Model-Checking for Real-Time Systems

Model Checking Applied to Quantum Physics

On the complexity of model checking interval-valued discrete time Markov chains

The Bouquet Algorithm for Model Checking Unbounded Until

Quantum Markov chains: Description of hybrid systems, decidability of equivalence, and model checking linear-time properties