Model Checking Super-Operator-Valued Markov Chains

Mingsheng Ying,Yuan Feng

2021-01-01

Abstract:This chapter is devoted to studying a class of even more complex quantum systems modelled as so-called super-operator-valued Markov chains (SVMCs). This new model is particularly useful in modelling the high-level structure of quantum programs and quantum communication protocols. Several algorithms for checking SVMCs are presented in this chapter.

What problem does this paper attempt to address?

Importance Sampling of Interval Markov Chains

Cyrille Jegourel,Jingyi Wang,Jun Sun

DOI: https://doi.org/10.1109/dsn.2018.00040

2018-01-01

Abstract:In real-world systems, rare events often characterize critical situations like the probability that a system fails within some time bound and they are used to model some potentially harmful scenarios in dependability of safety-critical systems. Probabilistic Model Checking has been used to verify dependability properties in various types of systems but is limited by the state space explosion problem. An alternative is the recourse to Statistical Model Checking (SMC) that relies on Monte Carlo simulations and provides estimates within predefined error and confidence bounds. However, rare properties require a large number of simulations before occurring at least once. To tackle the problem, Importance Sampling, a rare event simulation technique, has been proposed in SMC for different types of probabilistic systems. Importance Sampling requires the full knowledge of probabilistic measure of the system, e.g. Markov chains. In practice, however, we often have models with some uncertainty, e.g., Interval Markov Chains. In this work, we propose a method to apply importance sampling to Interval Markov Chains. We show promising results in applying our method to multiple case studies.
Model Checking Omega-regular Properties for Quantum Markov Chains .

Yuan Feng,Ernst Moritz Hahn,Andrea Turrini,Shenggang Ying

DOI: https://doi.org/10.4230/lipics.concur.2017.35

2017-01-01

Abstract:Quantum Markov chains are an extension of classical Markov chains which are labelled with super-operators rather than probabilities. They allow to faithfully represent quantum programs and quantum protocols. In this paper, we investigate model checking ω-regular properties, a very general class of properties (including, e.g., LTL properties) of interest, against this model. For classical Markov chains, such properties are usually checked by building the product of the model with a language automaton. Subsequent analysis is then performed on this product. When doing so, one takes into account its graph structure, and for instance performs different analyses per bottom strongly connected component (BSCC). Unfortunately, for quantum Markov chains such an approach does not work directly, because super-operators behave differently from probabilities. To overcome this problem, we transform the product quantum Markov chain into a single super-operator, which induces a decomposition of the state space (the tensor product of classical state space and the quantum one) into a family of BSCC subspaces. Interestingly, we show that this BSCC decomposition provides a solution to the issue of model checking ω-regular properties for quantum Markov chains. 1998 ACM Subject Classification D.2.4 Software/Program Verification
Model Checking Quantum Markov Chains

Yuan Feng,Nengkun Yu,Mingsheng Ying

DOI: https://doi.org/10.1016/j.jcss.2013.04.002

IF: 1.043

2013-01-01

Journal of Computer and System Sciences

Abstract:Although security of quantum cryptography is provable based on principles of quantum mechanics, it can be compromised by flaws in the design of quantum protocols. So, it is indispensable to develop techniques for verifying and debugging quantum cryptographic systems. Model-checking has proved to be effective in the verification of classical cryptographic protocols, but an essential difficulty arises when it is applied to quantum systems: the state space of a quantum system is always a continuum even when its dimension is finite. To overcome this difficulty, we introduce a novel notion of quantum Markov chain, especially suited for modelling quantum cryptographic protocols, in which quantum effects are encoded as super-operators labelling transitions, leaving the location information (nodes) being classical. Then we define a quantum extension of probabilistic computation tree logic (PCTL) and develop a model-checking algorithm for quantum Markov chains.
Model Checking Quantum Automata

Mingsheng Ying,Yuan Feng

DOI: https://doi.org/10.1017/9781108613323.006

2021-01-01

Abstract:Quantum systems are modelled as different mathematical structures, depending on their nature and complexity. This chapter considers one of the simplest (discrete-time) models of quantum systems, namely quantum automata. It introduces a way of describing linear-time (dynamic) properties of quantum systems and presents several algorithms for checking certain linear-time properties of quantum automata, for example, invariants and reachability.
Model Checking Applied to Quantum Physics

Ji Guan,Yuan Feng,Andrea Turrini,Mingsheng Ying

DOI: https://doi.org/10.48550/arXiv.1902.03218

2019-02-09

Abstract:Model checking has been successfully applied to verification of computer hardware and software, communication systems and even biological systems. In this paper, we further push the boundary of its applications and show that it can be adapted for applications in quantum physics. More explicitly, we show how quantum statistical and many-body systems can be modeled as quantum Markov chains, and some of their properties that interest physicists can be specified in linear-time temporal logics. Then we present an efficient algorithm to check these properties. A few case studies are given to demonstrate the use of our algorithm to actual quantum physical problems.

Quantum Physics,Logic in Computer Science
Model-checking Quantum Systems.

Mingsheng Ying,Yuan Feng

DOI: https://doi.org/10.1093/nsr/nwy106

IF: 20.6

2018-01-01

National Science Review

Abstract:This article discusses the essential difficulties in developing model-checking techniques for quantum systems that are never present in model checking classical systems. It further reviews some early researches on checking quantum communication protocols as well as a new line of researches pursued by the authors and their collaborators on checking general quantum systems, applicable to both physical systems and quantum programs.
Basics of Model Checking

Mingsheng Ying,Yuan Feng

2021-01-01

Abstract:Model checking is an algorithmic technique for verification of computing and communication hardware and software. This book extends the technique of model checking for quantum systems. As preliminaries, this chapter introduces basics of model checking for both classical non-probabilistic and probabilistic systems.
Quantum Markov chains: Description of hybrid systems, decidability of equivalence, and model checking linear-time properties

Lvzhou Li,Yuan Feng

DOI: https://doi.org/10.1016/j.ic.2015.07.001

IF: 1.24

2015-01-01

Information and Computation

Abstract:In this paper, we study a model of quantum Markov chains that is a quantum analogue of Markov chains and is obtained by replacing probabilities in transition matrices with quantum operations. We show that this model is very suited to describe hybrid systems that consist of a quantum component and a classical one. Indeed, hybrid systems are often encountered in quantum information processing. Thus, we further propose a model called hybrid quantum automata (HQA) that can be used to describe the hybrid systems receiving inputs (actions) from the outer world. We show the language equivalence problem of HQA is decidable in polynomial time. Furthermore, we apply this result to the trace equivalence problem of quantum Markov chains, and thus it is also decidable in polynomial time. Finally, we discuss model checking linear-time properties of quantum Markov chains, and show the quantitative analysis of regular safety properties can be addressed successfully.
Checking Continuous Stochastic Logic against Quantum Continuous-Time Markov Chains

Jingyi Mei,Ming Xu,Ji Guan,Yuxin Deng,Nengkun Yu

2023-06-30

Abstract:Verifying quantum systems has attracted a lot of interest in the last decades. In this paper, we study the quantitative model-checking of quantum continuous-time Markov chains (quantum CTMCs). The branching-time properties of quantum CTMCs are specified by continuous stochastic logic (CSL), which is famous for verifying real-time systems, including classical CTMCs. The core of checking the CSL formulas lies in tackling multiphase until formulas. We develop an algebraic method using proper projection, matrix exponentiation, and definite integration to symbolically calculate the probability measures of path formulas. Thus the decidability of CSL is established. To be efficient, numerical methods are incorporated to guarantee that the time complexity is polynomial in the encoding size of the input model and linear in the size of the input formula. A running example of Apollonian networks is further provided to demonstrate our method.

Logic in Computer Science
Measurement-based Verification of Quantum Markov Chains

Ji Guan,Yuan Feng,Andrea Turrini,Mingsheng Ying

2024-05-09

Abstract:Model-checking techniques have been extended to analyze quantum programs and communication protocols represented as quantum Markov chains, an extension of classical Markov chains. To specify qualitative temporal properties, a subspace-based quantum temporal logic is used, which is built on Birkhoff-von Neumann atomic propositions. These propositions determine whether a quantum state is within a subspace of the entire state space. In this paper, we propose the measurement-based linear-time temporal logic MLTL to check quantitative properties. MLTL builds upon classical linear-time temporal logic (LTL) but introduces quantum atomic propositions that reason about the probability distribution after measuring a quantum state. To facilitate verification, we extend the symbolic dynamics-based techniques for stochastic matrices described by Agrawal et al. (JACM 2015) to handle more general quantum linear operators (super-operators) through eigenvalue analysis. This extension enables the development of an efficient algorithm for approximately model checking a quantum Markov chain against an MLTL formula. To demonstrate the utility of our model-checking algorithm, we use it to simultaneously verify linear-time properties of both quantum and classical random walks. Through this verification, we confirm the previously established advantages discovered by Ambainis et al. (STOC 2001) of quantum walks over classical random walks and discover new phenomena unique to quantum walks.

Quantum Physics
Model-Checking Linear-Time Properties of Quantum Systems

Mingsheng Ying,Yangjia Li,Nengkun Yu,Yuan Feng

DOI: https://doi.org/10.1145/2629680

2014-07-08

ACM Transactions on Computational Logic

Abstract:We define a formal framework for reasoning about linear-time properties of quantum systems in which quantum automata are employed in the modeling of systems and certain (closed) subspaces of state Hilbert spaces are used as the atomic propositions about the behavior of systems. We provide an algorithm for verifying invariants of quantum automata. Then, an automata-based model-checking technique is generalized for the verification of safety properties recognizable by reversible automata and ω--properties recognizable by reversible Büchi automata.

computer science, theory & methods,logic
Distributed Markov Chains

Sumit Kumar Jha,Madhavan Mukund,Ratul Saha,P S Thiagarajan

DOI: https://doi.org/10.48550/arXiv.1408.0979

2014-08-05

Abstract:The formal verification of large probabilistic models is important and challenging. Exploiting the concurrency that is often present is one way to address this problem. Here we study a restricted class of asynchronous distributed probabilistic systems in which the synchronizations determine the probability distribution for the next moves of the participating agents. The key restriction we impose is that the synchronizations are deterministic, in the sense that any two simultaneously enabled synchronizations must involve disjoint sets of agents. As a result, this network of agents can be viewed as a succinct and distributed presentation of a large global Markov chain. A rich class of Markov chains can be represented this way. We define an interleaved semantics for our model in terms of the local synchronization actions. The network structure induces an independence relation on these actions, which, in turn, induces an equivalence relation over the interleaved runs in the usual way. We construct a natural probability measure over these equivalence classes of runs by exploiting Mazurkiewicz trace theory and the probability measure space of the associated global Markov chain. It turns out that verification of our model, called DMCs (distributed Markov chains), can often be efficiently carried out by exploiting the partial order nature of the interleaved semantics. To demonstrate this, we develop a statistical model checking (SMC) procedure and use it to verify two large distributed probabilistic networks.

Distributed, Parallel, and Cluster Computing,Logic in Computer Science
On the complexity of model checking interval-valued discrete time Markov chains

Taolue Chen,Tingting Han,Marta Kwiatkowska

DOI: https://doi.org/10.1016/j.ipl.2013.01.004

IF: 0.851

2013-01-01

Information Processing Letters

Abstract:We investigate the complexity of model checking (finite) interval-valued discrete time Markov chains, that is, discrete time Markov chains where each transition is associated with an interval in which the actual transition probability must lie. Two semantics are considered, the uncertain Markov chain (UMC) semantics and the interval Markov decision process (IMDP) semantics. We show that, for reachability, these two semantics coincide and the problem is P-complete. This entails that PCTL model checking problem under the IMDP semantics is also P-complete. We also show that model checking PCTL under the UMC semantics is Square-Root-Sum hard, meaning that one can reduce the Square-Root-Sum problem to it.
Model Checking for Verification of Quantum Circuits

Mingsheng Ying

DOI: https://doi.org/10.1007/978-3-030-90870-6_2

2021-01-01

Abstract:In this survey paper, we describe a framework for assertion-based verification of quantum circuits by applying model checking techniques for quantum systems developed in our previous work, in which: - Noiseless and noisy quantum circuits are modelled as operator- and super-operator-valued transition systems, respectively, both of which can be further represented by tensor networks. - Quantum assertions are specified by a temporal extension of Birkhoff-von Neumann quantum logic. Their semantics is defined based on the following design decision: they will be used in verification of quantum circuits by simulation on classical computers or human reasoning rather than by quantum physics experiments (e.g. testing through measurements); - Algorithms for reachability analysis and model checking of quantum circuits are developed based on contraction of tensor networks. We observe that many optimisation techniques for computing relational products used in BDD-based model checking algorithms can be generalised for contracting tensor networks of quantum circuits.
An Algebraic Method to Fidelity-based Model Checking over Quantum Markov Chains

Ming Xu,Jianling Fu,Jingyi Mei,Yuxin Deng

DOI: https://doi.org/10.1016/j.tcs.2022.08.016

2021-01-13

Abstract:Fidelity is one of the most widely used quantities in quantum information that measure the distance of quantum states through a noisy channel. In this paper, we introduce a quantum analogy of computation tree logic (CTL) called QCTL, which concerns fidelity instead of probability in probabilistic CTL, over quantum Markov chains (QMCs). Noisy channels are modelled by super-operators, which are specified by QCTL formulas; the initial quantum states are modelled by density operators, which are left parametric in the given QMC. The problem is to compute the minimumfidelity over all initial states for conservation. We achieve it by a reduction to quantifier elimination in the existential theory of the reals. The method is absolutely exact, so that QCTL formulas are proven to be decidable in exponential time. Finally, we implement the proposed method and demonstrate its effectiveness via a quantum IPv4 protocol.

Logic in Computer Science
Decomposition of Quantum Markov Chains and Its Applications

Ji Guan,Yuan Feng,Mingsheng Ying

DOI: https://doi.org/10.1016/j.jcss.2018.01.005

IF: 1.043

2018-01-01

Journal of Computer and System Sciences

Abstract:Markov chains have been widely employed as a fundamental model in the studies of probabilistic and stochastic communicating and concurrent systems. It is well-understood that decomposition techniques play a key role in reachability analysis and model-checking of Markov chains. (Discrete-time) quantum Markov chains have been introduced as a model of quantum communicating systems [1] and also a semantic model of quantum programs [2]. The BSCC (Bottom Strongly Connected Component) and stationary coherence decompositions of quantum Markov chains were introduced in [3, 4, 5]. This paper presents a new decomposition technique, namely periodic decomposition, for quantum Markov chains. We further establish a limit theorem for them. As an application, an algorithm to find a maximum dimensional noiseless subsystem of a quantum communicating system is given using decomposition techniques of quantum Markov chains.
Survey for Stochastic Model Checking

Yang LIU,Xuan-Dong LI,Yan MA,Lin-Zhang WANG

DOI: https://doi.org/10.11897/SP.J.1016.2015.02145

2015-01-01

Abstract:Stochastic model checking is extension and generalization of the theory of model checking,which can verify and analyze system model quantitatively and qualitatively,and has been applied in the areas of verification of randomized distributed algorithms,performance analysis of communication protocols,and even the cross-disciplinary fields such as systems biology.Since the late 1990s,stochastic model checking has received widespread concern in the formal verification filed,and has made great progress.In this paper,we retrospect the origin of stochastic model checking,and discuss the basic principle of stochastic model checking systematically including the PCTL,LTL with probability bounds,PCTL* and CSL model checking algorithm.Then we summarize the main research direction and progress of stochastic model checking in recent years, analyze the verification process and advantages/disadvantages of stochastic model checking deeply, classify and list tools for stochastic model checking.Finally,we introduce the application areas of stochastic model checking and point out its future challenge.
A Survey of Statistical Model Checking

Gul Agha,Karl Palmskog

DOI: https://doi.org/10.1145/3158668

IF: 0.851

2018-01-31

ACM Transactions on Modeling and Computer Simulation

Abstract:Interactive, distributed, and embedded systems often behave stochastically, for example, when inputs, message delays, or failures conform to a probability distribution. However, reasoning analytically about the behavior of complex stochastic systems is generally infeasible. While simulations of systems are commonly used in engineering practice, they have not traditionally been used to reason about formal specifications. Statistical model checking (SMC) addresses this weakness by using a simulation-based approach to reason about precise properties specified in a stochastic temporal logic. A specification for a communication system may state that within some time bound, the probability that the number of messages in a queue will be greater than 5 must be less than 0.01. Using SMC, executions of a stochastic system are first sampled, after which statistical techniques are applied to determine whether such a property holds. While the output of sample-based methods are not always correct, statistical inference can quantify the confidence in the result produced. In effect, SMC provides a more widely applicable and scalable alternative to analysis of properties of stochastic systems using numerical and symbolic methods. SMC techniques have been successfully applied to analyze systems with large state spaces in areas such as computer networking, security, and systems biology. In this article, we survey SMC algorithms, techniques, and tools, while emphasizing current limitations and tradeoffs between precision and scalability.

computer science, interdisciplinary applications,mathematics, applied
Reachability Probabilities of Quantum Markov Chains

Shenggang Ying,Yuan Feng,Nengkun Yu,Mingsheng Ying

DOI: https://doi.org/10.48550/arXiv.1304.0060

2013-03-30

Quantum Physics

Abstract:This paper studies three kinds of long-term behaviours, namely reachability, repeated reachability and persistence, of quantum Markov chains (qMCs). As a stepping-stone, we introduce the notion of bottom strongly connected component (BSCC) of a qMC and develop an algorithm for finding BSCC decompositions of the state space of a qMC. As the major contribution, several (classical) algorithms for computing the reachability, repeated reachability and persistence probabilities of a qMC are presented, and their complexities are analysed.
Central Limit Model Checking

Luca Bortolussi,Luca Cardelli,Marta Kwiatkowska,Luca Laurenti

DOI: https://doi.org/10.48550/arXiv.1804.08744

2018-04-24

Abstract:We consider probabilistic model checking for continuous-time Markov chains (CTMCs) induced from Stochastic Reaction Networks (SRNs) against a fragment of Continuous Stochastic Logic (CSL) extended with reward operators. Classical numerical algorithms for CSL model checking based on uniformisation are limited to finite CTMCs and suffer from the state sapce explosion problem. On the other hand, approximate techniques such as mean-field approximations and simulations combined with statistical inference are more scalable, but can be time consuming and do not support the full expressiveness of CSL. In this paper we employ a continuous-space approximation of the CTMC in terms of a Gaussian process based on the Central Limit Approximation (CLA), also known as the Linear Noise Approximation (LNA), whose solution requires solving a number of differential equations that is quadratic in the number of species and independent of the population size. We then develop efficient and scalable approximate model checking algorithms on the resulting Gaussian process, where we restrict the target regions for probabilistic reachability to convex polytopes. This allows us to derive an abstraction in terms of a time-inhomogeneous discrete-time Markov chain (DTMC), whose dimension is independent of the number of species, on which model checking is performed. Using results from probability theory, we prove the convergence in distribution of our algorithms to the corresponding measures on the original CTMC. We implement the techniques and, on a set of examples, demonstrate that they allow us to overcome the state space explosion problem, while still correctly characterizing the stochastic behaviour of the system. Our methods can be used for formal analysis of a wide range of distributed stochastic systems, including biochemical systems, sensor networks and population protocols.

Logic in Computer Science,Quantitative Methods

Model Checking Super-Operator-Valued Markov Chains

Importance Sampling of Interval Markov Chains

Model Checking Omega-regular Properties for Quantum Markov Chains .

Model Checking Quantum Markov Chains

Model Checking Quantum Automata

Model Checking Applied to Quantum Physics

Model-checking Quantum Systems.

Basics of Model Checking

Quantum Markov chains: Description of hybrid systems, decidability of equivalence, and model checking linear-time properties

Checking Continuous Stochastic Logic against Quantum Continuous-Time Markov Chains

Measurement-based Verification of Quantum Markov Chains

Model-Checking Linear-Time Properties of Quantum Systems

Distributed Markov Chains

On the complexity of model checking interval-valued discrete time Markov chains

Model Checking for Verification of Quantum Circuits

An Algebraic Method to Fidelity-based Model Checking over Quantum Markov Chains

Decomposition of Quantum Markov Chains and Its Applications

Survey for Stochastic Model Checking

A Survey of Statistical Model Checking

Reachability Probabilities of Quantum Markov Chains

Central Limit Model Checking