Abstract:Stochastic modeling and algorithmic verification techniques have been proved useful in analyzing and detecting unusual trends in performance and energy usage of systems such as power management controllers and wireless sensor devices. Many important properties are dependent on the cumulated time that the device spends in certain states, possibly intermittently. We study the problem of verifying continuous-time Markov chains (CTMCs) against linear duration properties (LDP), i.e. properties stated as conjunctions of linear constraints over the total duration of time spent in states that satisfy a given property. We identify two classes of LDP properties, eventuality duration properties (EDP) and invariance duration properties (IDP), respectively referring to the reachability of a set of goal states, within a time bound; and the continuous satisfaction of a duration property over an execution path. The central question that we address is how to compute the probability of the set of infinite timed paths of the CTMC that satisfy a given LDP. We present algorithms to approximate these probabilities up to a given precision, stating their complexity and error bounds. The algorithms mainly employ an adaptation of uniformization and the computation of volumes of multi-dimensional integrals under systems of linear constraints, together with different mechanisms to bound the errors.

Observing Continuous-Time Mdps By 1-Clock Timed Automata

Monitoring Ctmcs By Multi-Clock Timed Automata

Model Checking of Continuous-Time Markov Chains Against Timed Automata Specifications

Efficient CTMC Model Checking of Linear Real-Time Objectives

Verification of Linear Duration Properties over Continuous-Time Markov Chains

Time-Bounded Verification of CTMCs Against Real-Time Specifications

Computing Maximum Reachability Probabilities in Markovian Timed Automata

CTMCs with Imprecisely Timed Observations

Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

A Systematic Study on Explicit-State Non-Zenoness Checking for Timed Automata

Probabilistic Timed Automata with One Clock and Initialised Clock-Dependent Probabilities

Reachability Probabilities in Markovian Timed Automata.

Verifying Probabilistic Timed Automata Against Omega-Regular Dense-Time Properties

LTL Model Checking of Time-Inhomogeneous Markov Chains

The monitoring problem for timed automata

Unknown Biases and Timing Constraints in Timed Automata

Towards the Complexity of Controls for Timed Automata with a Small Number of Clocks

On the complexity of model checking interval-valued discrete time Markov chains

Reachability for Multi-Priced Timed Automata with Positive and Negative Rates

Checking Timed Automata for Some Discretisable Duration Properties

Statistically Model Checking PCTL Specifications on Markov Decision Processes via Reinforcement Learning