Abstract:We address the reachability problem for continuous-time stochastic dynamic systems. Our objective is to present a unified framework that characterizes the reachable set of a dynamic system in the presence of both stochastic disturbances and deterministic inputs. To achieve this, we devise a strategy that effectively decouples the effects of deterministic inputs and stochastic disturbances on the reachable sets of the system. For the deterministic part, many existing methods can capture the deterministic reachability. As for the stochastic disturbances, we introduce a novel technique that probabilistically bounds the difference between a stochastic trajectory and its deterministic counterpart. The key to our approach is introducing a novel energy function termed the Averaged Moment Generating Function that yields a high probability bound for this difference. This bound is tight and exact for linear stochastic dynamics and applicable to a large class of nonlinear stochastic dynamics. By combining our innovative technique with existing methods for deterministic reachability analysis, we can compute estimations of reachable sets that surpass those obtained with current approaches for stochastic reachability analysis. We validate the effectiveness of our framework through various numerical experiments. Beyond its immediate applications in reachability analysis, our methodology is poised to have profound implications in the broader analysis and control of stochastic systems. It opens avenues for enhanced understanding and manipulation of complex stochastic dynamics, presenting opportunities for advancements in related fields.

Reachability Probabilities in Markovian Timed Automata.

Computing Maximum Reachability Probabilities in Markovian Timed Automata

A Study of Optimization Techniques about Reachability in Timed Automata

Model Checking of Continuous-Time Markov Chains Against Timed Automata Specifications

Optimal Time-Abstract Schedulers for CTMDPs and Markov Games

Unknown Biases and Timing Constraints in Timed Automata

Undecidability of Cost-Bounded Reachability in Priced Probabilistic Timed Automata

Probabilistic Timed Automata with One Clock and Initialised Clock-Dependent Probabilities

LTL Model Checking of Time-Inhomogeneous Markov Chains

Time-Bounded Verification of CTMCs Against Real-Time Specifications

Reachability for Multi-Priced Timed Automata with Positive and Negative Rates

Reachability and Safety Objectives in Markov Decision Processes on Long but Finite Horizons

Advanced method and application on Markov state transfer chain

Monitoring Ctmcs By Multi-Clock Timed Automata

Observing Continuous-Time Mdps By 1-Clock Timed Automata

A Refined Algorithm for Reachability Analysis of Updatable Timed Automata.

An Algorithm to Dynamically Reduce the State Space of Timed Automata during the Reachability Analysis

Probabilistic Reachability of Discrete-Time Nonlinear Stochastic Systems

Probabilistic Reachability Analysis of Stochastic Control Systems

Time-Abstracting Bisimulation for Probabilistic Timed Automata

Solving Markov Decision Processes with Reachability Characterization from Mean First Passage Times