Abstract:Neural networks (NN) are taking over ever more decisions thus far taken by humans, even though verifiable system-level guarantees are far out of reach. Neither is the verification technology available, nor is it even understood what a formal, meaningful, extensible, and scalable testbed might look like for such a technology. The present paper is a modest attempt to improve on both the above aspects. We present a family of formal models that contain basic features of automated decision making contexts and which can be extended with further orthogonal features, ultimately encompassing the scope of autonomous driving. Due to the possibility to model random noise in the decision actuation, each model instance induces a Markov decision process (MDP) as verification object. The NN in this context has the duty to actuate (near-optimal) decisions. From the verification perspective, the externally learnt NN serves as a determinizer of the MDP, the result being a Markov chain which as such is amenable to statistical model checking. The combination of a MDP and a NN encoding the action policy is central to what we call “deep statistical model checking” (DSMC). While being a straightforward extension of statistical model checking, it enables to gain deep insight into questions like “how high is the NN-induced safety risk?”, “how good is the NN compared to the optimal policy?” (obtained by model checking the MDP), or “does further training improve the NN?”. We report on an implementation of DSMC inside TheModestToolset in combination with externally learnt NNs, demonstrating the potential of DSMC on various instances of the model family.

From Statistical Model Checking to Run-Time Monitoring Using a Bayesian Network Approach

Importance Sampling of Interval Markov Chains

Should We Learn Probabilistic Models for Model Checking? A New Approach and An Empirical Study.

Faster Statistical Model Checking for Unbounded Temporal Properties

Distributed Self-Monitoring Sensor Networks Via Markov Switching Dynamic Linear Models

UPPAAL-SMC: Statistical Model Checking for Priced Timed Automata

A Systematic Monitoring Framework Utilizing Dynamic Bayesian Network in Plant-wide Processes

What Are the Odds? Improving the foundations of Statistical Model Checking

Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

Bayesian Statistical Model-Checking for Complex Stochastic Systems

Monitoring Real-Time Systems under Parametric Delay

Structured Sequential Gaussian Graphical Models for Monitoring Time-Varying Process

Monitoring Metric First-Order Temporal Properties

Intelligent quantitative safety monitoring approach for ATP system by neural computing and probabilistic model checking

Smoothed Model Checking for Uncertain Continuous Time Markov Chains

A Survey of Statistical Model Checking

Deep Statistical Model Checking

Application Performance Monitoring and Analyzing Based on Bayesian Network

An efficient statistical model checker for nondeterminism and rare events

Schedulability Analysis Model for Multiprocessor Real-Time Systems Using UPPAAL

Probabilistic Alternating-time Temporal Logic and Model Checking Algorithm