Abstract:Probabilistic models are a critical part of the modern deep learning toolbox - ranging from generative models (VAEs, GANs), sequence to sequence models used in machine translation and speech processing to models over functional spaces (conditional neural processes, neural processes). Given the size and complexity of these models, safely deploying them in applications requires the development of tools to analyze their behavior rigorously and provide some guarantees that these models are consistent with a list of desirable properties or specifications. For example, a machine translation model should produce semantically equivalent outputs for innocuous changes in the input to the model. A functional regression model that is learning a distribution over monotonic functions should predict a larger value at a larger input. Verification of these properties requires a new framework that goes beyond notions of verification studied in deterministic feedforward networks, since requiring worst-case guarantees in probabilistic models is likely to produce conservative or vacuous results. We propose a novel formulation of verification for deep probabilistic models that take in conditioning inputs and sample latent variables in the course of producing an output: We require that the output of the model satisfies a linear constraint with high probability over the sampling of latent variables and for every choice of conditioning input to the model. We show that rigorous lower bounds on the probability that the constraint is satisfied can be obtained efficiently. Experiments with neural processes show that several properties of interest while modeling functional spaces can be modeled within this framework (monotonicity, convexity) and verified efficiently using our algorithms

Brownian Motion in Isabelle/HOL

Safe Probabilistic Invariance Verification for Stochastic Discrete-Time Dynamical Systems

A Framework for Safe Probabilistic Invariance Verification of Stochastic Dynamical Systems

Automating Verification of Event-B Models

Bayesian Formal Synthesis of Unknown Systems via Robust Simulation Relations

Formal Verification of Unknown Dynamical Systems via Gaussian Process Regression

Scalable Automated Verification for Cyber-Physical Systems in Isabelle/HOL

Towards Deductive Verification of Control Algorithms for Autonomous Marine Vehicles

Automated Verification and Synthesis of Stochastic Hybrid Systems: A Survey

Data-driven Safety Verification of Stochastic Systems via Barrier Certificates

Continuous Martingales and Brownian Motion

Analyzing Non-Markovian Systems by Using a Stochastic Process Calculus and a Probabilistic Model Checker

A Tutorial on Brownian Motion for Biostatisticians

Formal Verification of Unknown Stochastic Systems via Non-parametric Estimation

Verification of deep probabilistic models

Model-based Validation as Probabilistic Inference

Automated Reasoning for Physical Quantities, Units, and Measurements in Isabelle/HOL

The Open Quantum Brownian Motion

Invariance Principles for [math]-Brownian-Motion-Driven Stochastic Differential Equations and Their Applications to [math]-Stochastic Control

Bayesian Learning for the Robust Verification of Autonomous Robots

Solving non-Markovian Stochastic Control Problems driven by Wiener Functionals