Abstract:Dynamical system state estimation and parameter calibration problems are ubiquitous across science and engineering. Bayesian approaches to the problem are the gold standard as they allow for the quantification of uncertainties and enable the seamless fusion of different experimental modalities. When the dynamics are discrete and stochastic, one may employ powerful techniques such as Kalman, particle, or variational filters. Practitioners commonly apply these methods to continuous-time, deterministic dynamical systems after discretizing the dynamics and introducing fictitious transition probabilities. However, approaches based on time-discretization suffer from the curse of dimensionality since the number of random variables grows linearly with the number of time-steps. Furthermore, the introduction of fictitious transition probabilities is an unsatisfactory solution because it increases the number of model parameters and may lead to inference bias. To address these drawbacks, the objective of this paper is to develop a scalable Bayesian approach to state and parameter estimation suitable for continuous-time, deterministic dynamical systems. Our methodology builds upon information field theory. Specifically, we construct a physics-informed prior probability measure on the function space of system responses so that functions that satisfy the physics are more likely. This prior allows us to quantify model form errors. We connect the system's response to observations through a probabilistic model of the measurement process. The joint posterior over the system responses and all parameters is given by Bayes' rule. To approximate the intractable posterior, we develop a stochastic variational inference algorithm. In summary, the developed methodology offers a powerful framework for Bayesian estimation in dynamical systems.

Bayesian inference with information content model check for Langevin equations

High-dimensional Bayesian Parameter Estimation: Case Study for a Model of JAK2/STAT5 Signaling.

Quantifying the mini-batching error in Bayesian inference for Adaptive Langevin dynamics

Inferring the Langevin Equation with Uncertainty via Bayesian Neural Networks

Bayesian Model Selection Methods and Their Application to Biological ODE Systems

Bayesian Statistical Model-Checking for Complex Stochastic Systems

Application of Bayesian Inference to Estimate the Parameters in 2D Convection-diffusion Equation with Source

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Combining Data and Physical Models for Probabilistic Analysis: A Bayesian Augmented Space Learning Perspective

Efficient Bayesian estimation of the generalized Langevin equation from data

Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

A Bayesian approach for parameter estimation and prediction using a computationally intensive model

Bayesian inference in physics

Bayesian inference of biochemical kinetic parameters using the linear noise approximation

Second- and third-order properties of multidimensional Langevin equations

Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo

An information field theory approach to Bayesian state and parameter estimation in dynamical systems

Bayesian inference for nonlinear structural time series models

A Probabilistic State Space Model for Joint Inference from Differential Equations and Data

Likelihood free inference for Markov processes: a comparison

Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference