Abstract:Dynamical system state estimation and parameter calibration problems are ubiquitous across science and engineering. Bayesian approaches to the problem are the gold standard as they allow for the quantification of uncertainties and enable the seamless fusion of different experimental modalities. When the dynamics are discrete and stochastic, one may employ powerful techniques such as Kalman, particle, or variational filters. Practitioners commonly apply these methods to continuous-time, deterministic dynamical systems after discretizing the dynamics and introducing fictitious transition probabilities. However, approaches based on time-discretization suffer from the curse of dimensionality since the number of random variables grows linearly with the number of time-steps. Furthermore, the introduction of fictitious transition probabilities is an unsatisfactory solution because it increases the number of model parameters and may lead to inference bias. To address these drawbacks, the objective of this paper is to develop a scalable Bayesian approach to state and parameter estimation suitable for continuous-time, deterministic dynamical systems. Our methodology builds upon information field theory. Specifically, we construct a physics-informed prior probability measure on the function space of system responses so that functions that satisfy the physics are more likely. This prior allows us to quantify model form errors. We connect the system's response to observations through a probabilistic model of the measurement process. The joint posterior over the system responses and all parameters is given by Bayes' rule. To approximate the intractable posterior, we develop a stochastic variational inference algorithm. In summary, the developed methodology offers a powerful framework for Bayesian estimation in dynamical systems.

Systematic physics constrained parameter estimation of stochastic differential equations

Ensemble-Based Parameter Estimation in a Coupled General Circulation Model

Parameter Estimation in Stochastic Differential Equations

Data2Dynamics: a Modeling Environment Tailored to Parameter Estimation in Dynamical Systems.

Fast Stable Parameter Estimation for Linear Dynamical Systems

A Physics-Constrained Neural Differential Equation Framework for Data-Driven Snowpack Simulation

An information field theory approach to Bayesian state and parameter estimation in dynamical systems

Stochastic Parameterization: Towards a new view of Weather and Climate Models

Stochastic parameterization identification using ensemble Kalman filtering combined with expectation-maximization and Newton-Raphson maximum likelihood methods

Differential-Equation Constrained Optimization With Stochasticity

Reducing local minima in fitness landscapes of parameter estimation by using piecewise evaluation and state estimation

Systematic parameter inference in stochastic mesoscopic modeling

Parameter estimation for computationally intensive nonlinear regression with an application to climate modeling

A Bayesian approach for parameter estimation and prediction using a computationally intensive model

Strang Splitting for Parametric Inference in Second-order Stochastic Differential Equations

Parameter Estimation for Multivariate Nonlinear Stochastic Differential Equation Models: A Comparison Study

Parameter estimation for SPDEs based on discrete observations in time and space

Sequential Maximal Updated Density Parameter Estimation for Dynamical Systems with Parameter Drift

Variational Stochastic Parameterisations and their Applications to Primitive Equation Models

Kinetic interacting particle system: parameter estimation from complete and partial discrete observations

Parameter Estimation in Nonlinear Multivariate Stochastic Differential Equations Based on Splitting Schemes