Abstract:The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at equally-spaced time points. However, in many applications this is a restrictive and unrealistic assumption. This paper addresses system identification for the continuous-discrete filter, with the aim of generalizing learning for the Kalman filter by relying on a solution to a continuous-time Itô stochastic differential equation (SDE) for the latent state and covariance dynamics. We introduce a novel two-filter, analytical form for the posterior with a Bayesian derivation, which yields analytical updates which do not require the forward-pass to be pre-computed. Using this analytical and efficient computation of the posterior, we provide an EM procedure which estimates the parameters of the SDE, naturally incorporating irregularly sampled measurements. Generalizing the learning of latent linear dynamical systems (LDS) to continuous-time may extend the use of the hybrid Kalman filter to data which is not regularly sampled or has intermittent missing values, and can extend the power of non-linear system identification methods such as switching LDS (SLDS), which rely on EM for the linear discrete-time Kalman filter as a sub-unit for learning locally linearized behavior of a non-linear system. We apply the method by learning the parameters of a latent, multivariate Fokker-Planck SDE representing a toggle-switch genetic circuit using biologically realistic parameters, and compare the efficacy of learning relative to the discrete-time Kalman filter as the step-size irregularity and spectral-radius of the dynamics-matrix increases.

An asymptotically optimal indirect approach to continuous-time system identification

System identification: New developments of the asymptotic theory/method

System Identification Using Slow and Irregular Output Samples

Two-stage Method for System Identification Based on Asymptotic Theory

Multivariable Process Identification Method Based on Asymptotic Theory

Identifiability Implies Robust, Globally Exponentially Convergent On-line Parameter Estimation: Application to Model Reference Adaptive Control

Identification of Additive Continuous-time Systems in Open and Closed loop

Parsimonious Identification of Continuous-Time Systems: A Block-Coordinate Descent Approach

On the Relation between Discrete and Continuous-time Refined Instrumental Variable Methods

Subspace Identification for Continuous-Time Errors-in-variables Model from Sampled Data

Identification of Analytic Nonlinear Dynamical Systems with Non-asymptotic Guarantees

System Identification for Continuous-time Linear Dynamical Systems

Identification of Stochastic Wiener Systems using Indirect Inference

Probabilistic Numeric SMC Sampling for Bayesian Nonlinear System Identification in Continuous Time

Simultaneous System Identification and Model Predictive Control with No Dynamic Regret

A Tutorial on the Non-Asymptotic Theory of System Identification

Real-time Hybrid System Identification with Online Deterministic Annealing

Non-asymptotic and robust estimation for a class of nonlinear fractional-order systems

System Identification of a Class of Second-Order Continuous System

Sampling in Parametric and Nonparametric System Identification: Aliasing, Input Conditions, and Consistency

Identification of fractional-order transfer functionsand nonzero initial conditions using exponentiallymodulated signals