Abstract:The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at equally-spaced time points. However, in many applications this is a restrictive and unrealistic assumption. This paper addresses system identification for the continuous-discrete filter, with the aim of generalizing learning for the Kalman filter by relying on a solution to a continuous-time Itô stochastic differential equation (SDE) for the latent state and covariance dynamics. We introduce a novel two-filter, analytical form for the posterior with a Bayesian derivation, which yields analytical updates which do not require the forward-pass to be pre-computed. Using this analytical and efficient computation of the posterior, we provide an EM procedure which estimates the parameters of the SDE, naturally incorporating irregularly sampled measurements. Generalizing the learning of latent linear dynamical systems (LDS) to continuous-time may extend the use of the hybrid Kalman filter to data which is not regularly sampled or has intermittent missing values, and can extend the power of non-linear system identification methods such as switching LDS (SLDS), which rely on EM for the linear discrete-time Kalman filter as a sub-unit for learning locally linearized behavior of a non-linear system. We apply the method by learning the parameters of a latent, multivariate Fokker-Planck SDE representing a toggle-switch genetic circuit using biologically realistic parameters, and compare the efficacy of learning relative to the discrete-time Kalman filter as the step-size irregularity and spectral-radius of the dynamics-matrix increases.

Revisiting Ho–Kalman-Based System Identification: Robustness and Finite-Sample Analysis

Non-Asymptotic Identification of Linear Dynamical Systems Using Multiple Trajectories

Learning Unstable Continuous-Time Stochastic Linear Control Systems

System Identification Using Slow and Irregular Output Samples

Sample Complexity Bounds for Linear System Identification from a Finite Set

Non-Asymptotic Bounds for Closed-Loop Identification of Unstable Nonlinear Stochastic Systems

Non-asymptotic and Accurate Learning of Nonlinear Dynamical Systems

Learning Linearized Models from Nonlinear Systems with Finite Data

Learning Linear Dynamics from Bilinear Observations

System Identification for Continuous-time Linear Dynamical Systems

Markov Parameter Identification via Chebyshev Approximation

Non-asymptotic System Identification for Linear Systems with Nonlinear Policies

Joint Learning of Linear Time-Invariant Dynamical Systems

Learning Sparse Dynamical Systems from a Single Sample Trajectory

A least-square method for non-asymptotic identification in linear switching control

Identifying Single-Input Linear System Dynamics from Reachable Sets

About identifiability and observability for a class of dynamical systems

Fundamental Identification Limit of Single-Input and Single-Output Linear Time-Invariant Systems.

Identification of Analytic Nonlinear Dynamical Systems with Non-asymptotic Guarantees

Meta-State-Space Learning: An Identification Approach for Stochastic Dynamical Systems

Kalman Filter-Based Identification of Systems with Randomly Missing Measurements and Linear Constraints.