Abstract:Recursive adaptive filtering methods are often used for solving the problem of simultaneous state and parameters estimation arising in many areas of research. The gradient-based schemes for adaptive Kalman filtering (KF) require the corresponding filter sensitivity computations. The standard approach is based on the direct differentiation of the KF equations. The shortcoming of this strategy is a numerical instability of the conventional KF (and its derivatives) with respect to roundoff errors. For decades, special attention has been paid in the KF community for designing efficient filter implementations that improve robustness of the estimator against roundoff. The most popular and beneficial techniques are found in the class of square root (SR) or ${UDU}^T$ factorization-based (UD-based) methods. They imply the Cholesky decomposition of the corresponding error covariance matrix. Another important matrix factorization method is the singular value decomposition (SVD) and, hence, further encouraging KF algorithms might be found under this approach. Meanwhile, the filter sensitivity computation heavily relies on the use of matrix differential calculus. Previous works on the robust KF derivative computation have produced the SR- and UD-based methodologies. Alternatively, in this paper, we design the SVD-based approach. The solution is expressed in terms of the SVD-based KF covariance quantities and their derivatives (with respect to unknown system parameters). The results of numerical experiments illustrate that although the newly developed SVD-based method is algebraically equivalent to the conventional approach and the previously derived SR- and UD-based strategies, it outperforms the mentioned techniques for estimation accuracy in ill-conditioned situations.

Computation of the Gradient and the Hessian of the Log-likelihood of the State-space Model by the Kalman Filter

An implimentation of the Differential Filter for Computing Gradient and Hessian of the Log-likelihood of Nonstationary Time Series Models

Online natural gradient as a Kalman filter

Nonlinear Kalman Filtering with Reparametrization Gradients

Constructing numerically stable Kalman filter-based algorithms for gradient-based adaptive filtering

Automatic numerical differentiation by maximum likelihood estimation of state-space model

A Step by Step Mathematical Derivation and Tutorial on Kalman Filters

Iterative and Algebraic Algorithms for the Computation of the Steady State Kalman Filter Gain

Likelihood Gradient Evaluation Using Square-Root Covariance Filters

Dynamical Gaussian, lognormal, and reverse lognormal maximum‐likelihood ensemble filter

Lie Algebraic Method in Nonlinear Filtering with State Space Dimension Up to 6

The Extended Kalman Filter is a Natural Gradient Descent in Trajectory Space

Faster computation of likelihood gradients for discrete observation Hidden Markov model

Kalman filter demystified: from intuition to probabilistic graphical model to real case in financial markets

Kalman filters as the steady-state solution of gradient descent on variational free energy

On Computational Complexity Reduction Methods for Kalman Filter Extensions

SVD-Based Kalman Filter Derivative Computation

A Note on the Relation Between Balenzela's Algorithm for Two-Filter Formula for Smoothing and Information Filter

A Recursive Newton Method for Smoothing in Nonlinear State Space Models

The Maximum Likelihood Ensemble Filter with State Space Localization

Computation-Aware Kalman Filtering and Smoothing