Abstract:Recursive adaptive filtering methods are often used for solving the problem of simultaneous state and parameters estimation arising in many areas of research. The gradient-based schemes for adaptive Kalman filtering (KF) require the corresponding filter sensitivity computations. The standard approach is based on the direct differentiation of the KF equations. The shortcoming of this strategy is a numerical instability of the conventional KF (and its derivatives) with respect to roundoff errors. For decades, special attention has been paid in the KF community for designing efficient filter implementations that improve robustness of the estimator against roundoff. The most popular and beneficial techniques are found in the class of square root (SR) or ${UDU}^T$ factorization-based (UD-based) methods. They imply the Cholesky decomposition of the corresponding error covariance matrix. Another important matrix factorization method is the singular value decomposition (SVD) and, hence, further encouraging KF algorithms might be found under this approach. Meanwhile, the filter sensitivity computation heavily relies on the use of matrix differential calculus. Previous works on the robust KF derivative computation have produced the SR- and UD-based methodologies. Alternatively, in this paper, we design the SVD-based approach. The solution is expressed in terms of the SVD-based KF covariance quantities and their derivatives (with respect to unknown system parameters). The results of numerical experiments illustrate that although the newly developed SVD-based method is algebraically equivalent to the conventional approach and the previously derived SR- and UD-based strategies, it outperforms the mentioned techniques for estimation accuracy in ill-conditioned situations.

Likelihood Gradient Evaluation Using Square-Root Covariance Filters

Constructing numerically stable Kalman filter-based algorithms for gradient-based adaptive filtering

Square-root filtering via covariance SVD factors in the accurate continuous-discrete extended-cubature Kalman filter

On the stable Cholesky factorization-based method for the maximum correntropy criterion Kalman filtering

MATLAB-based general approach for square-root extended-unscented and fifth-degree cubature Kalman filtering methods

A new method for the nonlinear transformation of means and covariances in filters and estimators

An implimentation of the Differential Filter for Computing Gradient and Hessian of the Log-likelihood of Nonstationary Time Series Models

A Square-Root Kalman Filter Using Only QR Decompositions

Kalman Gradient Descent: Adaptive Variance Reduction in Stochastic Optimization

Computation of the Gradient and the Hessian of the Log-likelihood of the State-space Model by the Kalman Filter

SVD-Based Kalman Filter Derivative Computation

A Gaussian-Multivariate Laplacian Mixture Distribution Based Robust Cubature Kalman Filter

Improved Discrete-Time Kalman Filtering within Singular Value Decomposition

Second order stochastic gradient update for Cholesky factor in Gaussian variational approximation from Stein's Lemma

A Stochastic Variance Reduced Gradient using Barzilai-Borwein Techniques as Second Order Information

Variance Reduction for Generalized Likelihood Ratio Method by Conditional Monte Carlo and Randomized Quasi-Monte Carlo Methods

Quadratic Gradient: Combining Gradient Algorithms and Newton's Method as One

Likelihood Ratio Gradient Estimation for Steady-State Parameters

Online natural gradient as a Kalman filter

Recursive filtering with non-Gaussian noises

Nonlinear Kalman Filtering with Reparametrization Gradients