Abstract:Practical Bayes filters often assume the state distribution of each time step to be Gaussian for computational tractability, resulting in the so-called Gaussian filters. When facing nonlinear systems, Gaussian filters such as extended Kalman filter (EKF) or unscented Kalman filter (UKF) typically rely on certain linearization techniques, which can introduce large estimation errors. To address this issue, this paper reconstructs the prediction and update steps of Gaussian filtering as solutions to two distinct optimization problems, whose optimal conditions are found to have analytical forms from Stein's lemma. It is observed that the stationary point for the prediction step requires calculating the first two moments of the prior distribution, which is equivalent to that step in existing moment-matching filters. In the update step, instead of linearizing the model to approximate the stationary points, we propose an iterative approach to directly minimize the update step's objective to avoid linearization errors. For the purpose of performing the steepest descent on the Gaussian manifold, we derive its natural gradient that leverages Fisher information matrix to adjust the gradient direction, accounting for the curvature of the parameter space. Combining this update step with moment matching in the prediction step, we introduce a new iterative filter for nonlinear systems called \textit{N}atural Gr\textit{a}dient Gaussia\textit{n} Appr\textit{o}ximation filter, or NANO filter for short. We prove that NANO filter locally converges to the optimal Gaussian approximation at each time step. Furthermore, the estimation error is proven exponentially bounded for nearly linear measurement equation and low noise levels through constructing a supermartingale-like property across consecutive time steps.

An Iterative Nonlinear Filter Based on Posterior Distribution Approximation Via Penalized Kullback-Leibler Divergence Minimization

Recursive Nonlinear Filtering Via Gaussian Approximation with Minimized Kullback–Leibler Divergence

A Gaussian approximation filter for nonlinear systems with compound noises

Nonlinear Bayesian Filtering with Natural Gradient Gaussian Approximation

An Iterative Nonlinear Filter Using Variational Bayesian Optimization

Iterated Posterior Linearization Filters and Smoothers with Cross-Correlated Noises.

Gaussian Filter for Nonlinear Systems with One-Step Randomly Delayed Measurements.

A Gaussian Approximation Recursive Filter for Nonlinear Systems with Correlated Noises.

Variational Gaussian approximation of the Kushner optimal filter

A Non-Gaussian Bayesian Filter Using Power and Generalized Logarithmic Moments

ApproximateGaussian Conjugacy: Parametric Recursive Filtering under Nonlinearity,multimodality, Uncertainty, and Constraint, and Beyond

Bayesian Nonlinear Filtering Via Information Geometric Optimization

Gaussian filtering and variational approximations for Bayesian smoothing in continuous-discrete stochastic dynamic systems

Linear Likelihood Approximation Filter for Nonlinear State Estimation

Linear Gaussian Regression Filter Based on Variational Bayes.

Nonlinear Interacting Particle Filter Algorithm

Implicit Maximum a Posteriori Filtering via Adaptive Optimization

Gaussian Filter Estimation Framework for Nonlinear Systems with Multiple Non-Ideal Scenarios

Perron-Frobenius operator filter for stochastic dynamical systems

Gaussian Sum Approximation Filter for Nonlinear Dynamic Time-Delay System

Gaussian sum filter of Markov jump non-linear systems