Abstract:This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter-to-data map is embedded, with the goal of employing techniques from nonlinear Kalman filtering to estimate the parameter given the data. The extended Kalman filter (which we refer to as ExKI in the context of inverse problems) can be effective for some inverse problems approached this way, but is impractical when the forward map is not readily differentiable and is given as a black box, and also for high dimensional parameter spaces because of the need to propagate large covariance matrices. Application of ensemble Kalman filters, for example use of the ensemble Kalman inversion (EKI) algorithm, has emerged as a useful tool which overcomes both of these issues: it is derivative free and works with a low-rank covariance approximation formed from the ensemble. In this paper, we work with the ExKI, EKI, and a variant on EKI which we term unscented Kalman inversion (UKI). The paper contains two main contributions. Firstly, we identify a novel stochastic dynamical system in which the parameter-to-data map is embedded. We present theory in the linear case to show exponential convergence of the mean of the filtering distribution to the solution of a regularized least squares problem. This is in contrast to previous work in which the EKI has been employed where the dynamical system used leads to algebraic convergence to an unregularized problem. Secondly, we show that the application of the UKI to this novel stochastic dynamical system yields improved inversion results, in comparison with the application of EKI to the same novel stochastic dynamical system.

Nonlinear filtering with exogenous Kalman filter and double Kalman filter

Maneuvering Target Tracking with an Adaptive UKF Filter

Dynamic Positioning Observer Design Using Exogenous Kalman Filter

Internal and External Double-cycle High-order Kalman Filter Design

A New Framework for Nonlinear Kalman Filters

Design Method of High-Order Kalman Filter for Strong Nonlinear System Based on Kronecker Product Transform

Extended fractional singular kalman filter

An enhanced linear Kalman filter (EnLKF) algorithm for parameter estimation of nonlinear rational models

Inverse Extended Kalman Filter -- Part II: Highly Non-Linear and Uncertain Systems

Nonlinear Kalman Filtering with Divergence Minimization

A Novel Case of Practical Exponential Observer Using Extended Kalman Filter.

Inverse Extended Kalman Filter -- Part I: Fundamentals

A Novel Kalman Filter for Nonlinear Non-Gaussian Systems and Its Applications in Self-localization

Iterated Filters for Nonlinear Transition Models

A Novel Extended Kalman Filter for A Class of Nonlinear Systems

Kalman Filter and its Modern Extensions for the Continuous-time Nonlinear Filtering Problem

KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics

Iterated Kalman Methodology For Inverse Problems

An Adaptive State Filtering Algorithm for Systems With Partially Known Dynamics

The discriminative Kalman filter for nonlinear and non-Gaussian sequential Bayesian filtering

High-Order Extended Kalman Filter for State Estimation of Nonlinear Systems