Abstract:This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter-to-data map is embedded, with the goal of employing techniques from nonlinear Kalman filtering to estimate the parameter given the data. The extended Kalman filter (which we refer to as ExKI in the context of inverse problems) can be effective for some inverse problems approached this way, but is impractical when the forward map is not readily differentiable and is given as a black box, and also for high dimensional parameter spaces because of the need to propagate large covariance matrices. Application of ensemble Kalman filters, for example use of the ensemble Kalman inversion (EKI) algorithm, has emerged as a useful tool which overcomes both of these issues: it is derivative free and works with a low-rank covariance approximation formed from the ensemble. In this paper, we work with the ExKI, EKI, and a variant on EKI which we term unscented Kalman inversion (UKI). The paper contains two main contributions. Firstly, we identify a novel stochastic dynamical system in which the parameter-to-data map is embedded. We present theory in the linear case to show exponential convergence of the mean of the filtering distribution to the solution of a regularized least squares problem. This is in contrast to previous work in which the EKI has been employed where the dynamical system used leads to algebraic convergence to an unregularized problem. Secondly, we show that the application of the UKI to this novel stochastic dynamical system yields improved inversion results, in comparison with the application of EKI to the same novel stochastic dynamical system.

Convergence Analysis of Nonlinear Kalman Filters with Novel Innovation-Based Method

A New Framework for Nonlinear Kalman Filters

A new method for the nonlinear transformation of means and covariances in filters and estimators

Improving the Convergence of the Iterative Ensemble Kalman Filter by Resampling

Exponential convergence of the Kalman filter based parameter estimation algorithm

On Parameter Convergence of Nonlinearly Parameterized Adaptive Systems: Analysis Via Contraction and First Lyapunov's Methods

An enhanced linear Kalman filter (EnLKF) algorithm for parameter estimation of nonlinear rational models

Probability-Guaranteed Distributed Filtering for Nonlinear Systems With Innovation Constraints Over Sensor Networks

Neural-Network-Based Filtering for A General Class of Nonlinear Systems under Dynamically Bounded Innovations over Sensor Networks

A Nonlinear Filter Switch Method Based on Normalized Innovation Square

Multiple-Level Quantized Innovation Kalman Filter

A New Nonlinear State Estimator Using the Fusion of Multiple Extended Kalman Filters

Set-Membership Based Hybrid Kalman Filter for Nonlinear State Estimation under Systematic Uncertainty.

Recursive Parameter Estimation Methods and Convergence Analysis for a Special Class of Nonlinear Systems

A Novel Adaptive Unscented Kalman Filter for Nonlinear Estimation

Constrained Kalman Filtering for Nonlinear Dynamical Systems with Observation Losses

Kalman Filter and its Modern Extensions for the Continuous-time Nonlinear Filtering Problem

Nonlinear Measurement Function in the Ensemble Kalman Filter

A Novel Kalman Filter for Nonlinear Non-Gaussian Systems and Its Applications in Self-localization

A Novel Extended Kalman Filter for A Class of Nonlinear Systems

Iterated Kalman Methodology For Inverse Problems