Abstract:This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter-to-data map is embedded, with the goal of employing techniques from nonlinear Kalman filtering to estimate the parameter given the data. The extended Kalman filter (which we refer to as ExKI in the context of inverse problems) can be effective for some inverse problems approached this way, but is impractical when the forward map is not readily differentiable and is given as a black box, and also for high dimensional parameter spaces because of the need to propagate large covariance matrices. Application of ensemble Kalman filters, for example use of the ensemble Kalman inversion (EKI) algorithm, has emerged as a useful tool which overcomes both of these issues: it is derivative free and works with a low-rank covariance approximation formed from the ensemble. In this paper, we work with the ExKI, EKI, and a variant on EKI which we term unscented Kalman inversion (UKI). The paper contains two main contributions. Firstly, we identify a novel stochastic dynamical system in which the parameter-to-data map is embedded. We present theory in the linear case to show exponential convergence of the mean of the filtering distribution to the solution of a regularized least squares problem. This is in contrast to previous work in which the EKI has been employed where the dynamical system used leads to algebraic convergence to an unregularized problem. Secondly, we show that the application of the UKI to this novel stochastic dynamical system yields improved inversion results, in comparison with the application of EKI to the same novel stochastic dynamical system.

Parameter Estimation and Convergence Analysis for a Class of Canonical Dynamic Systems by Extended Kalman Filter

State Estimation for Batch Distillation Operations with a Novel Extended Kalman Filter Approach

Transport Parameter Estimations of Plasma Transport Dynamics Using the Extended Kalman Filter

The Solution of High Accuracy Parameter Estimation Based on the Model of Enhanced Kalmen Filtering

Exponential convergence of the Kalman filter based parameter estimation algorithm

A Novel Extended Kalman Filter for A Class of Nonlinear Systems

Extended Kalman Filter for Estimation of Parameters in Nonlinear State-Space Models of Biochemical Networks.

The Ensemble Kalman Filter for Dynamic Inverse Problems

An enhanced linear Kalman filter (EnLKF) algorithm for parameter estimation of nonlinear rational models

A Novel Case of Practical Exponential Observer Using Extended Kalman Filter.

Iterated Kalman Methodology For Inverse Problems

Online chaotic time-series prediction with the derivative-free extended Kalman filter

A Kalman particle filter for online parameter estimation with applications to affine models

Ensemble Kalman inversion: mean-field limit and convergence analysis

Fast Stable Parameter Estimation for Linear Dynamical Systems

Extended Kalman Filter Using A Kernel Recursive Least Squares Observer

A Dynamic State Estimation Method for Integrated Energy System Based on Radial Basis Kernel Function

Convergence Acceleration of Ensemble Kalman Inversion in Nonlinear Settings

Adaptive Variational Bayesian Extended Kalman Filtering for Nonlinear Systems

Parameter identification of nonlinear system and its application based on strong tracking filter and wavelet transform

State Estimation for a Class of Nonlinear Systems with Multi-Package Transmission