Abstract:This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter-to-data map is embedded, with the goal of employing techniques from nonlinear Kalman filtering to estimate the parameter given the data. The extended Kalman filter (which we refer to as ExKI in the context of inverse problems) can be effective for some inverse problems approached this way, but is impractical when the forward map is not readily differentiable and is given as a black box, and also for high dimensional parameter spaces because of the need to propagate large covariance matrices. Application of ensemble Kalman filters, for example use of the ensemble Kalman inversion (EKI) algorithm, has emerged as a useful tool which overcomes both of these issues: it is derivative free and works with a low-rank covariance approximation formed from the ensemble. In this paper, we work with the ExKI, EKI, and a variant on EKI which we term unscented Kalman inversion (UKI). The paper contains two main contributions. Firstly, we identify a novel stochastic dynamical system in which the parameter-to-data map is embedded. We present theory in the linear case to show exponential convergence of the mean of the filtering distribution to the solution of a regularized least squares problem. This is in contrast to previous work in which the EKI has been employed where the dynamical system used leads to algebraic convergence to an unregularized problem. Secondly, we show that the application of the UKI to this novel stochastic dynamical system yields improved inversion results, in comparison with the application of EKI to the same novel stochastic dynamical system.

Parallel Ode-Solvers for Kalman-Bucy Filter with Arbitrary Initial Condition

New Direct Method for Kalman-Bucy Filtering System with Arbitrary Initial Condition

Parallel Computations for Yau Filters

Finite-dimensional Filters with Nonlinear Drift. V: Solution to Kolmogorov Equation Arising from Linear Filtering with Non-Gaussian Initial Condition

Direct Method Without the Riccati Equation for a Linear Filtering System with Arbitrary Initial Conditions

Design of the Ordinary Differential Equation Solver in the Yau Filtering System

Direct Method for Yau Filtering System with Nonlinear Observations

Finite Dimensional Filters with Nonlinear Drift, XI

Special Solutions to Some Kolmogorov Equations Arising from Cubic Sensor Problems.

Solution of Filtering Problem with Nonlinear Observations

UltimateKalman: Flexible Kalman Filtering and Smoothing Using Orthogonal Transformations

Iterated Kalman Methodology For Inverse Problems

Continuous-discrete unscented Kalman filtering framework by MATLAB ODE solvers and square-root methods

Application of Kalman Filter in Stochastic Differential Equations

Linear Filtering System With Arbitrary Initial Conditions

Lie Algebraic Method in Nonlinear Filtering with State Space Dimension Up to 6

Kalman Filter and its Modern Extensions for the Continuous-time Nonlinear Filtering Problem

An Efficient Algorithm of Yau-Yau Method for Solving Nonlinear Filtering Problems.

Finite-dimensional Filters with Nonlinear Drift. III: Duncan-Mortensen-Zakai Equation with Arbitrary Initial Condition for the Linear Filtering System and the Benes Filtering System

Low-rank approximated Kalman-Bucy filters using Oja's principal component flow for linear time-invariant systems

Optimization Algorithm for Kalman Filter Exploiting the Numerical Characteristics of SINS/GPS Integrated Navigation Systems