Abstract:The projection filter is a technique for approximating the solutions of optimal filtering problems. In projection filters, the Kushner--Stratonovich stochastic partial differential equation that governs the propagation of the optimal filtering density is projected to a manifold of parametric densities, resulting in a finite-dimensional stochastic differential equation. Despite the fact that projection filters are capable of representing complicated probability densities, their current implementations are limited to Gaussian family or unidimensional filtering applications. This work considers a combination of numerical integration and automatic differentiation to construct projection filter algorithms for more generic problems. Specifically, we provide a detailed exposition of this combination for the manifold of the exponential family, and show how to apply the projection filter to multidimensional cases. We demonstrate numerically that based on comparison to a finite-difference solution to the Kushner--Stratonovich equation and a bootstrap particle filter with systematic resampling, the proposed algorithm retains an accurate approximation of the filtering density while requiring a comparatively low number of quadrature points. Due to the sparse-grid integration and automatic differentiation used to calculate the expected values of the natural statistics and the Fisher metric, the proposed filtering algorithms are highly scalable. They therefore are suitable to many applications in which the number of dimensions exceeds the practical limit of particle filters, but where the Gaussian-approximations are deemed unsatisfactory.

A Trust Region Filter Method Based on Generalized Projection Technique

Convergence Analysis of a Trust-Region Multidimensional Filter Method for Nonlinear Complementarity Problems

A stabilized filter SQP algorithm for nonlinear programming

On globally solving nonconvex trust region subproblem via projected gradient method

The Convergence of the Generalized Lanczos Trust-Region Method for the Trust-Region Subproblem

Nested Heuristic and Gradient-Based Method for Generalized Disjunctive Programming

Projection iterative method for solving general variational inequalities

A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications

Multidimensional Projection Filters via Automatic Differentiation and Sparse-Grid Integration

Delayed Projection Techniques for Linearly Constrained Problems: Convergence Rates, Acceleration, and Applications

A Revised Conjugate Gradient Projection Algorithm for Inequality Constrained Optimizations

An improved relaxed inertial projection algorithm for solving the minimum-norm solution of variational inequality and fixed point problems

Fast projection onto the intersection of simplex and singly linear constraint and its generalized Jacobian

A conjugate gradient projection method with restart procedure for solving constraint equations and image restorations

Optimizing generalized linear fractional program using the image space branch-reduction-bound scheme

Successive Projection for Solving Systems of Nonlinear Equations/Inequalities

Novel reformulations and efficient algorithms for the generalized trust region subproblem

A Matrix-Free Trust-Region SQP Method for Equality Constrained Optimization

Projection-type method with line-search process for solving variational inequalities

Efficient Euclidean projections via Piecewise Root Finding and its application in gradient projection

An inertial Fletcher–Reeves-type conjugate gradient projection-based method and its spectral extension for constrained nonlinear equations