Error Estimates for the Kernel Gain Function Approximation in the Feedback Particle Filter

Amirhossein Taghvaei,Prashant G. Mehta,Sean P. Meyn
DOI: https://doi.org/10.48550/arXiv.1612.05606
2016-12-17
Abstract:This paper is concerned with the analysis of the kernel-based algorithm for gain function approximation in the feedback particle filter. The exact gain function is the solution of a Poisson equation involving a probability-weighted Laplacian. The kernel-based method -- introduced in our prior work -- allows one to approximate this solution using {\em only} particles sampled from the probability distribution. This paper describes new representations and algorithms based on the kernel-based method. Theory surrounding the approximation is improved and a novel formula for the gain function approximation is derived. A procedure for carrying out error analysis of the approximation is introduced. Certain asymptotic estimates for bias and variance are derived for the general nonlinear non-Gaussian case. Comparison with the constant gain function approximation is provided. The results are illustrated with the aid of some numerical experiments.
Numerical Analysis
What problem does this paper attempt to address?
The core problem that this paper attempts to solve is to analyze the performance of the gain function approximation algorithm based on the kernel method in the Feedback Particle Filter (FPF). Specifically, the paper focuses on how to use the kernel method to approximately solve the gain function, which is obtained by solving a weighted Poisson equation. ### Main Problem Description 1. **Definition and Importance of the Gain Function**: - The gain function \( K_t(x) \) is obtained by solving the following Poisson equation: \[ \nabla \cdot (p(x,t) \nabla \varphi(x,t)) = -(h(x) - \hat{h}) p(x,t) \] where \( p(x,t) \) is the conditional density of the state \( X_t \) given the observation \( Z_t \), \( h(x) \) is the observation function, and \( \hat{h} \) is the expected value of \( h(X_t) \). - The gain function \( K_t(x)=\nabla \varphi(x,t) \) is used to update the particle states in the FPF. 2. **Challenges in Numerical Implementation**: - In practical applications, it is very difficult to directly solve the above - mentioned Poisson equation, especially in high - dimensional and nonlinear cases. - Therefore, effective numerical methods need to be developed to approximately solve the gain function. 3. **Advantages of the Kernel Method**: - The kernel method allows the gain function to be approximately solved using only particles sampled from the probability distribution. - This method is implemented by constructing a Markov matrix and solving a fixed - point problem on a finite set of particles. 4. **Error Analysis**: - The paper introduces a new formula to approximate the gain function and provides a process for error analysis. - Asymptotic estimates of bias and variance are derived, which are applicable to the general nonlinear non - Gaussian case. ### Research Contributions - A new approximation formula for the gain function is proposed. - A method for error analysis is introduced, and asymptotic estimates of bias and variance are derived. - The kernel method is compared with the constant gain approximation. - Theoretical results are verified through numerical experiments. ### Numerical Experiments The paper shows the performance of the kernel method under different parameter settings through numerical experiments. In particular, for larger and smaller values of \( \epsilon \), the effects of bias and variance on the error are explored respectively. ### Summary The main objective of this paper is to improve the approximate solution of the gain function through the kernel method and conduct a detailed theoretical and empirical analysis of its error, thereby providing a more effective numerical implementation scheme for the feedback particle filter.