On the Convergence Analysis of Yau-Yau Nonlinear Filtering Algorithm: from a Probabilistic Perspective

Zeju Sun,Xiuqiong Chen,Stephen S.-T. Yau
2024-05-10
Abstract:At the beginning of this century, a real time solution of the nonlinear filtering problem without memory was proposed in [1, 2] by the third author and his collaborator, and it is later on referred to as Yau-Yau algorithm. During the last two decades, a great many nonlinear filtering algorithms have been put forward and studied based on this framework. In this paper, we will generalize the results in the original works and conduct a novel convergence analysis of Yau-Yau algorithm from a probabilistic perspective. Instead of considering a particular trajectory, we estimate the expectation of the approximation error, and show that commonly-used statistics of the conditional distribution (such as conditional mean and covariance matrix) can be accurately approximated with arbitrary precision by Yau-Yau algorithm, for general nonlinear filtering systems with very liberal assumptions. This novel probabilistic version of convergence analysis is more compatible with the development of modern stochastic control theory, and will provide a more valuable theoretical guidance for practical implementations of Yau-Yau algorithm.
Optimization and Control,Probability
What problem does this paper attempt to address?
The core problem that this paper attempts to solve is: **Analyze the convergence of the Yau - Yau non - linear filtering algorithm from the perspective of probability theory, and prove that this algorithm can accurately approximate the conditional expectation solution of the non - linear filtering problem in the sense of expectation**. Specifically, the objectives of the paper can be decomposed into the following aspects: 1. **Research background and problem definition**: - The non - linear filtering problem is an important topic in modern control theory. Its goal is to accurately estimate or predict the state of a stochastic dynamical system based on a series of noisy observation data. - The Yau - Yau algorithm is a real - time, memory - less numerical method for solving the non - linear filtering problem described by the DMZ equation. However, previous convergence analyses were mainly pathwise rather than in the probabilistic sense. 2. **Core contributions of the paper**: - Re - examine the convergence analysis of the Yau - Yau algorithm from the perspective of probability theory. - Prove that the numerical solution of the Yau - Yau algorithm can converge to the exact solution of the DMZ equation in the sense of expectation. - Further prove that, after normalization, the approximate solution of the filtering problem provided by the Yau - Yau algorithm can converge to the conditional expectation \( E[\phi(X_t)|Y_t] \). 3. **Specific problems**: - The key problem that the paper attempts to solve is: How to strictly prove the convergence of the Yau - Yau algorithm theoretically and provide an analysis method in the probabilistic framework. - At the same time, the paper also hopes to reduce the regularity assumptions on the observation path and only rely on the assumptions of the filtering system coefficients and test functions, which are easier to verify in practical applications. ### Summary of formulas involved The following are the key formulas in the paper and their functions: 1. **Core formulas of the filtering problem**: - Definition of conditional expectation: \[ E[\phi(X_t)|Y_t]=\arg\min_{U\text{ is }Y_t\text{-measurable}}E[(\phi(X_t)-U)^2] \] - DMZ equation: \[ \rho_t(\phi)=\rho_0(\phi)+\int_0^t\rho_s(L\phi)ds+\sum_{j = 1}^d\int_0^t\rho_s(h_j\phi)dY_s^j \] where \( L \) is a second - order elliptic operator. 2. **Core formulas of the Yau - Yau algorithm**: - Robust DMZ equation after exponential transformation: \[ \frac{\partial w}{\partial t}=\frac{1}{2}\sum_{i,j = 1}^d a_{ij}(x)\frac{\partial^2 w}{\partial x_i\partial x_j}+\sum_{i = 1}^d F_i(t,x)\frac{\partial w}{\partial x_i}+J(t,x)w(t,x) \] - The final approximate formula of the algorithm: \[ E[\phi(X_t)|Y_t]\approx\frac{\int_{B_R}\phi(x)\tilde{u}_{k + 1}(\tau_k,x)dx}{\int_{B_R}\tilde{u}_{k + 1}(\tau_k,x)dx} \] 3. **Core formulas of convergence analysis**: - Error estimate of convergence: \[ E\left|E[\phi(X_{\tau_k})|Y_{\tau_k}]-\frac{\int_{B_R}\phi(x)\tilde{u}_{k+1}(\tau_k,x)dx}{\int_{B_R}\tilde{u}_{k+1}(\tau_k,x)dx}\right|