Convergence analysis of kernel learning FBSDE filter

Yunzheng Lyu,Feng Bao
2024-06-29
Abstract:Kernel learning forward backward SDE filter is an iterative and adaptive meshfree approach to solve the nonlinear filtering problem. It builds from forward backward SDE for Fokker-Planker equation, which defines evolving density for the state variable, and employs KDE to approximate density. This algorithm has shown more superior performance than mainstream particle filter method, in both convergence speed and efficiency of solving high dimension problems. However, this method has only been shown to converge empirically. In this paper, we present a rigorous analysis to demonstrate its local and global convergence, and provide theoretical support for its empirical results.
Machine Learning,Numerical Analysis,Mathematical Finance
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the convergence analysis problem of the forward - backward stochastic differential equation (FBSDE) filter. Specifically, the author aims to provide strict theoretical support to prove the local and global convergence of this kernel - learning - based FBSDE filter algorithm. ### Problem Background 1. **Non - linear Filtering Problem**: In many application fields (such as signal processing, quantum physics, mathematical finance, machine learning, etc.), we often need to estimate the unknown state variable \(S_t\) from the noisy observation data \(O_t\). 2. **Limitations of Existing Methods**: - For linear systems, the Kalman filter provides the optimal analytical solution. - For non - linear systems, variants such as the extended Kalman filter and the ensemble Kalman filter perform poorly in highly non - linear situations. - Although the particle filter and its improved versions can effectively handle non - linear systems, they are prone to degradation problems in long - time or high - frequency simulations. - Although the method based on SPDE is theoretically feasible, it has problems of slow convergence speed and high complexity. ### Core Problems - **Kernel - learning FBSDE Filter**: This is an iterative and adaptive mesh - free method, which approximates the evolution density of the state variable by combining the forward - backward stochastic differential equation (FBSDE) with kernel density estimation (KDE). This method performs well in terms of convergence speed and efficiency in solving high - dimensional problems, but its convergence has only been verified empirically. - **Strict Convergence Analysis**: The main objective of this paper is to provide strict local and global convergence proofs for the kernel - learning FBSDE filter, thereby providing theoretical support for its empirical results. ### Mathematical Models and Formulas To describe the working principle of the kernel - learning FBSDE filter, the following key formulas are involved: 1. **Stochastic Differential Equations of the State and Observation Systems**: \[ dS_t = g(S_t)dt+\sigma_t dW_t \] \[ dO_t = h(S_t)dt + r_t dV_t \] 2. **Forward - backward Stochastic Differential Equations (FBSDE)**: \[ X_t=x+\int_0^t g(X_s)ds+\int_0^t\sigma_s dW_s \] \[ Y_t=\psi(X_T)-\int_t^T Z_s dW_s \] 3. **Feynman - Kac Formula**: \[ Y_t = u(t, x)=\mathbb{E}[\psi(X_T)|X_t = x] \] 4. **Fokker - Planck Equation**: \[ \frac{\partial u}{\partial t}=-\sum_{j = 1}^{d_x}\frac{\partial(g_j(x)u)}{\partial x_j}+\frac{1}{2}\sum_{i = 1}^{d_x}\sum_{j = 1}^{d_x}(\sigma_t\sigma_t^T)_{ij}\frac{\partial^2 u}{\partial x_i\partial x_j} \] ### Solutions The author solves the above problems through the following steps: 1. **Prediction Step**: Use the FBSDE equation to propagate the prior state variable density \(p(S_t|O_{t^-})\). 2. **Update Step**: Update the posterior density \(p(S_t|O_t)\) through Bayesian inference. 3. **Kernel Density Estimation (KDE)**: Learn the kernel function to approximate the state variable density. 4. **Fixed - point Iteration**: Combine expectation estimation for fixed - point iteration to estimate the prior state variable density. 5. **Bayesian Update**: Use Bayesian inference to update the posterior state variable density estimate. 6. **Resampling**: Resample more densely in the high - density value area to prevent samples in long - time simulations.